Skip to main content

gu

Experimental script runner, inspired by make and GitHub’s Scripts To Rule Them All.

Note

This is still very much in development, although it should work…

If you find a bug, please open an issue.

What is it?

A CLI application that wraps a layer of developer-convenience around running ./scripts/*.

It’s intended for human’s to use while working, rather than for CI systems etc.

What does it offer?

  • ability to define dependencies between ./scripts/* files in a ./gu.config.ts (makefile-style)
  • able to discover and list all available scripts for the current directory
  • can run multiple scripts at once (in series only, for now)
  • provides visual feedback on what it’s doing in your terminal

It also comes with some helper functions for gu.config.ts file that standardise some common tasks (e.g. checking the current Node version) – see Configuration below.

Screenshot

screenshot of gu running

What can it run?

If a file is executable and lives in ./scripts, gu can run it.

Example

.scripts/
├── build.mjs #!/usr/bin/env node
├── lint      #!/usr/bin/env ruby
└── test      #!/usr/bin/env bash

Now you can run:

gu lint test build

File extensions are ignored by gu, so having both lint.rb and lint.mjs would throw an error.

Installation

Install gu using Deno.

deno install --allow-read --allow-write --allow-net --allow-run --unstable https://deno.land/x/gu_cli/gu.ts

[!INFO]

See deno.land if you need to install Deno as well…

Usage

gu <script_name> [<script_name> ...] [-- args...]

Examples

# runs ./scripts/test
gu test

You can run multiple scripts:

# runs ./scripts/test and ./scripts/lint serially, in order
gu test lint

[!INFO]

Like make (which inspired it), gu will only run a script once. So running gu test lint test is no different to running gu test lint.

You can pass arguments to individual scripts by quoting them:

gu test 'lint --cache'

Or you can pass arguments to all scripts by passing them after --:

gu test lint -- --cache

You can also provide globs:

# run all scripts in the top level of ./scripts/
gu '*'

# run all scripts in the top level of ./scripts/ that start with "build-"
gu 'build-*'

# run all 'test' scripts in ./scripts/ (at any depth)
gu '**/test'

Flags

--list, -l

List all available tasks in the current directory.

--help, -h

Show help.

--version, -v

Show the version number.

Configuration

You can optionally define a gu.config.ts file in the root of your project. This allows you to enhance the behaviour of the raw scripts when run with gu.

Example

// gu.config.ts

import { type Config } from 'https://deno.land/x/gu_cli/mod.ts';

export default {
    // enhances ./scripts/my-script
    'my-script': {
        // options
    },
} satisfies Config;

As with the CLI, keys can be globs:

// gu.config.ts
export default {
    // applies to all scripts in the top level of ./scripts/
    '*': {},

    // applies to all scripts in ./scripts/ (at any depth)
    '**/*': {},

    // applies to all scripts in ./scripts/ that start with "build-" (at any depth)
    '**/build-*': {},
} satisfies Config;

options.dependencies

Declares the dependency of a script on other scripts (like in a makefile).

Example

// gu.config.ts

import { type Config } from 'https://deno.land/x/gu_cli/mod.ts';

export default {
    'build': { dependencies: ['test'] },
} satisfies Config;

Now running gu build will run ./scripts/test before running ./scripts/build.


Dependencies can also be async TypeScript functions. Because gu is built with Deno, you can use any of the Deno runtime APIs.

// gu.config.ts

import { type Config } from 'https://deno.land/x/gu_cli/mod.ts';

const cleanDist = async () => {
    await Deno.remove('./dist', { recursive: true });
};

export default {
    'build': { dependencies: [cleanDist, 'test'] },
} satisfies Config;

Now running gu build will call cleanDist and then run ./scripts/test before running ./scripts/build.

[!INFO]

As with the CLI (and make), gu will only run a dependency once. So, given the example above, if you ran gu test build it will still only run test once.

options.description

Used when running gu --list to describe them to users.

Example

// gu.config.ts
import { type Config } from 'https://deno.land/x/gu_cli/mod.ts';

export default {
    'build': {
        // describes `./scripts/build`
        description: 'Builds the project, including dependencies',
    },
} satisfies Config;

options.phony

Creates a “phony” script from a config, which does not refer to a file in ./scripts/.

This allows you to compose scripts for common development tasks.

Example

// gu.config.ts

import { type Config } from 'https://deno.land/x/gu_cli/mod.ts';

export default {
    'validate': {
        phony: ['test', 'lint'],
    },
} satisfies Config;

Now running gu validate will run ./scripts/test and ./scripts/lint.

[!INFO]

In theory, you could only have phony scripts in a gu.config.ts and not make use of ./scripts at all. Remember that only users of gu will be able to run these, though.

Helpers

gu provides some helpers for common tasks in the config file.

checkNode

Ensures the current Node version matches the one in your .nvmrc.

// gu.config.ts

import { checkNode, type Config } from 'https://deno.land/x/gu_cli/mod.ts';

export default {
    '*': { dependencies: [checkNode] },
} satisfies Config;

installNodeModules

(Re)installs node_modules if they are out of date, using the correct package manager.

// gu.config.ts

import {
    type Config,
    installNodeModules,
} from 'https://deno.land/x/gu_cli/mod.ts';

export default {
    '*': { dependencies: [installNodeModules] },
} satisfies Config;

exec

Runs a command in the current directory.

// gu.config.ts

import { type Config, exec } from 'https://deno.land/x/gu_cli/mod.ts';

export default {
    '*': { dependencies: [exec('rm -rf **/dist')] },
} satisfies Config;

Why would I want this?

Currently, projects at the Guardian define tasks in a variety of ways: makefiles, npm-scripts, shell scripts, sbt (and probably more) are all in use across our projects – often in the same project.

For example, in DCR right now, we use a mix of executable and non-executable files in scripts directories, a makefile and npm-scripts in multiple package.jsons. CI workflows use a mixture of calls to those and direct calls to commands.

This creates a steep learning curve for newcomers to the project, and adds complexity and confusion for people working on the project’s workflows.

Context matters

In development, the task-at-hand is usually close-up – you don’t want to have to worry about how the entire application runs and fits together.

For example, in projects like DCR, dependencies change frequently enough (and between branches) that things can unexpectedly break in development.

In this case, it would improve the developer experience to always run yarn install before running anything in ./scripts – gu can do that for you.

In CI or production, it’s opposite – you are only dealing with how it all runs and fits together.

The codebase doesn’t change, and you only probably only need to run yarn install once. Running the same task you ran in development would be wasteful. It makes much more sense to do it once manually and then run ./scripts/start etc directly.

In both cases, you need to do achieve things, but in very different contexts. By keeping the raw, key functionality in ./scripts/* files, and enhancing it with gu in development, we can keep the task definitions DRY and add a rich DX where it’s useful, and not where it isn’t.

That’s the plan, anyway…

Why scripts?

The idea behind GitHub’s Scripts To Rule Them All is to formalise where and how tasks are defined.

This means that people who know a project well can manage all the complexity of running it (installing dependencies/runtimes, starting servers, running tests etc), while people who don’t can expect a standard set of scripts that abstract that detail away.

By standardising on writing executable scripts, we can (hopefully) make these tasks:

  1. easy to discover (all in one place)
  2. simple to run (you just run the script)
  3. flexible to write (much more so than, for example, npm-scripts)

Why not just run them directly?

You can! That’s part of the point.

gu is intended to ease pain-points that arise in development. If you (or your project) don’t feel that pain, you don’t need it!

Development

You will need Deno. See deno.land for more information.

While developing, you can install gu from disk by running:

deno install --allow-read --allow-write --allow-net --allow-run --unstable gu.ts

Now when you run gu, it will use your local copy.