Repository files navigation

Run commands in parallel and aggregate outputs. Async application usingtokio.

Example commands anddetailed manual.

Listed inAwesome Rust - utilities

Similar interface toGNU Parallel orxargs plus useful features:

• More than 10x faster than GNU Parallelin benchmarks
• Run commands fromstdin,input files, or::: arguments
• Automatic parallelism to all cpus, orconfigure manually
• Transform inputs withvariables orregular expressions
• Preventoutput interleaving and maintain input order with-k/--keep-order
• Shell mode to runbash functions andcommands
• TUI progress bar usingindicatif
• Path cache
• Command timeouts
• Structured debug logging
• Dry run mode
• Configurable error handling

• Installation
• Documents
• Tech Stack

WithHomebrew installed, run

brew install rust-parallel

1. Download a pre-built release fromGithub Releases for Linux, MacOS, or Windows.
2. Extract the executable and put it somewhere in your $PATH.

1. Install Rust

2. Install the latest version of this app fromcrates.io:

   $ cargo install rust-parallel

The samecargo install rust-parallel command will also update to the latest version after initial installation.

1. Examples - complete runnable commands to give an idea of overall features.
2. Manual - more detailed manual on how to use individual features.
3. Benchmarks
4. Output Interleaving - output interleaving in rust-parallel compared with other commands.

• anyhow used for application error handling to propogate and format fatal errors.
• clap command line argument parser.
• itertools usingmulti_cartesian_product to process::: command line inputs.
• indicatif optional TUI progress bar.
• regex optional regular expression capture groups processing for-r/--regex option.
• tokio asynchronous runtime for rust. From tokio this app uses:
  • async /await functions (aka coroutines)
  • SingletonCommandLineArgs instance usingtokio::sync::OnceCell.
  • Asynchronous command execution usingtokio::process::Command
  • tokio::sync::Semaphore used to limit number of commands that run concurrently.
  • tokio::sync::mpsc::channel used to receive inputs from input task, and to send command outputs to an output writer task. To await command completions, use the elegant property that when allSenders are dropped the channel is closed.
• tracing structured debug and warning logs.
  • tracing::Instrument is used to provide structured debug logs.
• which used to resolve command paths for path cache.