crew: A Distributed Worker Launcher Framework
In computationally demanding analysis projects, statisticians and data scientists asynchronously deploy long-running tasks to distributed systems, ranging from traditional clusters to cloud services. The 'NNG'-powered 'mirai' R package by Gao (2023) <doi:10.5281/zenodo.7912722> is a sleek and sophisticated scheduler that efficiently processes these intense workloads. The 'crew' package extends 'mirai' with a unifying interface for third-party worker launchers. Inspiration also comes from packages. 'future' by Bengtsson (2021) <doi:10.32614/RJ-2021-048>, 'rrq' by FitzJohn and Ashton (2023) <https://github.com/mrc-ide/rrq>, 'clustermq' by Schubert (2019) <doi:10.1093/bioinformatics/btz284>), and 'batchtools' by Lang, Bischel, and Surmann (2017) <doi:10.21105/joss.00135>.
| Version: | 1.3.0 |
| Depends: | R (≥ 4.0.0) |
| Imports: | cli (≥ 3.1.0),collections (≥ 0.3.9),data.table,later,mirai (≥ 2.5.0),nanonext (≥ 1.7.0),processx,promises,ps,R6,rlang, stats,tibble,tidyselect, tools, utils |
| Suggests: | autometric (≥ 0.1.0),knitr (≥ 1.30),markdown (≥ 1.1),rmarkdown (≥ 2.4),testthat (≥ 3.0.0) |
| Published: | 2025-09-13 |
| DOI: | 10.32614/CRAN.package.crew |
| Author: | William Michael Landau [aut, cre], Daniel Woodie [ctb], Eli Lilly and Company [cph, fnd] |
| Maintainer: | William Michael Landau <will.landau.oss at gmail.com> |
| BugReports: | https://github.com/wlandau/crew/issues |
| License: | MIT + fileLICENSE |
| URL: | https://wlandau.github.io/crew/,https://github.com/wlandau/crew |
| NeedsCompilation: | no |
| Language: | en-US |
| Materials: | NEWS |
| In views: | HighPerformanceComputing |
| CRAN checks: | crew results |
Documentation:
| Reference manual: | crew.html ,crew.pdf |
| Vignettes: | Controller groups (source) Introduction to crew (source) Logging (source,R code) Launcher plugins (source,R code) Integration with promises (source) Known risks of crew (source) Asynchronous Shiny apps (source) |
Downloads:
| Package source: | crew_1.3.0.tar.gz |
| Windows binaries: | r-devel:crew_1.3.0.zip, r-release:crew_1.3.0.zip, r-oldrel:crew_1.3.0.zip |
| macOS binaries: | r-release (arm64):crew_1.3.0.tgz, r-oldrel (arm64):crew_1.3.0.tgz, r-release (x86_64):crew_1.3.0.tgz, r-oldrel (x86_64):crew_1.3.0.tgz |
| Old sources: | crew archive |
Reverse dependencies:
| Reverse imports: | crew.aws.batch,crew.cluster,FLAMES |
| Reverse suggests: | geotargets,targets |
Linking:
Please use the canonical formhttps://CRAN.R-project.org/package=crewto link to this page.