Daily Development using Archery#

To ease some of the daily development tasks, we developed a Python-writtenutility called Archery.

Installation#

Archery requires Python 3.10 or later. It is recommended to install Archery ineditable mode with the-e flag to automatically update the installationwhen pulling the Arrow repository. After cloning the Arrow repository, fromthe top level directory install Archery by using the command

$pipinstall-e"dev/archery[all]"

Many operations in Archery make use ofDockerandDocker Compose, which you mayalso want to install.

Usage#

You can inspect Archery usage by passing the--help flag:

$archery--helpUsage: archery [OPTIONS] COMMAND [ARGS]...  Apache Arrow developer utilities.  See sub-commands help with `archery <cmd> --help`.Options:  --debug      Increase logging with debugging output.  --pdb        Invoke pdb on uncaught exception.  -q, --quiet  Silence executed commands.  --help       Show this message and exit.Commands:  benchmark    Arrow benchmarking.  build        Initialize an Arrow C++ build  crossbow     Schedule packaging tasks or nightly builds on CI services.  docker       Interact with Docker Compose based builds.  integration  Execute protocol and Flight integration tests  linking      Quick and dirty utilities for checking library linkage.  lint         Check Arrow source tree for errors  numpydoc     Lint python docstring with NumpyDoc  release      Release related commands.  trigger-bot

Archery exposes independent subcommands, each of which provides dedicatedhelp output, for example:

$archerydocker--helpUsage: archery docker [OPTIONS] COMMAND [ARGS]...  Interact with Docker Compose based builds.Options:  --src <arrow_src>  Specify Arrow source directory.  --help             Show this message and exit.Commands:  images  List the available Docker Compose images.  push    Push the generated Docker Compose image.  run     Execute Docker Compose builds.

A more detailed introduction to using Docker withArchery is available atRunning Docker Builds.