Structured concurrency is aprogramming paradigm aimed at improving the clarity, quality, and development time of acomputer program by using a structured approach toconcurrent programming.
The core concept is the encapsulation of concurrent threads of execution (here encompassing kernel and userland threads and processes) by way of control flow constructs that have clear entry and exit points and that ensure all spawned threads have completed before exit. Such encapsulation allows errors in concurrent threads to be propagated to the control structure's parent scope and managed by the native error handling mechanisms of each particular computer language. It allows control flow to remain readily evident by the structure of the source code despite the presence of concurrency. To be effective, this model must be applied consistently throughout all levels of the program – otherwise concurrent threads may leak out, become orphaned, or fail to have runtime errors correctly propagated.
Structured concurrency is analogous tostructured programming, which uses control flow constructs that encapsulate sequential statements and subroutines.
Thefork–join model from the 1960s, embodied by multiprocessing tools likeOpenMP, is an early example of a system ensuring all threads have completed before exit. However, Smith argues that this model is not true structured concurrency as the programming language is unaware of the joining behavior, and is thus unable to enforce safety.[1]
The concept was formulated in 2016 by Martin Sústrik (a developer ofZeroMQ) with his C library libdill, withgoroutines as a starting point.[2] It was further refined in 2017 by Nathaniel J. Smith, who introduced a "nursery pattern" in hisPython implementation called Trio.[3] Meanwhile, Roman Elizarov independently came upon the same ideas while developing an experimentalcoroutine library for theKotlin language,[4][5] which later became a standard library.[6]
In 2021,Swift adopted structured concurrency.[7] Later that year, a draft proposal was published to add structured concurrency toJava.[8]
A major point of variation is how an error in one member of a concurrent thread tree is handled. Simple implementations will merely wait until the children and siblings of the failing thread run to completion before propagating the error to the parent scope. However, that could take an indefinite amount of time. The alternative is to employ a general cancellation mechanism (typically a cooperative scheme allowing program invariants to be honored) to terminate the children and sibling threads in an expedient manner.
We needed a name and we needed to finalize this whole concept [...] and we stumble onto this blog post [...] by Nathaniel J. Smith.