![]() | This article'suse ofexternal links may not follow Wikipedia's policies or guidelines. Pleaseimprove this article by removingexcessive orinappropriate external links, and converting useful links where appropriate intofootnote references.(April 2024) (Learn how and when to remove this message) |
Coroutines arecomputer program components that allow execution to be suspended and resumed, generalizingsubroutines forcooperative multitasking. Coroutines are well-suited for implementing familiar program components such ascooperative tasks,exceptions,event loops,iterators,infinite lists andpipes.
They have been described as "functions whose execution you can pause".[1]
Melvin Conway coined the termcoroutine in 1958 when he applied it to the construction of anassembly program.[2] The first published explanation of the coroutine appeared later, in 1963.[3]
There is no single precise definition of coroutine. In 1980 Christopher D. Marlin[4] summarized two widely-acknowledged fundamental characteristics of a coroutine:
Besides that, a coroutine implementation has 3 features:
yield
andresume
. Programmers cannot freely choose which frame to yield to. The runtime only yields to the nearest caller of the current coroutine. On the other hand, insymmetric coroutines, programmers must specify a yield destination.yield
.The paper "Revisiting Coroutines"[5] published in 2009 proposed termfull coroutine to denote one that supports first-class coroutine and is stackful. Full Coroutines deserve their own name in that they have the sameexpressive power as one-shotcontinuations and delimited continuations. Full coroutines are either symmetric or asymmetric. Importantly, whether a coroutine is symmetric or asymmetric has no bearing on how expressive it can be, though full coroutines are more expressive than non-full coroutines. While their expressive power is the same, asymmetrical coroutines more closely resemble routine based control structures in the sense that control is always passed back to the invoker, which programmers may find more familiar.
Subroutines are special cases of coroutines.[6] When subroutines are invoked, execution begins at the start, and once a subroutine exits, it is finished; an instance of a subroutine only returns once, and does not hold state between invocations. By contrast, coroutines can exit by calling other coroutines, which may later return to the point where they were invoked in the original coroutine; from the coroutine's point of view, it is not exiting but calling another coroutine.[6] Thus, a coroutine instance holds state, and varies between invocations; there can be multiple instances of a given coroutine at once. The difference between calling another coroutine by means of"yielding" to it and simply calling another routine (which then, also, would return to the original point), is that the relationship between two coroutines which yield to each other is not that of caller-callee, but instead symmetric.
Any subroutine can be translated to a coroutine which does not callyield.[7]
Here is a simple example of how coroutines can be useful. Suppose you have a consumer-producer relationship where one routine creates items and adds them to a queue and another removes items from the queue and uses them. For reasons of efficiency, you want to add and remove several items at once. The code might look like this:
var q := new queuecoroutine produceloopwhile q is not full create some new items add the items to qyield to consumecoroutine consumeloopwhile q is not empty remove some items from q use the itemsyield to producecall produce
The queue is then completely filled or emptied before yielding control to the other coroutine using theyield command. The further coroutines calls are starting right after theyield, in the outer coroutine loop.
Although this example is often used as an introduction tomultithreading, two threads are not needed for this: theyield statement can be implemented by a jump directly from one routine into the other.
Coroutines are very similar tothreads. However, coroutines arecooperatively multitasked, whereas threads are typicallypreemptively multitasked. Coroutines provideconcurrency, because they allow tasks to be performed out of order or in a changeable order, without changing the overall outcome, but they do not provideparallelism, because they do not execute multiple tasks simultaneously. The advantages of coroutines over threads are that they may be used in ahard-realtime context (switching between coroutines need not involve anysystem calls or anyblocking calls whatsoever), there is no need for synchronization primitives such asmutexes, semaphores, etc. in order to guardcritical sections, and there is no need for support from the operating system.
It is possible to implement coroutines using preemptively-scheduled threads, in a way that will be transparent to the calling code, but some of the advantages (particularly the suitability for hard-realtime operation and relative cheapness of switching between them) will be lost.
Generators, also known as semicoroutines,[8] are a subset of coroutines. Specifically, while both can yield multiple times, suspending their execution and allowing re-entry at multiple entry points, they differ in coroutines' ability to control where execution continues immediately after they yield, while generators cannot, instead transferring control back to the generator's caller.[9] That is, since generators are primarily used to simplify the writing ofiterators, theyield
statement in a generator does not specify a coroutine to jump to, but rather passes a value back to a parent routine.
However, it is still possible to implement coroutines on top of a generator facility, with the aid of a top-level dispatcher routine (atrampoline, essentially) that passes control explicitly to child generators identified by tokens passed back from the generators:
var q := new queuegenerator produceloopwhile q is not full create some new items add the items to qyieldgenerator consumeloopwhile q is not empty remove some items from q use the itemsyieldsubroutine dispatchervar d := new dictionary(generator →iterator) d[produce] :=start consume d[consume] :=start producevar current := produceloopcall current current :=next d[current]call dispatcher
A number of implementations of coroutines for languages with generator support but no native coroutines (e.g. Python[10] before 2.5) use this or a similar model.
Using coroutines for state machines or concurrency is similar to usingmutual recursion withtail calls, as in both cases the control changes to a different one of a set of routines. However, coroutines are more flexible and generally more efficient. Since coroutines yield rather than return, and then resume execution rather than restarting from the beginning, they are able to hold state, both variables (as in a closure) and execution point, and yields are not limited to being in tail position; mutually recursive subroutines must either use shared variables or pass state as parameters. Further, each mutually recursive call of a subroutine requires a new stack frame (unlesstail call elimination is implemented), while passing control between coroutines uses the existing contexts and can be implemented simply by a jump.
Coroutines are useful to implement the following:
Coroutines originated as anassembly language method, but are supported in somehigh-level programming languages.
Sincecontinuations can be used to implement coroutines, programming languages that support them can also quite easily support coroutines.
As of 2003[update], many of the most popular programming languages, including C and its derivatives, do not have built-in support for coroutines within the language or their standard libraries. This is, in large part, due to the limitations ofstack-based subroutine implementation. An exception is the C++ libraryBoost.Context, part ofboost libraries, which supports context swapping on ARM, MIPS, PowerPC, SPARC and x86 on POSIX, Mac OS X and Windows. Coroutines can be built upon Boost.Context.
In situations where a coroutine would be the natural implementation of a mechanism, but is not available, the typical response is to use aclosure – a subroutine with state variables (static variables, often boolean flags) to maintain an internal state between calls, and to transfer control to the correct point. Conditionals within the code result in the execution of different code paths on successive calls, based on the values of the state variables. Another typical response is to implement an explicit state machine in the form of a large and complexswitch statement or via agoto statement, particularly acomputed goto. Such implementations are considered difficult to understand and maintain, and a motivation for coroutine support.
Threads, and to a lesser extentfibers, are an alternative to coroutines in mainstream programming environments today. Threads provide facilities for managing the real-time cooperative interaction ofsimultaneously executing pieces of code. Threads are widely available in environments that support C (and are supported natively in many other modern languages), are familiar to many programmers, and are usually well-implemented, well-documented and well-supported. However, as they solve a large and difficult problem they include many powerful and complex facilities and have a correspondingly difficult learning curve. As such, when a coroutine is all that is needed, using a thread can be overkill.
One important difference between threads and coroutines is that threads are typically preemptively scheduled while coroutines are not. Because threads can be rescheduled at any instant and can execute concurrently, programs using threads must be careful aboutlocking. In contrast, because coroutines can only be rescheduled at specific points in the program and do not execute concurrently, programs using coroutines can often avoid locking entirely. This property is also cited as a benefit ofevent-driven or asynchronous programming.
Since fibers are cooperatively scheduled, they provide an ideal base for implementing coroutines above.[23] However, system support for fibers is often lacking compared to that for threads.
In order to implement general-purpose coroutines, a secondcall stack must be obtained, which is a feature not directly supported by theC language. A reliable (albeit platform-specific) way to achieve this is to use a small amount ofinline assembly to explicitly manipulate the stack pointer during initial creation of the coroutine. This is the approach recommended byTom Duff in a discussion on its relative merits vs. the method used byProtothreads.[24][non-primary source needed] On platforms which provide thePOSIXsigaltstack system call, a second call stack can be obtained by calling a springboard function from within a signal handler[25][26] to achieve the same goal in portable C, at the cost of some extra complexity. C libraries complying toPOSIX or theSingle Unix Specification (SUSv3) provided such routines asgetcontext, setcontext, makecontext and swapcontext, but these functions were declared obsolete in POSIX 1.2008.[27]
Once a second call stack has been obtained with one of the methods listed above, thesetjmp and longjmp functions in thestandard C library can then be used to implement the switches between coroutines. These functions save and restore, respectively, thestack pointer,program counter, callee-savedregisters, and any other internal state as required by theABI, such that returning to a coroutine after having yielded restores all the state that would be restored upon returning from a function call. Minimalist implementations, which do not piggyback off the setjmp and longjmp functions, may achieve the same result via a small block ofinline assembly which swaps merely the stack pointer and program counter, andclobbers all other registers. This can be significantly faster, as setjmp and longjmp must conservatively store all registers which may be in use according to the ABI, whereas the clobber method allows the compiler to store (by spilling to the stack) only what it knows is actually in use.
Due to the lack of direct language support, many authors have written their own libraries for coroutines which hide the above details. Russ Cox's libtask library[28] is a good example of this genre. It uses the context functions if they are provided by the native C library; otherwise it provides its own implementations for ARM, PowerPC, Sparc, and x86. Other notable implementations include libpcl,[29] coro,[30] lthread,[31] libCoroutine,[32] libconcurrency,[33] libcoro,[34] ribs2,[35] libdill.,[36] libaco,[37] and libco.[26]
In addition to the general approach above, several attempts have been made to approximate coroutines in C with combinations of subroutines and macros.Simon Tatham's contribution,[38] based onDuff's device, is a notable example of the genre, and is the basis forProtothreads and similar implementations.[39] In addition to Duff's objections,[24] Tatham's own comments provide a frank evaluation of the limitations of this approach: "As far as I know, this is the worst piece of C hackery ever seen in serious production code."[38] The main shortcomings of this approximation are that, in not maintaining a separate stack frame for each coroutine, local variables are not preserved across yields from the function, it is not possible to have multiple entries to the function, and control can only be yielded from the top-level routine.[24]
C# 2.0 added semi-coroutine (generator) functionality through the iterator pattern andyield
keyword.[44][45]C# 5.0 includesawait syntax support. In addition:
Cloroutine is a third-party library providing support for stackless coroutines inClojure. It's implemented as a macro, statically splitting an arbitrary code block on arbitrary var calls and emitting the coroutine as a stateful function.
D implements coroutines as its standard library classFiber Agenerator makes it trivial to expose a fiber function as aninput range, making any fiber compatible with existing range algorithms.
Go has a built-in concept of "goroutines", which are lightweight, independent processes managed by the Go runtime. A new goroutine can be started using the "go" keyword. Each goroutine has a variable-size stack which can be expanded as needed. Goroutines generally communicate using Go's built-in channels.[46][47][48][49] However, goroutines are not coroutines (for instance, local data does not persist between successive calls).[50]
There are several implementations for coroutines inJava. Despite the constraints imposed by Java's abstractions, the JVM does not preclude the possibility.[51] There are four general methods used, but two break bytecode portability among standards-compliant JVMs.
SinceECMAScript 2015, JavaScript has support forgenerators, which are a special case of coroutines.[53]
Kotlin implements coroutines as part of a first-party library.
Lua has supported first-class stackful asymmetric coroutines since version 5.0 (2003),[54] in the standard librarycoroutine.[55][56]
Modula-2 as defined byWirth implements coroutines as part of the standard SYSTEM library.
The procedure NEWPROCESS() fills in a context given a code block and space for a stack as parameters, and the procedure TRANSFER() transfers control to a coroutine given the coroutine's context as its parameter.
TheMono Common Language Runtime has support for continuations,[57] from which coroutines can be built.
During the development of the.NET Framework 2.0, Microsoft extended the design of theCommon Language Runtime (CLR) hosting APIs to handle fiber-based scheduling with an eye towards its use in fiber-mode for SQL server.[58] Before release, support for the task switching hook ICLRTask::SwitchOut was removed due to time constraints.[59] Consequently, the use of the fiber API to switch tasks is currently not a viable option in the .NET Framework.[needs update]
OCaml supports coroutines through itsThread
module.[60] These coroutines provide concurrency without parallelism, and are scheduled preemptively on a single operating system thread. Since OCaml 5.0,green threads are also available; provided by different modules.
Coroutines are natively implemented in allRaku backends.[61]
Racket provides native continuations, with a trivial implementation of coroutines provided in the official package catalog.Implementation by S. De Gabrielle
SinceScheme provides full support for continuations, implementing coroutines is nearly trivial, requiring only that a queue of continuations be maintained.
Since, in mostSmalltalk environments, the execution stack is a first-class citizen, coroutines can be implemented without additional library or VM support.
Since version 8.6, the Tool Command Language supports coroutines in the core language.[64]
Vala implements native support for coroutines. They are designed to be used with a Gtk Main Loop, but can be used alone if care is taken to ensure that the end callback will never have to be called before doing, at least, one yield.
Machine-dependentassembly languages often provide direct methods for coroutine execution. For example, inMACRO-11, the assembly language of thePDP-11 family of minicomputers, the "classic" coroutine switch is effected by the instruction "JSR PC,@(SP)+", which jumps to the address popped from the stack and pushes the current (i.e that of thenext) instruction address onto the stack. OnVAXen (inVAX MACRO) the comparable instruction is "JSB @(SP)+". Even on aMotorola 6809 there is the instruction "JSR [,S++]"; note the "++", as 2 bytes (of address) are popped from the stack. This instruction is much used in the (standard) 'monitor'Assist 09.
6. Symmetry is a complexity reducing concept (co-routines include sub-routines); seek it everywhere