General topics | ||||||||||||||||
Flow control | ||||||||||||||||
Conditional execution statements | ||||||||||||||||
Iteration statements (loops) | ||||||||||||||||
Jump statements | ||||||||||||||||
Functions | ||||||||||||||||
Function declaration | ||||||||||||||||
Lambda function expression | ||||||||||||||||
inline specifier | ||||||||||||||||
Dynamic exception specifications(until C++17*) | ||||||||||||||||
noexcept specifier(C++11) | ||||||||||||||||
Exceptions | ||||||||||||||||
Namespaces | ||||||||||||||||
Types | ||||||||||||||||
Specifiers | ||||||||||||||||
| ||||||||||||||||
Storage duration specifiers | ||||||||||||||||
Initialization | ||||||||||||||||
Expressions | ||||||||||||||||
Alternative representations | ||||||||||||||||
Literals | ||||||||||||||||
Boolean -Integer -Floating-point | ||||||||||||||||
Character -String -nullptr(C++11) | ||||||||||||||||
User-defined(C++11) | ||||||||||||||||
Utilities | ||||||||||||||||
Attributes(C++11) | ||||||||||||||||
Types | ||||||||||||||||
typedef declaration | ||||||||||||||||
Type alias declaration(C++11) | ||||||||||||||||
Casts | ||||||||||||||||
Memory allocation | ||||||||||||||||
Classes | ||||||||||||||||
Class-specific function properties | ||||||||||||||||
| ||||||||||||||||
Special member functions | ||||||||||||||||
Templates | ||||||||||||||||
Miscellaneous | ||||||||||||||||
A coroutine is a function that can suspend execution to be resumed later. Coroutines are stackless: they suspend execution by returning to the caller, and the data that is required to resume execution is stored separately from the stack. This allows for sequential code that executes asynchronously (e.g. to handle non-blocking I/O without explicit callbacks), and also supports algorithms on lazy-computed infinite sequences and other uses.
A function is a coroutine if its definition contains any of the following:
task<> tcp_echo_server(){char data[1024];while(true){std::size_t n= co_await socket.async_read_some(buffer(data)); co_await async_write(socket, buffer(data, n));}}
generator<unsignedint> iota(unsignedint n=0){while(true) co_yield n++;}
lazy<int> f(){ co_return7;}
Every coroutine must have a return type that satisfies a number of requirements, noted below.
Contents |
Coroutines cannot usevariadic arguments, plainreturn statements, orplaceholder return types (auto
orConcept).
Consteval functions,constexpr functions,constructors,destructors, and themain function cannot be coroutines.
Each coroutine is associated with
When a coroutine begins execution, it performs the following:
co_await
s its result. TypicalPromise
types either return astd::suspend_always, for lazily-started coroutines, orstd::suspend_never, for eagerly-started coroutines.Some examples of a parameter becoming dangling:
#include <coroutine>#include <iostream> struct promise; struct coroutine:std::coroutine_handle<promise>{using promise_type=::promise;}; struct promise{ coroutine get_return_object(){return{coroutine::from_promise(*this)};}std::suspend_always initial_suspend()noexcept{return{};}std::suspend_always final_suspend()noexcept{return{};}void return_void(){}void unhandled_exception(){}}; struct S{int i; coroutine f(){std::cout<< i; co_return;}}; void bad1(){ coroutine h= S{0}.f();// S{0} destroyed h.resume();// resumed coroutine executes std::cout << i, uses S::i after free h.destroy();} coroutine bad2(){ S s{0};return s.f();// returned coroutine can't be resumed without committing use after free} void bad3(){ coroutine h=[i=0]()-> coroutine// a lambda that's also a coroutine{std::cout<< i; co_return;}();// immediately invoked// lambda destroyed h.resume();// uses (anonymous lambda type)::i after free h.destroy();} void good(){ coroutine h=[](int i)-> coroutine// make i a coroutine parameter{std::cout<< i; co_return;}(0);// lambda destroyed h.resume();// no problem, i has been copied to the coroutine// frame as a by-value parameter h.destroy();}
When a coroutine reaches a suspension point
When a coroutine reaches theco_return statement, it performs the following:
Falling off the end of the coroutine is equivalent toco_return;, except that the behavior is undefined if no declarations ofreturn_void
can be found in the scope ofPromise
. A function with none of the defining keywords in its function body is not a coroutine, regardless of its return type, and falling off the end results in undefined behavior if the return type is not (possibly cv-qualified)void.
// assuming that task is some coroutine task typetask<void> f(){// not a coroutine, undefined behavior} task<void> g(){ co_return;// OK} task<void> h(){ co_await g();// OK, implicit co_return;}
If the coroutine ends with an uncaught exception, it performs the following:
When the coroutine state is destroyed either because it terminated viaco_return or uncaught exception, or because it was destroyed via its handle, it does the following:
Coroutine state is allocated dynamically via non-arrayoperator new.
If thePromise
type defines a class-level replacement, it will be used, otherwise globaloperator new will be used.
If thePromise
type defines a placement form ofoperator new that takes additional parameters, and they match an argument list where the first argument is the size requested (of typestd::size_t) and the rest are the coroutine function arguments, those arguments will be passed tooperator new (this makes it possible to useleading-allocator-convention for coroutines).
The call tooperator new can be optimized out (even if custom allocator is used) if
In that case, coroutine state is embedded in the caller's stack frame (if the caller is an ordinary function) or coroutine state (if the caller is a coroutine).
If allocation fails, the coroutine throwsstd::bad_alloc, unless thePromise
type defines the member functionPromise::get_return_object_on_allocation_failure(). If that member function is defined, allocation uses the nothrow form ofoperator new and on allocation failure, the coroutine immediately returns the object obtained fromPromise::get_return_object_on_allocation_failure() to the caller, e.g.:
struct Coroutine::promise_type{/* ... */ // ensure the use of non-throwing operator-newstatic Coroutine get_return_object_on_allocation_failure(){std::cerr<< __func__<<'\n';throwstd::bad_alloc();// or, return Coroutine(nullptr);} // custom non-throwing overload of newvoid*operator new(std::size_t n)noexcept{if(void* mem=std::malloc(n))return mem;return nullptr;// allocation failure}};
ThePromise
type is determined by the compiler from the return type of the coroutine usingstd::coroutine_traits.
Formally, let
R
andArgs...
denote the return type and parameter type list of a coroutine respectively,ClassT
denote the class type to which the coroutine belongs if it is defined as a non-static member function,itsPromise
type is determined by:
cv
ClassT&, Args...>::promise_type, if the coroutine is defined as an implicit object member function that is not rvalue-reference-qualified,
cv
ClassT&&, Args...>::promise_type, if the coroutine is defined as an implicit object member function that is rvalue-reference-qualified.For example:
If the coroutine is defined as ... | then itsPromise type is ... |
---|---|
task<void> foo(int x); | std::coroutine_traits<task<void>,int>::promise_type |
task<void> Bar::foo(int x)const; | std::coroutine_traits<task<void>,const Bar&,int>::promise_type |
task<void> Bar::foo(int x)&&; | std::coroutine_traits<task<void>, Bar&&,int>::promise_type |
The unary operatorco_await suspends a coroutine and returns control to the caller.
co_await expr | |||||||||
Aco_await expression can only appear in apotentially-evaluated expression within a regularfunction body (including the function body of alambda expression), and cannot appear
if
,switch
,for
and [[../range-for|range-for]]), unless it appears in an initializer of thatinit-statement ,Aco_await expression cannot be apotentially-evaluated subexpression of the predicate of acontract assertion. | (since C++26) |
First,expr is converted to an awaitable as follows:
Promise
type has the member functionawait_transform
, then the awaitable ispromise.await_transform(expr).Then, the awaiter object is obtained, as follows:
If the expression above is aprvalue, the awaiter object is a temporarymaterialized from it. Otherwise, if the expression above is aglvalue, the awaiter object is the object to which it refers.
Then,awaiter.await_ready() is called (this is a short-cut to avoid the cost of suspension if it's known that the result is ready or can be completed synchronously). If its result, contextually-converted tobool isfalse then
await_suspend
returnsvoid, control is immediately returned to the caller/resumer of the current coroutine (this coroutine remains suspended), otherwiseawait_suspend
returnsbool,await_suspend
returns a coroutine handle for some other coroutine, that handle is resumed (by a call tohandle.resume()) (note this may chain to eventually cause the current coroutine to resume).await_suspend
throws an exception, the exception is caught, the coroutine is resumed, and the exception is immediately re-thrown.Finally,awaiter.await_resume() is called (whether the coroutine was suspended or not), and its result is the result of the wholeco_await expr expression.
If the coroutine was suspended in theco_await expression, and is later resumed, the resume point is immediately before the call toawaiter.await_resume().
Note that the coroutine is fully suspended before enteringawaiter.await_suspend(). Its handle can be shared with another thread and resumed before theawait_suspend() function returns. (Note that the default memory safety rules still apply, so if a coroutine handle is shared across threads without a lock, the awaiter should use at leastrelease semantics and the resumer should use at leastacquire semantics.) For example, the coroutine handle can be put inside a callback, scheduled to run on a threadpool when async I/O operation completes. In that case, since the current coroutine may have been resumed and thus executed the awaiter object's destructor, all concurrently asawait_suspend() continues its execution on the current thread,await_suspend() should treat*this as destroyed and not access it after the handle was published to other threads.
#include <coroutine>#include <iostream>#include <stdexcept>#include <thread> auto switch_to_new_thread(std::jthread& out){struct awaitable{std::jthread* p_out;bool await_ready(){returnfalse;}void await_suspend(std::coroutine_handle<> h){std::jthread& out=*p_out;if(out.joinable())throwstd::runtime_error("Output jthread parameter not empty"); out=std::jthread([h]{ h.resume();});// Potential undefined behavior: accessing potentially destroyed *this// std::cout << "New thread ID: " << p_out->get_id() << '\n';std::cout<<"New thread ID: "<< out.get_id()<<'\n';// this is OK}void await_resume(){}};return awaitable{&out};} struct task{struct promise_type{ task get_return_object(){return{};}std::suspend_never initial_suspend(){return{};}std::suspend_never final_suspend()noexcept{return{};}void return_void(){}void unhandled_exception(){}};}; task resuming_on_new_thread(std::jthread& out){std::cout<<"Coroutine started on thread: "<<std::this_thread::get_id()<<'\n'; co_await switch_to_new_thread(out);// awaiter destroyed herestd::cout<<"Coroutine resumed on thread: "<<std::this_thread::get_id()<<'\n';} int main(){std::jthread out; resuming_on_new_thread(out);}
Possible output:
Coroutine started on thread: 139972277602112New thread ID: 139972267284224Coroutine resumed on thread: 139972267284224
Note: the awaiter object is part of coroutine state (as a temporary whose lifetime crosses a suspension point) and is destroyed before theco_await expression finishes. It can be used to maintain per-operation state as required by some async I/O APIs without resorting to additional dynamic allocations.
The standard library defines two trivial awaitables:std::suspend_always andstd::suspend_never.
This section is incomplete Reason: examples |
Demo ofpromise_type::await_transform and a program provided awaiter |
---|
[edit]ExampleRun this code #include <cassert>#include <coroutine>#include <iostream> struct tunable_coro{// An awaiter whose "readiness" is determined via constructor's parameter.class tunable_awaiter{bool ready_;public:explicit(false) tunable_awaiter(bool ready): ready_{ready}{}// Three standard awaiter interface functions:bool await_ready()constnoexcept{return ready_;}staticvoid await_suspend(std::coroutine_handle<>)noexcept{}staticvoid await_resume()noexcept{}}; struct promise_type{using coro_handle=std::coroutine_handle<promise_type>;auto get_return_object(){return coro_handle::from_promise(*this);}staticauto initial_suspend(){returnstd::suspend_always();}staticauto final_suspend()noexcept{returnstd::suspend_always();}staticvoid return_void(){}staticvoid unhandled_exception(){std::terminate();}// A user provided transforming function which returns the custom awaiter:auto await_transform(std::suspend_always){return tunable_awaiter(!ready_);}void disable_suspension(){ ready_=false;}private:bool ready_{true};}; tunable_coro(promise_type::coro_handle h): handle_(h){assert(h);} // For simplicity, declare these 4 special functions as deleted: tunable_coro(tunable_coroconst&)= delete; tunable_coro(tunable_coro&&)= delete; tunable_coro& operator=(tunable_coroconst&)= delete; tunable_coro& operator=(tunable_coro&&)= delete; ~tunable_coro(){if(handle_) handle_.destroy();} void disable_suspension()const{if(handle_.done())return; handle_.promise().disable_suspension(); handle_();} bool operator()(){if(!handle_.done()) handle_();return!handle_.done();}private: promise_type::coro_handle handle_;}; tunable_coro generate(int n){for(int i{}; i!= n;++i){std::cout<< i<<' ';// The awaiter passed to co_await goes to promise_type::await_transform which// issues tunable_awaiter that initially causes suspension (returning back to// main at each iteration), but after a call to disable_suspension no suspension// happens and the loop runs to its end without returning to main(). co_awaitstd::suspend_always{};}} int main(){auto coro= generate(8); coro();// emits only one first element == 0for(int k{}; k<4;++k){ coro();// emits 1 2 3 4, one per each iterationstd::cout<<": ";} coro.disable_suspension(); coro();// emits the tail numbers 5 6 7 all at ones} Output: 0 1 : 2 : 3 : 4 : 5 6 7 |
co_yield
expression returns a value to the caller and suspends the current coroutine: it is the common building block of resumable generator functions.
co_yield expr | |||||||||
co_yield braced-init-list | |||||||||
It is equivalent to
co_await promise.yield_value(expr)
A typical generator'syield_value
would store (copy/move or just store the address of, since the argument's lifetime crosses the suspension point inside theco_await
) its argument into the generator object and returnstd::suspend_always, transferring control to the caller/resumer.
#include <coroutine>#include <cstdint>#include <exception>#include <iostream> template<typename T>struct Generator{// The class name 'Generator' is our choice and it is not required for coroutine// magic. Compiler recognizes coroutine by the presence of 'co_yield' keyword.// You can use name 'MyGenerator' (or any other name) instead as long as you include// nested struct promise_type with 'MyGenerator get_return_object()' method.// (Note: It is necessary to adjust the declarations of constructors and destructors// when renaming.) struct promise_type;using handle_type=std::coroutine_handle<promise_type>; struct promise_type// required{ T value_;std::exception_ptr exception_; Generator get_return_object(){return Generator(handle_type::from_promise(*this));}std::suspend_always initial_suspend(){return{};}std::suspend_always final_suspend()noexcept{return{};}void unhandled_exception(){ exception_=std::current_exception();}// saving// exception template<std::convertible_to<T> From>// C++20 conceptstd::suspend_always yield_value(From&& from){ value_=std::forward<From>(from);// caching the result in promisereturn{};}void return_void(){}}; handle_type h_; Generator(handle_type h): h_(h){} ~Generator(){ h_.destroy();}explicit operatorbool(){ fill();// The only way to reliably find out whether or not we finished coroutine,// whether or not there is going to be a next value generated (co_yield)// in coroutine via C++ getter (operator () below) is to execute/resume// coroutine until the next co_yield point (or let it fall off end).// Then we store/cache result in promise to allow getter (operator() below// to grab it without executing coroutine).return!h_.done();} T operator()(){ fill(); full_=false;// we are going to move out previously cached// result to make promise empty againreturn std::move(h_.promise().value_);} private:bool full_=false; void fill(){if(!full_){ h_();if(h_.promise().exception_)std::rethrow_exception(h_.promise().exception_);// propagate coroutine exception in called context full_=true;}}}; Generator<std::uint64_t>fibonacci_sequence(unsigned n){if(n==0) co_return; if(n>94)throwstd::runtime_error("Too big Fibonacci sequence. Elements would overflow."); co_yield0; if(n==1) co_return; co_yield1; if(n==2) co_return; std::uint64_t a=0;std::uint64_t b=1; for(unsigned i=2; i< n;++i){std::uint64_t s= a+ b; co_yield s; a= b; b= s;}} int main(){try{auto gen= fibonacci_sequence(10);// max 94 before uint64_t overflows for(int j=0; gen;++j)std::cout<<"fib("<< j<<")="<< gen()<<'\n';}catch(conststd::exception& ex){std::cerr<<"Exception: "<< ex.what()<<'\n';}catch(...){std::cerr<<"Unknown exception.\n";}}
Output:
fib(0)=0fib(1)=1fib(2)=1fib(3)=2fib(4)=3fib(5)=5fib(6)=8fib(7)=13fib(8)=21fib(9)=34
Feature-test macro | Value | Std | Feature |
---|---|---|---|
__cpp_impl_coroutine | 201902L | (C++20) | Coroutines (compiler support) |
__cpp_lib_coroutine | 201902L | (C++20) | Coroutines (library support) |
__cpp_lib_generator | 202207L | (C++23) | std::generator: synchronous coroutine generator for ranges |
Coroutine support library defines several types providing compile and run-time support for coroutines.
The following behavior-changing defect reports were applied retroactively to previously published C++ standards.
DR | Applied to | Behavior as published | Correct behavior |
---|---|---|---|
CWG 2556 | C++20 | invalidreturn_void made the behavior offalling off the end of the coroutine undefined | the program is ill- formed in this case |
CWG 2668 | C++20 | co_await could not appear in lambda expressions | allowed |
CWG 2754 | C++23 | *this was taken when constructing the promise object for explicit object member functions | *this is not taken in this case |
(C++23) | Aview that represents synchronouscoroutine generator(class template)[edit] |
1. | Lewis Baker, 2017-2022 -Asymmetric Transfer. |
2. | David Mazières, 2021 -Tutorial on C++20 coroutines. |
3. | Chuanqi Xu & Yu Qi & Yao Han, 2021 -C++20 Principles and Applications of Coroutine. (Chinese) |
4. | Simon Tatham, 2023 -Writing custom C++20 coroutine systems. |