- Notifications
You must be signed in to change notification settings - Fork615
Improve AsyncManualResetEvent implementation to address races#1843
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
Conversation
danielmarbach commentedJun 7, 2025
I pushed an implementation based onhttps://raw.githubusercontent.com/dotnet/runtime/refs/heads/main/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/ValueTaskSource.cs which should properly address the races and keep the allocations on par with the current version |
26d1b38 toaddb51fComparedanielmarbach commentedJun 7, 2025
I reverted the value task source based implementation. The TCS based version reliably works while the value task source based one I have already tried to implement several "fixes" even with assistance I could never get it to be race free under load |
danielmarbach commentedJun 7, 2025
If someone wants to go down that level of optimization, be my guest but I have depleted my available experimenting and fiddling around budget I'm willing to spend on this |
lukebakken left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
Thank you!
a960e25 intorabbitmq:mainUh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Proposed Changes
I used the implementation further in some very high concurrent scenarios and ran into token problems with the manual reset implementation under the cover. I have concluded the original version I tweaked had some races that we collectively missed.
The race condition occurs in WaitAsync() where the IsSet check and valueTaskSource.Version capture happen at different moments without synchronization, allowing Set() or Reset() to execute between these operations and change the state. If Reset() is called after the IsSet check passes but before the ValueTask is created, the version becomes stale and the awaited task will never complete because it references the old version while the ManualResetValueTaskSourceCore has been reset. Additionally, the gap between checking IsSet and updating state in both Set() and Reset() creates windows where multiple threads can pass the initial checks simultaneously, leading to operations being performed on inconsistent state.
This implementation passed my concurrency tests, but it doesn't hurt if the original involved reviewers give this another review@lukebakken@paulomorgado@bollhals
Types of Changes
What types of changes does your code introduce to this project?
Put an
xin the boxes that applyChecklist
Put an
xin the boxes that apply. You can also fill these out after creatingthe PR. If you're unsure about any of them, don't hesitate to ask on the
mailing list. We're here to help! This is simply a reminder of what we are
going to look for before merging your code.
CONTRIBUTING.mddocumentFurther Comments
If this is a relatively large or complex change, kick off the discussion by
explaining why you chose the solution you did and what alternatives you
considered, etc.