Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

gh-132975: Improve Remote PDB interrupt handling#133223

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Merged

Conversation

godlygeek
Copy link
Contributor

@godlygeekgodlygeek commentedApr 30, 2025
edited by bedevere-appbot
Loading

Fix several problems in how Ctrl-C works in the Remote PDB client:

  • In some places we would capture a KeyboardInterrupt and proxy it to the remote, but in other cases the KeyboardInterrupt wound up killing the client (notably a Ctrl-C caught while it was printing a message would kill it, and you could easily get into that situation with a PDB command that spams messages, likefor x in itertools.count(): x). Fix this by explicitly blocking SIGINT signals except for the times when we're prepared to handle them and ready to send them on to the remote.
  • On Windows, it's not possible to interrupt thesockfile.readline() call made while waiting for the next message from the remote. Work around this by usingselectors to listen for updates on either of two streams - either a message from the remote,or a signal arriving and being written to asocketpair by our signal handler.
  • On Unix, send a SIGINT signal directly to the remote process when we want to interrupt it. This isn't applicable on Windows, where we can't send SIGINT to another process. Sending a SIGINT signal has all the disadvantages listed inhttps://docs.python.org/3/library/signal.html#note-on-signal-handlers-and-exceptions but it has the advantage of matching what happens for normal non-remote PDB, and the additional advantage of being able to interrupt IO.

Making this a draft PR for now to check whether the selectors and socketpair usage need us to skip tests on additional platforms.

Because our goal is to proxy interrupt signals to the remote process,it's important that we only accept those signals at moments when we'reready to handle them and send them on. In particular, we're prepared tohandle them when reading user input for a prompt, and when waiting forthe server to send a new prompt after our last command. We do not wantto accept them at other times, like while we're in the middle ofprinting output to the screen, as otherwise a    while True: "Hello"executed at the PDB REPL can't reliably be Ctrl-C'd: it's more likelythat the signal will arrive while the client is printing than while it'swaiting for the next line from the server, and if so nothing will beprepared to handle the `KeyboardInterrupt` and the client will exit.
Previously we worked with a file object created with `socket.makefile`,but on Windows the `readline()` method of a socket file can't beinterrupted with Ctrl-C, and neither can `recv()` on a socket. Thisrefactor lays the ground work for a solution this this problem.
Since a socket read can't be directly interrupted on Windows, use the`selectors` module to watch for either new data to be read from thatsocket, or for a signal to arrive (leveraging `signal.set_wakeup_fd`).This allows us to watch for both types of events and handle whicheverarrives first.
This unfortunately cannot be applied to Windows, which has no way totrigger a SIGINT signal in a remote process without running code insideof that process itself.
@godlygeekgodlygeekforce-pushed theimprove_remote_pdb_interrupt_handling branch from098b752 toed664b8CompareApril 30, 2025 21:53
@godlygeekgodlygeek marked this pull request as ready for reviewApril 30, 2025 22:21
@godlygeek
Copy link
ContributorAuthor

OK, this is ready for a review (and needs the skip-news label)

CC@gaogaotiantian@pablogsal

Copy link
Member

@gaogaotiantiangaogaotiantian left a comment
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Okay so_readline is to make it possible for the client to be interrupted while receiving data from the server. You have a_handle_sigint outside of each_readline call which enablesSIGINT. What if the interrupt happens before yourtry ... finally ... block in_readline?old_wakeup_fd would not be restored I think? Not sure if other evil thing could happen.

As far as I can tell, if you want to set your signal handler in_readline() anyway, you should just restore the signal handling inreadline() - you wouldn't need to wrap every call with_handle_sigint and less racing concerns.

I see that you put some effort to achieve a "delayed" interrupt compared "ignored" ones on Windows. Is that critical? We will have much less code if we treat them the same. I think interrupting at ignored region should be the rare case anyway right?

I'm not an expert in signal, if we have multipleSIGINT during the blackout region, will we trigger multiple handlers?

signal.default_int_handler is not documented, but it is used a few times in stdlib. If that's the only handler we are going to use for_handle_sigint, should we just put it into the function and call it_unblock_sigint so it's obvious that it has the opposite effect of_block_sigint?

Also, we need a news entry for this PR. This is a user observable change (even though it in alpha phase).

@godlygeek
Copy link
ContributorAuthor

What if the interrupt happens before yourtry ... finally ... block in_readline?old_wakeup_fd would not be restored I think?

Ooh, yes, that's a bug. I'll take another look at that.

I think interrupting at ignored region should be the rare case anyway right?

It depends... it can be very common, depending on what's happening. If you do thewhile True: "x" loop I mentioned above, most of the time is spent printing, and comparatively little time is spent reading input.

I see that you put some effort to achieve a "delayed" interrupt compared "ignored" ones on Windows. Is that critical? We will have much less code if we treat them the same.

I think I've thought of an idea for how to treat them the same, and get the "delayed" interrupts even on Windows. I'll get back to you on this...

Also, we need a news entry for this PR. This is a user observable change (even though it in alpha phase).

I thought news entries were only for things that have made it into releases, not for bug fixes to stuff that's never been released. But OK, I can add one if it's needed.

@gaogaotiantian
Copy link
Member

It depends... it can be very common, depending on what's happening. If you do the while True: "x" loop I mentioned above, most of the time is spent printing, and comparatively little time is spent reading input.

Okay so what if the server is somehow dumping a lot of data to the client? Your ideal solution is to be able to delay the interrupt signal then send it to the server right?

@godlygeek
Copy link
ContributorAuthor

Okay so what if the server is somehow dumping a lot of data to the client? Your ideal solution is to be able to delay the interrupt signal then send it to the server right?

Yes, exactly. If the user hits Ctrl-C while we're printing data, we want to set that Ctrl-C aside for later, and handle it the next time we're prepared for it - either when we next callinput() to show the user a prompt, or when we next read a message from the socket, whichever comes first. This is far easier than trying to handle the interrupt asynchronously at arbitrary points.

@godlygeek
Copy link
ContributorAuthor

godlygeek commentedMay 1, 2025
edited
Loading

So we've got 3 different ways that we want to handle SIGINT, at different points in the client:

  • When we've calledinput(), we want aKeyboardInterrupt to be raised by the signal handler, breaking us out of theinput() call.
  • When we've calledsocket.recv(), we want a flag to be set and something to be written to the wakeup fd, so that we can break out of theselect() call and raise aKeyboardInterrupt ourselves.
  • In all other cases we want a flag to be set that we can check later, when we're about to requestinput() from the user or arecv() from the remote.

I think I can make this simpler and more robust by using one SIGINT handler that does all 3 of those things, based on some flags being set by the application to tell it which mode it should be in. I'm gonna try that out, and if it does work it ought to be much safer than setting different handlers all over the place.

@godlygeek
Copy link
ContributorAuthor

OK, I switched this around to use a single signal handler and some flags to tell it what to do. It's about the same amount of code, but I do think it's easier to reason about now. Please take another look.

Copy link
Member

@gaogaotiantiangaogaotiantian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

I think this approach is easier to understand than the previous one. I have a few comments. Also do we still have any coverage for the new feature?

@godlygeek
Copy link
ContributorAuthor

Also do we still have any coverage for the new feature?

No tests yet, mostly because I'm still trying to figure out if there's something better we can do for Windows or not. This PR solves#132975 pretty thoroughly for Unix, but Windows still has the problem that awhile True: pass executed at the PDB prompt can't be interrupted, and I haven't yet figured out a solution I'm happy with.

@godlygeek
Copy link
ContributorAuthor

godlygeek commentedMay 2, 2025
edited
Loading

OK - I've landed on something that works for Windows. I've gone with the minimal thread approach that we discussed in#132975 (comment) butonly for Windows. Wecould use this approach for Unix too. The advantage of using it only for Windows is that we don't need to do the more complex thing with more failure modes on all the other platforms, but the disadvantage of using it only for Windows is that we now have two different code paths to maintain and test.

Take a look and let me know a) if you're OK with using this approach for Windows, and b) if you'd like to also use this approach for Unix for the sake of consistency or if you'd rather stick with the simpleros.kill() version on Unix.

@gaogaotiantian
Copy link
Member

Did we create a thread that will be in the process forever every time we attach to the process?

@godlygeek
Copy link
ContributorAuthor

godlygeek commentedMay 2, 2025
edited
Loading

No, the thread dies 0.25 seconds afteratexit handlers run or when the client disconnects, whichever comes first.

@godlygeek
Copy link
ContributorAuthor

godlygeek commentedMay 2, 2025
edited
Loading

Looks like I did break the graceful error handling for another PDB session already being attached (the server sends an error and disconnects, the client is still waiting for the server to make the second connection for interrupt signals). I'll fix that once you confirm you're OK with the overall approach.

Copy link
Member

@gaogaotiantiangaogaotiantian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

I'm okay with the overall approach. A few minor points:

  1. Could you test that the current code works with commands? I was a bit worried about how you use commands there - will it work when you expand those and write as a file?
  2. We have a few random functions that are only about remote pdb lying around now. It may not be a huge issue, but I was wondering if it makes more sense to put them into_PdbServer andPdbClient asclassmethods - so it's clear that they belong to remote pdb and we know which end we should call it.

@godlygeek
Copy link
ContributorAuthor

  1. Could you test that the current code works with commands? I was a bit worried about how you use commands there

I'm just gonna change that. I was trying to be clever and avoid adding an extra parameter to_connect, but that's ultimately the cause of this problem:

Looks like I did break the graceful error handling for another PDB session already being attached (the server sends an error and disconnects, the client is still waiting for the server to make the second connection for interrupt signals).

Rather than trying to smuggle client setup logic in the commands, I'll just be explicit about it, and do it in_connect before we start processing the commands, and before we check if there's another session attached.

2. We have a few random functions that are only about remote pdb lying around now. It may not be a huge issue, but I was wondering if it makes more sense to put them into_PdbServer andPdbClient asclassmethods

Sure, should be easy enough.

@godlygeek
Copy link
ContributorAuthor

godlygeek commentedMay 4, 2025
edited
Loading

I'm okay with the overall approach.

Do you want to use the thread approach on both Unix and Windows (less code, greater consistency, less to test, more potential failure modes on Unix, works in truly remote scenarios) or do you want to have the client useos.kill() on Unix (more code, less consistency, more to test, fewer potential failure modes on Unix, not usable in truly remote scenarios)?

@godlygeek
Copy link
ContributorAuthor

I'm leaning towards using the same approach on all platforms. It's overkill for what we actually need on Unix, but it'll be less code and fewer tests, and fewer platform-specific differences that maintainers need to remember. If we ever find a reason why this causes problems on Unix, we can always revert back to usingos.kill() directly as a bug fix.

Let the caller of `_connect` tell us whether to start the thread.
This gives us greater flexibility to reorder things or add things in thefuture without breaking backwards compatibility.
@gaogaotiantian
Copy link
Member

Yeah I think consistent code on different platforms is probably easier to maintain.

Copy link
Member

@gaogaotiantiangaogaotiantian left a comment
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Overall I think it's good for now. Need to resovle the conflict though.

@godlygeek
Copy link
ContributorAuthor

Overall I think it's good for now. Need to resovle the conflict though.

Resolved that, moved thecontextlib imports onto one line, and added some tests now that we've settled on the approach. I think this is ready to merge if you're happy with it.

@godlygeek
Copy link
ContributorAuthor

godlygeek commentedMay 4, 2025
edited
Loading

I'm leaning towards using the same approach on all platforms.

Yeah I think consistent code on different platforms is probably easier to maintain.

Ugh, no, there's a problem with that: it won't interrupt IO on Unix. I do think we need two different paths. Or alternatively, the signal listening thread can spawn a subprocess that sends a SIGINT to its parent process (more complex, more failure modes, but works in a truly remote scenario with the client and server on different hosts).

@godlygeek
Copy link
ContributorAuthor

I'm back to thinking this is ready to merge. I've switched it back to sending the signal from the client on Unix, so that it interrupts IO on the main thread.

@pablogsal
Copy link
Member

In plan to land this today so it makes it to beta 1 so people can try it unless@gaogaotiantian thinks there are still any big concerns pending that cannot be addressed later.

Copy link
Member

@gaogaotiantiangaogaotiantian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Yeah let's land this today and polish it later if necessary.

@pablogsalpablogsalenabled auto-merge (squash)May 5, 2025 18:12
@pablogsal
Copy link
Member

@godlygeek could you resolve the merge conflicts? If you don't have time I can try to do it in a couple of hours

@pablogsalpablogsal merged commit9434709 intopython:mainMay 5, 2025
39 checks passed
Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment
Reviewers

@gaogaotiantiangaogaotiantiangaogaotiantian approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

3 participants
@godlygeek@gaogaotiantian@pablogsal

[8]ページ先頭

©2009-2025 Movatter.jp