The error case leading to the linked issue is very hard to spot. I won't be able to provide a reproducer nor am I 100% sure that this will fix it. This patch comes solely from logical reasoning so I might have missed something, but hopefully this closes any possibility of passing a negative timeout toself::select().

The fix should be provided by the changed lines about$hasActivity and$lastActivity.
The rest is cleaning / hardening found meanwhile.