OFStreamObserver: Don't ignore the timeout when using select().