async/server: Optimize some code in async server.rs#264