With nearing completion of BufferRecyclerPool (#1078) there will be less need for tracking Recyclers; and while for 2.x we need to keep it around, there's no need to support it in 3.0.
So let's remove that functionality from master as regular maintenance/pruning.