librpc: core: Move the s4 handles implementation to the RPC server core