idr: make idr_remove_all() do removal -before- free_layer()