EnvPool: A Highly Parallel Reinforcement Learning Environment Execution Engine

Publication
arXiv preprint arXiv:2206.10558