Ray ☆

Ray turns a cluster into one Python program — data prep, training, hyperparameter search and serving as composable tasks. OpenAI has used it in training infrastructure, and vLLM began life in its orbit at Berkeley.