PyTorch is one of AI’s top open source projects. Now, its ruling foundation, the PyTorch Foundation has announced a major expansion. The group recently announced it would be an umbrella foundation for other open source AI programs. The first of these top-level projects are vLLM and DeepSpeed.
Virtual Large Language Model (vLLM) is an open source library focused on making large language model (LLM) inference and serving significantly faster and more efficiently. Originally developed at University of California Berkeley, vLLM is designed to…