Stars
A flexible, high-performance serving system for machine learning models
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
A Gradio web UI for Large Language Models.
Inference code for Persimmon-8B
A curated list of modern Generative Artificial Intelligence projects and services
🔊 Text-Prompted Generative Audio Model
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
Transformer related optimization, including BERT, GPT
A high-throughput and memory-efficient inference and serving engine for LLMs
High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
Universal LLM Deployment Engine with ML Compilation
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
StableLM: Stability AI Language Models
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
Hackable and optimized Transformers building blocks, supporting a composable construction.
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.