RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with com…

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

A high-throughput and memory-efficient inference and serving engine for LLMs

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

Get up and running with Llama 3, Mistral, Gemma 2, and other large language models.

An AI Control Centre for monitoring, authenticating, and providing resilient access to multiple Open AI services.

LLM inference in C/C++

Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen

A Native-PyTorch Library for LLM Fine-tuning

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.

Large Language Model Text Generation Inference

LlamaIndex is a data framework for your LLM applications

Gorilla: An API store for LLMs

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

structured outputs for llms

⛓️ Langflow is a visual framework for building multi-agent and RAG applications. It's open-source, Python-powered, fully customizable, model and vector store agnostic.

the AI-native open-source embedding database

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.

A powerful Python library for getting rich data from the Vietnam Stock Market using just a few lines of code

Integrate cutting-edge LLM technology quickly and easily into your apps

Examples and guides for using the OpenAI API

Enhanced ChatGPT Clone: Features OpenAI, Assistants API, Azure, Groq, GPT-4 Vision, Mistral, Bing, Anthropic, OpenRouter, Vertex AI, Gemini, AI model switching, message search, langchain, DALL-E-3,…

Chat language model that can use tools and interpret the results

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Task-based datasets, preprocessing, and evaluation for sequence models.