Block or Report
Block or report nghidinhit
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
Report abuseStars
Language: C++
Sort by: Most stars
🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformer…
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…
Transformer related optimization, including BERT, GPT
LostRuins / koboldcpp
Forked from ggerganov/llama.cppA simple one-file way to run various GGML and GGUF models with KoboldAI's UI
High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and field-aware factorization machines (FFM) for Python and CLI …