Various AI scripts. Mostly Stable Diffusion stuff.

Inference rwkv5 or rwkv6 with Qualcomm AI Engine Direct SDK

Repository for formalization of the Polynomial Freiman Ruzsa conjecture (and related results)

A MAD laboratory to improve AI architecture designs 🧪

Code Repository for CVPR 2023 Paper "PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360 degree"

Formatron empowers everyone to control the format of language models' output with minimal overhead.

On-device wake word detection powered by deep learning

Multilingual Voice Understanding Model

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

RAG SYSTEM FOR RWKV

Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)

Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models

A curated list of papers on the applications of RWKV in computer vision.

The Memory layer for your AI apps

GoldFinch and other hybrid transformer components

Run ComfyUI with an API

A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery

[ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning

[ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning

OpenChat: Advancing Open-source Language Models with Imperfect Data

ChatOllama is an open source chatbot based on LLMs. It supports a wide range of language models, and knowledge base management.

A fast RWKV Tokenizer written in Rust

The official code of "RWKV-CLIP: A Robust Vision-Language Representation Learner"

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

Implementation of Google's SELF-DISCOVER

A large-scale RWKV v6 inference with FLA . Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy on docker. Supports true multi-batch generation and dynamic State switching.…

Code base for "Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature".