Robust recipes to align language models with human and AI preferences

An open-source tool-augmented conversational language model from Fudan University

Firefly: 大模型训练工具，支持训练Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

Instruction Tuning with GPT-4

QLoRA: Efficient Finetuning of Quantized LLMs

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

An elegent pytorch implement of transformers

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

keras implement of transformers for humans

Transformer implemented in Keras