Creating and Using an Open Assistant API locally (Pythia 12B GPT model)
- OASST_tutorial.ipynb - Breaks down how everything works.
- oasstapiv1.py - Host a local API for the Open Assistant Pythia 12B model.
- chat-oasst-api.py - File to interact with the local API. You will need to modify
SERVER_IP
Video tutorial: