[go: nahoru, domu]
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support A local module such as gpt4all2, dolly2 or ChatGLM #35

Open
hatkyinc2 opened this issue Apr 7, 2023 · 2 comments
Open

Support A local module such as gpt4all2, dolly2 or ChatGLM #35

hatkyinc2 opened this issue Apr 7, 2023 · 2 comments
Labels
enhancement New feature or request Long term

Comments

@hatkyinc2
Copy link
Collaborator
hatkyinc2 commented Apr 7, 2023 •
edited
Loading

Why
Users don't want to send their code to OPENAI

What
Allow users to connect to different models. Maybe asking users to host the model and provide an API?

For example

Support gpt4all
https://github.com/nomic-ai/gpt4all

https://python.langchain.com/en/latest/modules/models/llms/integrations/gpt4all.html

For use on "secret"/proprietary code with fewer security concerns.
@Charuru
Copy link
Charuru commented Apr 7, 2023

Does llama only have 2k token limit?

@hatkyinc2
Copy link
Collaborator Author

yea seems like 2,048 tokens from a skim
might be harder to do, but if we can do this, the rest would work for sure.
Also, the cost is close to 0 and high speed hopefully as 0 networking, dedicated local resources, so running unlimited number of smaller queries

It's aspirational.
IDK if something else comes along that is open to running locally
The goal is for running local something so as not to send source code to central companies
Don't care what the final model and such would be as long as it would be able to do the job.

@hatkyinc2 hatkyinc2 added enhancement New feature or request Long term labels Apr 8, 2023
@hatkyinc2 hatkyinc2 mentioned this issue Apr 10, 2023
Merged
hatkyinc2 added a commit that referenced this issue Apr 13, 2023
@hatkyinc2
Merge pull request #35 from hatkyinc2/feature/print_log
83d9268 
Print log path for the user
@hatkyinc2 hatkyinc2 changed the title Support gpt4all Support A local module such as gpt4all Apr 16, 2023
@hatkyinc2 hatkyinc2 changed the title Support A local module such as gpt4all Support A local module such as gpt4all2 or dolly2 Apr 16, 2023
@hatkyinc2 hatkyinc2 mentioned this issue Apr 16, 2023
Closed
@hatkyinc2 hatkyinc2 changed the title Support A local module such as gpt4all2 or dolly2 Support A local module such as gpt4all2, dolly2 or ChatGLM Apr 16, 2023
This was referenced Apr 21, 2023
Closed
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request Long term
Projects
Autopilot
Status: Ideas
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Charuru @hatkyinc2