Expanding the docs of merge_and_unload
#615
Labels
documentation
Improvements or additions to documentation
Comments
|
Totally agreed! cc @pacman100 as well and @stevhliu @MKhalusova FYI |
|
I opened #650 to add a basic example usage in the API docs, but we'll also benefit from a more comprehensive doc on it! |
|
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Feature request
merge_and_unloadseems like a super nice gateway to "cast down" a model into a simpler version usable by other hf tools like optimum, tgi etc..I linked the doc here: huggingface/text-generation-inference#482 but I think a more complete documentation with examples and caveats would be nice.
Motivation
It's a very useful method to link back to other parts to the HF ecosystem without putting burden on other libs to reimplement peft logic.
Your contribution
I'm ok to write a PR, but probably not super knowledgeable about how to use and edge cases.
The text was updated successfully, but these errors were encountered: