Mistral.rs provides a convenient Rust multithreaded/async API. To install, add mistralrs = { git = "https://github.com/EricLBuehler/mistral.rs.git" } to the Cargo.toml file.
Examples can be found here.
mistralrs
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
parent directory.. | ||||