[go: nahoru, domu]
Skip to content

Pull requests: huggingface/tokenizers

New pull request New
Clear current search query, filters, and sorts
11 Open 590 Closed
11 Open 590 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix a few python stuff
#48 by thomwolf was merged Jan 10, 2020 Loading…
2
[WIP] try spin::RwLock
#33 by epwalsh was closed Jan 3, 2020 Loading…
2
avoid unnecessary write locks in the BPE cache
#34 by epwalsh was merged Jan 4, 2020 Loading…
7
Update benchmarks
#36 by epwalsh was merged Jan 4, 2020 Loading…
1
2
make cache optional
#37 by epwalsh was merged Jan 3, 2020 Loading…
4
Wordpiece training
#38 by n1t0 was merged Jan 4, 2020 Loading…
1
small wording changes
#39 by epwalsh was merged Jan 7, 2020 Loading…
1
Proposal for a more pythonic API
#40 by thomwolf was closed Jan 8, 2020 Loading…
1
Update Python training examples to reflect the higher-order API
#64 by mfuntowicz was merged Jan 14, 2020 Loading…
1
alternate builder pattern
#42 by epwalsh was merged Jan 8, 2020 Loading…
6
Improve Python bindings
#43 by n1t0 was merged Jan 8, 2020 Loading…
4
BPE save compatibility tweak
#45 by julien-c was merged Jan 8, 2020 Loading…
Added SentencePiece and YouTokenToMe model extractors.
#47 by mfuntowicz was merged Jan 8, 2020 Loading…
@n1t0
5
Allow importing from tokenizers modules.
#18 by mfuntowicz was closed Jan 14, 2020 Loading…
1
Fix Python typings
#49 by n1t0 was merged Jan 10, 2020 Loading…
Node Bindings & Typings
#50 by n1t0 was merged Jan 10, 2020 Loading…
1
2
Fix a few errors in the README.md
#55 by benjamin-ny was merged Jan 13, 2020 Loading…
1
update models API and documentation
#41 by epwalsh was merged Jan 7, 2020 Loading…
1
4
Python release CI
#2 by n1t0 was merged Dec 3, 2019 Loading…
fix fmt::Display for WordPiece error
#3 by epwalsh was merged Dec 12, 2019 Loading…
1
Add benchmark framework and benches for BPE (GPT2)
#4 by epwalsh was merged Jan 1, 2020 Loading…
11
Add RustFmt and Clippy to CI pipeline
#5 by epwalsh was merged Dec 13, 2019 Loading…
1
Add BPE tests and documentation
#6 by epwalsh was merged Dec 20, 2019 Loading…
1
remove Cargo.lock
#7 by epwalsh was merged Dec 24, 2019 Loading…
3
simplify initialization of BpeTrainer
#8 by epwalsh was merged Dec 24, 2019 Loading…
1
ProTip! Filter pull requests by the default branch with base:main.