[go: nahoru, domu]
Skip to content

Pull requests: huggingface/tokenizers

New pull request New
Clear current search query, filters, and sorts
11 Open 590 Closed
11 Open 590 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

GitHub actions
#1 by n1t0 was merged Nov 30, 2019 Loading…
Python release CI
#2 by n1t0 was merged Dec 3, 2019 Loading…
Handle offsets
#19 by n1t0 was merged Dec 30, 2019 Loading…
1
refactor benchmarks
#25 by epwalsh was merged Jan 2, 2020 Loading…
clean up benchmarks
#26 by epwalsh was merged Jan 3, 2020 Loading…
[WIP] try evmap
#32 by epwalsh was closed Jan 3, 2020 Loading…
make cache optional
#37 by epwalsh was merged Jan 3, 2020 Loading…
4
Wordpiece training
#38 by n1t0 was merged Jan 4, 2020 Loading…
1
small wording changes
#39 by epwalsh was merged Jan 7, 2020 Loading…
1
update models API and documentation
#41 by epwalsh was merged Jan 7, 2020 Loading…
1
4
Improve Python bindings
#43 by n1t0 was merged Jan 8, 2020 Loading…
4
BPE save compatibility tweak
#45 by julien-c was merged Jan 8, 2020 Loading…
Fix Python typings
#49 by n1t0 was merged Jan 10, 2020 Loading…
node: add tests + linting
#76 by Pierrci was merged Jan 22, 2020 Loading…
3
node: fix windows build
#101 by Pierrci was merged Jan 23, 2020 Loading…
node: cache workflows
#103 by Pierrci was merged Jan 23, 2020 Loading…
Added RobertaProcessor on Rust side.
#110 by mfuntowicz was closed Jan 29, 2020 Loading…
Char based delimiter splitting - TransfoXL
#114 by mfuntowicz was merged Feb 4, 2020 Loading…
1
[WIP - Do not merge] LookupTable based model - TransformerXL
#116 by mfuntowicz was closed Jan 31, 2020 Loading…
node: add binding for original string
#118 by Pierrci was merged Feb 3, 2020 Loading…
1
1
[WIP] Implementing the building blocks of TransformerXL model
#121 by mfuntowicz was closed Feb 4, 2020 Loading…
Introduce WordLevel model for TransformerXL
#125 by mfuntowicz was merged Feb 5, 2020 Loading…
6
Add Strip normalizer
#140 by mfuntowicz was merged Feb 17, 2020 Loading…
1
Expose num_added_tokens on Python side
#146 by mfuntowicz was merged Feb 14, 2020 Loading…
8
Hotfix models save
#167 by n1t0 was merged Feb 24, 2020 Loading…
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.