-
Notifications
You must be signed in to change notification settings - Fork 747
Pull requests: huggingface/tokenizers
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Add normalization option to Chinese characters (using OpenCC) and separate symbols from merging
Stale
#473
by ecchochan
was closed May 15, 2024
Loading…
Adding ways to flow
unk_token from trainer to new model.
#518
by Narsil
was closed Jul 29, 2021
Loading…
Bump ini from 1.3.5 to 1.3.8 in /bindings/node
dependencies
Pull requests that update a dependency file
#561
by dependabot
bot
was merged Dec 15, 2020
Loading…
Python - Add components getter/setters to BaseTokenizer
#590
by n1t0
was merged Jan 11, 2021
Loading…
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.