This repository has been archived by the owner on Feb 25, 2022. It is now read-only.

allow use of tokenizer from gpt2 when creating tfrecords #57

Merged

sdtblck merged 1 commit into master from pw/allow-gpt2-encoder-use-for-create-tfrecords

Sep 19, 2020

Collaborator

lucidrains commented

No description provided.


          allow use of tokenizer from gpt2 when creating tfrecords

cd0efc4

Collaborator

sdtblck commented

👍

sdtblck merged commit 6963ecd into master

sdtblck deleted the pw/allow-gpt2-encoder-use-for-create-tfrecords branch

September 19, 2020 08:17

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.