Hugging Face's logo

text2font
/
SentencePieceBPETokenizer_full_word

Model card Files Community
pain commited on
Commit
c1f18ca
·
1 Parent(s): 7c8459a

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +1 -0
  2. SentencePieceBPETokenizer_fulldata_word.csv +3 -0
  3. SentencePieceBPETokenizer_fulldata_word.pkl +3 -0
  4. SentencePieceBPETokenizer_words.tokenizer.json +0 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ SentencePieceBPETokenizer_fulldata_word.csv filter=lfs diff=lfs merge=lfs -text
SentencePieceBPETokenizer_fulldata_word.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4cce90858b0fba06d68c0d76caf0878f3afe1fa36ea3395714dda3612ffd582
3
+ size 1111061364
SentencePieceBPETokenizer_fulldata_word.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c4c388c5dc82b9d7c6cfcaa90106584f6f79eba1f9b689ec3c425de9551bc29
3
+ size 807051
SentencePieceBPETokenizer_words.tokenizer.json ADDED
The diff for this file is too large to render. See raw diff