Commit Graph

2 Commits (269b514b0590e89652ab768fc8df8c5594a1c19a)

Author SHA1 Message Date
qianlong 980ddd32a2 change output of WordpieceTokenizer and BertTokenizer to 1-D string tensors
6 years ago
qianlong 4f16f036be Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp
6 years ago