Add Char model
4871469 - 1.18 kB initial commit
- 1.05 GB Add more tokenization methods
- 1.05 GB Add Char model
- 1.05 GB Add pinyin
- 1.05 GB Add wubi and no index model
- 1.05 GB Add more tokenization methods
- 1.05 GB Add wubi and no index model
- 1.05 GB Add wubi and no index model
- 1.05 GB Add more tokenization methods
zhuyin.pt Detected Pickle imports (13)
- "torch._utils._rebuild_tensor_v2",
- "torch.utils.data.dataloader.DataLoader",
- "numpy.core.multiarray._reconstruct",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "__main__.WorkerInitObj",
- "numpy.dtype",
- "__main__.pretraining_dataset",
- "numpy.ndarray",
- "torch.utils.data.sampler.BatchSampler",
- "torch.utils.data.sampler.RandomSampler",
- "torch.utils.data._utils.collate.default_collate",
- "_codecs.encode"
How to fix it?
1.44 GB Add more tokenization methods
