Commit Graph

27 Commits (a9de00a86dae82de8ddbc1bc90d4b791482f0df0)

Author SHA1 Message Date
typhoonzero 0e8568679d wip
9 years ago
ying 9a97c7f745 add wmt16 into dataset.
9 years ago
dzhwinter 0237b7e99a
"remove random shuffle" (#7521)
9 years ago
wangmeng28 c175eeb387 Fix wrong index in dataset downloading exception
9 years ago
Yu Yang 0760043d18 Add retry when download dataset (#5098)
9 years ago
Yancey1989 cbabaa4544 convert dataset into recordio format
9 years ago
武毅 c10121e13c [Done] Sync master client between passes and fix recordio split (#2948)
9 years ago
Yancey 83f263e6ec Fix fetch record from master failed (#2848)
9 years ago
武毅 23b8346072 Fault tolerant distributed training, just work version, with etcd (#2849)
9 years ago
root 97270b9f27 add convert function
9 years ago
Yi Wang ff4be82252 Handle multiple processes trying to create the data home directory
9 years ago
Helin Wang 936ac658c0 Fix unit test error: File exists: /root/.cache/paddle/dataset
9 years ago
gongweibao 77c4dce759 modify 10000 to 1000
9 years ago
gongweibao 283bdc5062 fix by helin's comments
9 years ago
gongweibao 9011f9e52c add precommit
9 years ago
Yancey 97a594e7f8 Split dataset into multiple files (#2320)
9 years ago
Yu Yang 270c0c5f5c Remove unecessary code to generate freq_dict.
9 years ago
Yancey1989 14eb5b8e10 rename fetch_all to fetch; add fetch_all function
9 years ago
Helin Wang 1996d4de74 fix according to comment
9 years ago
Helin Wang 4157e009c1 dataset: print download progress
9 years ago
dangqingqing 0dd53294ca add copyright
9 years ago
Yi Wang eb1e34d2c3 Add imdb and unit test
10 years ago
Yi Wang 4eb54c2437 Debug unit tests
10 years ago
Yi Wang 91115ab6de Use module name and raw data filename as the local filename
10 years ago
Yi Wang 37e2b92089 Add md5file into dataset/common.py, and unit test in tests/common_test.py
10 years ago
Yi Wang b93722df95 Set data cache home directory to ~/.cache/paddle/dataset
10 years ago
王益 7fe21602f6 Rename config.py into common.py
10 years ago