Paddle

Commit Graph

Author	SHA1	Message	Date
qiaolongfei	06915d0a05	add wmt14_util.py and a small dataset on bos for test	8 years ago
qiaolongfei	98522dcb33	optimizer wmt14 dataset	8 years ago
Helin Wang	d6c6a996b1	dataset reader for wmt14 example usage: import paddle.v2 as paddle if __name__ == '__main__': dict_en, dict_fr = paddle.dataset.wmt14.build_dict() train = paddle.dataset.wmt14.train(dict_en, dict_fr) test = paddle.dataset.wmt14.test(dict_en, dict_fr) total_train = 0 for i in train(): total_train += 1 total_test = 0 for i in test(): total_test += 1 print total_train, total_test	8 years ago

Author

SHA1

Message

Date

qiaolongfei

06915d0a05

add wmt14_util.py and a small dataset on bos for test

qiaolongfei

98522dcb33

optimizer wmt14 dataset

Helin Wang

d6c6a996b1

dataset reader for wmt14

example usage:

import paddle.v2 as paddle

if __name__ == '__main__':
    dict_en, dict_fr =	paddle.dataset.wmt14.build_dict()
    train = paddle.dataset.wmt14.train(dict_en, dict_fr)
    test = paddle.dataset.wmt14.test(dict_en, dict_fr)

    total_train = 0
    for i in train():
        total_train += 1

    total_test = 0
    for i in test():
        total_test += 1

    print total_train, total_test

3 Commits (06915d0a0507ba25e46917e4e622fcbbe3cd2668)