Commit Graph

14755 Commits (afa64a5cfa22c44a24c5dad71abe550495c26a87)

Author SHA1 Message Date
dongdaxiang 3c73859eec add trainer_desc.proto to distributed executor
6 years ago
dongdaxiang 60b7bf6fa6 add infer_from_dataset for inference
6 years ago
xjqbest 030c7e7e9d fix FillSparseValue error
6 years ago
dongdaxiang 88880d9b69 fix import trainer_desc_pb2 error
6 years ago
dongdaxiang 0030eb2a61 fix distributed building
6 years ago
dongdaxiang ed31874397 undefine rand_r()
6 years ago
dongdaxiang f7e4813804 add WIN32 for rand_r and usleep
6 years ago
dongdaxiang cedbc161da add more _LINUX maroc on data_feed.cc for mac and window compile
6 years ago
dongdaxiang c5980c3566 add _LINUX macro
6 years ago
dongdaxiang 433301fbc2 remove glog in shell.h
6 years ago
dongdaxiang 9e51ad4a65 fix io and fs compile on mac
6 years ago
dongdaxiang 6eca88ac76 fix io and fs compile on mac
6 years ago
dongdaxiang 2708108a08 fix fleet_wrapper compile on windows
6 years ago
dongdaxiang 4ce35815fb fix windows GLOG problem
6 years ago
dongdaxiang e3107a6ae0 fix windows compile problem
6 years ago
dongdaxiang 398004ece0 disable sys/wait.h to fix windows compile problem, include scope in lodtensor_printer
6 years ago
dongdaxiang d4514949bf remove local random engine in fleet with rand_r()
6 years ago
dongdaxiang e82969eeb0 remove getdelim in windows
6 years ago
dongdaxiang 45eb6f0765 run pre-commit check files and fix code style problem
6 years ago
dongdaxiang d87ba58c14 refine document of python API, make device_worker and trainer's API private
6 years ago
dongdaxiang 5687f234bf fix trainer_desc.proto error
6 years ago
dongdaxiang b95b80bc76 add doc string for executor and update API.spec
6 years ago
dongdaxiang 6be9f719e2 make string_helper dependency work
6 years ago
xjqbest e95cafd9a7 fix code style & add dataset testcase
6 years ago
dongdaxiang 39362a8415 move root_scope->DropKids() into Finalize() so that we do not have to drop all the kids
6 years ago
dongdaxiang ba15d6b164 move root_scope->DropKids() into Finalize() so that we do not have to drop all the kids
6 years ago
xjqbest be74de2c61 fix code style & fix register bug & add release_memory
6 years ago
dongdaxiang a0b59773af fix code style
6 years ago
dongdaxiang f39b323ed7 remove trainer_library in CMakeLists
6 years ago
dongdaxiang 365be5d559 support win32 flag in io.cc shell.cc, fix code style problem in fleet_wrapper, fix lodtensor_printer_test problem
6 years ago
dongdaxiang dc8cf36e4b add more example on datagenerator
6 years ago
dongdaxiang 6bf796df14 refine print fetch list
6 years ago
xjqbest 589467f24c fix bug
6 years ago
xjqbest b7940c2918 fix bug of gen_worker_desc and set_filelist, add some doc
6 years ago
dongdaxiang 68d7bf3de5 add fetch var function
6 years ago
xjqbest a34fe6248f add some doc
6 years ago
xujiaqi01 f5c6a14b54 fix runtime error
6 years ago
xujiaqi01 a5b1a0e12b support multi dataset && add init model && fix bug
6 years ago
dongdaxiang 3c65cc1bbd add document for role_maker and fleet parameter, data_generator
6 years ago
dongdaxiang f6c9232a3d fix dataset float32 type problem
6 years ago
dongdaxiang 73b1f396d7 add data_generator into paddle.fluid.incubate.data_generator, add op run log in hogwild_device_worker and downpour_device_worker
6 years ago
dongdaxiang 73544e8b8d add training speed log
6 years ago
dongdaxiang 9419de521f add IO percent for multi_trainer
6 years ago
dongdaxiang 6af697adb0 add trainfileswithprofiler for downpour worker
6 years ago
dongdaxiang 2644b88685 add comment for MPI Symetric role maker
6 years ago
dongdaxiang cf45c54340 add distributed optimizer factory
6 years ago
dongdaxiang b7a202aa38 add distributed optimizer factory
6 years ago
xujiaqi01 70a5d4f797 fix error
6 years ago
xujiaqi01 d25389fefd add some log && fix error
6 years ago
dongdaxiang f612877797 add incubate for unified API
6 years ago
dongdaxiang 317eb0aad3 add incubate for unified API
6 years ago
xujiaqi01 39449ba0b9 fix bug && add DestroyReaders in trainer
6 years ago
dongdaxiang e657c127a8 hide opt_info in distirbuted optimizer
6 years ago
xujiaqi01 ecfc7df913 add dataset factory && fix style
6 years ago
dongdaxiang 328f11b8b6 refactor downpour optimization
6 years ago
xujiaqi01 3cea00bd52 store memory data in Dataset && fix bug
6 years ago
dongdaxiang ff87698a44 refactor downpour optimization
6 years ago
dongdaxiang b66f0074b6 fix data reading bugs in api, add VLOG(3) log for setup
6 years ago
dongdaxiang b415ec27e8 make Dataset* as an argument
6 years ago
xjqbest dd67ad08a2 modify c++ and python dataset related code & fix bug
6 years ago
dongdaxiang cc4def6ba5 fix some conflict for compilation
6 years ago
heqiaozhi 9bca1926c1 refactor & fix bug
6 years ago
xjqbest 2e9a836c6f add DataSet and InMemoryDataFeed, support load data into memory and shuffle data
6 years ago
dongdaxiang 2486389793 add RunFromDataset in executor
6 years ago
dongdaxiang e36bbcc871 fix some typo and CMakefile.txt
6 years ago
xjqbest 824b84d185 add DataSet and InMemoryDataFeed, support load data into memory and shuffle data
6 years ago
dongdaxiang 08c25995a2 add run from dataset in executor.
6 years ago
dongdaxiang c28bbdf8ba add dataset_generator.py
6 years ago
dongdaxiang be757096da add pybind for fleet
6 years ago
dongdaxiang 687cb79dbb add pipe command io interface
6 years ago
dongdaxiang 1fe54416c9 move fs.cc and shell.cc into paddle/fluid/framework/io
6 years ago
dongdaxiang 53fbab5d33 add fs_local_open example
6 years ago
dongdaxiang afaf937010 add fs_local_open example
6 years ago
dongdaxiang cf1360643f add printer for fetch variable
6 years ago
dongdaxiang d65cb13ad5 add pslib flag on fleet_wrapper CMakefile
6 years ago
dongdaxiang 6de9ebc65c refine VLOG in fleet_wrapper.h
6 years ago
dongdaxiang 97d5cd30f0 make pull dense worker work
6 years ago
dongdaxiang 39014b9f9f fix class register problem
6 years ago
dongdaxiang f0dd1201cc fix destructor problem
6 years ago
dongdaxiang f2bde9c241 fix destructor problem
6 years ago
dongdaxiang 54f047a126 fix ngraph compile option
6 years ago
dongdaxiang dd1dc9bcf0 add common.h.in back
6 years ago
dongdaxiang 378037c535 make s_instance_ private to ensure singleton
6 years ago
dongdaxiang a446d26e8a add todo for asynce executor
6 years ago
dongdaxiang c165012031 refine device_worker and trainer code
6 years ago
dongdaxiang 8a335b50be add downpour device_worker pb configuration
6 years ago
dongdaxiang 24a8001142 make -DWITH_PSLIB=ON compilable
6 years ago
dongdaxiang 67b1d6d721 add dist_multi_trainer for distributed training, add trainer_factory and device_worker_factory so that we can easily extend new training mode, add pull dense worker which is a singleton for parameter fetching
6 years ago
dongdaxiang 855bf579d2 add dist_multi_trainer for distributed training, add trainer_factory and device_worker_factory so that we can easily extend new training mode, add pull dense worker which is a singleton for parameter fetching
6 years ago
lujun d4f63d82ac
Merge pull request #16475 from junjun315/fix-doc-multiplex
6 years ago
Qiao Longfei d8974e6da0 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor-communicator
6 years ago
Shixiaowei02 bddb2cd315 resolve conflicts with the develop branch test=develop
6 years ago
lidanqing 0d656996bf fix some bugs of unzip and reading val list
6 years ago
chengduo 1096746cbf
Fuse Adam And SGD ops (#15933)
6 years ago
Jacek Czaja 2632327429 [MKL-DNN] Tensor modifications revert (#16462)
6 years ago
Zeng Jinle 4143a1c216
Merge pull request #16491 from sneaxiy/feature/advance_gc
6 years ago
chengduo 2265d091e6
Fix threaded executor bug (#16508)
6 years ago
sneaxiy 2c836ff914 check default grad maker
6 years ago
nhzlx d065b5bf2b Anakin ssd support
6 years ago
Zeng Jinle 69cb9792ea
Merge pull request #16506 from sneaxiy/revert-16424-fix_allocator_bug
6 years ago
lidanqing b46e467abc add wget and unzip part and change data_dir
6 years ago
lidanqing 894aa9b235 change script file name and data_dir location
6 years ago
lidanqing 57f51e5b08 preprocess with PIL the full val dataset and save binary
6 years ago
chengduo ed61d67c73
Fix the interface of Pass::Apply (#16484)
6 years ago
dengkaipeng 193185b840 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into shift
6 years ago
Zeng Jinle 5f1c92a81c
Merge pull request #16450 from zhhsplendid/del-redundant-op-var-reg
6 years ago
Zeng Jinle 2aa18e2bda
Merge pull request #16496 from sneaxiy/fix_gc_bug
6 years ago
Sylwester Fraczek 8ece7a9708 fixed url to dataset
6 years ago
sneaxiy 5656fa9f7c fix travis ci
6 years ago
Zeng Jinle 174d0d0b90 Revert "Fix allocator bug"
6 years ago
gongweibao eb83abeac3
Add DGC(Deep Gradient Compression) interface. (#15841)
6 years ago
Qiao Longfei 34890fd3b1 fix gpu build for lookup_table_op test=develop
6 years ago
Sylwester Fraczek fe21578a44 create test for quantized resnet50
6 years ago
Michał Gallus 2d8b7b3a76 Refine default MKL-DNN Pass order (#16490)
6 years ago
Wojciech Uss 09dfc7a2aa
C-API quantization core 2 (#16396)
6 years ago
Jiabin Yang e41d581304
test=develop, fix space_to_depth_doc (#16293)
6 years ago
sneaxiy 4c8254e3bf revert some loop op revision
6 years ago
Zeng Jinle 644e8af4cf
Merge pull request #16424 from sneaxiy/fix_allocator_bug
6 years ago
sneaxiy c4c6205268 fix gc bug
6 years ago
sneaxiy 16f0994728 Merge develop
6 years ago
sneaxiy 63651c1968 fix grad desc maker
6 years ago
Yihua Xu 57dc3c1943 Disable compare for Issue#16316 (#16466)
6 years ago
Zeng Jinle c7c6eeb44e
Merge pull request #16409 from sneaxiy/feature/advance_gc
6 years ago
Qiao Longfei 33be014535 fix distribute compile problem test=develop
6 years ago
Jiabin Yang 54a73578a8
Feature/install check (#16044)
6 years ago
Qiao Longfei b542639dc0 code clean test=develop
6 years ago
wopeizl c300b1ba69
Tensor index (#16223)
6 years ago
Jiabin Yang 0d9d25d40f
Feature/refactor layers to Layers (#16337)
6 years ago
dengkaipeng 3e352388eb fix format. test=develop
6 years ago
dengkaipeng eb2123e12d fix doc and jit. test=develop
6 years ago
liuwei1031 8d22bc17a4
Memory optimize (#16410)
6 years ago
Xin Pan f8c279b11c
Merge pull request #16454 from panyx0718/imperative2
6 years ago
Zhaolong Xing fa1796a30a
Merge pull request #16330 from NHZlX/merge_anakin_branch_to_dev
6 years ago
lujun 3f8b2f5ff5 fix multiplex doc, test=develop
6 years ago
sneaxiy a0f4fefb60 delete source file no_need_buffer_vars_inference.cc
6 years ago
Qiao Longfei 392e97aae5 fix cpplint test=develop
6 years ago
Qiao Longfei 37f6b9ab7a fix build test=develop
6 years ago
tensor-tang 1eff834e97
update jitkernel doc (#16327)
6 years ago
Qiao Longfei 30618409db Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor-communicator
6 years ago
Yiqun Liu 98802e1f75
Optimize the implementation of while_op again, for cases when is_test is true. (#16359)
6 years ago
lujun c34b24ede7
Merge pull request #16425 from junjun315/checkpoint-hotfix
6 years ago
Wu Yi 9ffd5eecef
test fix fetch bar place for ce (#16406)
6 years ago
sneaxiy 318072c26b add comments of allocator design
6 years ago
chengduo 4f2278f032
Add doc for CPUPlace CUDAPlace CUDAPinPlace (#16442)
6 years ago
nhzlx 953bdde058 Merge branch 'develop' of https://github.com/paddlepaddle/paddle into HEAD
6 years ago
Tao Luo e0a3a49096
Merge pull request #16438 from wojtuss/wojtuss/move-cpu-quantize-passes
6 years ago
gongweibao ec6519e806
Fix allreducedep bug (#16443)
6 years ago
sneaxiy 78fb3a62e0 fix env variable settting bug
6 years ago
sneaxiy 2d92b6be98 merge develop
6 years ago
Jiabin Yang f735102eab
add layer norm to Layers, add transformer test in imperative mode (#16092)
6 years ago