Commit Graph

758 Commits (5b4f2830694d3709617a11d8f0cb478c769d3eef)

Author SHA1 Message Date
yuyang18 e5281b3c2d Clean code & add execution strategy
7 years ago
typhoonzero 928418a9ac Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into gen_nccl_id_op
7 years ago
typhoonzero 0ae726f060 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into gen_nccl_id_op
7 years ago
typhoonzero f5840d8925 follow comments
7 years ago
typhoonzero 04bde96e4c Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into gen_nccl_id_op
7 years ago
yuyang18 54cbf799d6 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/change_pe_strategy
7 years ago
yuyang18 9f705a4bb9 Use int instead of VarType as unordered_map key
7 years ago
chengduoZH 97cb5479ae change PE strategy
7 years ago
chengduo 18f527bfa3
Merge pull request #10586 from jacquesqiao/fix-compile
7 years ago
yuyang18 c4d6daac58 Polish SizeOfType
7 years ago
Yu Yang 046405e091
Merge pull request #10486 from reyoung/feature/clean_op_maker
7 years ago
yuyang18 711d86bb56 Polish data_type.h
7 years ago
qiaolongfei 3c2a6109ec fix build computation_op_handle
7 years ago
qiaolongfei 07d94bdd82 fix compile fetch_op_handle on mac
7 years ago
chengduo ce72c3ff26
Merge pull request #10476 from chengduoZH/refine_parallel_exe
7 years ago
chengduoZH a89cd46700 Wait VarDummyHandle generated
7 years ago
fengjiayi e15d616e29 Complete the C++ core of 'CustomReader'
7 years ago
reyoung a0c413833d Polish Dctor
7 years ago
reyoung b0ca371f11 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/clean_op_maker
7 years ago
chengduoZH 830532213a extract method from broadcast::RunImpl
7 years ago
chengduoZH 9eec2c7509 refine pe
7 years ago
Yao Cheng 9ca8124f99 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into develop
7 years ago
chengduoZH f4851f14b8 clean code
7 years ago
chengduoZH a459764de7 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_fetchop
7 years ago
Yu Yang 0e78cb69fb Clean OpProtoAndCheckerMaker
7 years ago
Yao Cheng 8cbb49ce63 rm space
7 years ago
Yao Cheng e97645c959 rm block_desc.h whitespace
7 years ago
gmcather be1f058f52
Merge branch 'develop' into develop
7 years ago
Yao Cheng 55218dafbc add prependAllocatedop
7 years ago
chengduoZH 676dfd1875 follow comments
7 years ago
chengduoZH aff8a26d71 check generated_op_
7 years ago
chengduoZH 2e5d44f102 fix fetch op
7 years ago
typhoonzero a529d790b6 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into gen_nccl_id_op
7 years ago
Yiqun Liu fd1971caa0
Add the call of DropKids at the end of executor.Run to delete the local scopes created in operators (#10403)
7 years ago
chengduo 99acf1da4c
Merge pull request #10351 from chengduoZH/feature/update_sparse_parameter
7 years ago
chengduoZH 881e063ee2 follow comments
7 years ago
chengduoZH ff599b9218 use Reduce and Broadcast
7 years ago
chengduoZH 0441c2cc45 fix ci
7 years ago
Yancey 2d98a418d7
fix remove op (#10410)
7 years ago
chengduoZH f9c680c43e Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/update_sparse_parameter
7 years ago
typhoonzero d9320dcd94 complete code
7 years ago
chengduoZH 7722baa8e3 follow comments and clean code
7 years ago
Yiqun Liu 6084af47ef
Fix the bug when a input variable of op is dispensable. (#10268)
7 years ago
chengduoZH c891189568 update sparse gradient parameter with reduce and broadcast
7 years ago
chengduoZH 5ff1ef36ee update sparse parameter
7 years ago
Yancey ff99d94197
Merge pull request #10164 from Yancey1989/lookup_sparse_table_op
7 years ago
Yang yaming 9a8be9daca
Merge pull request #10223 from pkuyym/fix-10219
7 years ago
yangyaming 13fac4232a Fix to pass CI.
7 years ago
Yu Yang c0ac0cd6b3 Complete rename
7 years ago
chengduoZH 9fda5c92cd Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add_FLAGS_use_deterministic_algo
7 years ago
yangyaming f456cd8079 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix-10219
7 years ago
Yu Yang 25779c982d
Merge pull request #10265 from reyoung/feature/polish_code
7 years ago
Yu Yang 9612c7e599 Add comments and polish code
7 years ago
fengjiayi 71fa3ca9c4
Merge pull request #10232 from JiayiFeng/fix_unittests
7 years ago
whs 2f9fa9b721
Merge pull request #10167 from wanghaoshuang/fluid_init
7 years ago
fengjiayi 330fa95cbd Follow comments
7 years ago
fengjiayi b88721213f fix broadcast_op_test and reduce_op_test
7 years ago
yangyaming 82571deb89 Change `customize_loss_grad` to `use_default_grad_scale`.
7 years ago
Abhinav Arora 4c8ff72615
Fix CPPLint errors with rxecutor (#10212)
7 years ago
Yancey1989 e393c86c4a Merge branch 'develop' of github.com:PaddlePaddle/Paddle into lookup_sparse_table_op
7 years ago
Tao Luo 8b2391858f
Merge pull request #10181 from abhinavarora/cpplint_advanced
7 years ago
Wu Yi 3fdfa940be
Merge pull request #10135 from typhoonzero/unify_blocking_queue
7 years ago
wanghaoshuang ad3f6f4ad5 Fix devices 'not undefined' error.
7 years ago
Abhinav Arora edd3587e50 Fix CPPLint errors with op_desc
7 years ago
Yang Yang(Tony) 81dfc0cf0e
Clean up unused code in operator class (#10035)
7 years ago
Abhinav Arora f09aed0475
Fix CPPLint issues in framework/data_transform framework/prune.cc (#10178)
7 years ago
wanghaoshuang 3d96b3811a Fix InitGflags.
7 years ago
wanghaoshuang a4b452a2d6 Remove initP2P(bool) and init function in framework.
7 years ago
Yu Yang 4ecc9b7bae
Merge pull request #10166 from reyoung/feature/train_and_test_recordio
7 years ago
wanghaoshuang a0b258278e Reuse 'initP2P(bool, std::vector)' in 'initP2P(bool)'
7 years ago
wanghaoshuang f31bb1476c Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fluid_init
7 years ago
wanghaoshuang 48b7b54321 Refine code.
7 years ago
Abhinav Arora 5ce57555ee
Fix CPPLint issues in init.cc, init.h and library_type.h (#10148)
7 years ago
wanghaoshuang 1bdea0a8d2 Add init interface for customize devices.
7 years ago
Yu Yang 2c8fe4e544
Merge pull request #10143 from typhoonzero/fix_multiGPU_dist_train
7 years ago
Yu Yang 54ada9449e Add demo for recordio train/test and parallel executor
7 years ago
Yancey1989 e8d802159e add lookup_sparse_table_op
7 years ago
fengjiayi 00b54d5803 fix fetch_op_handle
7 years ago
fengjiayi dd5946528a
Merge pull request #10142 from JiayiFeng/Add_TensorCopySync
7 years ago
Abhinav Arora 504e60a881 Fix Cpplint issues in framework/data_type.h and framework/feed_fetch_type.h (#10146)
7 years ago
typhoonzero f03415207a Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_multiGPU_dist_train
7 years ago
typhoonzero 1fba0c578a fix multi gpu dist train
7 years ago
fengjiayi c5e178f4fd fix errors
7 years ago
fengjiayi 9f11da5931 Add synchronous TensorCopy and use it in double buffer
7 years ago
Yang yaming f3e4e42def
Merge pull request #10130 from reyoung/feature/skip_loss
7 years ago
Yu Yang 55feba9b5a Fix CPU compile
7 years ago
Wu Yi 3863c6a9a8
Merge pull request #10126 from typhoonzero/fix_para_exe_dist_train
7 years ago
typhoonzero 251e4a8ee5 unify fluid blocking queue
7 years ago
Yu Yang 7a395881d4 Add customize_loss_grad option to PE
7 years ago
typhoonzero 2b06b4b4e9 updates follow up para exe
7 years ago
typhoonzero 8ee837255e fix send op handle local scope
7 years ago
chengduoZH f5b4ac6e50 enable delay op feature
7 years ago
Tao Luo 58fd4c0994
Merge pull request #10111 from abhinavarora/cpplint_tensor_util_test
7 years ago
Abhinav Arora 1c70600d09 Fix compile error
7 years ago
Abhinav Arora 6402b59a7c
Fix CPPLint issues in some tests in fluid/framework (#10068)
7 years ago
Abhinav Arora c08752ca43 Fix compile error
7 years ago
Abhinav Arora feaf168d95 Fiux compile error
7 years ago
Abhinav Arora b6ec45d8da Fix CPPLint warnings in tensor_util_test
7 years ago
Abhinav Arora e66f0c73af
Fix CPPLint errors in framework/details (#10104)
7 years ago
chengduo eb8e14c9fd
Merge pull request #10081 from chengduoZH/refine/gather_broadcast
7 years ago
Qiao Longfei acd7309ea1
Merge pull request #10079 from jacquesqiao/fix-reduce_op_handle_test
7 years ago
chengduoZH 9a4ae4df79 fix scope of gather broadcast
7 years ago
Tao Luo 8e00540778
Merge pull request #10058 from Xreki/core_fix_flush
7 years ago
qiaolongfei 9a0ad10ff1 fix reduce_op_handle_test
7 years ago
chengduo cec4e6ed0d
Merge pull request #9946 from chengduoZH/feature/add_reduce_op_handle
7 years ago
chengduo 23a21c86b1
Merge pull request #9922 from chengduoZH/feature/refine_gather_reduce
7 years ago
Yu Yang 92b5f49ee4 Eager destruct local scope
7 years ago
qiaolongfei 0ffd33d30e VariableResponse support deserialize var into local scope
7 years ago
Liu Yiqun 7ffbcbcaf0 Add flush of program desc to update the proto information.
7 years ago
Yancey 0b8630b9b4
Merge pull request #9897 from Yancey1989/auto_grwon_sparse_table
7 years ago
chengduo 88f8183576 Merge branch 'develop' into feature/refine_gather_reduce
7 years ago
chengduoZH 035712822c fix VisitVariable
7 years ago
Abhinav Arora cbbf08aee9 Fix CPPLint errors in some framework files
7 years ago
Yiqun Liu 598035f985 Fix a bug in save_inference_model and prune when the program is initailized by load_inference_model (#10011)
7 years ago
Xin Pan 98c12b1a08 Clean up C++ codes. (#10022)
7 years ago
Tao Luo d84cdb7b59
Merge pull request #9911 from tonyyang-svail/unify_op_registry
7 years ago
Yancey1989 f12b3f3617 use memcpy
7 years ago
Yu Yang 60e0d1aabd
Merge pull request #10023 from reyoung/feature/DtorOfPE
7 years ago
Yu Yang 28013ef9e2
Merge pull request #10019 from reyoung/feature/feed_fetch_tensor_on_cpu
7 years ago
Yancey1989 13e7194ebd Merge branch 'develop' of github.com:PaddlePaddle/Paddle into auto_grwon_sparse_table
7 years ago
Yancey1989 70bf732f82 refine get interface
7 years ago
chengduoZH fbb75c6bb6 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/refine_gather_reduce
7 years ago
Yu Yang 5305c5f845 Correctly implement destructor of ParallelExecutor
7 years ago
Yu Yang 38d75c912c Follow comments
7 years ago
chengduoZH 4760ac44f1 check the generate_op is null or not and add DEPS of broadcast_op_handle and gather_op_handle
7 years ago
Yu Yang 6de5fd9e8a Fix FetchTensor on CPU
7 years ago
Yu Yang 35ebe2eca7 Clean MultiDevicesGraphBuilder
7 years ago
Yu Yang d24ef931b5 Clean Code
7 years ago
Yancey1989 b920b51686 rename parameter
7 years ago
Yancey1989 2917a75b7a add some comments for sparse table
7 years ago
fengjiayi fbe562478d
Merge pull request #9994 from reyoung/feature/debug
7 years ago
chengduoZH e63013a86f Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_reduce_op_handle
7 years ago
chengduoZH 1eeb2e0042 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_reduce_op_handle
7 years ago
Abhinav Arora 1b5c1bcb57 Disabling Channel Test to fix CI
7 years ago
Yang Yang 68d96385e4 remove REGISTER_OP and REGISTER_OP_EX
7 years ago
Yu Yang 9b60d0decb
Merge pull request #9975 from reyoung/feature/VarHandleCtor
7 years ago
Yu Yang 06fb055a2f New group
7 years ago
Yancey1989 ca327508cc update
7 years ago
chengduoZH e4de957f19 code refine
7 years ago
Yu Yang 71a2e6b73c Reverse create var
7 years ago
Yu Yang 2e8459be71 DebugCode
7 years ago
Yu Yang fc6f0be276
Merge pull request #9942 from reyoung/feature/tuning_pe_trans
7 years ago
Yu Yang d7527681c6 Fix scale grad
7 years ago
Yu Yang 89728f8e66 update
7 years ago
Yu Yang eb2e4eeade Debug
7 years ago
Yu Yang 64c139e854 Using constructor for VarHandle
7 years ago
chengduoZH 4abef50123 code refine
7 years ago
Yu Yang b4aaa00a8a Polish logic of ParallelExecutor
7 years ago
Yu Yang e9e27e0f32 Revert
7 years ago
Yu Yang 7289e75836 Udpate
7 years ago
Yancey1989 ed6241cd44 Merge branch 'develop' of github.com:PaddlePaddle/Paddle into auto_grwon_sparse_table
7 years ago
Yu Yang 4999f85f6a Clean RunDelayedOp method
7 years ago
Yu Yang c0f4e0332c Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/simplify_delay_logic
7 years ago
Yang Yang dafe06af46 first commit
7 years ago
chengduoZH 3301d4402e Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_reduce_op_handle
7 years ago
chengduoZH 3c5bbf42c4 make unit test to work
7 years ago
chengduoZH 2aaa75ecf8 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/refine_gather_reduce
7 years ago
chengduoZH e39adc8600 add reduce op handle
7 years ago
guru4elephant a097d082c7
Merge pull request #9938 from guru4elephant/fix_testcase
7 years ago
Yu Yang 5b84c9b59c CreateOpHandleIOs
7 years ago
dongdaxiang fb873713e7 update program_desc_test testcase
7 years ago
Yu Yang d0342f12aa Simplify DelayOps Logic
7 years ago
chengduoZH 690cd1f748 refine gather and broadcast
7 years ago
chengduo b43d87c917
Merge pull request #9825 from chengduoZH/feature/add_gather_and_BCast_op_handle
7 years ago
chengduoZH 384d6ee8ac follow comments
7 years ago
Yu Yang ed2d7d7d26 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/mix_cpu_gpu_op
7 years ago
Yu Yang 925c17aba7
Merge pull request #9895 from reyoung/feature/fix_transformer_hang
7 years ago
Yu Yang 4452ff76b7 Fix CPU compile
7 years ago
chengduoZH 02842cfc25 enhance broadcast_op_handle and gather_op_handle
7 years ago
Yu Yang 79be06045c Support CPU/GPU mixture for ParallelExecutor
7 years ago
Yancey1989 ac7cb949d0 auto-grown sparse table
7 years ago
Yu Yang 7083c2a6b3 Merge branch 'feature/fix_transformer_hang' into feature/mix_cpu_gpu_op
7 years ago
Yu Yang cedade9494 Stash
7 years ago
Wu Yi 1bdc7261a5
Merge pull request #9578 from typhoonzero/threadpool_for_io
7 years ago
Tao Luo 2c552d4e61
Merge pull request #9630 from Xreki/core_inference_prepare
7 years ago
Yu Yang 6b20b35589 Fix Transformer Hang Problem
7 years ago
typhoonzero a08bf76f74 refine name
7 years ago
chengduoZH b0267ac93a refine broadcast op
7 years ago
chengduoZH 8b597d9ddc Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_gather_and_BCast_op_handle
7 years ago
Liu Yiqun 449bdde58a Correct some typos.
7 years ago
chengduoZH e26c6d78ad code refine
7 years ago
Qiao Longfei 4c55a6022a
Dist transpiler support prefetch (#9714)
7 years ago
typhoonzero 26cfc634b9 multi stream thread pool
7 years ago
Liu Yiqun 2762959f79 Merge branch 'develop' into core_inference_prepare
7 years ago
Liu Yiqun 339be6254e Refine the order of arguments.
7 years ago
Yu Yang ad73b331c7 Eagerly drop local scope in iteration (#9838)
7 years ago
Yang Yang(Tony) a64edbf14e
delete backward.cc related code on the python side (#9854)
7 years ago
Yang Yang(Tony) b26f505002
remove net op and cond_op (#9663)
7 years ago
chengduoZH ae5923e205 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/add_gather_and_BCast_op_handle
7 years ago
chengduoZH e7684911fd add gather op handle
7 years ago
Liu Yiqun bf485999f4 Merge branch 'develop' into core_inference_prepare
7 years ago
typhoonzero dfc60251bf Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into multigpumultinode
7 years ago
fengjiayi 90084a25d2
Merge pull request #9743 from JiayiFeng/modify_readers_to_fit_parallel_executor
7 years ago
chengduoZH 124c93081d remove ContextMap
7 years ago
typhoonzero e2ca8e1097 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into threadpool_for_io
7 years ago
typhoonzero d1e63a1d92 fix ci
7 years ago
typhoonzero 16a9dfe480 finish
7 years ago
JiayiFeng 273f4892b2 update recordio unittest
7 years ago
chengduoZH 6db96ec23c follow comments
7 years ago
chengduoZH 8eaec5dd7c add BCast and Gather
7 years ago
Tao Luo 0ad892a0d4
Merge pull request #9816 from luotao1/remove_op
7 years ago
typhoonzero ec6976810d Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into multigpumultinode
7 years ago
fengjiayi a84b81502c Remove Readers' HasNext()
7 years ago
wanghaoshuang 19c1a68ee9 Fix lost of LoD while splitting tensor in parallel executor.
7 years ago
typhoonzero ce08dc8751 have stream removed error
7 years ago
typhoonzero 0bf799a523 wip testing
7 years ago
chengduo e0babe7c3e
Merge pull request #9780 from chengduoZH/feature/fix_batch_size_is_littler_than_gpu_count
7 years ago
typhoonzero b9c28df922 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into multigpumultinode
7 years ago
Luo Tao e7467d94a0 add remove_op, remove_var in Python end
7 years ago
JiayiFeng ee178d5aeb fix bugs
7 years ago
Yu Yang 161344bf47
Merge pull request #9774 from reyoung/feature/simplify_data_structures
7 years ago
Xin Pan 326b434ab5
Merge pull request #9699 from panyx0718/test
7 years ago
typhoonzero 22f03a1b3b Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into multigpumultinode
7 years ago
Yu Yang 17bfe3f6be Change to avoid GCC4.8 bug
7 years ago
Liu Yiqun e24172eb54 Simplify the inference unittest of fit a line and add some comment.
7 years ago
Liu Yiqun bdb21f6bc3 Merge branch 'develop' into core_inference_multi_thread
7 years ago
chengduoZH 7e7611d067 when the number of samples of current batch is less than the count of devices, let it crash.
7 years ago
Yu Yang ad40faaafb Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/simplify_data_structures
7 years ago
Yu Yang f051c768e5 Simplify DataStructure in SSAGraph
7 years ago
Liu Yiqun a9855e4afd Merge branch 'develop' into core_inference_fix_run
7 years ago
qingqing01 2b7e5bd366
Support testing during training by ParallelExecutor. (#9738)
7 years ago
Yi Wang 25ad6884bb Merge branch 'develop' of http://github.com/paddlepaddle/paddle into cpplint-memory-detail
7 years ago
typhoonzero baea2cf178 wip
7 years ago
Yancey1989 9eaf445809 Merge branch 'develop' of github.com:PaddlePaddle/Paddle into prefech_prog_on_server
7 years ago
Liu Yiqun a9e826ed49 Add the check of has_feed/fetch_operators back.
7 years ago
Liu Yiqun 7b40f7ce4a Merge branch 'develop' into core_inference_prepare
7 years ago
Liu Yiqun 208fcf5225 Merge branch 'develop' into core_inference_multi_thread
7 years ago
typhoonzero 01c6618de9 first wip commit
7 years ago
Yi Wang eebb205324 Update CMakeLists
7 years ago
Yi Wang e185502ebe
Fix cpplint errors with paddle/fluid/platform/dynload (#9715)
7 years ago
Xin Pan b138d29c38 Avoid init_p2p all the times
7 years ago
Yi Wang 797a7184ac
Unify Fluid code to Google C++ style (#9685)
7 years ago
Abhinav Arora b5b7ea12fa
Fix CPPLint issues in tuple.h (#9670)
7 years ago
chengduo 3d3e5aeb9c
Merge pull request #9648 from chengduoZH/feature/expose_CUDAPinnedPlace_to_python
7 years ago
chengduoZH 4ff237f93c follow comments
7 years ago
Lei Wang 09b4a1a361 Build: generate all the build related files into one directory. (#9512)
7 years ago
Qiao Longfei 424dd2fc43
Merge pull request #9597 from jacquesqiao/sgd-support-update-selected-rows
7 years ago
Abhinav Arora 7bf82f82b1
Fix CPPlint errors in channel.h, channel_impl.h and channel_test.cc (#9628)
7 years ago
qiaolongfei ff4208e676 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into sgd-support-update-selected-rows
7 years ago
qiaolongfei e66bd4cb73 add GetDataTypeOfVar
7 years ago
chengduoZH 17842e33c3 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/expose_CUDAPinnedPlace_to_python
7 years ago
Xin Pan 043c23080c
Merge pull request #9637 from panyx0718/feed
7 years ago
chengduoZH 8e4e155c52 add PyCUDAPinnedTensorSetFromArray
7 years ago
Tao Luo 5eb9cecc4a
Merge pull request #9607 from luotao1/remove_var
7 years ago
Liu Yiqun fecbf7ff73 Merge branch 'develop' into core_inference_fix_run
7 years ago
Yancey1989 abfd9fe798 Merge branch 'develop' of github.com:PaddlePaddle/Paddle into prefech_prog_on_server
7 years ago
Liu Yiqun 3a82578278 Merge branch 'develop' into core_inference_prepare
7 years ago
Yancey1989 1842758117 prefetch prog run on new scope
7 years ago
Xin Pan 4bbfa9eccb Add feed to ParallelExecutor
7 years ago
Yu Yang bc8f436061
Merge pull request #9634 from reyoung/feature/fix_leaf_ops
7 years ago