Commit Graph

790 Commits (bd77a4258d18328b4e2a9b47e111de803d69933c)

Author SHA1 Message Date
gongweibao eb83abeac3
Add DGC(Deep Gradient Compression) interface. (#15841)
6 years ago
sneaxiy c4c6205268 fix gc bug
6 years ago
Zeng Jinle c7c6eeb44e
Merge pull request #16409 from sneaxiy/feature/advance_gc
6 years ago
Qiao Longfei 33be014535 fix distribute compile problem test=develop
6 years ago
Qiao Longfei b542639dc0 code clean test=develop
6 years ago
liuwei1031 8d22bc17a4
Memory optimize (#16410)
6 years ago
sneaxiy a0f4fefb60 delete source file no_need_buffer_vars_inference.cc
6 years ago
Qiao Longfei 392e97aae5 fix cpplint test=develop
6 years ago
Qiao Longfei 37f6b9ab7a fix build test=develop
6 years ago
Qiao Longfei 30618409db Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor-communicator
6 years ago
Wu Yi 9ffd5eecef
test fix fetch bar place for ce (#16406)
6 years ago
gongweibao ec6519e806
Fix allreducedep bug (#16443)
6 years ago
sneaxiy 78fb3a62e0 fix env variable settting bug
6 years ago
sneaxiy 7000ec85d9 fix some op grad maker
6 years ago
sneaxiy f8ed2c229e try to fix ci error
6 years ago
Qiao Longfei be0c482304 update trainer_id
6 years ago
sneaxiy 072d95d8f6 Merge develop
6 years ago
sneaxiy a93a9eef8f add op registry type
6 years ago
chengduo a6a3b2fbbc
[Speed]Refine ParallelExecutor (#16190)
6 years ago
chengduo 33965527fd
Add unit test for fuse all reduce (#16354)
6 years ago
chengduo f26ba5bddd
Fuse AllReduce (#15921)
6 years ago
Wu Yi 6382b62f6b
Collective ops (#15572)
6 years ago
Qiyang Min c7f1f3ed0c
Merge pull request #16214 from velconia/imperative_infer_var_type
6 years ago
minqiyang b40e41fbd1 Polish code style
6 years ago
minqiyang 36dce65bb3 Take DataType and VarType apart
6 years ago
minqiyang 438bca9c3d Implement Runtime Var Type Inference
6 years ago
qingqing01 8ad672a287
Support sync batch norm. (#16121)
6 years ago
minqiyang ca392c7e97 Implement infer var type context
6 years ago
liuwei1031 1c6caf8466
1. disable reuse SELECTED_ROWS type variable (#16150)
6 years ago
Zhen Wang 5685a48c23 Add some fixme. test=develop
6 years ago
Zeng Jinle 472f16b5aa
Merge pull request #16063 from sneaxiy/enhance_gc
6 years ago
Qiao Longfei ff8054c5a7 can run
6 years ago
Qiao Longfei 3225e19591 fix remove recv op
6 years ago
Qiao Longfei fe6a840924 fix delete recv ops
6 years ago
Wu Yi d206582337
add parallel graph dist test (#16076)
6 years ago
Qiao Longfei 446fdf9563 fix compile problem
6 years ago
Qiao Longfei a23f1ee85a optimize code
6 years ago
Qiao Longfei a0bb18beec Merge branch 'add-async-ssa-graph-executor' of ssh://github.com/jacquesqiao/Paddle into add-async-ssa-graph-executor-communicator
6 years ago
liuwei1031 045e5911bf
fix a code bug which cause crash when empty variable is used, test=develop (#16080)
6 years ago
sneaxiy 7b608396fe fix travis-ci format check
6 years ago
Qiao Longfei 255b36dad2 can run
6 years ago
Qiao Longfei 5e8de51409 code format test=develop
6 years ago
Qiao Longfei 4e218dabc5 code format test=develop
6 years ago
sneaxiy 814a759061 merge develop
6 years ago
sneaxiy 597dc65e76 enhance gc
6 years ago
liuwei1031 caadd0581d
add IfElse test case for ir memory optimize (#15998)
6 years ago
Qiao Longfei f28c258453 code clean test=develop
6 years ago
Qiao Longfei 8c38aca954 tmp commit
6 years ago
Qiao Longfei fab1b54d99 Merge branch 'add-communicator' of ssh://github.com/jacquesqiao/Paddle into add-async-ssa-graph-executor-communicator
6 years ago
Qiao Longfei e70b1727ef Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor
6 years ago
sneaxiy a9ea99d700 merge develop
6 years ago
chengduo ae37f82964
Unified ParallelExecutor and Compiler (#15970)
6 years ago
Qiao Longfei 847e4f4e85 pure async mode train
6 years ago
Qiao Longfei 49f2f4f91d Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator
6 years ago
Qiao Longfei f768fbf715 support multi graph
6 years ago
Qiao Longfei ff01d70583 fix style
6 years ago
Qiao Longfei dab7f36909 optimize code test=develop
6 years ago
Qiao Longfei cf0511f21e Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor
6 years ago
Qiao Longfei 43c82376cb use one graph
6 years ago
dzhwinter 660e410655
Merge pull request #15855 from dzhwinter/fix/nightly_test
6 years ago
Xin Pan a6e3cd5eb7
Merge pull request #15425 from panyx0718/api
6 years ago
Qiao Longfei b8491bfd4e Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-communicator
6 years ago
dzhwinter a71f2fbe4f fix default value. test=develop
6 years ago
乔龙飞 Qiao Longfei ec8e878200
Merge pull request #15840 from jacquesqiao/revert-15684-revert-15661-fix-cpu-broadcast
6 years ago
Qiao Longfei 2b7931d5c9 refine code test=develop
6 years ago
Xin Pan 0362ef75f4 fix
6 years ago
Xin Pan 12a0e2ed9d polish codes
6 years ago
Xin Pan 19d78f6797 polish
6 years ago
Qiao Longfei ecedd531c1 fix code bug test=develop
6 years ago
Qiao Longfei f4f4816b0c fix gpu error test=develop
6 years ago
Xin Pan 32d5a16036 resolve conflicts
6 years ago
Qiao Longfei 3f9263f67e optimize style test=develop
6 years ago
Qiao Longfei 4233d0a820 add more comment test=develop
6 years ago
Qiao Longfei 3bccc1e6e2 optimize broadcast logic test=develop
6 years ago
Xin Pan 26e32e095a allow compiler to use graph
6 years ago
Qiao Longfei 12f6b8c3d6 change the include of ThreadPool.h test=develop
6 years ago
Qiao Longfei 7f3be09045 fix multi graph test=develop
6 years ago
Qiao Longfei 31a05d3efd Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor
6 years ago
Qiao Longfei 62f1248ff5 fix use gpu test=develop
6 years ago
Xin Pan 6019054cdd
Merge pull request #15716 from Yancey1989/refine_pg
6 years ago
Dun a83e470405
Profiler refine and add CUDA runtime api tracer (#15301)
6 years ago
Qiao Longfei cc71e89499 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor
6 years ago
dzhwinter f2e8409f5a
Merge pull request #15795 from dzhwinter/fix/block_desc
6 years ago
tensor-tang e1c707fe9c
fix warnings (#15790)
6 years ago
Yancey1989 4b193db14c polish code test=develop
6 years ago
dzhwinter 6deb17ed8c fix default value. test=develop
6 years ago
dzhwinter 089d262c41 fix default value. test=develop
6 years ago
dzhwinter 9c92d0304f fix default value. test=develop
6 years ago
Yancey1989 d5090c892d polish code test=develop
6 years ago
Yancey1989 0f8bd73cc9 cleanup code test=develop
6 years ago
Yancey1989 5677c9d4ee update comment test=develop
6 years ago
Yancey1989 642fd68ce0 update by comment test=develop
6 years ago
dzhwinter d94a314db5 add reference. test=develop
6 years ago
dzhwinter 591ad33e32 polish code for reading. test=develop
6 years ago
dzhwinter 18afb77e78 polish code for reading. test=develop
6 years ago
dzhwinter 684b572307 polish code for reading. test=develop
6 years ago
dzhwinter 3787e61fca polish code for reading. test=develop
6 years ago
dzhwinter c1455e606d Merge remote-tracking branch 'origin/develop' into cherry-pick/memory
6 years ago
dzhwinter d376cf71b7 polish code for reading. test=develop
6 years ago
Yancey1989 7cd6de37f5 fix cpu test=develop
6 years ago
Yancey1989 bd0d44af24 fix build failed test=develop
6 years ago
Yancey1989 ecdd1166b8 cleanup code test=develop
6 years ago
Yancey1989 73005ee00d cleanup code test=develop
6 years ago
Yancey1989 88d3dc949e Merge branch 'develop' of github.com:PaddlePaddle/Paddle into refine_pg
6 years ago
Yancey1989 f3463ecb6e refine pg execution
6 years ago
dzhwinter 283573c6aa add details. test=develop
6 years ago
乔龙飞 Qiao Longfei 45b19cbc9a
Revert "Revert "cpu reduce mode did not need to broadcast params test=develop""
6 years ago
dzhwinter 6d6ddcfe15 add details. test=develop
6 years ago
dzhwinter 11afbe0f53 add details. test=develop
6 years ago
tensor-tang e49706c80e
Merge pull request #15659 from GBuella/add_to_string
6 years ago
Gabor Buella da9c94da33 Clang build fixes (#15628)
6 years ago
乔龙飞 Qiao Longfei 6e0e706198
Revert "cpu reduce mode did not need to broadcast params test=develop"
6 years ago
Qiao Longfei 97b143fb49 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix-cpu-broadcast
6 years ago
Qiao Longfei ffd0d1d216 clean need_broadcast_var_ test=develop
6 years ago
Qiao Longfei fbadd4b60c follow comment test=develop
6 years ago
dzhwinter 04e9776aef add details. test=develop
6 years ago
Qiao Longfei c4ded17e8c async mode support dist train
6 years ago
Qiao Longfei 84367cf8bc support async mode in dist mode parallel executor
6 years ago
Qiao Longfei e72637ddd2 ThreadedSSAGraphExecutor support num_iteration_per_run test=develop
6 years ago
Qiao Longfei a7152613f7 Merge branch 'fix-cpu-broadcast' of ssh://github.com/jacquesqiao/Paddle into add-communicator
6 years ago
Qiao Longfei 76072261f8 fix compiler
6 years ago
Qiao Longfei b99db0e2c2 cpu reduce mode did not need to broadcast test=develop
6 years ago
Qiao Longfei 5cf0092825 add more log and fix test_dist_base in multi_batch_merge_pass
6 years ago
Gabor Buella 4975a9050a Tests - add some missing to_string calls
6 years ago
Qiao Longfei b1fe8d4570 add a check for async_ssa_graph_exe test=develop
6 years ago
Qiao Longfei 16af1dbc7b Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor
6 years ago
dzhwinter 4ef34916a4 enhanced print message. test=develop
6 years ago
dzhwinter ce0394bcd0 merge develop branch. test=develop
6 years ago
dzhwinter cca71532eb add skip send.recv test=develop
6 years ago
dzhwinter 9f001c6525 skip dist. test=develop
6 years ago
dzhwinter 2561a6fc59 follow comment. test=develop
6 years ago
dzhwinter 2a5ecb68b0 follow comment. test=develop
6 years ago
dzhwinter e537634d16 delete graph print pass. test=develop
6 years ago
dzhwinter 5cab99a686 fuck windows. rerun windows ci. test=develop
6 years ago
dzhwinter 0a63234c85 follow comments. test=develop
6 years ago
dzhwinter 9e87fbebb7 rerun windows ci. test=develop
6 years ago
dzhwinter 32a2014939 refine build strategy. test=develop
6 years ago
dzhwinter 8156fedf56 merge develop branch. test=develop
6 years ago
Qiao Longfei 02dab46ab8 add some debug info
6 years ago
dzhwinter ee3aae56cd merge develop branch. test=develop
6 years ago
dzhwinter d6d3e6afe2 add more skip strategy
6 years ago
Qiao Longfei be738a646e add some debug infor
6 years ago
dzhwinter 2739096eec compatibable with python side mem_opt
6 years ago
Qiao Longfei a66115bed5 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor
6 years ago
Qiao Longfei fab8457e6b code optimize
6 years ago
gongweibao d303270a0e
revert test=develop (#15535)
6 years ago
Qiao Longfei ada43e89c3 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-async-ssa-graph-executor
6 years ago
gongweibao d54494ba87
cleanup test=develop (#15347)
6 years ago
sneaxiy ef788603d4 merge develop
6 years ago
sneaxiy d8568acd19 turn on remove_unnecessary_lock
6 years ago
sneaxiy eac5a0aa0c Merge develop
6 years ago
WangZhen 3ce6172052 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into graph_quantization
6 years ago
dzhwinter 8f3b252392 squash commits. test=develop
6 years ago
Dun 9f8f0fc2d3 Memory optimization of depthwise conv op and group norm op (#15313)
6 years ago
WangZhen e2ff300b02 add UT for quantization.
6 years ago
WangZhen 451896fce4 init quantization.
6 years ago
Qiao Longfei 88d71fa2f9 support num_iteration_per_run
6 years ago
gongweibao 7cd4dd7ce4
Hide varhandle members. (#15382)
6 years ago
Qiao Longfei ea66979684 can run
6 years ago
Qiao Longfei 92a6c7a049 init async ssa executor
6 years ago
flame fb63cd89d4
Add python ir graph API (#14917)
6 years ago
sneaxiy 594dc4d8f0 partial gc 1st version
6 years ago
minqiyang 68a07328fa Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add_pyramid_dnn_support
6 years ago
minqiyang 4bfa110fd8 Add no lock optimize pass
6 years ago
chengduo eabb2105fa
Refactor MultiDevSSAGraphBuilder (#15090)
6 years ago
Yancey1989 4ad9de74dd disable sync nccl by default test=develop
6 years ago
Yancey1989 e65436103f Merge branch 'develop' of github.com:PaddlePaddle/Paddle into parallel_graph_mode
6 years ago
Yancey1989 94c80347b6 update by comment
6 years ago
Wu Yi 227e0c4518
fix nccl2 mode startup test=develop (#15132)
6 years ago
Yancey1989 35cda13e9f fix unittest test=develop
6 years ago
Yancey1989 0a885ac12a Merge branch 'develop' of github.com:PaddlePaddle/Paddle into parallel_graph_mode
6 years ago
Yancey1989 ca8c77d966 selecte execution according to strategy test=develop
6 years ago
wopeizl 7ab501264d
Merge pull request #15069 from wopeizl/windows/dsosupport
6 years ago
Yancey1989 4743c9cd5d Merge branch 'develop' of github.com:PaddlePaddle/Paddle into parallel_graph_mode
6 years ago
minqiyang ef7d563db9 Add changes back
6 years ago
minqiyang a318a490ab Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into accelerate_ddpg
6 years ago
Zeng Jinle c0bcff00dc
Merge pull request #14962 from sneaxiy/rewrite_variable_type
6 years ago
chengduo fe8495a758
[WIP] Refine MultiDevSSAGraph (#15040)
6 years ago
Qiyang Min 0238a3bb4f
Merge pull request #14972 from velconia/accelerate_lstm
6 years ago
minqiyang 8ed0233924 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into accelerate_ddpg
6 years ago
Yancey1989 1a4f79a7de fix unittest test=develop
6 years ago
Yancey1989 86bb583881 Merge branch 'develop' of github.com:PaddlePaddle/Paddle into parallel_graph_mode
6 years ago
Yancey1989 845bfd5807 cleanup code
6 years ago
peizhilin 1e7f83e60a add cuda dso support for windows
6 years ago
Yancey1989 41a64f6a2a Merge branch 'develop' of github.com:PaddlePaddle/Paddle into parallel_graph_mode
6 years ago
Wu Yi 856f0da0fe
Fp16 training (#14992)
6 years ago
minqiyang 68b86d6665 Change default value to align with the original react
6 years ago
minqiyang 250e893745 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into accelerate_ddpg
6 years ago
minqiyang 8149a07a41 Fix wait stream two times bug
6 years ago
minqiyang 0a4b6fc056 Remove unnessesary code
6 years ago
minqiyang 53619a79b4 Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into accelerate_lstm
6 years ago
minqiyang 6fabbd8fb8 Polish code and remove spin lock
6 years ago
sneaxiy c1f7e54f62 merge develop
6 years ago
typhoonzero da87f7a698 Revert "[Feature] Fp16 training for resnet50 (#14850)"
6 years ago
chengduo 550e7e410b
Code Clean parallel_executor.py (#14849)
6 years ago
Wu Yi 3d750f9c5a
[Feature] Fp16 training for resnet50 (#14850)
6 years ago
minqiyang 679d1a9e0b Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into accelerate_lstm
6 years ago
sneaxiy ae6f46a1a9 rewrite variable type
6 years ago
dzhwinter 7cd24b1318
add ir memory optimize. (#14530)
6 years ago
Yancey1989 06936a2ff5 fix 1gpu test=develop
6 years ago