qiaolongfei
111bde9725
add warning to dist lookup table optimizer
7 years ago
qiaolongfei
fd73f2bb26
dist lookup table only support sgd while other dense table support all optimizer
7 years ago
minqiyang
a58dd3e557
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into port_python3_syntax
7 years ago
qiaolongfei
f761874b22
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix-dis-trans
7 years ago
minqiyang
d8ddd3b307
Add TODO for memory optimization in python3 and polishing code
7 years ago
minqiyang
000ba1ac5f
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into port_python3_syntax
7 years ago
qiaolongfei
2aa732ba34
fix distribute transpiler to optimize selected rows
7 years ago
Xin Pan
412ad81644
keep seed in dist transpiler
...
better test
7 years ago
minqiyang
4bf3c8c5a1
Use six.moves to migrate zip, map, reduce and pickle in Python2 to Python3
7 years ago
minqiyang
91f0573bc1
Fix the overfix of 2to3 for print function
7 years ago
minqiyang
559d36328c
Apply 2to3 to current paddle main python code
7 years ago
tangwei12
04b1df2ac8
Merge branch 'develop' into dis_ckpt_fix
7 years ago
qiaolongfei
754e96a30c
distribute lookup table work with parallel executor
7 years ago
qiaolongfei
aa3618ed3e
fix _create_prefetch_block in distribute_transpiler
7 years ago
tangwei12
2c05e37a77
hidden slice_vars in distribute transpile, hidden it to users
7 years ago
Wu Yi
9f0d9dffe6
hide variable API ( #12307 )
...
* hide variable API
* edit API.spec
7 years ago
tangwei12
438de1e03b
Merge branch 'Pdv' into dis_ckpt_fix
7 years ago
dzhwinter
abe32a4912
"fix memory optimize bug in lr decay" ( #12299 )
7 years ago
tangwei12
1dd14a704d
bug fix
7 years ago
Wu Yi
db67d60e31
Remove block api ( #12107 )
...
* remove block api
* remove clone_variable
* hide block inner apis
* update
* fix tests
7 years ago
typhoonzero
32d81909dc
fix pserver with condition block
7 years ago
gongweibao
7040c67920
Change blocksize ( #11863 )
7 years ago
seiriosPlus
0f3aa74d11
fix split_var=False
7 years ago
tangwei12
4bd64781ca
fix distribued transpile when slice_var_up=False
7 years ago
qiaolongfei
600f5f0b49
simpilify distribute transpiler
7 years ago
qiaolongfei
5c12c5eb42
update distribute transformer for adam and adamax optimizer
7 years ago
Tao Luo
d3a48484bd
Merge pull request #11983 from luotao1/inference_doc
...
add inference_transpiler doc to develop branch
7 years ago
Luo Tao
da70863080
add inference_transpiler doc to develop branch
7 years ago
minqiyang
4cf76cfdf3
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_reader_op_in_pserver
7 years ago
Wu Yi
adfaf9a665
make transpiler test reliable ( #11848 )
...
* make transpiler test reliable
* add more
* follow comments
7 years ago
minqiyang
5ebf56bf0e
Only the inputs vars of ops in Pserver program will be cloned, other
...
input vars will NOT take into account
7 years ago
pzelazko-intel
9a15c92317
bnorm+relu fuse for mkldnn (inference) ( #11434 )
...
* bnorm+relu fuse for mkldnn
* separate fuse_relu function
* bug fix
* proper while range in inference_transpiler
* description fix
* review fix
* review fix
* unit test for fwd batch norm+relu MKLDNN fuse
7 years ago
Xin Pan
008e0c9bc1
small clean
7 years ago
yi.wu
88cb47bd86
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_paraexe_bcast
7 years ago
yi.wu
8e48c77b54
wip
7 years ago
tangwei12
b6e63554e6
Merge branch 'develop' of github.com:PaddlePaddle/Paddle into ckpt_m2
7 years ago
Yancey1989
86e09b34e3
fix asyn update error on pserver
7 years ago
tangwei12
33ff69b621
file path can not be empty
7 years ago
tangwei12
dc847f129e
bug fix and code optimize
7 years ago
tangwei12
fb7e479188
merger paddle develop
7 years ago
Yancey
0d4b376fc0
Merge pull request #11585 from Yancey1989/fix_pserver_sub_blocks
...
fix pserver sub-blocks
7 years ago
Yancey1989
76e3ec600a
fix cloned op
7 years ago
tangwei12
e684575f66
checkpoint feature optimized
7 years ago
Yancey1989
56a903d3ac
use optimize block list instead of first optimize block
7 years ago
tensor-tang
d5fb8fa778
Revert "Merge pull request #11628 from PaddlePaddle/revert-11102-mozga-intel/Sum_mkldnn_layout"
...
This reverts commit 4d8e8ee226
, reversing
changes made to d6a9f005c8
.
7 years ago
Yancey1989
3a37e14285
Merge branch 'develop' of github.com:PaddlePaddle/Paddle into fix_pserver_sub_blocks
7 years ago
Yancey1989
0970bd9edc
use optimize blocks attr to record optimize block id
7 years ago
tensor-tang
90780e22ce
Revert "MKLDNN layout: Support for sum operator"
7 years ago
tangwei12
e589005229
merge
7 years ago
Yancey1989
e02cbf3538
Merge branch 'develop' of github.com:PaddlePaddle/Paddle into fix_pserver_sub_blocks
7 years ago
Yu Yang
b94f7848c4
Merge pull request #11531 from reyoung/feature/non_layer_api_doc
...
Polish Non-Layer API
7 years ago
tangwei12
c073bb3b2c
code style
7 years ago
yuyang18
760d2305a3
Polish doc style
7 years ago
tangwei12
5a4a24cce1
Merge branch 'develop' into ckpt_m2
7 years ago
Yu Yang
e66a725396
Merge branch 'develop' into transpiler_doc
7 years ago
yuyang18
9942a3048d
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/non_layer_api_doc
7 years ago
Yancey1989
5c7d6a5594
update
7 years ago
Yancey1989
b54d1ba968
fix pserver sub-blocks
7 years ago
mozga-intel
96b4904d2f
MKLDNN layout: Support for sum operator
7 years ago
Qiyang Min
a29cb4be2a
Fix decay bug ( #11520 )
...
* Add sub_blocks of lr_decay_op to pserver_prog after distribute_transpiler
* Remove unused logs and logics
* 1. Add ops to new block (considering the nested block condition)
2. Follow the original hierarchy of blocks
3. Change the function's name and remove debug lines
7 years ago
tangwei12
620698e7e6
bug fux
7 years ago
tangwei12
af0a6a149f
checkpoint notify
7 years ago
tangwei12
ae12281d9b
checkpoint notify
7 years ago
tangwei12
30880844bb
merge develop
7 years ago
yuyang18
ea44157b09
Add APIs
7 years ago
Luo Tao
8c2a834ef3
add doc for inference_transpiler
7 years ago
yi.wu
f63d071c8e
gen rst
7 years ago
yi.wu
6588d2e9a8
complete dist transpiler doc
7 years ago
QI JUN
34ac0eb8e6
enhance memory optimization transpiler to support user defined skip_opt_set ( #11372 )
...
* fix mac build error
* enhance memory optimize transpiler to let users set to some skip opt set of variables
7 years ago
tangwei12
41701969a9
[wip] ckpt m2 develop
7 years ago
qiaolongfei
f031555cfb
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-merge-splited-ids
7 years ago
qiaolongfei
2b9ff39f5f
fix the default value prefetch_var_name_to_block_id
7 years ago
qiaolongfei
6dd3f3cf27
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-merge-splited-ids
7 years ago
qiaolongfei
fe65064827
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into refine-prefetch
7 years ago
gongweibao
627d7a64f8
Clean `sendop` `recv` operator. ( #11309 )
7 years ago
qiaolongfei
0d3d4ae775
refine prefetch logic
7 years ago
qiaolongfei
eccf0d5e19
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add-merge-splited-ids
7 years ago
qiaolongfei
a941786393
replace concat_op with merge_ids_op
7 years ago
qiaolongfei
bf03a2094b
fix distribute_transpiler
7 years ago
yi.wu
9d3114c8c9
fix transpiler error
7 years ago
minqiyang
b33ea7be2d
1. change the variable name from align_var_to_block to slice_var_up
...
2. replace split_method with slice_var_up in func init_splited_variables
7 years ago
minqiyang
e90bfd562b
1. Make a base unittest class for dist transpiler unittest
...
2. Merge the develop repo
7 years ago
Qiyang Min
b31647c67d
Merge branch 'develop' into update_simple_distranspiler
7 years ago
Wu Yi
d90610624f
Cleanup transpiler and move weight decay and clip on pservers ( #11039 )
...
* WIP move weight decay
* weight decay ok
* wip
* clean up transpiler
* add details folder
* update
* fix split var test
* follow comments
7 years ago
minqiyang
8248333ad2
remove simple distranspiler in transpiler/ repo
7 years ago
minqiyang
a2c017da9b
1. merge simple_dist_transpiler to distribute_transpiler
...
2. add align_var_to_block argument to func transpile
3. remove concat and spilt if align_var_to_block is False
4. unittests for simple_dist_transpiler
7 years ago
qiaolongfei
59a25fd2c9
update
7 years ago
qiaolongfei
74701b2692
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix-prefetch
7 years ago
qiaolongfei
21f068ab19
optimize the name of table_grad_list
7 years ago
qiaolongfei
16027ea111
use block.clone_variable instead of _clone_var
7 years ago
Yancey1989
20c24c05aa
singleton rpc_client
7 years ago
qiaolongfei
c797adede7
append table grad to grad_to_block_id
7 years ago
qiaolongfei
9f4b66f684
table gradient should be split and send to each pserver
7 years ago
Yancey1989
ad6c0142c4
clean up codes
7 years ago
Yancey1989
0aa6f9e934
Merge branch 'develop' of github.com:PaddlePaddle/Paddle into overlap_send_op
7 years ago
QI JUN
c509c82546
Fix range in data flow analysis ( #10865 )
...
* fix range in data flow analysis
7 years ago
Yancey1989
fc06222ae9
fix async worker
7 years ago
Yancey1989
540b45350d
use req_count as atomic type
7 years ago
Yancey1989
6debbcd9f9
connect fetch barrier and concat op
7 years ago
Yancey1989
e9abc66910
fix pe
7 years ago
Yancey1989
952fa04009
Merge branch 'develop' of github.com:PaddlePaddle/Paddle into overlap_send_op
7 years ago
dzhwinter
5828101c23
make uint8 support in data_type transform and memory optimize ( #10715 )
...
* "a piece of job."
* "fix typeo"
* "fix ci"
7 years ago
Yancey1989
274df85ca6
Merge branch 'develop' of github.com:PaddlePaddle/Paddle into overlap_send_op
7 years ago
gongweibao
13836b046f
Change default split minimize value to speed up transport data to pserver. ( #10635 )
...
Change default split minimize value to speed up transport data to pserver
7 years ago
Yancey1989
00efc4ccfa
Merge branch 'develop' of github.com:PaddlePaddle/Paddle into overlap_send_op
7 years ago
Yancey1989
315e44acee
add fetch_barrier_op
7 years ago
Yancey
0acc93cab9
add dist transpiler unit test ( #10485 )
...
* add dist transpiler unit test
* update by comment
* update by comment
* fix ci
* fix ci
7 years ago
Yancey1989
b35ea1a4d6
Merge branch 'develop' of github.com:PaddlePaddle/Paddle into overlap_send_op
7 years ago
Yancey1989
6e5635fd1e
update
7 years ago
Yancey1989
b1e5183627
overlap sendop and backward ops
7 years ago
typhoonzero
a2de156dfa
refine serde code
7 years ago
Yancey
76b63c25bf
move transpiler files into transpiler folder ( #10415 )
7 years ago