Paddle

Commit Graph

Author	SHA1	Message	Date
ShenLiang	9401173e3a	Remove scale loss before reduce in dygraph (#30807 )	5 years ago
WangXi	b1026f64af	【kunlun】dygraph supports multi xpu card training (#30671 )	5 years ago
ShenLiang	a60f17b89d	Support unused parameters in dynamic graph distributed (#30224 )	5 years ago
ShenLiang	01e2874a0e	Support multi-stream communication for dynamic graph distributed (#29525 ) * fix fleet for multi-stream * fix memcpy for ncclid * use sync to solve move operation	5 years ago
ShenLiang	2ef9e0e23c	Rebuild group automatically in dynamic graph distributed (#29255 ) * add tensor_indices in AssignGroupBySize * add rebuild group in reducer	5 years ago
ShenLiang	311b3b44fc	Fix the bug where embedding can‘t be processed correctly in reducer (#29485 ) * fix the bug of reducer in embedding * add comment	5 years ago
ShenLiang	4064354a01	support dp run single card (#29358 )	5 years ago
ShenLiang	46b73e6cd9	Change the api of DataParallel and Fleet (#29224 )	5 years ago
ShenLiang	e2d01eb650	Support dynamic graph distributed (#28997 ) * add reducer * refine envent for memorycopy * add concat&split for allreduce * apply concat & split for fuse tensor * fix nccl dep * fix the untest, compile problem and ddp initialize problem * fix untest for mac & add some comments & solve the repeated param in sublayers * fix untest for windows & fix document	5 years ago
gongweibao	1358397e97	Clean up the redundant files and unify the launch interface. (#28928 )	5 years ago
Chen Weihang	bb16c2515d	Polish parallel api impl & doc details (#28980 ) * polish parallel api impl & doc details * add unittest for coverage * remove spawn test in py2.7 * add parallel api into white list	5 years ago
Chen Weihang	ed31dac6eb	remove scale loss and coll grads, test=document_fix (#27874 )	6 years ago
Chen Weihang	dec53a9c79	Remove DataParallel.scale_loss & apply_collective_grads (#27603 ) * remove data parallel scale loss & apply collective_grads * move apply in minimize * fix failed unittests	6 years ago
Chen Weihang	199da9689c	Polish api Program/CompiledProgram/ParallelEnv doc & code example (#27656 ) * polish Program api doc & example * polish CompiledProgram api doc & example * polish ParallelEnv api doc & examples * polish details, test=document_fix * polish program doc details, test=document_fix * polish details, test=document_fix * fix note format error, test=document_fix * add lost example, test=document_fix * fix lost example, test=document_fix	6 years ago
Leo Chen	c7e0a8bebf	Remove inplace argument when calling nn.reshape() (#27376 ) * remove inplace argument * fix sample code * fix sample code	6 years ago
Chen Weihang	bb84f0e646	Add new paddle.save/load APIs (#27331 ) * init commit of new save/load * fix failed unittests * fix save_load_v2 unittest failed * fix failed unittest & polish doc * add tests for coverage * add more tests & move static apis * fix example code error * polish emample code * fix detail example code problem	6 years ago
Chen Weihang	9cb57f94c6	Update set_dict method name & add aliases (#26700 ) * update set_dict method name & add aliases * fix var name error * fix alias formats * use set_state_dict in unittest * add decorator solve compatible problem * polish decorator * replace layer set_state_dict by patched method * remove import monkey path layer * fix import function error * add unittest for coverage	6 years ago
Yang Zhang	6129b0e246	Revert `no_grad` changes and add new implementation (#26826 )	6 years ago
Chen Weihang	28cb653145	Remove backend argument of init_parallel_env (#26773 ) * remove backend argument of init_parallel_env * remove keep name table in transformer * add cpu version check * add skip unittest for init_parallel_env * polish doc: remove func use & update example	6 years ago
Chen Weihang	31f422ae5e	Add interface to launch parallel dygraph by multiprocessing (#26044 ) * add dygraph parallel run interface * polish implement & unified env property name * add print config arg * refactor init_parallel_env function * Compatible with multiprocessing and launch modes * set default trainer start port * support run in python 2 * polish python2 support code * remove python2 support * refine launch import * polish dome design details * refactor api implemention & path * use new method _set_expected_place * add spawn unittest framework & mnist test * add more unittests & doc * fix unittest failed * polish english doc * self review and polish details * refactor code by reviewer's comments * fix unittest failed * fix parallel_env unittest * fix several typos * fix error introduced when fixing typos * add unpublic note for start_processes * polish details by xiaoguang's comment * verify correctly when spawn nprocs=-1 * refactor spawn & init_parallel_env design * polish doc details * open spawn unittests * try to fix doc compile error * try to fix unknown doc format error * add skip unittest when not gpu	6 years ago
Chen Weihang	a7cd61fdd1	fix DataParallel code samples, test=document_fix (#26423 )	6 years ago
Yang Zhang	617eb67f29	Upgrade `no_grad` decorator (#25472 ) * Upgrade `no_grad` decorator test=develop - match torch decorator usage (i.e., with parenthesis) - handle generator functions - add `paddle.no_grad` alias * Switch from `functools` to `decorator` preserves signature * Reword decorator usage note	6 years ago
Chen Weihang	4a702ef361	Support SelelctedRows allreduce in multi-cards imperative mode (#24690 ) * support selectedrows allreduce in multi-cards dygraph, test=develop * remove useless import modules in unittests, test=develop * add nccl cmake to get nccl version, test=develop * add if-condition to compiled correctly, test=develop * add detail version parseing for old nccl, test=develop * polish camke details, test=develop * fix remove test cmake error, test=develop * fix cmake condition, test=develop * change unittest camke list, test=develop * fix unittest cmake rule, test=develop, test=framep0	6 years ago
Cindy Cai	86ca31ab58	English API Docs Optimization Part 1 (#24536 ) * test=develop, test=document_fix * test=develop, test=document_fix Co-authored-by: swtkiwi <1208425345@qq.com>	6 years ago
zhongpu	7ca836d3da	support if logic for Variable in dygraph (#22892 ) * support if logic for Variable in dygraph, test=develop * fix test_learning_rate_scheduler.py, test=develop * fix optest, test=develop * fix error message, test=develop * fix optest,test=develop * fix comment, test=develop	6 years ago
Chen Weihang	3dfaf44adc	Rename dygraph parallel env & add doc (#22925 ) * add dygraph parallel env doc, test=develop * polish details, test=develop, test=document_fix * fix examples error in other apis, test=develop * fix more example error in other api, test=develop * add white list for gpu examples, test=develop, test=document_fix	6 years ago
hong	737334989b	State dict do not count data parallel layers (#22169 ) * DataParallel state dict don't include _layers.; test=develop * add unitest of data parallel; test=develop * add load state test; test=develop	6 years ago
zhongpu	cf475f95df	Remove FC in dygraph, modify FC to Linear in sample code (#22082 ) * modify fc to linear in sample code, test=develop * remove FC, test=develop * remove warnings, test=develop * drop fluid/imperative/README.md , test=develop * change fc to linear, test=develop * polish code style, test=develop	6 years ago
Leo Chen	cdd46d7e02	Split VarBase from Python Variable for Dygraph (#21359 ) * test=develop, fix docker with paddle nccl problem * don't expose numerous Tensor.set(), test=develop * fix condition, test=develop * fix float16 bug, test=develop * feed should be Tensor or np.array, not Variable or number, test=develop * use forcecast to copy numpy slice to new array, test=develop * remove float16-uint16 hacking, test=develop * add variable method to varbase and refactor to_variable to support return varbase * support kwargs in varbase constructor * add VarBase constructor to support default python args * refine varbase initial method * reset branch * fix ut for change VarBase error info to PaddleEnforce * cherry is parameter change before * overload isinstance to replace too many change of is_variable * rm useless files * rm useless code merged by git * test=develop, fix some ut failed error * test=develop, fix test_graph_wrapper * add some tests, test=develop * refine __getitem__, test=develop * add tests, test=develop * fix err_msg, test=develop	6 years ago
Chen Weihang	664f958a02	Fix optimizer op infershape failed in dygraph multi-cards mode (#21374 ) * add param & grad shape check for sgd op * add _reshape_inplece interface for dygraph parallel * refine unittest based paddle/models scripts, test=develop * add unittest for parallel grad fuse, test=develop	6 years ago
Jiabin Yang	e9233d1c1e	Refactor dygraph (#19107 ) * refactor dygraph,test=develop * fix failed unittest,test=develop * polish code,test=develop * check windows ci error,test=develop try to fix windows ci error by np.allclose,test=develop * polish vlog and profiler, test=develop * try to fix preceding ops order,test=develop * test transformer in windows ci, test=develop * use python c-api to speed up tracer.trace,test=develop * test=develop, fix docker with paddle nccl problem * test=develop, add ut for debug string and gradient_accumulator * test=develop, add tests for layer/gradient_accumulator/prepared_op * test=develop, fix complie error for test_prepared_op * test=develop, add more ut for dygraph * test=develop, create API.spec for dygraph api change * test=develop, refoctor name to make it easier to understand * test=develop, refoctor name to make it easier to understand * test=develop, fix multi-gpu failed problem , add Tracer tests, change PADDLEENFORCE to PADDLEENFORCE_EQ * test=develop, fix ut failed on parallel se-resnext * test=develop, change one more PADDLE_ENFORCE	7 years ago
chengduo	5a579df9ba	[Speedup] Make dygraph data parallel faster (#19280 ) * update parallel.py test=develop	7 years ago
chengduo	20859c08e8	[DyGraph] Make multi-card program faster (#18892 ) * update parallel.py test=develop	7 years ago
chengduo	b5f4d5ed0e	Add broadcast operators (#17503 ) * This PR adds broadcast for multi-process. And it could be used in dynamic graph to broadcast parameters.	7 years ago
Yan Xu	0217555530	polish parallel dygraph code (#17164 ) * add var grad hook test=develop	7 years ago
Yan Xu	0b07eef118	ParallelDyGraph with GPU collective mode (#16827 ) implement dygraph.parallel.DataParallel to hook reduce op.	7 years ago
Yan Xu	b4c3a6aa0b	[Imperative] implement imperative NCCLParallelContext (#16477 ) add NCCLParallelContext for parallel dygraph	7 years ago

37 Commits (adaec0073d02c0ea55bcabc4671ebfc8dbd3182c)