198 Commits (269db0d1d16c0079a0f7039a5717b27e2c139af6)

Author	SHA1	Message	Date
hong	00c0139e6e	add learning rate api of optimizer (#22080) ... * add learning rate api; test=develop * fix uni test converage; test=develop * fix travis ci error; test=develop * fix comment; test=develop * fix example error; test=develop * polish the api description, test=develop Co-authored-by: zhongpu <2013000149@qq.com>	5 years ago
zhongpu	b1c081f4c7	polish Optimizer's API description, test=develop (#22314)	5 years ago
Aurelius84	60a6d68fb9	remove _optimized_guard in dygrahpe_mode (#22143) ... * remove _optimized_guard in dygrahpe_mode test=develop * remove comment code test=develop * remove list append test=develop * remove list append test=develop	5 years ago
Leo Chen	d4bdbf8cf0	Polish nn code, test=develop (#22237) ... * refine code, test=develop * reuse contain_var, test=develop	5 years ago
zhongpu	d0f0a2520c	test Optimizer in dygraph (#21949) ... * test Optimizer in dygraph, test=develop * add optest for Optimizer in dygraph, test=develop * fix adagrad optimizer, test=develop * fix dpsgd optimizer, test=develop * fix test_optimizer.py, test=develop * fix dpsgd optimizer, this op only support cpu, test=develop * add optest for optimizer, test=develop * add description for dpsgd, test=develop * add rmsprop to white_list in unused_var_check.cc, test=develop * polish code style, test=develop * polish code style, test=develop * delete seed attribute for DpsgdOptimizer, test=develop * change testing to debugging, test=develop	5 years ago
zhongpu	7d10edc5ee	add clear_gradients for Optimizer and add clear_gradients api description (#21948) ... * add clear_gradients for Optimizer, add api description, test=develop * fix optest for optimizer's clear_gradient interface, test=develop * add sample code, test=develop * polish sample code, test=develop	5 years ago
Leo Chen	51cb918a05	update layers used in transformer dygraph model, test=develop (#22051) ... * update layers, test=develop * update layers for resnet, test=develop * fix is_test attr, test=develop * update cycle_gan, test=develop * update reinforcement_learning, test=develop * update ocr, test=develop * fix bug, test=develop	5 years ago
Yibing Liu	434f7b9c0f	Fix the global_step & continuous applying error in EMA (#22090) ... * Fix the global_step & continuous applying error in EMA test=develop * Fix for step 0 & add unit test, test=develop	5 years ago
liym27	7d8d45991a	control flow: support optimizer called (#21851) ... * append optimize op in the grad block of current block if current block is in control flow. test=develop * add conditional grad op when optimizer used in control flow. test=develop * add comment and modify typo. test=develop * fix append_backward to support control flow. test=develop * add test. test=develop * fix copy_var_to_parent_block and conditional_block_grad. test=develop * fix bug: revert to append conditional_block_grad vars to sub grad block. test=develop * fix bug: revert to assign var to parent block even if var already is in parent block * fix bug: consider outputs is empty. test=develop * move _rename_grad_ out. test=develop * modify code according to reviews from Huihuang. test=develop * modify code according to reviews from Jinle. test=develop	5 years ago
Chen Weihang	9a2204ee1f	Uniform append_backward & gradients parameter_list type to Variable (#21938) ... * update doc, test=develop * fix related unittests, test=develop * fix str incompatible error, test=develop	5 years ago
Aurelius84	6b4c33ee30	fix decay param in DecayAdagrad test=develop (#22026)	5 years ago
Leo Chen	33f1306753	update layers used in mnist dygraph model, test=develop (#21947) ... * update layers used in mnist dygraph model, test=develop * fix import issue, test=develop * add dygraph utils, test=develop * add unittest, test=develop	5 years ago
zhongpu	dca075839b	remove params in Tracer object (in dygraph) (#20815) ... * remove params in Tracer object, test=develop * Repair failed optest, test=develop * remove build_once & name_scope (Conv2D) test=develop * fix unittest test=develop * Conv2DTranspose * Conv3D & Conv3DTranspose test=develop * Pool2D & BatchNorm * Embedding * LayerNorm * GRUUnit & NCE * PRelu * BilinearTensorProduct * GroupNorm & SpectralNorm * TreeConv test=develop * fix LayerNorm in transformer unnittest test=develop * disable LayerNorm or BatchNorm in multicard test=develop * refine Layer.create_parameter api test=develop * refine LayerNorm, remove begin_norm_axis param, add normed shape check test=develop * LayerNorm bug fix test=develop * fix optest,test=develop * fix optest, test=develop * fix optest for pass parameter_list when constructing an Optimizer class instance, test=develop * polish code for better code style, test=develop * fix se_resnext optest, test=develop * polish code for better code style, test=develop Co-authored-by: songyouwei <youwei0314@gmail.com>	5 years ago
Aurelius84	51a86d2b6b	Optimize adam speed (#21777) ... * optimize adam speed by removing _finish_update test=develop * fix SparseAdamFunctor param list test=develop * Remove scale_op in expect_list of adam_op test=develop * fix test optimizer loss assert error test=develop * fix test optimizer loss assert error test=develop * modify PADDLE_ENFORCE usage test=develop * fix op_type in lamb_op.cc test=develop * fix errors ostream format bug test=develop * add betaPowOut in ngraph op test=develop * fix ngraph::op api for gcc8 test=develop * clean code test=develop * modify struct into class test=develop * remove code of beta1Tensor in lamb_op test=develop	5 years ago
Leo Chen	310edc0d0c	Update layers used in ptb model to use auto-generated op functions in dygraph mode (#21724) ... * update layers, test=develop * fix input numpy, test=develop * fix bugs, test=develop * follow commments, test=develop * update getitem, test=develop	5 years ago
tangwei12	934d99867a	add selected rows supported in framework (#21808) ... * add selected rows supported in framework	5 years ago
hutuxian	c5aec2fe68	Paddlebox Related to Framework (#21586) ... * Add a single_process_multi_thread transpiler. * Add some UTs. * Fix some API description.	5 years ago
Leo Chen	cdd46d7e02	Split VarBase from Python Variable for Dygraph (#21359) ... * test=develop, fix docker with paddle nccl problem * don't expose numerous Tensor.set(), test=develop * fix condition, test=develop * fix float16 bug, test=develop * feed should be Tensor or np.array, not Variable or number, test=develop * use forcecast to copy numpy slice to new array, test=develop * remove float16-uint16 hacking, test=develop * add variable method to varbase and refactor to_variable to support return varbase * support kwargs in varbase constructor * add VarBase constructor to support default python args * refine varbase initial method * reset branch * fix ut for change VarBase error info to PaddleEnforce * cherry is parameter change before * overload isinstance to replace too many change of is_variable * rm useless files * rm useless code merged by git * test=develop, fix some ut failed error * test=develop, fix test_graph_wrapper * add some tests, test=develop * refine __getitem__, test=develop * add tests, test=develop * fix err_msg, test=develop	5 years ago
WangXi	768f9242e9	Fix dgc clip & rampup step, test=develop (#21491)	5 years ago
zhongpu	6ebf0f47b8	support SelectedRows in dygraph, test=develop (#21078) ... * support SelectedRows in dygraph, test=develop * fix bug of _grad_ivar interface, test=develop * add optest for support seletedrows, test=develop * fix bug for gradient_accumulator in GPU mode, test=develop * fix error when Selectedrows addto LodTensor in sorted_gradient mdoe in dygraph, test=develop * refine and simplify gradient accumulator code, test=develop * add optest, test=develop * add optest and simplify code, test=develop * fix bug for test_imperative_selected_rows, test=develop * add optest for Coverage, test=develop * fix gradient interface and simplify code, test=develop * update api for gradient, test=develop * fix ShareDim's bug in DygraphExecutionContext class, test=develop * add optest, test=develop	5 years ago
Aurelius84	4bf115b42d	Fix AdamOptimizer and Scale sample code Bug (#21478) ... * fix adam sample code bug test=document_fix * fix sample code bug in scale test=document_fix	5 years ago
Zeng Jinle	87ab93af01	fix adam fp64, test=develop (#21423)	5 years ago
Kaipeng Deng	ebfb720a63	add Adam beta1/beta2 support Variable (#21234) ... * add Adam beta1/beta2 support Variable. test=develop	5 years ago
WangXi	8ac7687e36	Fix dgc accuracy by mv regularization to local (#21278)	5 years ago
WangXi	de5d3ff688	Fix dgc buffer illegal & reuse velocity (#21012)	5 years ago
WangXi	250e72d254	Fix DGC algorithm flow to make it the same as paper (#20758)	5 years ago
WangXi	507afa8a8a	Fix dgc nan by stripping nccl from sparseReduce. (#20630)	5 years ago
wopeizl	6b612a2807	optimize the english description for APIs test=develop test=document_fix (#20286) ... * optimize the english description for APIs test=develop test=document_fix	5 years ago
Yibing Liu	899ab30df0	Fix several api docs (#20282) ... * Fix several api docs test=develop, test=document_fix	5 years ago
Zeng Jinle	7fb958b2e1	replace data layers, test=develop, test=document_fix (#20368)	5 years ago
hong	fa43e80e19	New save load interface (#20148) ... * add new save load interface; test=develop * add new save interface; test=develop * add save load interface ; * fix save load error; * fix dygraph set dict bug; * add save load unit test; test=develop * fix test_imperative_optimizer bug; test=develop * fix unitest optimizer bug; test=develop * fix code coverage; test=develop * fix converage; test=develop * add document for apis; test=develop * fix unitest error; test=develop * fix save load unit test error; test=develop * fix error message; test=develop * change set_parameter set_optimizer to save_dygraph; test=develop * add load_graph check; test=develop * fix api spec; test=develop	5 years ago
Chen Weihang	98acfe97ec	Polish English APIs' doc of several Optimizers (#20166) ... * polish minimize en doc * polish adam optimizer en doc * polish adamax optimizer en doc * polish adagrad and decayed adagrad optimizer en doc * polish model average en doc, test=develop, test=document_fix, test=document_preview * self review and further polishing doc * update API.spec, test=develop, test=document_fix * update fluid.data api in examples, test=develop, test=document_fix * update fluid.data inferface, test=develop, test=document_fix * replace -1 by none, test=document_fix	5 years ago
Zeng Jinle	02c6edc0d5	refine optimizer name doc, test=develop, test=document_fix (#20074)	5 years ago
Zeng Jinle	20f0878f70	Fix en docs of apis (#20050) ... * fix en docs of apis, test=develop, test=document_fix * follow chunwei's comments, test=develop	5 years ago
WangXi	8d92b36d51	Refine document of DGCMomentumOptimizer (#19960) ... Refine document of DGCMomentumOptimizer	5 years ago
mapingshuo	d62360fe5f	fix doc of apply_optimize (#19965) ... * fix doc of apply_optimize test=document_fix test=document_preview * modify doc of backward test=develop test=document_fix * modify document hash test=develop test=document_preview	5 years ago
Zeng Jinle	4a5ce4feb1	Add AdadeltaOptimizer doc (#19875) ... * add AdadeltaOptimizer doc, test=develop * refine doc,test=develop * folllow lanxiang's comments, test=develop, test=document_fix	5 years ago
jhjiangcs	766bd529d1	add optimizer:dpsgd,test=develop (#19915)	5 years ago
mapingshuo	9901f69677	Forward recompute3 (#19913) ... * add recompute based checkpoints methods for large batch training test=develop * add append_backward_with_forward_recomputation test=develop * refine optimizer test=develop * update backward and optimizer test=develop * make Variable usable test=develop * add recompute code * refine optimizer test=develop * refine addup _append_backward_ops_with_checkpoints_ 1) for recompute part, just cache the grad_op_desc without appending to block 2) before appending grad_op_desc to backward part, addup_repetitive_vars, remove unused branch test=develop * make method private * add recompute strategy into DistributedStrategy test=develop * checkpoint version3 test=develop * remove some print information test=develop * remove unused sumop test=develop * try to fix recompute with graph building modules * add input names to vars should be held * add memory debug tool * backup backward * Fix bugs * add backward desc for op not in any segments * add exception info for sub_block test=develop * modify code style test=develop * modify code style test=develop * remove print functions test=develop * add API spec test=develop test=document_preview * make Recompute a child class of Optimizer test=develop test=document_preview * add API spec test=develop test=document_preview * modify API spec test=develop test=document_preview * add document for Recompute test=develop test=document_preview * change API doc of Rcompute test=develop test=document_preview * code cleaning test=develop test=document_preview * modify API spec * fix bugs when segments hold no element * add testcase for Recompute Optimizer test=develop test=document_preview * add test for apply_gradient, and code cleaning test=develop test=document_preview * add test case for load function * enable CI test=develop test=document * add test case test=develop test=document_preview * add sample code for 4 function of recompute optimizer test=develop test=document_preview	5 years ago
chengduo	ae31faaa87	refine optimier function (#19886) ... test=developt	5 years ago
gongweibao	6c2bc29cc0	Fix float16 optimizer. (#19682) ... Fix float16 optimizer	6 years ago
Jiabin Yang	e9233d1c1e	Refactor dygraph (#19107) ... * refactor dygraph,test=develop * fix failed unittest,test=develop * polish code,test=develop * check windows ci error,test=develop try to fix windows ci error by np.allclose,test=develop * polish vlog and profiler, test=develop * try to fix preceding ops order,test=develop * test transformer in windows ci, test=develop * use python c-api to speed up tracer.trace,test=develop * test=develop, fix docker with paddle nccl problem * test=develop, add ut for debug string and gradient_accumulator * test=develop, add tests for layer/gradient_accumulator/prepared_op * test=develop, fix complie error for test_prepared_op * test=develop, add more ut for dygraph * test=develop, create API.spec for dygraph api change * test=develop, refoctor name to make it easier to understand * test=develop, refoctor name to make it easier to understand * test=develop, fix multi-gpu failed problem , add Tracer tests, change PADDLEENFORCE to PADDLEENFORCE_EQ * test=develop, fix ut failed on parallel se-resnext * test=develop, change one more PADDLE_ENFORCE	6 years ago
chengduo	bfb6ac816e	Fix optimizer bug (#19410) ... * fix optimizer bug test=develop	6 years ago
mapingshuo	d5ac87ec22	Lookahead optimizer (#19386) ... * Add lookahead optimizer * add unittest for lookahead optimizer test=develop * add doc string for LookaheadOptimizer test=develop test=document_preview * add API spec for lookahead test=develop test=document_preview * modify api spec test=develop test=document_preview * modified doc string * modify the test file test=develop test=document_preview * modify doc string test=develop test=document_preview	6 years ago
gongweibao	29d8781240	Polish fleet API to support cuda collective mode and nccl2 mode. (#18966) ... Polish fleet API to support cuda collective mode and nccl2 mode	6 years ago
LielinJiang	e5b9753a18	Fix ExponentialMovingAverage api bug in python3, test=develop (#18775)	6 years ago
xsrobin	47e2ef38e9	add "import paddle.fluid as fluid" to examples lack of it	6 years ago
hutuxian	8a39e5c110	update api format (#18413) ... * update api format test=develop * update API.spec test=develop	6 years ago
Yibing Liu	23941e43ec	Update lamb optimizer (#18333) ... * Update lamb optimizer test=develop, test=document_preview * Regenerate api spec test=develop, test=document_preview	6 years ago
hutuxian	6ed73830c2	add api desc for pipeline training (#18293)	6 years ago