217 Commits (8002b2beb4a787d7f21a272289f4b1a36953c371)

Author	SHA1	Message	Date
Zhou Wei	8002b2beb4	Avoid logging.info be printed many times in dygraph_mode,test=develop (#23932)	5 years ago
Zhou Wei	66dc8e30f0	move the initialize position of grad_clip to optimizer(__init__),and speed up clip (#23782)	5 years ago
mapingshuo	f0e743f136	fix AMP and recompute (#23551) ... * allow amp and recompute working together	5 years ago
Zhou Wei	629b6c7896	add the prompt message of repeated settings of regularization,test=develop (#23355)	5 years ago
qingqing01	6162cf2f2e	Make optimizer consistent in dygraph and static-graph and remove some LOG-INFO. (#23426) ... * Make optimizer consistent in dygraph and static-graph and remove some LOG-INFO	5 years ago
Zhou Wei	e8efaee92d	update gradient clip english doc for new gradient clipping strategy ... 梯度裁剪的策略进行了升级，配合修复相应的 裁剪API、minimize、ParamAttr 的API英文文档。 对应API变动的文档： #23224 对应中文文档PR：PaddlePaddle/FluidDoc#1942	5 years ago
Leo Chen	a62599a888	[feature] prune program by feed and fetch_list automatically (#22474) ... * prune train program by fetch_list, test=develop * add unittest for prune, test=develop * fix pruned feed, test=develop * support ParallelExecutor and feed prune, test=develop * add comments, test=develop * update unittest, test=develop * update unittests, test=develop * remove debug code, test=develop * support cond in clone, test=develop * support cond in prune, test=develop * support multiple minimize, test=develop * support cache, test=develop * fix _copy_param_info_from, test=develop * support python2 str, test=develop * remove debug code, test=develop * fix bug of caching CompiledProgram, test=develop * fix multi_device issue, test=develop * tmp * support tuple in fetch_list and overriding use_prune, test=develop * dont use nonlocal in python2, test=develop * remove nonlocal, test=develop * code clean, test=develop * code clean, test=develop * feed list, test=develop * test adam, test=develop * follow comments, test=develop * reduce duplicate code, test=develop * update comments, test=develop	5 years ago
Zhou Wei	7fda333ac1	add new method of gradient_clip, better to use,test=develop (#23224)	5 years ago
Leo Chen	488b2387e2	Feature/expand params in auto-generated pybind functions for dygraph operators (#23181) ... * expand parameters, test=develop * support resnet, test=develop * fix resnet, test=develop * support duplicable out, test=develop * support ptb * fix bugs, test=develop * support null input, test=develop * fix bugs, test=develop * fix batchNorm is_test, test=develop * refine code, test=develop * follow comments, test=develop * follow comments, test=develop * follow comments, test=develop * follow comments, test=develop	5 years ago
Zhang Ting	eec10aaba2	set op_device for loss_op_desc (#23027)	5 years ago
WangXi	f2265d9ffd	Fix problem use recompute and dgc same time (#23010)	5 years ago
mapingshuo	08a772cb46	fix API param bug of recompute.backward() (#22582) ... * fix API param bug of recompute.backward(), test=develop	5 years ago
WangXi	62fd3209e1	Fix dgc param regularizer, test=develop (#22888)	5 years ago
Zhang Ting	4e8bc02461	add fluid.device_guard to specify the device type for Op (#22254) ... * add fluid.device_guard to specify the device type for Op	5 years ago
tianshuo78520a	433cef03e5	fix typo word (#22784)	5 years ago
zhaoyuchen2018	72dde4abde	Refine adam op to improve performance, test=develop (#22346) ... * Refine adam op, test=develop * Fuse kernels together to reduce cpu time. * Refine paddle enforce, test=develop * Remove some comments, test=develop * Refine code,test=develop * Refine cuda kernel, test=develop * Refine code according to comments, test=develop	5 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	5 years ago
WangXi	d69df9bf26	Add wrong info when use DGC in cpu (#22515)	5 years ago
Aurelius84	50af6b5d79	polish no_grad_set of gradient and append_backward (#22440) ... * polish backward api doc test=develop, test=document_preview, test=document_fix * polish backward api doc test=develop, test=document_preview, test=document_fix * no_grad supports set of Variable test=develop, test=document_preview * polish sample code of append_backward test=develop, test=document_preview * modify assert into Raise TypeError test=develop,test=document_preview * fix unittest failed test=develop * rm useless file test=develop * polish en doc test=develop * polish code of no_grad_set test=develop * polish code of no_grad_set test=develop	5 years ago
hong	00c0139e6e	add learning rate api of optimizer (#22080) ... * add learning rate api; test=develop * fix uni test converage; test=develop * fix travis ci error; test=develop * fix comment; test=develop * fix example error; test=develop * polish the api description, test=develop Co-authored-by: zhongpu <2013000149@qq.com>	5 years ago
zhongpu	b1c081f4c7	polish Optimizer's API description, test=develop (#22314)	5 years ago
Aurelius84	60a6d68fb9	remove _optimized_guard in dygrahpe_mode (#22143) ... * remove _optimized_guard in dygrahpe_mode test=develop * remove comment code test=develop * remove list append test=develop * remove list append test=develop	5 years ago
Leo Chen	d4bdbf8cf0	Polish nn code, test=develop (#22237) ... * refine code, test=develop * reuse contain_var, test=develop	5 years ago
zhongpu	d0f0a2520c	test Optimizer in dygraph (#21949) ... * test Optimizer in dygraph, test=develop * add optest for Optimizer in dygraph, test=develop * fix adagrad optimizer, test=develop * fix dpsgd optimizer, test=develop * fix test_optimizer.py, test=develop * fix dpsgd optimizer, this op only support cpu, test=develop * add optest for optimizer, test=develop * add description for dpsgd, test=develop * add rmsprop to white_list in unused_var_check.cc, test=develop * polish code style, test=develop * polish code style, test=develop * delete seed attribute for DpsgdOptimizer, test=develop * change testing to debugging, test=develop	6 years ago
zhongpu	7d10edc5ee	add clear_gradients for Optimizer and add clear_gradients api description (#21948) ... * add clear_gradients for Optimizer, add api description, test=develop * fix optest for optimizer's clear_gradient interface, test=develop * add sample code, test=develop * polish sample code, test=develop	6 years ago
Leo Chen	51cb918a05	update layers used in transformer dygraph model, test=develop (#22051) ... * update layers, test=develop * update layers for resnet, test=develop * fix is_test attr, test=develop * update cycle_gan, test=develop * update reinforcement_learning, test=develop * update ocr, test=develop * fix bug, test=develop	6 years ago
Yibing Liu	434f7b9c0f	Fix the global_step & continuous applying error in EMA (#22090) ... * Fix the global_step & continuous applying error in EMA test=develop * Fix for step 0 & add unit test, test=develop	6 years ago
liym27	7d8d45991a	control flow: support optimizer called (#21851) ... * append optimize op in the grad block of current block if current block is in control flow. test=develop * add conditional grad op when optimizer used in control flow. test=develop * add comment and modify typo. test=develop * fix append_backward to support control flow. test=develop * add test. test=develop * fix copy_var_to_parent_block and conditional_block_grad. test=develop * fix bug: revert to append conditional_block_grad vars to sub grad block. test=develop * fix bug: revert to assign var to parent block even if var already is in parent block * fix bug: consider outputs is empty. test=develop * move _rename_grad_ out. test=develop * modify code according to reviews from Huihuang. test=develop * modify code according to reviews from Jinle. test=develop	6 years ago
Chen Weihang	9a2204ee1f	Uniform append_backward & gradients parameter_list type to Variable (#21938) ... * update doc, test=develop * fix related unittests, test=develop * fix str incompatible error, test=develop	6 years ago
Aurelius84	6b4c33ee30	fix decay param in DecayAdagrad test=develop (#22026)	6 years ago
Leo Chen	33f1306753	update layers used in mnist dygraph model, test=develop (#21947) ... * update layers used in mnist dygraph model, test=develop * fix import issue, test=develop * add dygraph utils, test=develop * add unittest, test=develop	6 years ago
zhongpu	dca075839b	remove params in Tracer object (in dygraph) (#20815) ... * remove params in Tracer object, test=develop * Repair failed optest, test=develop * remove build_once & name_scope (Conv2D) test=develop * fix unittest test=develop * Conv2DTranspose * Conv3D & Conv3DTranspose test=develop * Pool2D & BatchNorm * Embedding * LayerNorm * GRUUnit & NCE * PRelu * BilinearTensorProduct * GroupNorm & SpectralNorm * TreeConv test=develop * fix LayerNorm in transformer unnittest test=develop * disable LayerNorm or BatchNorm in multicard test=develop * refine Layer.create_parameter api test=develop * refine LayerNorm, remove begin_norm_axis param, add normed shape check test=develop * LayerNorm bug fix test=develop * fix optest,test=develop * fix optest, test=develop * fix optest for pass parameter_list when constructing an Optimizer class instance, test=develop * polish code for better code style, test=develop * fix se_resnext optest, test=develop * polish code for better code style, test=develop Co-authored-by: songyouwei <youwei0314@gmail.com>	6 years ago
Aurelius84	51a86d2b6b	Optimize adam speed (#21777) ... * optimize adam speed by removing _finish_update test=develop * fix SparseAdamFunctor param list test=develop * Remove scale_op in expect_list of adam_op test=develop * fix test optimizer loss assert error test=develop * fix test optimizer loss assert error test=develop * modify PADDLE_ENFORCE usage test=develop * fix op_type in lamb_op.cc test=develop * fix errors ostream format bug test=develop * add betaPowOut in ngraph op test=develop * fix ngraph::op api for gcc8 test=develop * clean code test=develop * modify struct into class test=develop * remove code of beta1Tensor in lamb_op test=develop	6 years ago
Leo Chen	310edc0d0c	Update layers used in ptb model to use auto-generated op functions in dygraph mode (#21724) ... * update layers, test=develop * fix input numpy, test=develop * fix bugs, test=develop * follow commments, test=develop * update getitem, test=develop	6 years ago
tangwei12	934d99867a	add selected rows supported in framework (#21808) ... * add selected rows supported in framework	6 years ago
hutuxian	c5aec2fe68	Paddlebox Related to Framework (#21586) ... * Add a single_process_multi_thread transpiler. * Add some UTs. * Fix some API description.	6 years ago
Leo Chen	cdd46d7e02	Split VarBase from Python Variable for Dygraph (#21359) ... * test=develop, fix docker with paddle nccl problem * don't expose numerous Tensor.set(), test=develop * fix condition, test=develop * fix float16 bug, test=develop * feed should be Tensor or np.array, not Variable or number, test=develop * use forcecast to copy numpy slice to new array, test=develop * remove float16-uint16 hacking, test=develop * add variable method to varbase and refactor to_variable to support return varbase * support kwargs in varbase constructor * add VarBase constructor to support default python args * refine varbase initial method * reset branch * fix ut for change VarBase error info to PaddleEnforce * cherry is parameter change before * overload isinstance to replace too many change of is_variable * rm useless files * rm useless code merged by git * test=develop, fix some ut failed error * test=develop, fix test_graph_wrapper * add some tests, test=develop * refine __getitem__, test=develop * add tests, test=develop * fix err_msg, test=develop	6 years ago
WangXi	768f9242e9	Fix dgc clip & rampup step, test=develop (#21491)	6 years ago
zhongpu	6ebf0f47b8	support SelectedRows in dygraph, test=develop (#21078) ... * support SelectedRows in dygraph, test=develop * fix bug of _grad_ivar interface, test=develop * add optest for support seletedrows, test=develop * fix bug for gradient_accumulator in GPU mode, test=develop * fix error when Selectedrows addto LodTensor in sorted_gradient mdoe in dygraph, test=develop * refine and simplify gradient accumulator code, test=develop * add optest, test=develop * add optest and simplify code, test=develop * fix bug for test_imperative_selected_rows, test=develop * add optest for Coverage, test=develop * fix gradient interface and simplify code, test=develop * update api for gradient, test=develop * fix ShareDim's bug in DygraphExecutionContext class, test=develop * add optest, test=develop	6 years ago
Aurelius84	4bf115b42d	Fix AdamOptimizer and Scale sample code Bug (#21478) ... * fix adam sample code bug test=document_fix * fix sample code bug in scale test=document_fix	6 years ago
Zeng Jinle	87ab93af01	fix adam fp64, test=develop (#21423)	6 years ago
Kaipeng Deng	ebfb720a63	add Adam beta1/beta2 support Variable (#21234) ... * add Adam beta1/beta2 support Variable. test=develop	6 years ago
WangXi	8ac7687e36	Fix dgc accuracy by mv regularization to local (#21278)	6 years ago
WangXi	de5d3ff688	Fix dgc buffer illegal & reuse velocity (#21012)	6 years ago
WangXi	250e72d254	Fix DGC algorithm flow to make it the same as paper (#20758)	6 years ago
WangXi	507afa8a8a	Fix dgc nan by stripping nccl from sparseReduce. (#20630)	6 years ago
wopeizl	6b612a2807	optimize the english description for APIs test=develop test=document_fix (#20286) ... * optimize the english description for APIs test=develop test=document_fix	6 years ago
Yibing Liu	899ab30df0	Fix several api docs (#20282) ... * Fix several api docs test=develop, test=document_fix	6 years ago
Zeng Jinle	7fb958b2e1	replace data layers, test=develop, test=document_fix (#20368)	6 years ago
hong	fa43e80e19	New save load interface (#20148) ... * add new save load interface; test=develop * add new save interface; test=develop * add save load interface ; * fix save load error; * fix dygraph set dict bug; * add save load unit test; test=develop * fix test_imperative_optimizer bug; test=develop * fix unitest optimizer bug; test=develop * fix code coverage; test=develop * fix converage; test=develop * add document for apis; test=develop * fix unitest error; test=develop * fix save load unit test error; test=develop * fix error message; test=develop * change set_parameter set_optimizer to save_dygraph; test=develop * add load_graph check; test=develop * fix api spec; test=develop	6 years ago