4673 Commits (976961de6dc4320e97ac931c3f4d49d68266dfca)

Author	SHA1	Message	Date
chentianyu03	976961de6d	fix random failed of complex matmul (#29285)	5 years ago
furnace	7584bb5096	Layer norm fp16 (#29169) ... * add fp16 for layer_norm op * revert layernorm api * fix forward * fix forward * fix backward for layernorm with fp16 * fix unit test for layernorm with fp16 * fix with_mkldnn compile error for layernorm with fp16 * 1. revert to PADDLE_ENFORCE_NOT_NULL, 2. change static_cast<float> to static_cast<U> * fix with_mkldnn compile error for layernorm with fp16 * fix with_mkldnn compile error for layernorm with fp16 Co-authored-by: zhiqiu <chenqiuliang@baidu.com>	5 years ago
Huihuang Zheng	aec05d811c	[Dy2stat] Fix PaddleGan Deoldify Model Dy2stat Problems (#29226) ... This PR fixes several problems in dy2stat for Deoldify model in PaddleGan. In model, software engineer wrote if x.shape == y.shape, the Tenser shape is a tuple in dygraph so the == returns True/False, but in static graph the == becomes element-wise comparison, which is a different behavior. In this PR we reduce the element-wise comparison result. If software engineer write computations which uses parameters in hooks, the static graph can loss the parameter variable because we put param_guard at forward of a Layer. In this PR we made param_guard cover pre-hook and post-hook. In PaddleGan, software engineer calculated some parameter values in __init__ by running some dygraph code. Those code also run during dy2stat. So some variables may be assign as a VarBase (Tensor) first and then Variable, which raised an error. We fixed the bug in this PR by handling the case. TODO: We just added testcase for the 1. shape comparison. Should add test case for 2. and 3. But since we are chasing 2.0RC, I will do it in the near future PR	5 years ago
Leo Chen	116305ea4b	Improve performance of elementwise_add grad op (#29187) ... * pass stop_gradient for cast op * improve performance of elementwise_add grad * use tensor copy async * dygraph branch * fix dygraph branch * add ut	5 years ago
卖鱼的哲学	07c67d5a8b	add deformable_conv op on xpu (#29234) ... * rebase develop * update deformable_conv op on xpu * update deformable_conv op on xpu	5 years ago
Chen Weihang	1de32f823d	Hot fix complle failed in gcc4.8 caused by complex impl (#29254) ... * hot fix complle failed in gcc4.8 * fix failed unittest	5 years ago
ShenLiang	46b73e6cd9	Change the api of DataParallel and Fleet (#29224)	5 years ago
QingshuChen	64f29fbb70	update kunlun conv2d/softmax/elementwise implemetation (#29229) ... * update conv2d & softmax to new xpu api * test=kunlun * remove useless comments * test=kunlun * remote softmax xpu op * test=kunlun * update kunlun softmax * test=kunlun * update xpu unitest * test=kunlun * fix elementwise_grad bug for kunlun *test=kunlun	5 years ago
Jiawei Wang	b11ab12787	Fix doc (adadelta, sgd, momentum) (#29212) ... * fix 3 doc * fix 3 doc * Update adadelta.py	5 years ago
lijianshe02	76312deb30	fix nll_loss test random fail bug test=develop (#29236)	5 years ago
Jiawei Wang	a5d13d593c	Momentum Velocity init in Momentum.__init__() (#29223) ... * add lamb optimizer and unittest * fix momentum resume training * fix momentum acc	5 years ago
wanghuancoder	2b2cd1864a	revert python file coverage, delete coverage run --include, test=develop (#29230)	5 years ago
chentianyu03	8f45d14263	add complex64 and complex128 type; add +-*/@ and slice opreator for c… (#29199) ... * add complex64 and complex128 type; add +-*/@ and slice opreator for complex types * add test cases for complex elementwise, matmul and getitem unittest * add test cases for complex types * add test cases for complex matmul unittest	5 years ago
Zhou Wei	c0a991c874	accumulate gradient for leaf tensor with previous graph and expose leaf tensor concept (#28429) ... * The leaf tensor concept is exposed and the gradient accumulation of leaf tensor * The leaf tensor concept is exposed and the gradient accumulation of leaf tensor * fix coverage * fix api doc * fix CI unittest * fix CI unittest * fix unitest * empty tensor does’t need inner_var_ * fix some error message	5 years ago
Chen Weihang	786e69e9c7	diable test_yolov3 in musl (#29216)	5 years ago
hong19860320	f23665e5d5	Refine the doc and unit test for Sigmoid and stanh (#29198)	5 years ago
123malin	b5c6342336	Update ps gpu (#29209) ... * fix paramete prefetch & device guard Co-authored-by: MrChengmo <cmchengmo@163.com> Co-authored-by: chengmo <chengmo@baidu.com>	5 years ago
liym27	865a45984f	Check whether there is any inplace operation affecting gradient calculation. (#27901) ... * Add a class TensorInplaceVersion to count the inplace version and put it in framework::Tensor instead of Allocation or Variable. * Add a new attribute `_inplace_version` for VarBase. * Raise exception if an inplace operation can result in incorrect gradient computation. * Add a new interface _bump_inplace_version() for VarBase to bump the version whenever the Tensor is modified through an inplace operation. * For api assign, call _bump_inplace_version() when it's an inplace operation inn dynamic mode. * Use original var_wrapper if the inplace_version is not changed. * Replace SnapshotVarWrapperList with SnapshotVarWrapper to optimize performane.	5 years ago
joejiong	dc070ecfb0	Remove cast from paddle.pow api (#29134) ... As the title	5 years ago
WangXi	0c2a51d240	optimizer amp, all use fp16 communication, overlap last comm and compute (#28957)	5 years ago
Chen Weihang	0b032faeee	Polish unittests details and execution conditions to adapt to MUSL (#29044) ... * fix failed tests in yingchun gived list * add unittests into static_mode_white_list * add enable static * fix dist unittest * skip test_sigmoid_focal_loss_op & add gym * revert no need skip unittests * remove gym	5 years ago
Thunderbrook	4adddcc89a	add set_trainer_num api in dataset (#29133)	5 years ago
liym27	e03440812a	fix code: if y is True -> if y (#29184)	5 years ago
WeiXin	1476e1f998	save model after jit.load (#28748) ... * Changed a variable name error * Add comments * Move member functions of TranslatedLayer out of function * edit code according to review * Edit input argument of '_run_static_graph' * reset due to Segmentation fault * rename variables when stitching graph * modify code according CI * Add comments to '__i_m_p_l__' * remove blanks befor 'Get...' * edit code according to review * Add a comment to '_execution_method_creator' * Edit a comment to '_execution_method_creator'	5 years ago
wanghuancoder	0239f79695	Generate code coverage reports only for incremental files (#28508) ... * Generate code coverage reports only for incremental files, test=develop * Generate code coverage reports only for incremental files, test=develop * Generate code coverage reports only for incremental files, test=develop * test for diff python file, test=develop * fix no python diff report, test=develop * add cc test file, test=develop * fix bug in generic.cmake, test=develop * for debug no cc report, test=develp * modify compire branch form test_pr to test, test=develop * fix bug, test=develop * test for h file changed, test=develop * debug for redefinition of argument optimize error, test=develop * close -o3 for test, test=develop * remove -o3 for test, test=develop * remove coverage option for nvcc, test=develop * use CMAKE_CXX_FLAGS open coverage option when header file changed, test=develop * reopen -o3, test=develop * remove debug code, test=develop * remove unused code, test=develop	5 years ago
Huihuang Zheng	27b4218333	[Dy2stat] Disable PaddleInference IR Optimization in test_mnist for CUDA11 (#29105) ... test_mnist failed on CUDA11. We found that it is due to PaddleInference IR Optimization after debugging. We disable it in this PR and we will re-enable it after PaddleInference fixes it.	5 years ago
liym27	01bdea7c31	[Dy2Stat] Don't conver the function from third library logging (#29161)	5 years ago
liym27	a7433cc379	[Dy2Stat] Fix bug: the return statement should be transformed to an equivalent Paddle/Python if statement, which depends on if conditions of the return stmt. (#29165)	5 years ago
Huihuang Zheng	4a0a870177	[dy2stat] Set shape for linspace to Fix dy2stat for GridGenerator Model (#29173) ... GridGenerator model failed because the output shape of `linspace` is (-1). The reason is that C++ InferShape fixes the shape to (-1): 5da3d514eb/paddle/fluid/operators/linspace_op.cc (L49) We cannot set the shape in C++ infer shape because this Tensor may not be initialized during compile time, but when input `num` of `linspace` is an integer, we know the shape at compiler time. This PR simply set the shape in Python and add GridGenerator as unittest.	5 years ago
Aurelius84	cb680c8013	[Dy2Stat]Refine code of test_lac unittest (#29087)	5 years ago
ShenLiang	e2d01eb650	Support dynamic graph distributed (#28997) ... * add reducer * refine envent for memorycopy * add concat&split for allreduce * apply concat & split for fuse tensor * fix nccl dep * fix the untest, compile problem and ddp initialize problem * fix untest for mac & add some comments & solve the repeated param in sublayers * fix untest for windows & fix document	5 years ago
lilong12	7e5e9934fe	update expand as op to use the shape of the target tensor instead of the target tensor itself. (#29020) ... * update, test=develop	5 years ago
Kaipeng Deng	f4c894a693	alias yolo_loss & yolo_box to paddle.vision. (#28520) ... * alias yolo_loss & decode_yolo_box to paddle.vision. test=develop	5 years ago
LutaoChu	28280647eb	add paddle.subtract, optimize paddle.maximum and paddle.minimum ... add paddle.subtract, optimize paddle.maximum and paddle.minimum	5 years ago
Jack Zhou	085260f3de	Add eigen gru and fix the dropout bug in the rnn ... Add eigen gru and fix the dropout bug in the rnn	5 years ago
liym27	5fe44571f0	[Dynamic-to-Static] Support **kwargs as input of the function which is decorated by `jit.save.to_static` (#29098)	5 years ago
YUNSHEN XIE	0fca8cdfdf	fix error with ut timeout and failed (#29148)	5 years ago
Chen Weihang	0d1900d329	add debug msg for test_buffer_shared_memory_reuse_pass (#29151)	5 years ago
Shang Zhizhou	b9e76a0103	detect tensorRT plugin fp16 in runtime (#27933) ... * remove -DSUPPORTS_CUDA_FP16 in cuda.cmake * comile with cuda9 * add some unittest * notest;test=coverage * add unittest for trt plugin swish && split * update ernie unittest * fix some error message * remove repeated judgement of CUDA version in mbEltwiseLayerNormOpConverter * fix comile errror when CUDA_ARCH_NAME < Pascal" * fix comile error * update unittest timeout * compile with cuda9 * update error msg * fix code style * add some comments * add define IF_CUDA_ARCH_SUPPORT_FP16 * rename IF_CUDA_ARCH_SUPPORT_FP16 to CUDA_ARCH_FP16_SUPPORTED	5 years ago
Chen Weihang	c39da29db7	Add symlink force for unittest test_static_save_load (#29137) ... * add symlink force for unittest * open unittest	5 years ago
Chen Weihang	95a0f87b44	support jit.save datra parallel (#29135)	5 years ago
lilong12	449903dead	add paddle.broadcast_to api which is a alias of paddle.expand (#28706) ... * update, test=develop	5 years ago
Leo Chen	770395cb93	Split train_mode and has_grad for tracer (#29064) ... * split train_mode and has_grad * fix format * fix ci problems * fix sample code	5 years ago
YUNSHEN XIE	27d04a3b1f	disable ut test_static_save_load (#29119)	5 years ago
JZ-LIANG	0dadacc4eb	[sharding] doc, api, bug fixed (#28983) ... * add lars to fleet meta optimizer * add lamb to proto * add lamb to fleet meta optimizer * fixed syntax bug * fixed syntax bug * fixed syntax error in lamb, add config setter of lamb in distributed_strategy * trigger unitest to rerun * add new unitest func for lamb * revise unitest for lars and lamb * revise dgc meta unitest * revise lars document in distribute_strategy * revise lars lamb document in distributed_strategy.py * revise lars lamb document in distributed_strategy.py * add weight decay exclude logic to lars * restore optimzier.py * restore optimizer.py as develop except lars * add epsilon and exclude fn to distributed_sttrategy * add lars epsilon * revise unitest for fleet lars and lamb * revise lars lamb unitest for CI coverage * revise lars argument api * revise lars argument api * revise lars argument api * revise api doc of lars * fix op role * add sharding save and add_sync_comm_for_test function * add comm_analyse to utlis * revise sharding_utils * add sharding saving unittest * revise sharding utils for unittest * revise sharding en doc * update sharding utils api * add doc for sharding * fixed bug in sharding var size count * update varsize count in sharding * fix sharding num_nccl_comm * Revert "fix sharding num_nccl_comm" This reverts commit d51587c15e9323acf226ddd36154275f0d1daf76.	5 years ago
Yanghello	dd41775059	fix crypto ut test error for windows ci (#29090)	5 years ago
WangXi	e931c7baf9	Fix multi nccl comm & wait server ready (#28663)	5 years ago
Shibo Tao	db41258501	add API serialize_program, serialize_persistables, save_to_file, deserialize_program, deserialize_persistables, load_from_file. (#29034)	5 years ago
Kaipeng Deng	b052149dcf	remove BatchSampler type check (#29114) ... * remove BatchSampler type check. test=develop	5 years ago
hutuxian	db85f4cf8f	Add dygraph implementation for multiplex op (#29049)	5 years ago