10647 Commits (d33d468f02e8033c10be897b1d95f9e29165f75b)

Author	SHA1	Message	Date
Wilber	d68af02c04	fix analysis_config bug. (#29304)	5 years ago
ShenLiang	0fb18bc214	enforce the matmul_v2 error message (#29297)	5 years ago
Zhen Wang	9b59a589b1	Remove some useless log. (#29300)	5 years ago
Leo Chen	13a22a3752	fix shape of tile_grad op (#29289)	5 years ago
Zhen Wang	be3777a50a	Add pure fp16 training with master weights. (#27712) ... * add the weight decay func for the momentum op * Add the multi_precision function in Momentum Optimizer. * Make sure that the initial value of master weights are same with the fp16 weights. * add static loss scaling. * add the rescale_grad function in the pure fp16 training. * use the original momentum updating method. * Polish some codes, such as variable names. * add docstring for apis. * update the var creation details of _create_master_weight. * not modify codes about imperative momentum updating. * Fix the error of test_dist_sparse_tensor_load_momentum UT. * add unit test for multi precision fp16 training. * add more unit tests for CI. * Use lower threshold values for allclose comparing in test_multi_precision_fp16_train UT. * For CI Coverage Checking.	5 years ago
Wojciech Uss	6673fb0565	change import math.h to cmath (#29260)	5 years ago
furnace	7584bb5096	Layer norm fp16 (#29169) ... * add fp16 for layer_norm op * revert layernorm api * fix forward * fix forward * fix backward for layernorm with fp16 * fix unit test for layernorm with fp16 * fix with_mkldnn compile error for layernorm with fp16 * 1. revert to PADDLE_ENFORCE_NOT_NULL, 2. change static_cast<float> to static_cast<U> * fix with_mkldnn compile error for layernorm with fp16 * fix with_mkldnn compile error for layernorm with fp16 Co-authored-by: zhiqiu <chenqiuliang@baidu.com>	5 years ago
Shang Zhizhou	c59b4f28a2	fix cmake error when WITH_GPU=ON and WITH_TENSORRT=ON && WITH_MKL=OFF (#29275)	5 years ago
Leo Chen	116305ea4b	Improve performance of elementwise_add grad op (#29187) ... * pass stop_gradient for cast op * improve performance of elementwise_add grad * use tensor copy async * dygraph branch * fix dygraph branch * add ut	5 years ago
卖鱼的哲学	07c67d5a8b	add deformable_conv op on xpu (#29234) ... * rebase develop * update deformable_conv op on xpu * update deformable_conv op on xpu	5 years ago
Chen Weihang	1de32f823d	Hot fix complle failed in gcc4.8 caused by complex impl (#29254) ... * hot fix complle failed in gcc4.8 * fix failed unittest	5 years ago
GeminiCarrie	642abe2a48	Fix a bug when running on an operating system without "bash." (#29131) ... * Fix a bug when running on an operating system without "bash." * add execution condition * for ci-coverage	5 years ago
ShenLiang	46b73e6cd9	Change the api of DataParallel and Fleet (#29224)	5 years ago
QingshuChen	64f29fbb70	update kunlun conv2d/softmax/elementwise implemetation (#29229) ... * update conv2d & softmax to new xpu api * test=kunlun * remove useless comments * test=kunlun * remote softmax xpu op * test=kunlun * update kunlun softmax * test=kunlun * update xpu unitest * test=kunlun * fix elementwise_grad bug for kunlun *test=kunlun	5 years ago
chentianyu03	8f45d14263	add complex64 and complex128 type; add +-*/@ and slice opreator for c… (#29199) ... * add complex64 and complex128 type; add +-*/@ and slice opreator for complex types * add test cases for complex elementwise, matmul and getitem unittest * add test cases for complex types * add test cases for complex matmul unittest	5 years ago
Zhou Wei	c0a991c874	accumulate gradient for leaf tensor with previous graph and expose leaf tensor concept (#28429) ... * The leaf tensor concept is exposed and the gradient accumulation of leaf tensor * The leaf tensor concept is exposed and the gradient accumulation of leaf tensor * fix coverage * fix api doc * fix CI unittest * fix CI unittest * fix unitest * empty tensor does’t need inner_var_ * fix some error message	5 years ago
Wilber	74c43ac638	fix lite unit test. (#29233)	5 years ago
Adam Osewski	4096ff94dc	Small optimizations for conv2d kernel subroutines. (#29188) ... - Make sure that oneDNN memory descriptors are created only once at first iteration.	5 years ago
joanna.wozna.intel	5c61eeef61	Enable all image classification models (#29155)	5 years ago
Wilber	4fec182d24	[Lite-Subgraph] Fix compile error for lite subgraph. (#29146)	5 years ago
123malin	b5c6342336	Update ps gpu (#29209) ... * fix paramete prefetch & device guard Co-authored-by: MrChengmo <cmchengmo@163.com> Co-authored-by: chengmo <chengmo@baidu.com>	5 years ago
liym27	865a45984f	Check whether there is any inplace operation affecting gradient calculation. (#27901) ... * Add a class TensorInplaceVersion to count the inplace version and put it in framework::Tensor instead of Allocation or Variable. * Add a new attribute `_inplace_version` for VarBase. * Raise exception if an inplace operation can result in incorrect gradient computation. * Add a new interface _bump_inplace_version() for VarBase to bump the version whenever the Tensor is modified through an inplace operation. * For api assign, call _bump_inplace_version() when it's an inplace operation inn dynamic mode. * Use original var_wrapper if the inplace_version is not changed. * Replace SnapshotVarWrapperList with SnapshotVarWrapper to optimize performane.	5 years ago
123malin	03d4665f44	prefetch optimize (#29095) ... * test=develop, optimize async prefetch	5 years ago
WangXi	0c2a51d240	optimizer amp, all use fp16 communication, overlap last comm and compute (#28957)	5 years ago
Chen Weihang	0b032faeee	Polish unittests details and execution conditions to adapt to MUSL (#29044) ... * fix failed tests in yingchun gived list * add unittests into static_mode_white_list * add enable static * fix dist unittest * skip test_sigmoid_focal_loss_op & add gym * revert no need skip unittests * remove gym	5 years ago
Wojciech Uss	4fd4095d1b	Add quantization of multi_gru op and tests (#28615)	5 years ago
Jack Zhou	bc6033f86b	fix gru gcc7.4 bug for the gru compile ... fix gru gcc7.4 bug for the gru compile	5 years ago
wangchaochaohu	b818429ae7	optimize cumsum OP (#29193)	5 years ago
ShenLiang	e2d01eb650	Support dynamic graph distributed (#28997) ... * add reducer * refine envent for memorycopy * add concat&split for allreduce * apply concat & split for fuse tensor * fix nccl dep * fix the untest, compile problem and ddp initialize problem * fix untest for mac & add some comments & solve the repeated param in sublayers * fix untest for windows & fix document	5 years ago
lilong12	7e5e9934fe	update expand as op to use the shape of the target tensor instead of the target tensor itself. (#29020) ... * update, test=develop	5 years ago
Zhou Wei	e668cb07fb	fix CUDA 11 error on windows (#29101)	5 years ago
Jack Zhou	085260f3de	Add eigen gru and fix the dropout bug in the rnn ... Add eigen gru and fix the dropout bug in the rnn	5 years ago
yaoxuefeng	545df287fc	add user_define_dump (#28596)	5 years ago
arlesniak	bc902044a4	Fixes mkldnn dygraph learning rate scheduler crashes (#28988)	5 years ago
Shang Zhizhou	b9e76a0103	detect tensorRT plugin fp16 in runtime (#27933) ... * remove -DSUPPORTS_CUDA_FP16 in cuda.cmake * comile with cuda9 * add some unittest * notest;test=coverage * add unittest for trt plugin swish && split * update ernie unittest * fix some error message * remove repeated judgement of CUDA version in mbEltwiseLayerNormOpConverter * fix comile errror when CUDA_ARCH_NAME < Pascal" * fix comile error * update unittest timeout * compile with cuda9 * update error msg * fix code style * add some comments * add define IF_CUDA_ARCH_SUPPORT_FP16 * rename IF_CUDA_ARCH_SUPPORT_FP16 to CUDA_ARCH_FP16_SUPPORTED	5 years ago
Leo Chen	fd3fcb051a	fix typo of flag name (#29154)	5 years ago
Noel	da71173bc9	Fix ops doc for some ops ... Fix ops doc for some ops	5 years ago
Leo Chen	770395cb93	Split train_mode and has_grad for tracer (#29064) ... * split train_mode and has_grad * fix format * fix ci problems * fix sample code	5 years ago
Aurelius84	7ae3cb554a	Polish CUDA Information stdout (#29109)	5 years ago
WangXi	173c22aec2	optimize fast graph executor (#28962)	5 years ago
Shang Zhizhou	562ded1041	fix unittest trt_dynamic_shape_transformer_prune_test error (#29122)	5 years ago
Shibo Tao	db41258501	add API serialize_program, serialize_persistables, save_to_file, deserialize_program, deserialize_persistables, load_from_file. (#29034)	5 years ago
joanna.wozna.intel	b0d1ac161e	Add bf16 pool2d and unify bf16 unit tests (#29039) ... * Add bf16 pool2d and unify bf16 unit tests * Add change default ops test	5 years ago
joanna.wozna.intel	fddea67445	Fix cpu_bfloat16_pass (#28730) ... * Fix cpu_bfloat16_pass * Add output_format * Fix incorrect SetOutput * Change fromating	5 years ago
Qi Li	2fd16cf6fc	fix win ci failure, test=develop (#29089) ... * fix win ci failure, test=develop * add ci test, test=develop	5 years ago
Chen Weihang	fea0e294ee	Hide the C++ stack by default and add hints (#29042) ... * default not show cpp statck & add hint * fix failed unittest * fix failed unittests	5 years ago
joejiong	582c0a0468	add uint8 for reshape op (#28996) ... add uint8 for reshape operator	5 years ago
Zhou Wei	8ca0a8a859	fix tensor detach to zero copy (#27921) ... * fix tensor detach to zero copy * fix tensor detach to zero copy	5 years ago
taixiurong	a5aa4dc7a9	add xpu elementwise ops (#29031)	5 years ago
joejiong	b04c78ef5e	Update pow (#29000) ... Simple code clean up	5 years ago
wawltor	b2c8a00745	remove eigen threadpool for the speed up ... remove eigen threadpool for the speed up	5 years ago
Wojciech Uss	7b5a8e46de	Add multi_gru_fuse_pass and tests (#28601) ... * Add multi_gru_fuse_pass and tests * fix date * cleaned up headers	5 years ago
lilong12	767d0ba267	update, test=develop (#28700)	5 years ago
Wojciech Uss	991345b368	Add multi_gru_seq_fuse_pass and tests (#28604) ... * Add multi_gru_seq_fuse_pass and tests * fix date * removed unused functions	5 years ago
123malin	fbf9564f6b	【paddle.distributed.fleet】Optimize ParameterServer's Async Mode (#28442) ... * test=develop, optimize global_step	5 years ago
lilong12	f77a78cdee	enable pipeline to run with Executor.run() (#28373) ... * update, test=develop	5 years ago
Thunderbrook	0073f9bdb0	support ps-gpu (#28752) ... * ps gpu transpile * ps gpu * remove op * gps trainer * local ps * add macro * HeterBox * def cuda * tab * code style * style Co-authored-by: Thunderbrook <a754913769#163.com>	5 years ago
Chen Weihang	768dab441e	polish two api doc detail, test=document_fix (#28971)	5 years ago
furnace	8ff3550658	refactor momentum op to combine weight (#27414) ... * refactor momentum op to combine weight_decay (scale op and sum op)	5 years ago
Jacek Czaja	bd1d6d3b30	extends oneDNN caching keys so caching objects are unique to executor/predictor (#28758)	5 years ago
Pei Yang	994673bf4f	change avg pooling and global pooling to trt layer in dynamic shape mode (#28702) ... * change avg pooling and global pooling to trt layer * add support for static shape global pooling * modify trt errmsg	5 years ago
yaoxuefeng	71c1cd1408	fix truncated_gaussian seed (#28777)	5 years ago
HappyAngel	de528981e5	fix paddlepredictor build error. test=develop (#28792)	5 years ago
Wilber	a22ea652cf	fix trt delete_pass bug. (#28763)	5 years ago
gongweibao	1dad8ceaab	Fix gpu memory allocation bug. (#28703)	5 years ago
Chen Weihang	b969c32ab1	fix occupied 0 device memory bug (#28771)	5 years ago
joejiong	1a532d5133	add uint8 support for squeeze operator (#28734) ... Adding uint8 support for squeeze operator.	5 years ago
wangchaochaohu	8b853b3030	fix the number of perf algo for conv cudnn in exhaustive mode (#28694)	5 years ago
joanna.wozna.intel	8c0ea4bffe	Add bf16 matmul, fc, elementwise add and mul (#28729) ... * Add bf16 matmul, fc, elementwise add and mul * Correct unit test	5 years ago
Wojciech Uss	efc3b182f0	a fix for the fc_lstm_fuse_pass (#28709)	5 years ago
Zhou Wei	3b0dd5f620	fix bug that to_tensor not support paddle.Place (#28717)	5 years ago
yaoxuefeng	08b62f4902	fix shuffle batch op shuffle (#28533)	5 years ago
taixiurong	d3d1a6b6e0	add kunlun kernel: slice, slice_grad, top_k, cast. *test=kunlun (#28542) ... * 1.add xpu slice op 2. add xpu top_k op 3.modify xpu cast to new api * 1.add xpu slice op 2. add xpu top_k op 3.modify xpu cast to new api	5 years ago
Jack Zhou	9362d85e0e	Add LSTM, Simple RNN and GRU CPU kernel (#28577) ... * add lstm, simple rnn op kernel * fix the test_lstm for the rnn op * change func name * fix forward postprocess bug * add gru forward, backward code * remove unittest.skipIf; use a big rnn op instead of combination op * fix input doesn't have gradient bug * add eigen lstm forward, backward Co-authored-by: wawltor <fangzeyang0904@hotmail.com>	5 years ago
QingshuChen	30ef3815b3	adjust kunlun header file (#28536) ... * adjust kunlun header file *test=kunlun * update kunlun unittest *test=kunlun * update xpu unitest * test = kunlun * update xpu unittest * test=kunlun * update xpu unitest * test=kunlun	5 years ago
Zhang Ting	dab4920568	improve performance of cast op (#28727)	5 years ago
yaoxuefeng	03f46e3526	fix truncated_gaussian op cuda seed setting (#28678)	5 years ago
Wilber	04cefeacc5	Disable windows gpu static lib. (#28741)	5 years ago
Wojciech Uss	04bcc13fac	Add multi_gru op and tests (#28591) ... * Add multi_gru op and tests * removed redundant disable_dygraph()	5 years ago
wanghuancoder	5aec7dbeb0	use forward declarations for framework.pb.h (#28494) ... * use forward declarations for framework.pb.h, test=develop * use forward declarations for framework.pb.h, test=develop	5 years ago
joejiong	32b90b1c2d	add log10 (#28576) ... Add new operator log10	5 years ago
Leo Chen	3d09929b1f	Add check for non-dispensable input (#28666) ... * Add check for non-dispensable input * fix typo	5 years ago
Chen Weihang	7eeb99fe02	Add basic hook classes for dygraph & implement reduce hook (#28584) ... * add base hook classes and reduce hook impl * fix constructor typo * polish comment format * refactor baisc hook class design * polish design details	5 years ago
Guo Sheng	858ffa0c8b	Fix the dropout setting when not initialized in rnn_op. (#28561) ... test=develop	5 years ago
Jacek Czaja	6d8d3d4c22	[oneDNN] Layer norm bf16 kernel (#28619)	5 years ago
lilong12	80d2024644	bug fix, test=develop (#28674)	5 years ago
Zhou Wei	bf143652ac	fix lstm OP compile error on windows (#28667) ... * add unittest and check unittest for windows * fix lstm OP compile error on windows	5 years ago
石晓伟	57dab959ca	add datanorm op new scale_w register (#28657) ... Co-authored-by: yaoxuefeng6 <yaoxuefeng@baidu.com>	5 years ago
cc	65aac81191	Fix fake_quant error when cout > 1024, test=develop (#28603)	5 years ago
lilong12	b2f7ab6636	bug fix, test=develop (#28648)	5 years ago
wawltor	8f2656ef5c	fix the gradient bug for the topk v2 ... fix the gradient bug for the topk v2	5 years ago
wangchaochaohu	a972c33fd7	refine gather OP performance for dynamic mode (#28587)	5 years ago
joanna.wozna.intel	2cb71c0cde	Add checkpoint to quantize (#28612) ... * Add checkpoint to quantize * Change bfloat16 option	5 years ago
lidanqing	804271cff9	Op version python mkldnn_inplace test (#28354) ... * add mkldnn inplace op version test * update mkldnn_inplace fuse pass * update the inplace test	5 years ago
pangyoki	b889a0cee2	add gaussian_random op_version (#28602)	5 years ago
Guo Sheng	110febdc54	Fix gradients with ignore_idx in softmax_with_cross_entropy (#28622) ... * Fix gradients with ignore_idx in softmax_with_cross_entropy. test=develop * Fix gradients with ignore_idx in softmax_with_cross_entropy on cpu. Remove softmax_with_cross_entropy from op_threshold_white_list. test=develop * Fix test_softmax_cross_entropy_op.py. test=develop	5 years ago
Wilber	8b97bb2e1f	Update cmake for arm ft and fix a bug for Predictor dtor. (#28586)	5 years ago
Leo Chen	f962bd3432	Fix cudnn workspace limit in cudnn-8 (#28611)	5 years ago
Leo Chen	90805e2df7	Register op_version for new attribute use_addto (#28463) ... * register op_version for addto * upgrade pass capability * change eq to le * change eq to le * fix merge	5 years ago
danleifeng	a24d186814	fix nccl init failed in parallel dygraph mode (#28497)	5 years ago