Commit Graph

5026 Commits (develop)

Author SHA1 Message Date
liym27 13ef444fa6
[Dy2Stat] Fix error message when the message has more than one lines. (#30714)
6 years ago
Tao Luo 824a79d383
Revert "Added vanilla LSTM and LSTM with peepholes oneDNN fp32 kernel (#30661)" (#30708)
6 years ago
jakpiase d834f4e6e8
Added vanilla LSTM and LSTM with peepholes oneDNN fp32 kernel (#30661)
6 years ago
Leo Chen 1a13626f5f
polish printing dtype (#30682)
6 years ago
WangXi a28a202603
fix test_gen_nccl_id_op failed (#30686)
6 years ago
chentianyu03 fb7fbc7a5d
fix abs bug and add abs test case (#30637)
6 years ago
ShenLiang 9514b4aa5f
Fix scatter grad bug (#30604)
6 years ago
Qi Li 1f5841c2a0
[ROCM] update cmake and dockerfile, test=develop (#30598)
6 years ago
Zhen Wang 4a9de931a2
Fix the bug in fleet amp_init. (#30606)
6 years ago
TTerror 10271ddfc4
support reduce_max op on kunlun (#30581)
6 years ago
WeiXin ca33821475
延长单测'test_static_save_load'超时 (#30599)
6 years ago
chentianyu03 358106fcb0
make abs op support complex types (#30375)
6 years ago
huangxu96 138620084c
Add fleet amp_init() (#30572)
6 years ago
lilong12 8126a41d73
fix the bug of all_reduce pipeline gradient multiple times (#30437)
6 years ago
Aurelius84 621bc4f771
[Dy2static]Fix paddle prefix in is_paddle_api (#30569)
6 years ago
Aurelius84 5067e3a8d2
[Dy2Static]Enhance check of TracedLayers out vars (#30576)
6 years ago
liym27 ff25c5b36f
Fix bug: GetAttrValue should deal with attr with attrType vector<double> (#30536)
6 years ago
WangXi 572c466d19
[Prepare for MultiProcess xpu] unified gen nccl id, refine imperative reducer (#30455)
6 years ago
ykkk2333 549855ac20
add rmsprop_op_xpu test=kunlun (#30493)
6 years ago
Leo Chen 7043b8cfc6
support layer_norm fp16 in dygraph amp (#30430)
6 years ago
Zhang Ting 66c514ce83
[2.0 API] device guard (#30307)
6 years ago
WangXi 7a0a576e51
fix adamw lr_to_coeff is fixed when dygraph (#30526)
6 years ago
WeiXin c0fb03a0dc
Supplement PR29988(https://github.com/PaddlePaddle/Paddle/pull/29988) (#30507)
6 years ago
hutuxian 40ede12631
Ascend Framework Part1: OP & Wrapper (#30281)
6 years ago
gongweibao bdae7ed326
Fix potential port conflicts. (#30508)
6 years ago
QingshuChen 8489d4f76f
optimize batch_norm & pool op for kunlun (#30490)
6 years ago
taixiurong 5e5c2827a3
fix range op crash in dygraph xpu place (#30469)
6 years ago
WeiXin 18ecd433f5
Avoid bug on 'MAC python3.5/6'. (#30485)
6 years ago
JZ-LIANG 16ba0abc79
Recompute Offload: fixed bug in memcpy (#30484)
6 years ago
lijianshe02 d8a9ba56ef
fix random seed in nll_loss unittest test=develop (#30468)
6 years ago
guofei 11e78ebaa3
Modify the calculation logic of LambOptimizer (#29313)
6 years ago
pangyoki 13d757362c
Add Inplace strategy (Output reuse Input Varbase) in dygraph (#30103)
6 years ago
WeiXin e5bb4edb2c
perfect 'var_list' of static.load/fluid.load (#30457)
6 years ago
123malin 05f06d9ae1
test=develop, fix fleet.metric (#30438)
6 years ago
taixiurong 6a3c8725b0
support transformer v2.0 (#30381)
6 years ago
123malin 2a98e9323a
test=develop, add distributed_infer (#30300)
6 years ago
Chen Weihang ae1f32091a
fix prune input bug (#30384)
6 years ago
Huihuang Zheng cd5f11b822
Decrease Batch Size for Windows CI, test=develop (#30331)
6 years ago
Huihuang Zheng 017a534888
Decrease Mac Input Size Because of CI Short Memory (#30330)
6 years ago
QingshuChen 2c1bba02e4
optimize memcpy perf for kunlun (#30291)
6 years ago
ShenLiang a60f17b89d
Support unused parameters in dynamic graph distributed (#30224)
6 years ago
JZ-LIANG 75936d838f
Recompute Offload (#30233)
6 years ago
lidanqing a238298659
Skip some conv2d_int8 tests in windows (#30128)
6 years ago
Wojciech Uss fc42faffc2
Wojtuss/upgrade one dnn 2.0 (#30295)
6 years ago
YUNSHEN XIE da3ab010e0
disable test_pipeline (#30204)
6 years ago
chajchaj 113810c557
fix bug of celoss when using ignore_index and reduction (#30180)
6 years ago
Double_V 231501fefc
fix elugradgrad test fail & error message opt (#30171)
6 years ago
Zhen Wang fb49ea388e
Fix the accuracy problem of allclose op when using float64 data type in static mode. (#29890)
6 years ago
furnace 77051cc9f0
add fp16 support for tril_triu op (#30186)
6 years ago
liym27 b4989fb744
Support vector<double> as type of op attribute and op set_value suppport vector<double> as value (#30126)
6 years ago
furnace c6296b2b0e
fix empty op unit test fail sometimes (#30225)
6 years ago
AshburnLee 924aac2216
Add tf32 switch for cuDNN (#29192)
6 years ago
chentianyu03 c7371b7b20
type promotion for grad (#30177)
6 years ago
YUNSHEN XIE 42a6442a08
disable ut test_tsm on windows (#30017)
6 years ago
WeiXin edafb5465a
Fix bug for 'save mutiple method' (#30218)
6 years ago
gongweibao 8700a7bd90
Fix unittests bugs. (#30250)
6 years ago
Bai Yifan dd6f591991
fix test_pool3d_op timeout issue (#30248)
6 years ago
Huihuang Zheng c372a76303
Add Static Variable Clone (#30208)
6 years ago
XiaoguangHu 6bfdef727e
clean redundant API alias in 2.0 - part 2 (#30013)
6 years ago
wangchaochaohu af80859dd6
reduce the occupied size of memory for the fused pattern of elementwise_add Op and activation Op(relu Op for example) (#29885)
6 years ago
pangyoki da16b33f2e
add View(reuse allocation) strategy on squeeze, unsqueeze, reshape, flatten op (#29913)
6 years ago
huangxu96 be5c2e6050
fix windows bug (#29993)
6 years ago
Chen Weihang 3016ba852e
remove distributed prepare context (#30219)
6 years ago
Leo Chen 8696335f86
Fix dtype of ungenerated grad var (#28511)
6 years ago
Aurelius84 03e072736e
Skip convert tensor shape while using Paddle.shape (#30223)
6 years ago
liym27 ad55f609d5
[Dy2Stat] Don't convert to paddle.shape if var_x.shape is not negetive (#29965)
6 years ago
Leo Chen 1f97d61c68
Add callback after TensorCopy (#30123)
6 years ago
liym27 b2483d78a8
Fix test_slice: avoid unnecessary copying of TensorArray from subblock to parent block(#30168)
6 years ago
Chengmo 528e03fc08
【Paddle.Fleet】Fix tensor table (#30075)
6 years ago
Chen Weihang d0fb06b27f
[Complex] Simplify prepared op impl to improve performance (#30153)
6 years ago
Chen Weihang e503470700
try multi times for sys.exit (#30188)
6 years ago
WangXi 619c62bb48
fix adamw apply gradient (#30130)
6 years ago
wangchaochaohu 7dd551e08b
refine the paddle place support using str (#28769)
6 years ago
Chen Weihang 8020e34e7c
Simplify the options of spawn based on fleetrun (#30144)
6 years ago
tangwei12 4763e6bc4e
pre padding in dygraph (#30163)
6 years ago
123malin 198fbdfb60
Add Lookahead and ModelAverage Optimizer (#30004)
6 years ago
ceci3 6a19e41f1f
fix syncbn convert (#30158)
6 years ago
Leo Chen adac38c506
add dispenable input for core.ops.reshape2/expand/slice (#30072)
6 years ago
Zhou Wei 30888ca343
Polish and Optimize the print/repr information of Layer (#29998)
6 years ago
WeiXin f3a2392662
Extend the timeout for the (#30151)
6 years ago
Zhou Wei 9c99d37906
fix unittest failed on windows (#29837)
6 years ago
liym27 9922bd4125
Fix bug: In dynamic mode, if start or end is negetive, __getitem__ return wrong result(#30003)
6 years ago
ceci3 334247791a
add attribute for batch_norm (#29950)
6 years ago
Jiaqi Liu 2e8425b693
Fix beam search bug (#29824)
6 years ago
WeiXin f43e1d8c57
Support storage of large parameters (#29988)
6 years ago
chentianyu03 666e665132
change the kron gradient when complex types (#29995)
6 years ago
WangXi ab04997846
[fleet] combine amp and gradient merge, test=develop (#30086)
6 years ago
WangXi ee16006b5d
Optimization grad merge performance (#29784)
6 years ago
lilong12 9e51e3833f
update, test=develop (#30047)
6 years ago
chentianyu03 e012930aa3
complex gradient matmul (#29966)
6 years ago
lilong12 b0bd93de00
Disable gloo by default (#29805)
6 years ago
ShenLiang b6fd262951
fix gather nd for untest (#30037)
6 years ago
lilong12 2bc5121da8
add the paddle.distributed.split api (#29970)
6 years ago
cc c3c064a8fc
Add mkldnn nearest_interp and bilinear_interp op (#30016)
6 years ago
tangwei12 ed856d254e
fix ut (#29989)
6 years ago
Chen Weihang a1d9a14e89
support grad accumulated across batch (#29942)
6 years ago
liuyuhui bb20dcfc1a
[Kunlun] bug fix of PR2: Support MultiDevicePass and BKCL in parallel executor (#29961)
6 years ago
XiaoguangHu 726c78f293
clean redundant API alias in 2.0 - part 1 (#29928)
6 years ago
liym27 14bd77f941
[Windows CI test] Enable unittest test_optimizer_in_control_flow and remove unnecessay code (#29851)
6 years ago
littletomatodonkey 5c162fe66e
fix reg api ut fail (#29921)
6 years ago
Leo Chen a4b9daf97c
fix optimizer dtype (#29917)
6 years ago
liuyuhui 4427df37cf
[Kunlun] PR2: Support MultiDevicePass and BKCL in parallel executor (#29574)
6 years ago
LielinJiang 0b74428db8
Fix Conv2DTanspose bug when padding='same' (#29915)
6 years ago
lilong12 01950ceb42
fix the bug in pipeline data parallelism (#29731)
6 years ago
YUNSHEN XIE 2a01756bf3
remove duplicate ut names (#29809)
6 years ago
Chen Weihang a6072055be
[Complex] Handle complex to real after type promotion (#29855)
6 years ago
Chen Weihang 1a304e6c06
[Complex] Add support for complex grad accumulated (#29889)
6 years ago
guofei 80eb77788f
Skip Windows Multi-GPU test of test_fetch_lod_tensor_array (#29508)
6 years ago
Leo Chen 6b258317cb
fix TransferInplaceBack (#29830)
6 years ago
QingshuChen 59b47f3b32
feat: support check_nan_inf for kunlun/xpu device (#29694)
6 years ago
wawltor 7498df2587
add the cumsum unit test for the develop (#29881)
6 years ago
wanghuancoder 26f9ab70f7
if PR have no .py files, do not use 'python coverage run', to speedup unit test (#29739)
6 years ago
Tao Luo 5d130d5670
Revert "fix conv2d int8 windows UT (#29528)" (#29869)
6 years ago
tangwei12 032414ca2a
[Feature] one ps (3/4) (#29604)
6 years ago
jakpiase edc06c6a1b
Added fc + activation fuse pass (currently only gelu, sigmoid and tanh are supported) (#29772)
6 years ago
Chen Weihang 0e0bb1b97d
replace exit method (#29862)
6 years ago
lidanqing 067d7f1d0d
fix conv2d int8 windows UT (#29528)
6 years ago
liym27 97e75ad0f5
[setitem] Support Tensor setitem in static mode (#29708)
6 years ago
YUNSHEN XIE 24ce051a84
remove duplicate ut reload (#29810)
6 years ago
ceci3 c4eb5d0378
fix unittest timeout (#29820)
6 years ago
chentianyu03 ddfc3d2c2f
change grad elementwise_mul for complex types (#29757)
6 years ago
chentianyu03 2a260d9b0e
change the grad of div when complex types (#29804)
6 years ago
Guo Sheng 356efd36fa
Remove test_rnn_decode_api from disable list. (#29814)
6 years ago
TTerror 82aa01c373
add nearest_interp_v2 on kunlun (#29725)
6 years ago
whs 82630408b4
Support double backward rsqrt (#29589)
6 years ago
xiaoting 55725cd2e1
fix for timeout, test=develop (#29788)
6 years ago
LielinJiang a94c3cbbf3
register cudnn conv double grad for depthwise conv (#29807)
6 years ago
liym27 0cc42e34c6
Migrate 4 APIs about array to paddle.tensor.* (#29565)
6 years ago
liym27 41a7b07159
[Dy2Stat] Fix bug for loop: a variable is used and created in loop, but used before created (#29769)
6 years ago
LielinJiang e5af650b71
Add double grad for conv_transpose (#29706)
6 years ago
Wojciech Uss 6ef8129dcc
upgrade oneDNN with GRU INT8 optimizations (#28420)
6 years ago
Huihuang Zheng dfffee8a5d
[Dy2stat] Enable jit.save to Save Without Running (#29579)
6 years ago
liym27 a0b60716f1
[Dy2Stat] Support grammar: for ele in var[idx] (#29541)
6 years ago
chentianyu03 b59b6d7ae6
Complex op test (#29753)
6 years ago
liym27 096c048b45
Fix unitest test_slice (#29740)
6 years ago
Huihuang Zheng 2e788bd81e
Reduce batch size ot fix CPU memory, test=develop (#29736)
6 years ago
chentianyu03 71063b8137
add conj op for complex types (#29527)
6 years ago
Chen Weihang 6cfa59de1b
[Complex] Add real & imag op and api for complex tensor (#29672)
6 years ago
TTerror af8ded773a
update activation op on kunlun (#29577)
6 years ago
ceci3 cc387159f3
add pad and concat double grad (#29549)
6 years ago
liuyuhui f13c3a9cd7
[Kunlun] PR1:Support one Kunlun card training in parallel executor (#29337)
6 years ago
YUNSHEN XIE d0b789d27f
disable ut test_cumsum_op (#29613)
6 years ago
Jack Zhou 84bae27779
fix wmt14 doc, remove backward, add bidirect direction in rnn api (#29633)
6 years ago
YUNSHEN XIE 2926e74326
New UT should not exceed 15s (#29492)
6 years ago
Chen Weihang f02aece1f0
Add complex dtype op (add) test example (#29603)
6 years ago
AshburnLee efea540ca9
Add tf32 support for A100 tensor core acceleration for cuBLAS (#28732)
6 years ago
lijianshe02 7779768b53
add transpose double grad test=develop (#29600)
6 years ago
ShenLiang 1efef8baed
Fix bug of matmul_v2 for broadcast case (#29599)
6 years ago
qingqing01 8d549fc85d
Add clip double grad (#29590)
6 years ago
Tao Luo 81acc3278c
disable test_parallel_executor_profiler in cuda 10.1 (#29581)
6 years ago
wangchaochaohu ac4bae8ee9
elementwise_add_grad Op optimization (#29575)
6 years ago
WangXi 467c716963
gen nccl id use socket (#29431)
6 years ago
Bai Yifan d72604cd46
fix unittst unstable issue on ci machine (#29588)
6 years ago
QingshuChen 79a41a9ed6
support roi_align & affine_channel for kunlun (#29561)
6 years ago
liym27 0cad1152f4
[Dy2Stat] 1. Fix bug of for-range stmts. 2. Support that step value is negative in for-range stmts (#29519)
6 years ago
Huihuang Zheng 831e9135b9
Fix Windows Unittest (#29543)
6 years ago
GeminiCarrie 08f24a3108
Fix precision problem (#29567)
6 years ago
Chen Weihang c1a26e2a05
fix train eval set error in static mode (#29540)
6 years ago
taixiurong 760d015c14
add xpu ops for training transformer in kunlun (#29539)
6 years ago
Leo Chen 0fdd365665
Add fast path for dropout when p == 0 (#29553)
6 years ago
lijianshe02 bd29052e33
fix random seed in nll_loss unitest test=develop (#29538)
6 years ago
joanna.wozna.intel 0ce6d7fa77
Fix bf16 activations test for softmax and gelu (#29502)
6 years ago
huangxu96 4001979309
Add ReserveSpace in dygraph batch_norm. (#29221)
6 years ago
arlesniak b781953ef5
[oneDNN] Fix flags use test for #29080, assert condition more general (#29493)
6 years ago
Zhen Wang 5ac71b36fb
Remove tensor copy in the update_loss_scaling op. (#29426)
6 years ago
Zhou Wei e74e1a226c
support deepcopy for Layer/Tensor/Paramerbase (#29387)
6 years ago
joejiong 50d3117d30
Add random_split and Subset dataset (#29291)
6 years ago
joejiong 87e75a77c2
Add tangent operator (#29207)
6 years ago
Wei Shengyu dc8bb76c68
remove addcmul (#28937)
6 years ago
Zhong Hui f459dd9634
fix abs double grad unittest (#29478)
6 years ago
ShenLiang 2ef9e0e23c
Rebuild group automatically in dynamic graph distributed (#29255)
6 years ago
procr 3a0558339d
support mobilenet for kunlun (#29458)
6 years ago
ShenLiang 311b3b44fc
Fix the bug where embedding can‘t be processed correctly in reducer (#29485)
6 years ago
Pei Yang 2480bdef6c
change hard_swish from plugin to layer (#29177)
6 years ago
lilong12 b122d0bb76
Fix bug in gloo that gloo initialization hangs (#29447)
6 years ago
taixiurong ecca6585cd
1. fix elementwise ops'bug 2. fix softmax_with_cross_entropy_op 3. add biliner_interp_op (#29448)
6 years ago
LoveAn 03b42d9fa7
fix unittest on windows, test=develop (#29365)
6 years ago
ShenLiang 22e6b9e373
Fix the ut of matmulv2 for broadcast case (#29461)
6 years ago
TTerror a5fcc4b545
update reduce_sum op on xpu (#29367)
6 years ago
Zhang Ting 6296f4ed09
revert cast eigen kernel (#29427)
6 years ago
Leo Chen a040c055a5
fix layer_norm accuracy (#29434)
6 years ago
Shang Zhizhou 225a9c4ed8
Fix unittest (#29412)
6 years ago
Pei Yang f860de4af7
support clip op trt converter (#29411)
6 years ago
Bai Yifan 87bb726258
Add deform_conv2d,DeformConv2D (#29364)
6 years ago
chentianyu03 64e4e17f0c
remove complexvariable (#29390)
6 years ago
chajchaj 79e6086743
change shape of output in cross_entropy, test=develop (#29220)
6 years ago
chentianyu03 879e913b6d
Make transpose, trace, kron, reshape, sum op support complex type (#29321)
6 years ago
liym27 5f84d0b375
Fix bug: delete wrong check_type of paddle.concat and support LoDTensorArray (#29306)
6 years ago
卖鱼的哲学 074065e5de
fix expand/uniform_random && concat/transpose to new api on xpu (#29280)
6 years ago
gongweibao 8989053443
Fix bug of test_fleet_launch_async.sh (#29332)
6 years ago
Huihuang Zheng 8f7627907c
[Dy2stat] Reduce Exception Type for Better Error Message (#29268)
6 years ago
liym27 61a8f2874f
[Dy2Stat] Fix bug: Do not use gast.Subscript to replace gast.Name in when transforming for_enumerate_loop (#29310)
6 years ago
liym27 b10ecd9d3a
[inplace] Add ShareHolderWith for class Variable and SharePlaceholderWith in VarBase.detach() to share the same Tensor/SelectedRows (#29267)
6 years ago
Chen Weihang 9ad800ebb2
Support type promote for basic math ops (quantum required) (#29265)
6 years ago
YUNSHEN XIE 28164b266f
disable test_rnn_decode_api and test_complex_matmul on windows (#29252)
6 years ago
Leo Chen b58cfff89d
use has_grad instead of train_mode (#29309)
6 years ago
Aurelius84 67c700b479
[Dy2Stat] Add cache for Executor and Context in run_program_op (#28421)
6 years ago
ShenLiang d6753e1e6d
fix matmulv2 for windows (#29327)
6 years ago
liym27 b9a8ebd50f
[Dy2stat] Add a decorator paddle.jit.not_to_static to support that not to convert a function in Dynamic-to-Static. (#29253)
6 years ago
ShenLiang c00af94435
fix matmulv2 for windows (#29302)
6 years ago