Paddle

Commit Graph

Author	SHA1	Message	Date
guofei	ef0dd3efed	Support loading parameters from checkpoint to save quantized model (#31419 ) * Support loading parameters from checkpoint to save quantized model * Fix the unittest test_moving_average_abs_max_scale_op * Add unittest of save_quantized_model from checkpoint * Add comments to explain the function	4 years ago
hong	99dcd66508	try to fix imperative orc unitest error; test=develop (#31568 )	4 years ago
Qi Li	3d5aa9d10a	[ROCM] fix conv2d and conv3d op, test=develop (#31553 )	4 years ago
Chen Weihang	95cceb2dd7	[CustomOp] Support duplicable op input and output (#31535 ) * support duplicable op inout * add costom concat op test	4 years ago
Aurelius84	def27bc801	[Dy2stat]Fix bug with static_convert_var_shape in locals scope (#31556 ) * Fix bug with static_convert_var_shape * replace dot with dash	4 years ago
LielinJiang	ac493f2c72	Update comments for API `RandomResizedCrop` (#31539 ) * update comments	4 years ago
jiangcheng	9ed6c895f1	optimize range op by place parameters on cpu rather than gpu, test=develop (#30811 )	4 years ago
Thunderbrook	3789a69923	solve bug in heter mode (#31531 ) * heter bug * format * format	4 years ago
chajchaj	6148b87f9d	add softmax_switch for softmax_with_cross_entropy_op, test=develop (#31428 ) * add softmax_switch for softmax_with_cross_entropy_op, test=develop * delete using EigenMatrix in softmax_with_cross_entropy_op.h, test=develop * add REGISTER_OP_VERSION for softmax_switch attr of softmax_with_cross_entropy_op, test=develop	4 years ago
Aurelius84	f3959e9ddc	[save/load] Fix bug with input_spec=dict[InputSpec] in jit.save (#31517 ) * fix bug with jit.save * refine code	4 years ago
WangXi	83a2fb1f08	Add collective async wait op (#31463 )	4 years ago
lilong12	0205e9f84e	remove the send/recv of tensor size (#31460 ) * remove the send/recv of tensor size, but users have to specify the shape of the received var explicitly.	4 years ago
Aurelius84	c8ae837d52	[CustomOp]Fix setup_install timeout (#31484 )	4 years ago
furnace	910f377fa5	Bugfix rocm (#31490 ) * bugfix for test_cholesky_op * bugfix for test_compare_op * bugfix for lookup_table_op * bugfix for affine_channel_op	4 years ago
Zhou Wei	634a12b368	fix bug of windows chineses msvc (#31493 )	4 years ago
wangguanzhong	43d6abf0a5	update conv2d, test=develop (#31480 )	4 years ago
wangguanzhong	50af0c2cbb	fix roi_align, test=develop (#31479 )	4 years ago
Qi Li	b85c8e03be	[ROCM] fix reduce op, test=develop (#31478 )	4 years ago
Jacek Czaja	39a5424ed1	[oneDNN] elementwise add bf16 grad kernel with broadcasting (#31385 )	4 years ago
Qi Li	133a914bd0	[ROCM] fix test_dist_op ci test, test=develop (#31468 )	4 years ago
Aurelius84	fadabbe9b0	[CustomOp] Automatically specify PADDLE_WITH_MKLDNN & Remove Interpreter argument (#31391 ) * auto specify PADDLE_WITH_MKLDNN and remove Interpretper * remove print * fix check abi * fix windows * fix compile flags	4 years ago
liuyuhui	9ebf05b003	[Kunlun]Multi xpu dygraph performance optimization , add distributed.spawn support for multi xpu and some bug-fixes (#31130 )	4 years ago
liym27	522c91ec67	[Dy2Stat] Remove gast.Index for compatibility of gast 0.4.0 (#31358 )	4 years ago
Zhang Ting	7d95e598c1	support float16 for temporal_shift op (#31432 )	4 years ago
Zhang Ting	dcce54ea76	improve performance of depthwise_conv2d (#31099 ) * improve performance of depthwise_conv2d * add unittest	4 years ago
liym27	0fff930667	Fix bug for set_value op when input dtype is not float32 (#31411 )	4 years ago
Huihuang Zheng	c40b98e068	Fix comment (#31424 ) Fix wrong code comment	4 years ago
Huihuang Zheng	6bf02a1261	[Dy2stat] Fix Read-Only Attribute as while_loop Output (#31415 ) Fix Read-Only Attribute as while_loop Output: Usually, our convert_while_loop will be like: ``` [a, b, c] = paddle.jit.dy2static.convert_while_loop( condition_name, body_name, [a, b, c]) ``` where a, b, c are in loop_var_names. However, if loop_var_names contains property such as foo.x, we cannot assign the attribute as output of convert_while_loop because Python property is a kind of read-only attribute. To handle the case, we replace the attributes which are output of convert_while_loop with generated variables, then if we know the attribute is not read-only at runtime, we assign the attribute. The created statements are like: ``` [a, b, __attribute_variable_1] = paddle.jit.dy2static.convert_while_loop( condition_name, body_name, [a, b, foo.x]) if not isinstance(getattr(type(foo), x, None), property): foo.x = __attribute_variable_1 ```	4 years ago
jakpiase	5b4f8aac82	Added LSTM BF16 and fixed GRU BF16 (#31234 )	4 years ago
Qi Li	db50fb6766	[ROCM] fix softmax with loss and update python scripts, test=develop (#31373 )	4 years ago
Pei Yang	32211fe9c4	TRT conv2d converter support SAME padding (#31379 )	4 years ago
Zhou Wei	13e4280f82	[Custom OP]polish doc of custom OP (#31369 )	4 years ago
Qi Li	946dbdae8c	[ROCM] update fluid operators for rocm (part6), test=develop (#31301 )	4 years ago
wangna11BD	1cbccfa594	Add attrs `deformable_groups` for deformable_conv API (#31335 ) * add attrs deformable_groups	4 years ago
Pei Yang	2e9e3fad15	add n-d input support for trt scale converter (#31316 ) * add n-d input support for trt scale converter * add flatten for ut * fix dims	4 years ago
Gradie	d79fdc3d62	lamb_op_xpu;test=kunlun (#31012 ) * lamb_op_xpu;test=kunlun * modify lamb_op_xpu.cc;test=kunlun * delete atol lamb_op_xpu; test=kunlun * update xpu.cmake;test=kunlun * test_error 1e-5,lamb_op_xpu;test=kunlun * error1e-5,lamb_op_xpu,test=kunlun * delete atol lamb_xpu;test=kunlun * modify atol,lamb_op_xpy;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu, XPUOptest;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu,modify xpu_cmake; test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu,modify xpucmake;test=kunlun	4 years ago
danleifeng	d1075df2e8	topo and memory performance for heterps (#30440 ) * topo and memory performance for heterps; test=develop * add trainwithprofiler in heter trainier; test=develop	4 years ago
Bin Lu	a37658daff	Update transforms.py (#31252 ) update RandomHorizontal Flip random description and examples	4 years ago
Zhou Wei	aebf223478	fix test_check_abi (#31288 )	4 years ago
Zhou Wei	cc89120a2c	[Custom OP]add MSVC compile check on Windows (#31265 )	4 years ago
Zhou Wei	af9066e89c	[Custom OP]add PD_THROW and PD_CHECK for User Error message (#31253 ) * [Custom OP]add PD_THROW and PD_CHECK for User error message * PD_THROW and PD_CHECK, fix comment * fix Windows error message * fix Windows error message * fix CI	4 years ago
Jiabin Yang	038ce70d69	[Custom OP] Support stream set on Custom Op (#31257 )	4 years ago
Aurelius84	1dd40870fc	[Dy2Stat] Fix eval_if_exist_else_none bug (#31261 ) * fix eval_if_exist_else_none bug * fix typo * fix typo * fix test_op_num unittest	4 years ago
pangyoki	6fafbdc39e	change np.int to int to fix paddle warning (#31221 )	4 years ago
Jiabin Yang	0c38708a90	[Custom Op] Remove unsupport dtypes (#31232 ) * remove remove_unsupport_dtype * remove remove_unsupport_dtype * remove test dtype * add more include * change dtype.h's enum as enum class to avoid conflict with inference lib * make enum as enum class * remove additional test * merge develop * polish code	4 years ago
WangXi	b8bce682e0	xpu support fuse allreduce (#31104 )	4 years ago
Aurelius84	59b00e8c45	[CustomOP]Support Incremental compilation and Add Version management (#31228 ) * Support Incremental compilation and Add Version management * replace hash with hashlib	4 years ago
Chen Weihang	126633c50f	[CustomOp] Split build op marco & polish details (#31229 ) * split build op marco & polish details * revert register api del * fix other unittest	4 years ago
Aurelius84	e8d24b546a	[CustomOp] Add Modeling with Custom op unittest (#31218 ) * add unittest for static/dygraph/dy2stat * add PE unittet * remove usless code * add unittest in CMakeList.txt	4 years ago
littletomatodonkey	ad50fa710b	add int pad support for Pad1D/2D/3D (#31209 ) * add int pad support for Pad1D/2D/3D * fix type * fix format	4 years ago
jakpiase	2f1165342b	OneDNN hardswish integration (#30211 )	4 years ago
Aurelius84	912022fa0c	[CustomOp]Add cpp_extension en doc (#31187 ) * add cpp_extension en doc * remove cuda_cflags and add optional in doc * refine style * fix indent problem * add default None	4 years ago
Chen Weihang	e8cdb49aa9	[CustomOp] Support attributes as func input in custom op (#31128 ) * add simple attr support and test * add int, float attr support * support other attribute * add custom attrs test in cmake * polish details * fix test failed * add backward test * update test flags	4 years ago
Zhou Wei	ffbf71359a	modify custom op dependent from paddle_framework to paddle_custom_op (#31195 )	4 years ago
lilong12	dc8dfba35b	align the default value of some configuration for fleet to that of single cards (#30740 ) * update, test=develop	4 years ago
lilong12	a373aa7645	fix the bug in expand_v2 op (#30984 ) * update, test=develop	4 years ago
Thunderbrook	c4f279fe8d	support multi node in heterps (#31102 ) * push multi node * multi node * MultiThread * remove log * solve bug in 30829	4 years ago
Aurelius84	406f4a7513	[CustomOp] Support to specific extra_cflags and exctra_cuda_flags independently (#31059 ) * split cxx/nvcc compile flags * enhance input argument check * rename extra_cflags into extrac_cxx_flags * add name checking in setup * fix test_dispatch failed * fix word typo and rm usless import statement * refine import statement * fix unittest failed * fix cuda flags error	4 years ago
qingqing01	572cc8bd0f	Update doc for 2.0 API and some callback (#31180 ) test=document_fix	4 years ago
Pei Yang	00b09e86ac	[Paddle-TRT] support group_norm (#31040 ) * add group norm plugin * fix compile problems * move concat axis check to trt op teller * add nbDims for scale and bias nv dims * add group norm unit test * fix unittest * add trt version restriction for group norm op teller * fix unittest	4 years ago
Chen Weihang	c209751c8d	change test_multiprocess_reader_exception cmake (#31174 )	4 years ago
YUNSHEN XIE	153121457f	fix ut timeout (#31061 )	4 years ago
Chen Weihang	1ce96fa118	[CustomOp] Add new paddle custom op so (#31141 ) * add new custom op so * fix use new method error * fix test failed	4 years ago
tangwei12	ebbdf52557	fix entry (#31079 ) * fix entry * fix distributed lookup table fuse case * fix entry bug at first time * move entry from paddle.fluid -> paddle.distributed * fix ut with paddle.enable_static() Co-authored-by: malin10 <malin10@baidu.com>	4 years ago
Aurelius84	dce2db4857	[CustomOp] Split build directory for each setup.py (#31124 ) * split build directory for each setup.py * fix template string	4 years ago
Zhou Wei	4b220550ef	[Custom OP]Fix problem of custom op unitests on Windows CI (#31114 ) * fix some problem of Windows custom op * fix some problem of Windows custom op * fix some problem of Windows custom op	4 years ago
chentianyu03	70131b475f	add warning message when dtypes of operator are not same (#31136 ) * add error msg when dtypes of operator are not same * add error msg when dtypes of operator are not same * change error msg to warning msg when dtypes of operator are not same * modify test case to fit for python2	4 years ago
Chen Weihang	e60fd1f6a8	[CustomOp] Split test and add inference test (#31078 ) * split test & add inference test * add timeout config * change to setup install * change to jit compile * add verbose for test * fix load setup name repeat * polish details * resolve conflict * fix code format error	4 years ago
xiemoyuan	edacb6293c	Optimization of Transformer API (#30957 ) * Support 'bool' and 'int' for attention mask. * Update docs. * Add unittest for Transformer. * fix bugs.	4 years ago
WeiXin	ee1801c1ad	Save load/save pickle protocol (#31044 ) * add default argument for paddle.save/static.save * edit documentation of * Add comments for special processing for protocol=2 and protocol=3. * Update python/paddle/fluid/io.py Co-authored-by: lanxianghit <47554610+lanxianghit@users.noreply.github.com> Co-authored-by: lanxianghit <47554610+lanxianghit@users.noreply.github.com>	4 years ago
yukavio	99fd9815b6	fix flops api (#31081 ) * remove PrettyTable dependence from paddle.flops * fix bug in python2.7 * fix flops * fix flops * fix bug * fix bug	4 years ago
Zhou Wei	44ee251fde	fix UNIX cmake problem (#31113 )	4 years ago
Thunderbrook	565354f676	support save multi sparse table in one path (#31108 ) * save multi table one path * format	4 years ago
Huihuang Zheng	cf43a321a8	[Dy2stat] Refactoring tensor_shape_transformer.py to Fix Change after Assign Bug (#31082 ) Problem In our old shape transformer logic, if user write: ``` s = tensor.shape ... y = paddle.some_api(s) ``` Dy2stat will change it to ``` ... y = paddle.some_api(convert_var_shape(tensor)) ``` However it will cause fatal bug if user changes the shape of `x` after assign. For example: ``` s = tensor.shape ... tensor = paddle.some_change_shape_api(tensor) ... y = paddle.some_api(s) ``` Then the Dy2stat will get wrong result because the code is translated into: ``` tensor = paddle.some_change_shape_api(tensor) ... y = paddle.some_api(convert_var_shape(tensor)) # tensor shape has been changed, not origin `s` value ``` Solution Logic It can not be solved in the old logic, so I refactoring tensor_shape_transformer logic. Now we will use `s` to store shape attribute and generate a var `s__STATIC_CONVERT_VAR_SHAPE_SUFFIX` to store static shape API `shape(tensor)` ``` s = tensor.shape ... y = paddle.some_api(s) ``` Dy2stat will change it to ``` s = tensor.shape s__STATIC_CONVERT_VAR_SHAPE_SUFFIX = shape(tensor) ... y = paddle.some_api(choose_shape_attr_or_api(s, s__STATIC_CONVERT_VAR_SHAPE_SUFFIX )) ``` In this case, the code is consistent with origin dygraph meaning and it fixed the change after assign bug. Code Key Note To help reviewers, the key change of this PR is changing `self.name_to_var_shape` from "mapping name to shape node" to "mapping name to its STATIC_CONVERT_VAR_SHAPE_SUFFIX name", then if a variable name has the SUFFIX, we can choose to use attribute shape or shape api. Other changes go with the key change. Consideration The issue of this PR is that we store extra static `shape` API result, will it harms the speed of Dy2stat? In some cases it will, but we argue that the benefit would be greater than the cost. 1. The extra calling to static `shape` API will happen when coder assign among shape variables. Take the following dygraph code as an instance: ``` s1 = tensor.shape s2 = s1 s3 = s2 ... ``` Then we called extra static `shape` APIs again and again, however users seldom write code like this. 2. If the shape variable is used a lot, for example: ``` s = tensor.shape y1 = paddle.some_api1(s) y2 = paddle.some_api2(s) y3 = paddle.some_api3(s) ``` Our old logic will create 3 shape APIs but now just 1. This is more common user code pattern. In fact, if reviewers take a look at the current unit test in this PR, you could see the op numbers decrease after this PR. So we argue that this PR can also improve speed in this code pattern.	4 years ago
tangwei12	0e4b154298	fix dist fleet ctr ut (#31087 ) * fix dist fleet ctr ut Change-Id: I59bf5123c7bd47bd0e8f1ca2a26295257597c0f5 * fix dist fleet ctr ut Change-Id: Iafcdd172364be47fe67b753774ce09af050bcbce * Update CMakeLists.txt	4 years ago
Zhou Wei	adaec0073d	[2.0Custom OP]Support New Custom OP on Windows (#31063 ) * [2.0.1]Support New Custom OP on windows * fix CI * fix code style * fix CI * fix CI * fix coverage * fix CI * fix CI	4 years ago
Chen Weihang	2168f08ac8	add optional for param attr args, test=document_fix (#31105 )	4 years ago
Chen Weihang	6beeafe797	[CustomOp] Add more dispatch marco for users (#31058 ) * add more dispatch marco * add more dispatch marco * add more tests * revert unneeded change * add timeout for test dispatch * add float and complex test * remove and marco	4 years ago
TTerror	d5323dab41	add squeeze_op/unsqueeze_op on kunlun;fix conv op and parallel executor;optimize lookup_table op (#31056 ) * add squeeze_op/unsqueeze_op on kunlun; fix conv op and parallel executor on kunlun; optimize lookup_table op on kunlun * update squeeze/unsqueeze op	4 years ago
123malin	16b4260b2f	test=develop, save/load, shrink (#30625 ) * test=develop, save/load, shrink Co-authored-by: seiriosPlus <tangwei12@baidu.com>	4 years ago
Shibo Tao	4424aac608	export paddle.static.normalize_program method. (#31072 ) * export paddle.static.normalize_program method. test=develop * fix ut coverage.test=develop	4 years ago
liym27	5b367dab44	[static setitem] Support the index is Tensor; step>1; step<0 .(#30949 ) * [static setitem] support the index step > 1. tensor_a[::3] = value * [static setitem] support the index step < 0. Eg: tensor_a[::-3] = value * [static setitem] support the index is Tensor. eg: tensor_a[tensor_3:0:-1] = value * Add op version.	4 years ago
Jack Zhou	6df1ca54c8	add detail about states index in rnn result, test=document_fix (#31048 )	4 years ago
Huihuang Zheng	ef627ac5b9	Fix that convert_var_shape doesn't support slice like [0:], test=develop (#31051 ) As the title, when slice_node like 1:3 being passed to idx of convert_var_shape, it will cause syntax error because a function cannot take this as argument. This PR fixed it.	4 years ago
Jacek Czaja	f7465641c3	Added reshape grad bf16 (#31035 ) * - added Reshape grad bf16 * - Added reshape grad bf16 * - cosmetics in py	4 years ago
Aurelius84	4dbe16c48f	[CustomOp] Refine name argument in setup (#31049 ) * refine setup name usage * fix unittest failed	4 years ago
Aurelius84	f2dc29a9fa	[CustomOp] Support output dtypes in generated Python API (#31045 )	4 years ago
ShenLiang	9401173e3a	Remove scale loss before reduce in dygraph (#30807 )	4 years ago
Kaipeng Deng	c4ddc3ab0d	fix dataloader collate return list mix tensor and numpy array (#30904 ) * fix dataloader collate return list mix tensor and numpy array. test=develop	4 years ago
Guanghua Yu	5b267474a9	add offset parameter in roi_align,generate_proposals.etc ops (#30864 ) * add parameter in roi_align op	4 years ago
Chen Weihang	75f81233ae	fix regex error & simplify marco name (#31031 )	4 years ago
Pei Yang	9b54fe4154	add trt transpose and flatten converter (#31022 )	4 years ago
Aurelius84	4c9f96c902	[CustomOp] Support Compile multi ops at same time (#30920 ) * add more unitest for ABI compatibility * add more unittest * refine warning style * support compile multi custom ops in same time * fix not import paddle in unittest * fix typo * add more unittest * add comment for details	4 years ago
joanna.wozna.intel	caf9d39839	Add Conv Transpose BF16 (#30877 ) * Add conv transpose BF16 * Share function GetWeightsTz * Adjust to review and fix op compatibility * Add bias to unique handler name * Remove errors related to paddle enforce * Add conv2d_transpose to bf16 list and kernel refator	4 years ago
Huihuang Zheng	cbbe127483	Refine fake_interface Error Message (#30981 ) Refine fake_interface Error Message	4 years ago
Huihuang Zheng	c137578341	Add Support for Tuple in for Loop (#30998 ) Dy2stat didn't support tuple as iteration variable in the past. This PR added there main cases: 1). Non-enumerate case: for var1, var2 in var\|var.numpy() will be re-written as: for FOR_ITER_TUPLE_PREFIX_x in var \| var.numpy(): var1 = FOR_ITER_TUPLE_PREFIX_x[0] var2 = FOR_ITER_TUPLE_PREFIX_x[1] 2). Enumerate out tuple case: for t in enumerate(var\|var.numpy) will be rewritten as: for FOR_ITER_TUPLE_INDEX_PREFIX_x, FOR_ITER_TUPLE_PREFIX_x in enumerate(var\|var.numpy): t = (FOR_ITER_TUPLE_INDEX_PREFIX_x, FOR_ITER_TUPLE_PREFIX_x) 3). Enumerate inner tuple case: for i, (var1, (var2, va3)) in enumerate(var\|var.numpy()) will be re-written as: for i, FOR_ITER_TUPLE_PREFIX_x in var \| var.numpy(): var1 = FOR_ITER_TUPLE_PREFIX_x[0] var2 = FOR_ITER_TUPLE_PREFIX_x[1][0] var3 = FOR_ITER_TUPLE_PREFIX_x[1][1]	4 years ago
Wojciech Uss	2497f4392f	Handle missing symlink method on Windows (#31006 )	4 years ago
Aurelius84	5653c3a488	[CustomOp] Check Compiler ABI compatibility (#30869 ) * support setup.py to compile custom op * move file into paddle.utils.cpp_extension * support python setup.py install * refine code style * Enrich code and add unittest	4 years ago
huangjun12	20e300e2df	fix lrn bug in reshape size, test=develop (#30968 )	4 years ago
WeiXin	8ab29f4bea	delay timeout of unnittest 'test_static_save_load'. (#30975 )	4 years ago

1 2 3 4 5 ...

12327 Commits (17030ff28b9a54bb57779e9b8448a6d222110ec5)