12497 Commits (test_model_benchmark_ci)

Author	SHA1	Message	Date
Pei Yang	2e9e3fad15	add n-d input support for trt scale converter (#31316) ... * add n-d input support for trt scale converter * add flatten for ut * fix dims	5 years ago
Gradie	d79fdc3d62	lamb_op_xpu;test=kunlun (#31012) ... * lamb_op_xpu;test=kunlun * modify lamb_op_xpu.cc;test=kunlun * delete atol lamb_op_xpu; test=kunlun * update xpu.cmake;test=kunlun * test_error 1e-5,lamb_op_xpu;test=kunlun * error1e-5,lamb_op_xpu,test=kunlun * delete atol lamb_xpu;test=kunlun * modify atol,lamb_op_xpy;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu, XPUOptest;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu,modify xpu_cmake; test=kunlun * lamb_op_xpu;test=kunlun * lamb_op_xpu,modify xpucmake;test=kunlun	5 years ago
danleifeng	d1075df2e8	topo and memory performance for heterps (#30440) ... * topo and memory performance for heterps; test=develop * add trainwithprofiler in heter trainier; test=develop	5 years ago
Bin Lu	a37658daff	Update transforms.py (#31252) ... update RandomHorizontal Flip random description and examples	5 years ago
Zhou Wei	aebf223478	fix test_check_abi (#31288)	5 years ago
Zhou Wei	cc89120a2c	[Custom OP]add MSVC compile check on Windows (#31265)	5 years ago
Zhou Wei	af9066e89c	[Custom OP]add PD_THROW and PD_CHECK for User Error message (#31253) ... * [Custom OP]add PD_THROW and PD_CHECK for User error message * PD_THROW and PD_CHECK, fix comment * fix Windows error message * fix Windows error message * fix CI	5 years ago
Jiabin Yang	038ce70d69	[Custom OP] Support stream set on Custom Op (#31257)	5 years ago
Aurelius84	1dd40870fc	[Dy2Stat] Fix eval_if_exist_else_none bug (#31261) ... * fix eval_if_exist_else_none bug * fix typo * fix typo * fix test_op_num unittest	5 years ago
pangyoki	6fafbdc39e	change np.int to int to fix paddle warning (#31221)	5 years ago
Jiabin Yang	0c38708a90	[Custom Op] Remove unsupport dtypes (#31232) ... * remove remove_unsupport_dtype * remove remove_unsupport_dtype * remove test dtype * add more include * change dtype.h's enum as enum class to avoid conflict with inference lib * make enum as enum class * remove additional test * merge develop * polish code	5 years ago
WangXi	b8bce682e0	xpu support fuse allreduce (#31104)	5 years ago
Aurelius84	59b00e8c45	[CustomOP]Support Incremental compilation and Add Version management (#31228) ... * Support Incremental compilation and Add Version management * replace hash with hashlib	5 years ago
Chen Weihang	126633c50f	[CustomOp] Split build op marco & polish details (#31229) ... * split build op marco & polish details * revert register api del * fix other unittest	5 years ago
Aurelius84	e8d24b546a	[CustomOp] Add Modeling with Custom op unittest (#31218) ... * add unittest for static/dygraph/dy2stat * add PE unittet * remove usless code * add unittest in CMakeList.txt	5 years ago
littletomatodonkey	ad50fa710b	add int pad support for Pad1D/2D/3D (#31209) ... * add int pad support for Pad1D/2D/3D * fix type * fix format	5 years ago
jakpiase	2f1165342b	OneDNN hardswish integration (#30211)	5 years ago
Aurelius84	912022fa0c	[CustomOp]Add cpp_extension en doc (#31187) ... * add cpp_extension en doc * remove cuda_cflags and add optional in doc * refine style * fix indent problem * add default None	5 years ago
Chen Weihang	e8cdb49aa9	[CustomOp] Support attributes as func input in custom op (#31128) ... * add simple attr support and test * add int, float attr support * support other attribute * add custom attrs test in cmake * polish details * fix test failed * add backward test * update test flags	5 years ago
Zhou Wei	ffbf71359a	modify custom op dependent from paddle_framework to paddle_custom_op (#31195)	5 years ago
lilong12	dc8dfba35b	align the default value of some configuration for fleet to that of single cards (#30740) ... * update, test=develop	5 years ago
lilong12	a373aa7645	fix the bug in expand_v2 op (#30984) ... * update, test=develop	5 years ago
Thunderbrook	c4f279fe8d	support multi node in heterps (#31102) ... * push multi node * multi node * MultiThread * remove log * solve bug in 30829	5 years ago
Aurelius84	406f4a7513	[CustomOp] Support to specific extra_cflags and exctra_cuda_flags independently (#31059) ... * split cxx/nvcc compile flags * enhance input argument check * rename extra_cflags into extrac_cxx_flags * add name checking in setup * fix test_dispatch failed * fix word typo and rm usless import statement * refine import statement * fix unittest failed * fix cuda flags error	5 years ago
qingqing01	572cc8bd0f	Update doc for 2.0 API and some callback (#31180) ... test=document_fix	5 years ago
Pei Yang	00b09e86ac	[Paddle-TRT] support group_norm (#31040) ... * add group norm plugin * fix compile problems * move concat axis check to trt op teller * add nbDims for scale and bias nv dims * add group norm unit test * fix unittest * add trt version restriction for group norm op teller * fix unittest	5 years ago
Chen Weihang	c209751c8d	change test_multiprocess_reader_exception cmake (#31174)	5 years ago
YUNSHEN XIE	153121457f	fix ut timeout (#31061)	5 years ago
Chen Weihang	1ce96fa118	[CustomOp] Add new paddle custom op so (#31141) ... * add new custom op so * fix use new method error * fix test failed	5 years ago
tangwei12	ebbdf52557	fix entry (#31079) ... * fix entry * fix distributed lookup table fuse case * fix entry bug at first time * move entry from paddle.fluid -> paddle.distributed * fix ut with paddle.enable_static() Co-authored-by: malin10 <malin10@baidu.com>	5 years ago
Aurelius84	dce2db4857	[CustomOp] Split build directory for each setup.py (#31124) ... * split build directory for each setup.py * fix template string	5 years ago
Zhou Wei	4b220550ef	[Custom OP]Fix problem of custom op unitests on Windows CI (#31114) ... * fix some problem of Windows custom op * fix some problem of Windows custom op * fix some problem of Windows custom op	5 years ago
chentianyu03	70131b475f	add warning message when dtypes of operator are not same (#31136) ... * add error msg when dtypes of operator are not same * add error msg when dtypes of operator are not same * change error msg to warning msg when dtypes of operator are not same * modify test case to fit for python2	5 years ago
Chen Weihang	e60fd1f6a8	[CustomOp] Split test and add inference test (#31078) ... * split test & add inference test * add timeout config * change to setup install * change to jit compile * add verbose for test * fix load setup name repeat * polish details * resolve conflict * fix code format error	5 years ago
xiemoyuan	edacb6293c	Optimization of Transformer API (#30957) ... * Support 'bool' and 'int' for attention mask. * Update docs. * Add unittest for Transformer. * fix bugs.	5 years ago
WeiXin	ee1801c1ad	Save load/save pickle protocol (#31044) ... * add default argument for paddle.save/static.save * edit documentation of * Add comments for special processing for protocol=2 and protocol=3. * Update python/paddle/fluid/io.py Co-authored-by: lanxianghit <47554610+lanxianghit@users.noreply.github.com> Co-authored-by: lanxianghit <47554610+lanxianghit@users.noreply.github.com>	5 years ago
yukavio	99fd9815b6	fix flops api (#31081) ... * remove PrettyTable dependence from paddle.flops * fix bug in python2.7 * fix flops * fix flops * fix bug * fix bug	5 years ago
Zhou Wei	44ee251fde	fix UNIX cmake problem (#31113)	5 years ago
Thunderbrook	565354f676	support save multi sparse table in one path (#31108) ... * save multi table one path * format	5 years ago
Huihuang Zheng	cf43a321a8	[Dy2stat] Refactoring tensor_shape_transformer.py to Fix Change after Assign Bug (#31082) ... **Problem** In our old shape transformer logic, if user write: ``` s = tensor.shape ... y = paddle.some_api(s) ``` Dy2stat will change it to ``` ... y = paddle.some_api(convert_var_shape(tensor)) ``` However it will cause fatal bug if user changes the shape of `x` after assign. For example: ``` s = tensor.shape ... tensor = paddle.some_change_shape_api(tensor) ... y = paddle.some_api(s) ``` Then the Dy2stat will get wrong result because the code is translated into: ``` tensor = paddle.some_change_shape_api(tensor) ... y = paddle.some_api(convert_var_shape(tensor)) # tensor shape has been changed, not origin `s` value ``` **Solution Logic** It can not be solved in the old logic, so I refactoring tensor_shape_transformer logic. Now we will use `s` to store shape attribute and generate a var `s__STATIC_CONVERT_VAR_SHAPE_SUFFIX` to store static shape API `shape(tensor)` ``` s = tensor.shape ... y = paddle.some_api(s) ``` Dy2stat will change it to ``` s = tensor.shape s__STATIC_CONVERT_VAR_SHAPE_SUFFIX = shape(tensor) ... y = paddle.some_api(choose_shape_attr_or_api(s, s__STATIC_CONVERT_VAR_SHAPE_SUFFIX )) ``` In this case, the code is consistent with origin dygraph meaning and it fixed the change after assign bug. **Code Key Note** To help reviewers, the key change of this PR is changing `self.name_to_var_shape` from "mapping name to shape node" to "mapping name to its STATIC_CONVERT_VAR_SHAPE_SUFFIX name", then if a variable name has the SUFFIX, we can choose to use attribute shape or shape api. Other changes go with the key change. **Consideration** The issue of this PR is that we store extra static `shape` API result, will it harms the speed of Dy2stat? In some cases it will, but we argue that the benefit would be greater than the cost. 1. The extra calling to static `shape` API will happen when coder assign among shape variables. Take the following dygraph code as an instance: ``` s1 = tensor.shape s2 = s1 s3 = s2 ... ``` Then we called extra static `shape` APIs again and again, however users seldom write code like this. 2. If the shape variable is used a lot, for example: ``` s = tensor.shape y1 = paddle.some_api1(s) y2 = paddle.some_api2(s) y3 = paddle.some_api3(s) ``` Our old logic will create 3 shape APIs but now just 1. This is more common user code pattern. In fact, if reviewers take a look at the current unit test in this PR, you could see the op numbers decrease after this PR. So we argue that this PR can also improve speed in this code pattern.	5 years ago
tangwei12	0e4b154298	fix dist fleet ctr ut (#31087) ... * fix dist fleet ctr ut Change-Id: I59bf5123c7bd47bd0e8f1ca2a26295257597c0f5 * fix dist fleet ctr ut Change-Id: Iafcdd172364be47fe67b753774ce09af050bcbce * Update CMakeLists.txt	5 years ago
Zhou Wei	adaec0073d	[2.0Custom OP]Support New Custom OP on Windows (#31063) ... * [2.0.1]Support New Custom OP on windows * fix CI * fix code style * fix CI * fix CI * fix coverage * fix CI * fix CI	5 years ago
Chen Weihang	2168f08ac8	add optional for param attr args, test=document_fix (#31105)	5 years ago
Chen Weihang	6beeafe797	[CustomOp] Add more dispatch marco for users (#31058) ... * add more dispatch marco * add more dispatch marco * add more tests * revert unneeded change * add timeout for test dispatch * add float and complex test * remove and marco	5 years ago
TTerror	d5323dab41	add squeeze_op/unsqueeze_op on kunlun;fix conv op and parallel executor;optimize lookup_table op (#31056) ... * add squeeze_op/unsqueeze_op on kunlun; fix conv op and parallel executor on kunlun; optimize lookup_table op on kunlun * update squeeze/unsqueeze op	5 years ago
123malin	16b4260b2f	test=develop, save/load, shrink (#30625) ... * test=develop, save/load, shrink Co-authored-by: seiriosPlus <tangwei12@baidu.com>	5 years ago
Shibo Tao	4424aac608	export paddle.static.normalize_program method. (#31072) ... * export paddle.static.normalize_program method. test=develop * fix ut coverage.test=develop	5 years ago
liym27	5b367dab44	[static setitem] Support the index is Tensor; step>1; step<0 .(#30949) ... * [static setitem] support the index step > 1. tensor_a[::3] = value * [static setitem] support the index step < 0. Eg: tensor_a[::-3] = value * [static setitem] support the index is Tensor. eg: tensor_a[tensor_3:0:-1] = value * Add op version.	5 years ago
Jack Zhou	6df1ca54c8	add detail about states index in rnn result, test=document_fix (#31048)	5 years ago
Huihuang Zheng	ef627ac5b9	Fix that convert_var_shape doesn't support slice like [0:], test=develop (#31051) ... As the title, when slice_node like 1:3 being passed to idx of convert_var_shape, it will cause syntax error because a function cannot take this as argument. This PR fixed it.	5 years ago