Paddle

Commit Graph

Author	SHA1	Message	Date
Huihuang Zheng	649868ffb2	[Dy2stat] Fix the bug that loop_body_func may return single element (#31806 ) Our old `loop_body` function may return single element when `loop_vars` just contains only 1 element, which can cause bug. The key point of this PR is forcing `loop_body` functions always return tuple.	4 years ago
Aurelius84	def27bc801	[Dy2stat]Fix bug with static_convert_var_shape in locals scope (#31556 ) * Fix bug with static_convert_var_shape * replace dot with dash	4 years ago
liym27	522c91ec67	[Dy2Stat] Remove gast.Index for compatibility of gast 0.4.0 (#31358 )	4 years ago
Huihuang Zheng	c40b98e068	Fix comment (#31424 ) Fix wrong code comment	4 years ago
Huihuang Zheng	6bf02a1261	[Dy2stat] Fix Read-Only Attribute as while_loop Output (#31415 ) Fix Read-Only Attribute as while_loop Output: Usually, our convert_while_loop will be like: ``` [a, b, c] = paddle.jit.dy2static.convert_while_loop( condition_name, body_name, [a, b, c]) ``` where a, b, c are in loop_var_names. However, if loop_var_names contains property such as foo.x, we cannot assign the attribute as output of convert_while_loop because Python property is a kind of read-only attribute. To handle the case, we replace the attributes which are output of convert_while_loop with generated variables, then if we know the attribute is not read-only at runtime, we assign the attribute. The created statements are like: ``` [a, b, __attribute_variable_1] = paddle.jit.dy2static.convert_while_loop( condition_name, body_name, [a, b, foo.x]) if not isinstance(getattr(type(foo), x, None), property): foo.x = __attribute_variable_1 ```	4 years ago
Aurelius84	1dd40870fc	[Dy2Stat] Fix eval_if_exist_else_none bug (#31261 ) * fix eval_if_exist_else_none bug * fix typo * fix typo * fix test_op_num unittest	4 years ago
Huihuang Zheng	cf43a321a8	[Dy2stat] Refactoring tensor_shape_transformer.py to Fix Change after Assign Bug (#31082 ) Problem In our old shape transformer logic, if user write: ``` s = tensor.shape ... y = paddle.some_api(s) ``` Dy2stat will change it to ``` ... y = paddle.some_api(convert_var_shape(tensor)) ``` However it will cause fatal bug if user changes the shape of `x` after assign. For example: ``` s = tensor.shape ... tensor = paddle.some_change_shape_api(tensor) ... y = paddle.some_api(s) ``` Then the Dy2stat will get wrong result because the code is translated into: ``` tensor = paddle.some_change_shape_api(tensor) ... y = paddle.some_api(convert_var_shape(tensor)) # tensor shape has been changed, not origin `s` value ``` Solution Logic It can not be solved in the old logic, so I refactoring tensor_shape_transformer logic. Now we will use `s` to store shape attribute and generate a var `s__STATIC_CONVERT_VAR_SHAPE_SUFFIX` to store static shape API `shape(tensor)` ``` s = tensor.shape ... y = paddle.some_api(s) ``` Dy2stat will change it to ``` s = tensor.shape s__STATIC_CONVERT_VAR_SHAPE_SUFFIX = shape(tensor) ... y = paddle.some_api(choose_shape_attr_or_api(s, s__STATIC_CONVERT_VAR_SHAPE_SUFFIX )) ``` In this case, the code is consistent with origin dygraph meaning and it fixed the change after assign bug. Code Key Note To help reviewers, the key change of this PR is changing `self.name_to_var_shape` from "mapping name to shape node" to "mapping name to its STATIC_CONVERT_VAR_SHAPE_SUFFIX name", then if a variable name has the SUFFIX, we can choose to use attribute shape or shape api. Other changes go with the key change. Consideration The issue of this PR is that we store extra static `shape` API result, will it harms the speed of Dy2stat? In some cases it will, but we argue that the benefit would be greater than the cost. 1. The extra calling to static `shape` API will happen when coder assign among shape variables. Take the following dygraph code as an instance: ``` s1 = tensor.shape s2 = s1 s3 = s2 ... ``` Then we called extra static `shape` APIs again and again, however users seldom write code like this. 2. If the shape variable is used a lot, for example: ``` s = tensor.shape y1 = paddle.some_api1(s) y2 = paddle.some_api2(s) y3 = paddle.some_api3(s) ``` Our old logic will create 3 shape APIs but now just 1. This is more common user code pattern. In fact, if reviewers take a look at the current unit test in this PR, you could see the op numbers decrease after this PR. So we argue that this PR can also improve speed in this code pattern.	4 years ago
Huihuang Zheng	ef627ac5b9	Fix that convert_var_shape doesn't support slice like [0:], test=develop (#31051 ) As the title, when slice_node like 1:3 being passed to idx of convert_var_shape, it will cause syntax error because a function cannot take this as argument. This PR fixed it.	4 years ago
Huihuang Zheng	c137578341	Add Support for Tuple in for Loop (#30998 ) Dy2stat didn't support tuple as iteration variable in the past. This PR added there main cases: 1). Non-enumerate case: for var1, var2 in var\|var.numpy() will be re-written as: for FOR_ITER_TUPLE_PREFIX_x in var \| var.numpy(): var1 = FOR_ITER_TUPLE_PREFIX_x[0] var2 = FOR_ITER_TUPLE_PREFIX_x[1] 2). Enumerate out tuple case: for t in enumerate(var\|var.numpy) will be rewritten as: for FOR_ITER_TUPLE_INDEX_PREFIX_x, FOR_ITER_TUPLE_PREFIX_x in enumerate(var\|var.numpy): t = (FOR_ITER_TUPLE_INDEX_PREFIX_x, FOR_ITER_TUPLE_PREFIX_x) 3). Enumerate inner tuple case: for i, (var1, (var2, va3)) in enumerate(var\|var.numpy()) will be re-written as: for i, FOR_ITER_TUPLE_PREFIX_x in var \| var.numpy(): var1 = FOR_ITER_TUPLE_PREFIX_x[0] var2 = FOR_ITER_TUPLE_PREFIX_x[1][0] var3 = FOR_ITER_TUPLE_PREFIX_x[1][1]	4 years ago
liym27	13ef444fa6	[Dy2Stat] Fix error message when the message has more than one lines. (#30714 )	4 years ago
Aurelius84	621bc4f771	[Dy2static]Fix paddle prefix in is_paddle_api (#30569 ) * add paddle. * add unittest	4 years ago
Chen Weihang	ae1f32091a	fix prune input bug (#30384 )	4 years ago
Huihuang Zheng	c372a76303	Add Static Variable Clone (#30208 ) Add clone method for static Variable so that this interface will be same as dygraph. It fixed some bugs in dy2stat	4 years ago
XiaoguangHu	6bfdef727e	clean redundant API alias in 2.0 - part 2 (#30013 ) * delete paddle.nn.functional.assign * fix dynamic to static error	4 years ago
Aurelius84	03e072736e	Skip convert tensor shape while using Paddle.shape (#30223 ) * fix tensor shape bug * fix op_num * clean code	4 years ago
liym27	31ed9a5ed3	[Dy2Stat] Use Paddle2.0 api paddle.tensor.array_* (#30156 )	4 years ago
liym27	ad55f609d5	[Dy2Stat] Don't convert to paddle.shape if var_x.shape is not negetive (#29965 ) 1. When x is Variable, call nn.shape(x) only in following cases: 1）The shape of x is used in control flow condition. 2）The dim to be used is negetive 2. When x is Variable, but x.shape or x.shape[idx] doesn't contain negetive value, don't convert to paddle.shape()	4 years ago
liym27	41a7b07159	[Dy2Stat] Fix bug for loop: a variable is used and created in loop, but used before created (#29769 )	5 years ago
Huihuang Zheng	dfffee8a5d	[Dy2stat] Enable jit.save to Save Without Running (#29579 ) Enable jit.save to Save Without Running.	5 years ago
liym27	a0b60716f1	[Dy2Stat] Support grammar: for ele in var[idx] (#29541 ) Support to transformfor ele in var stms in which var is a slice of Tensor.	5 years ago
liym27	0cad1152f4	[Dy2Stat] 1. Fix bug of for-range stmts. 2. Support that step value is negative in for-range stmts (#29519 ) 1. Fix error in _build_cond_stmt of for-range stmts. 2. Support that step value is negative in for-range stmts 3. Fix code because of the diff between Py2 and Py3	5 years ago
Huihuang Zheng	8f7627907c	[Dy2stat] Reduce Exception Type for Better Error Message (#29268 ) Reduce exception type so that if covert_to_static failed, it reports right error message.	5 years ago
liym27	61a8f2874f	[Dy2Stat] Fix bug: Do not use gast.Subscript to replace gast.Name in when transforming for_enumerate_loop (#29310 )	5 years ago
liym27	b9a8ebd50f	[Dy2stat] Add a decorator paddle.jit.not_to_static to support that not to convert a function in Dynamic-to-Static. (#29253 ) Usage scenarios：A function could have run successfully in static mode, you can use it to decorate a function in the following cases: 1. An unknown error occurs in the dynamic-to-static conversion process of the function; 2. In the internal implementation of the function, it has two branches: dynamic branch and static branch; 3. Users don't want to convert the function in the process of dynamic to static.	5 years ago
Huihuang Zheng	aec05d811c	[Dy2stat] Fix PaddleGan Deoldify Model Dy2stat Problems (#29226 ) This PR fixes several problems in dy2stat for Deoldify model in PaddleGan. In model, software engineer wrote if x.shape == y.shape, the Tenser shape is a tuple in dygraph so the == returns True/False, but in static graph the == becomes element-wise comparison, which is a different behavior. In this PR we reduce the element-wise comparison result. If software engineer write computations which uses parameters in hooks, the static graph can loss the parameter variable because we put param_guard at forward of a Layer. In this PR we made param_guard cover pre-hook and post-hook. In PaddleGan, software engineer calculated some parameter values in __init__ by running some dygraph code. Those code also run during dy2stat. So some variables may be assign as a VarBase (Tensor) first and then Variable, which raised an error. We fixed the bug in this PR by handling the case. TODO: We just added testcase for the 1. shape comparison. Should add test case for 2. and 3. But since we are chasing 2.0RC, I will do it in the near future PR	5 years ago
WeiXin	1476e1f998	save model after jit.load (#28748 ) * Changed a variable name error * Add comments * Move member functions of TranslatedLayer out of function * edit code according to review * Edit input argument of '_run_static_graph' * reset due to Segmentation fault * rename variables when stitching graph * modify code according CI * Add comments to '__i_m_p_l__' * remove blanks befor 'Get...' * edit code according to review * Add a comment to '_execution_method_creator' * Edit a comment to '_execution_method_creator'	5 years ago
liym27	01bdea7c31	[Dy2Stat] Don't conver the function from third library logging (#29161 )	5 years ago
liym27	a7433cc379	[Dy2Stat] Fix bug: the return statement should be transformed to an equivalent Paddle/Python if statement, which depends on if conditions of the return stmt. (#29165 )	5 years ago
liym27	5fe44571f0	[Dynamic-to-Static] Support **kwargs as input of the function which is decorated by `jit.save.to_static` (#29098 )	5 years ago
liym27	682cc17f53	[Dynamic-to-Static] Fix bug: support pop from a dict and polish code of convert_pop (#29023 ) * Support pop for dict in dy2stat * Move convert_pop to convert_operators.py and polish convert_pop	5 years ago
Huihuang Zheng	5b339262bc	[Dy2stat] Add Tuple as Assign Target for Tensor Shape (#28775 ) Add support for using tuple as tensor.shape (For example: a, b, c, d = x.shape)	5 years ago
liym27	85292e0b46	[Dynamic-to-Static] Fix bug of convert_logical_and/convert_logical_or: the operands are executed sequentially(#28993 ) 1) The operands are executed sequentially according to the running logic of Python. 2) If the left hand operand is True(for convert_logical_or)/False(for convert_logical_and), the right hand operand should be executed.	5 years ago
Huihuang Zheng	96126532cd	Fix Incorrect After Node Vars in IfElseTransformer, test=develop (#28992 ) The PR description is long. See details in the PR link.	5 years ago
liym27	269470d62e	[Dynamic-to-Static] Remove unnecessary variables of the arguments in true_func/false_func (#28722 )	5 years ago
liym27	e5f0e6b003	[Dynamic-to-Static] Fix bug in loop_transformer: loop vars should contain the var from ancestor-for-node (#28735 )	5 years ago
liym27	9881738e13	[Dynamic-to-Static ErrorMessage] Support dy2stat error message when call jit.save and polish error message (#28713 ) * Support dy2stat error message when call jit.save; * Polish dy2stat error message: (1) the original dygraph code is marked with (* user code *) ; (2) "In user code:" -> "In transformed code:"	5 years ago
Huihuang Zheng	9ab335bbd9	Fix convert_call May be Called Multiple Times, test=develop (#28710 ) Fix convert_callmMay be called multiple times in Dy2stat. Also strip some strings to make sure no influence from blank spaces.	5 years ago
Huihuang Zheng	b6f86b8491	Fix Using "isinstance" in Loop, test=develop (#28641 ) Fix a bug that used in PaddleGAN model which used `isinstance` in a for loop	5 years ago
liym27	0ce933a9ee	[API2.0] Fix documents of 6 APIs to fit API2.0: (#28514 ) 1. Remove 'fluid'; 2. Variable -> Tensor APIs: sum, convert_call, convert_ifelse, convert_logical_and, convert_logical_or, convert_logical_not	5 years ago
Huihuang Zheng	3b0d31ab89	Modify ProgramTranslator and TracedLayer Doc for API 2.0 (#28509 ) Modify ProgramTranslator and TracedLayer Doc for API 2.0	5 years ago
Huihuang Zheng	546b1c1dc4	Fix paddle.jit.dy2static.data_layer_not_check 2.0 API Doc (#28461 ) Remove "fluid", "variable" in 2.0 API doc	5 years ago
Aurelius84	2500dca878	[Dy2Stat] Fix bug in convert_call (#28368 ) * Fix bug in convert_call * refine unittest * refine code * refine code * fix unittest failed * add assert	5 years ago
liym27	b1eb28d74b	[Dy2Stat-log] Call warnings.warn() to display the warning-message only once when calling StaticFunc.__call__ or ProgramTranslator().get_output (#28260 )	5 years ago
Aurelius84	a5c18204e9	[Dy2stat]Join break cond with while cond in some pattern (#28171 ) * Join break cond with while cond * remove usless code * refine the if code * Split into BreakTransfromOptimizer * add BreakTransformOptimizer in ast_transformer * add more comment	5 years ago
Aurelius84	e730516090	[Dy2stat] Refine return mechanism in @to_static (#28116 ) * remove some judgement * fix len(outputs) == 1	5 years ago
Aurelius84	135b62a4ec	[Dy2stat] Refine code of DygraphToStaticAst (#28103 ) * refine code of DygraphToStaticAst * add __init__ function	5 years ago
Aurelius84	3718b2e706	Fix test_lstm unittest failed and Add more unittest (#28029 ) * fix test_lstm unittest failed * add more unittest * modify cmakelist * fix judgement	5 years ago
Guo Sheng	fa9d3fa5bf	Incorporate cudnn_lstm into LSTM api (#27217 ) * Incorporate cudnn_lstm into LSTM api. test=develop * Make coalesce_tensor support alignment optionally. test=develop * Reorganize RNN apis. test=develop * Fix cudnn rnn layout conversion. test=develop * Add sequence_length support for RNN cudnn implement. Add optional init_h and init_c gradient for cudnn_lstm_op. test=develop * Use create_parameter for rnn cudnn impl. test=develop * Move `self._flat_weight = self.create_parameter()` in RNNBase to main_program. test=develop * Update RNN api unittest to use set_device. test=develop * Fix set_place for unit tests of RNN apis. test=develop * Fix use_align in coalesce_tensor_op. test=develop * Adjust RNN apis arguments according to comments. test=develop * Polish documents for SimpleRNN apis. test=develop * Refine random seed in cudnn_lstm_op. Expose rnn params from sublayers to RNN. test=develop * Fix RNN saving for jit.save. Refine cudnn_lstm dropout behavior. test=develop * Fix doc of GRU. test=develop * Use ShareDataWith to avoid copying for cudnn_lstm_op test. test=develop * Remove updates on cudnn_lstm temporarily. test=develop * Use ShareDataWith to avoid copying for cudnn_lstm_op test. test=develop * Refine random seed in cudnn_lstm_op. test=develop * Fix test_lstm by adjust ConcreteProgram buffer getter. test=develop * Use create_parameter instead of create_var for rnn._flat_weight for static graph usage. test=develop * Remove W input for cudnn_lstm to pass unused_var_check. test=develop * Add test_predict for RNN unit tests coverage. test=develop * Fix code style of rnn. test=develop * Fix F.rnn usage in rnn.py. test=develop	5 years ago
Aurelius84	ffcc11758a	[Dy2Stat] Fix Error when generating train_program in eval mode (#27975 ) * Fix save in eval mode * remove assert statement * fix test_partial_program failed * add more test * modify back into _train_program	5 years ago
chentianyu03	d05058d268	Remove and reorganize the alias of APIs (#27717 ) * modify cond while_loop to paddle.static.nn.cond * modify crop_tensor to paddle.crop * modify Variable to paddle.static.Variable * remove nn.beam_search, nn.beam_search_decode, nn.gather_tree * remove bpr_loss, center_loss, rank_loss, smooth_l1, teacher_student_sigmoid_loss, edit_distance, sampled_softmax_with_cross_entropy in nn.functional * remove apis in nn.functional.learn_rate.py * remove pool2d, pool3d, adaptive_pool2d, adaptive_pool3d in nn.functional * remove apis in nn.functional.vision * remove erf, soft_relu in nn.functional.activation * remove apis in nn.functional.extension * remove nn.functional.rnn * remove hash from nn.functional.lod * remove row_conv from nn.functional.extension * remove one_hot, pad2d, pad_constant_like from nn.functional.common * remove nn.gather_tree, nn.BilinearTensorProduct, nn.Pool2D, nn.Pad2D * remove apis from optimizer.__init * remove tensor.creation.fill_constant * remove elementwise_mul in nn.functional.common and modify to paddle.multiply * remove tensor.stat.reduce_mean * remove reduce_all, reduce_any in tensor.logic * remove apis in tensor.math * remove apis in tensor.__init__ * remove has_inf, has_nan in tensor.search * remove apis in framework.__init__ * remove apis in paddle.__init__ * remove apis in nn.functional.__init__ * modify removed alias apis to raw api in doc and unittests * fix remove grid_sample bug * modify removed alias apis to raw api in doc and unittests * modify removed alias apis to raw api in doc and unittests * modify removed alias apis to raw api in doc and unittests * modify removed alias apis to raw api in doc and unittests * modify removed alias apis to raw api in doc and unittests * modify removed alias apis to raw api in doc and unittests * delete alias api relastions in doc * reserve paddle.compat, paddle.sysconfig * remove unittest for paddle.reduce_all, paddle.reduce_any * modify removed alias apis to raw api in doc and unittests * recover paddle.save and paddle.load * resolve conflicts * fix sample code missing paddle.enable_static() bug * fix sample code missing paddle.enable_static() bug * fix to_string sample code error	5 years ago

1 2 3 4

178 Commits (649868ffb262bdba89741eca93e7c7cb8632b9e2)