Paddle

Commit Graph

Author	SHA1	Message	Date
Huihuang Zheng	649868ffb2	[Dy2stat] Fix the bug that loop_body_func may return single element (#31806 ) Our old `loop_body` function may return single element when `loop_vars` just contains only 1 element, which can cause bug. The key point of this PR is forcing `loop_body` functions always return tuple.	5 years ago
liym27	522c91ec67	[Dy2Stat] Remove gast.Index for compatibility of gast 0.4.0 (#31358 )	5 years ago
Huihuang Zheng	c137578341	Add Support for Tuple in for Loop (#30998 ) Dy2stat didn't support tuple as iteration variable in the past. This PR added there main cases: 1). Non-enumerate case: for var1, var2 in var\|var.numpy() will be re-written as: for FOR_ITER_TUPLE_PREFIX_x in var \| var.numpy(): var1 = FOR_ITER_TUPLE_PREFIX_x[0] var2 = FOR_ITER_TUPLE_PREFIX_x[1] 2). Enumerate out tuple case: for t in enumerate(var\|var.numpy) will be rewritten as: for FOR_ITER_TUPLE_INDEX_PREFIX_x, FOR_ITER_TUPLE_PREFIX_x in enumerate(var\|var.numpy): t = (FOR_ITER_TUPLE_INDEX_PREFIX_x, FOR_ITER_TUPLE_PREFIX_x) 3). Enumerate inner tuple case: for i, (var1, (var2, va3)) in enumerate(var\|var.numpy()) will be re-written as: for i, FOR_ITER_TUPLE_PREFIX_x in var \| var.numpy(): var1 = FOR_ITER_TUPLE_PREFIX_x[0] var2 = FOR_ITER_TUPLE_PREFIX_x[1][0] var3 = FOR_ITER_TUPLE_PREFIX_x[1][1]	5 years ago
Aurelius84	621bc4f771	[Dy2static]Fix paddle prefix in is_paddle_api (#30569 ) * add paddle. * add unittest	5 years ago
Chen Weihang	ae1f32091a	fix prune input bug (#30384 )	5 years ago
Huihuang Zheng	dfffee8a5d	[Dy2stat] Enable jit.save to Save Without Running (#29579 ) Enable jit.save to Save Without Running.	5 years ago
liym27	a0b60716f1	[Dy2Stat] Support grammar: for ele in var[idx] (#29541 ) Support to transformfor ele in var stms in which var is a slice of Tensor.	5 years ago
liym27	0cad1152f4	[Dy2Stat] 1. Fix bug of for-range stmts. 2. Support that step value is negative in for-range stmts (#29519 ) 1. Fix error in _build_cond_stmt of for-range stmts. 2. Support that step value is negative in for-range stmts 3. Fix code because of the diff between Py2 and Py3	5 years ago
liym27	61a8f2874f	[Dy2Stat] Fix bug: Do not use gast.Subscript to replace gast.Name in when transforming for_enumerate_loop (#29310 )	5 years ago
WeiXin	1476e1f998	save model after jit.load (#28748 ) * Changed a variable name error * Add comments * Move member functions of TranslatedLayer out of function * edit code according to review * Edit input argument of '_run_static_graph' * reset due to Segmentation fault * rename variables when stitching graph * modify code according CI * Add comments to '__i_m_p_l__' * remove blanks befor 'Get...' * edit code according to review * Add a comment to '_execution_method_creator' * Edit a comment to '_execution_method_creator'	5 years ago
Huihuang Zheng	9ab335bbd9	Fix convert_call May be Called Multiple Times, test=develop (#28710 ) Fix convert_callmMay be called multiple times in Dy2stat. Also strip some strings to make sure no influence from blank spaces.	5 years ago
Aurelius84	a5c18204e9	[Dy2stat]Join break cond with while cond in some pattern (#28171 ) * Join break cond with while cond * remove usless code * refine the if code * Split into BreakTransfromOptimizer * add BreakTransformOptimizer in ast_transformer * add more comment	6 years ago
Huihuang Zheng	cc2fc93804	[Dy2stat] Refine Dy2stat APIs to 2.0rc (#27430 ) Refine Dy2stat APIs to 2.0rc After discussion, we accepted 3 key points from reviewers: 1. In 2.0rc we changed dygraph_to_static folder to dy2static 2. Keep the three files: convert_call_func.py, convert_operators.py, variable_trans_func.py 3. Remove convert_operators path when users import convert_xxx. After this PR, users can import convert_xxx APIs by: `import paddle.jit.dy2static.convert_xxx` The file structure will be: ``` jit dy2static convert_operators.py convert_func_call.py variable_trans_func.py ``` Detail changed API in files: In python/paddle/jit/dygraph_to_static/convert_call_func.py: from ...fluid.dygraph.dygraph_to_static.convert_call_func import convert_call #DEFINE_ALIAS In python/paddle/jit/dygraph_to_static/convert_operators.py: from ...fluid.dygraph.dygraph_to_static.convert_operators import cast_bool_if_necessary #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.convert_operators import convert_assert #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.convert_operators import convert_ifelse #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.convert_operators import convert_len #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.convert_operators import convert_logical_and #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.convert_operators import convert_logical_not #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.convert_operators import convert_logical_or #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.convert_operators import convert_print #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.convert_operators import convert_var_dtype #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.convert_operators import convert_var_shape #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.convert_operators import convert_while_loop #DEFINE_ALIAS In python/paddle/jit/dygraph_to_static/variable_trans_func.py: from ...fluid.dygraph.dygraph_to_static.variable_trans_func import create_fill_constant_node #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.variable_trans_func import create_static_variable_gast_node #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.variable_trans_func import data_layer_not_check #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.variable_trans_func import to_static_variable #DEFINE_ALIAS from ...fluid.dygraph.dygraph_to_static.variable_trans_func import to_static_variable_gast_node #DEFINE_ALIAS	6 years ago
liym27	f9d39b4916	[Dy2Stat] Transforme api 'to_tensor' to 'assign'. (#26873 )	6 years ago
Aurelius84	df0a22d98b	[Dy2stat]Fix Python Version compatibility of dict.iteritems (#26778 ) * Fix Python Version compatibility * add import six	6 years ago
Aurelius84	f05613683f	[Dy2stat] Support InputSpec and Return callable class instance in @declarative (#25960 ) * add InputSpec * add unittest for tensorSpec and SimpleNet	6 years ago
Huihuang Zheng	e1245f5c84	[Dy2stat] change deprecated imp dependency to importlib, test=develop (#26453 ) As the title	6 years ago
liym27	db272ca5ef	rename file to according to reviews. (#26236 )	6 years ago
liym27	f3ea615673	[Dy2Stat] Fix bug: unwrap func in dy2Stat. (#26279 )	6 years ago
liym27	1d730ffbf5	[Dy2Stat] Removes temporary files created during the transformation of dygraph to static graph. (#26150 )	6 years ago
Zhen Wang	dc17ac9199	fix import fluid error in dygraph_to_static. test=develop (#25195 )	6 years ago
Aurelius84	e8134e873a	[Dy2stat]Refine caches of converting function (#25085 ) * Refine caches of converting func test=develop * fix if statement test=develop * refine cache code test=develop * rm unuse import statement test=develop * Polish code comment test=develop	6 years ago
liym27	2e238c6eed	[[Dy2Static]]convert for stmt and support variable loaded and created in loop(#24901 ) * Move function 'convert_len' to file convert_operators.py * Support that for statements are transformed to while statements. * Fix bug: raise None -> return None. * Support variable loaded and created in loop. * Use int64 in Py2 and Py3 in function to_static_variable.	6 years ago
Chen Weihang	a1c1b59d48	[Dy2Static] Support for iter & enumerate VarBase (#24856 ) * support for iter & enumerate varbase, test=develop * revert IsControlFlowVisitor change, test=develop	6 years ago
liym27	824572c144	[Dy2Stat]Support to transform sequence assignments and multi-target assignments to normal assignments (#24643 )	6 years ago
Chen Weihang	d26f581c58	fix some detail problems, test=develop (#24614 )	6 years ago
Chen Weihang	03ba5b748d	[Dy2static] Add for enumerate Variable support (#24398 ) * initial test * for enumerate basic implement, test=develop * update unittests, test=develop * refine unittests to adapt new training mode, test=develop * refactor for node stmts parsing code, test=develop * self-review & polish details, test=develop	6 years ago
Aurelius84	100914ddbe	Fix bug with `if Tensor` in is_control_flow (#24433 ) * fix bug with `if Tensor` in is_control_flow test=develop * remove continue test=develop	6 years ago
liym27	f9a4f9f4c4	Remove redundant code. test=develop (#24397 )	6 years ago
liym27	2961a4f07d	[Dy2Stat] Optimize loop cond (#24049 ) * Simplify code for gast.If in is_control_flow_to_transform. * Move IsControlFlowVisitor to file utils. * Don't use convert_call for build-in func in CallTransformer. * Optimize api is_control_flow_to_transform. * Polish the document of IsControlFlowVisitor.	6 years ago
liym27	37ef7c1351	[dy2static]Fix a bug of is_dygraph_api and move BasicApiTransformer to a separate file(#23923 ) * Move BasicApiTransformer to a separate file. test=develop * Fix a bug: A api in module is not a real dygraph api in dygraph_to_static. test=develop	6 years ago
Aurelius84	d1f9a26c95	Refine mechanism of calling outer function in dy2static (#23688 ) * Refine mechanism of calling outer function test=develop * fix typo test=develop	6 years ago
Huihuang Zheng	036121b731	[Dy2stat] Make loop_transformer supports class variable (#23478 ) This CR makes two changes: 1. In old loop_transformer, if a class variable, such as "self.a, foo.bar" is a loop var, the Dy2stat will fail because `def func(self.foo)` is not legal syntax. We support class variable by renaming. 2. After https://github.com/PaddlePaddle/Paddle/pull/22892 is merged, we can support `while x < 10` in dygraph. I enable those tests in corresponding Dy2stat	6 years ago
liym27	11f94cdce9	Improve function is_control_flow_to_transform. test=develop (#23109 )	6 years ago
liym27	573d2faacd	fix bug in function `is_to_variable`. test=develop (#23147 )	6 years ago
Aurelius84	31fc3ab79a	Support to use external function (#23057 ) * Support to use external function test=develop * refine the parms of ast_to_func test=develop	6 years ago
Huihuang Zheng	fb7b008acc	Add Support for Break and Continue in Dygraph to Static (#23067 ) 1. Add support for Break and Continue in Dygraph to Static 2. Also add support for gast.Not in NodeTestTransformer 3. Also add support for logical op transformation in LoopTransformer	6 years ago
liym27	4af491c2bb	Tensor.shape support control flow if/for/while and bugfix (#22866 ) * Support Tensor.shape in control flow if/for/while and separate TensorShapeTransformer from BasicApiTransformer. test=develop	6 years ago
Aurelius84	ab473357a2	Support and/or in dygraph_to_static control_flow_if (#22967 ) * Support and/or in controlFlow if test=develop * Refine IsControlFlow interface test=develop	6 years ago
liym27	08e80d170b	Support list in control flow for dygraph_to_static (#22902 ) * support list in control flow if. test=develop * support list in for/while and supplement tests. test=develop	6 years ago
Huihuang Zheng	d7a7c5f0bf	Support Simple For Range Loop in Dygraph to Static (#22867 ) 1. Add basic support for `for in range` loop 2. Move `test_dygraph_to_static_*` to `dygraph_to_static` dir and rename them 3. Add test case for dict in while_loop	6 years ago
Aurelius84	4ff2915d1f	Refine code of IfElseTransformer and rename unittest files (#22930 ) + Refine code structure and move code related with control flow `if` into `ifelse_transformer.py` + Merge code of `ast_utils.py` into `utils.py`	6 years ago
liym27	b290420fc4	fix bug in the transformation from to_variable to assign. test=develop (#22885 )	6 years ago
liym27	4ea95b6fe5	Support Tensor.shape in dygraph_to_static (#22830 ) * support basic tensor.shape. * Support tensor.shape with dependencies.	6 years ago
liym27	8c381cd957	support fetch feed in dygraph to static graph (#22767 ) * Support fetch and run program in the process of dygraph_to_static_output. test=develop * fix to_source(gast) and remove dygraph API such as Conv2D, Linear. test=develop	6 years ago
liym27	68c76793ca	support dygraph basic api transformed to static api (#22678 ) * support dygraph to static graph for simple case. * add test for dygraph API recognition. test=develop * support basic to_variable api. test=develop * update dict: dygraph_class_to_static_api * add all tests of dygraph api. test=develop * use gast/astor instead of ast/codegen for the compatibility of PY2 and PY3. test=develop * add arg 'num_flatten_dims' for fc ast node. test=develop * Modify names of class by Camel-Case.	6 years ago

46 Commits (develop)