Paddle

Commit Graph

Author	SHA1	Message	Date
Aurelius84	02adf68dcc	[Dy2stat]Support buffers and register_buffer in Layer (#24888 ) * support to save varBase created in __init__ test=develop * polish code test=develop * refine to_static_var test=develop * refine warning test=develop * add unitteset for to_static_var test=develop * fix logger test=develop * polish buffers en doc test=develop * fix param_guard test=develop * refine en doc test=develop	5 years ago
Huihuang Zheng	6f631a27c7	[Dy2stat] Add Basic Support for Grammar 'return' (#25176 ) This PR added basic support for 'return' grammar in dy2stat. It supports the control flow of 'return'. The basics idea is using a return value variable to store the early return statements and boolean state variables with if-else to skip the statements after the return statements. This PR is very basic support. There are some corner cases I didn't develop/test. For example, 'return None', 'return different length of variables', 'return non-tensor and tensor together', 'no return statement'. These corner cases will be done in my next PRs. Target date is this week. Note: 1. for the unit test, I changed test_program_translator.py because the StaticCode of `dyfunc_with_if_else` will change. To guarantee the correctness of `dyfunc_with_if_else`, I also run it in `TestRecursiveReturn` in test_return.py. 2. I commented the early return code in bert_dygraph_model.py because 'return different length of variables' is unsupported now. I also know that there are some other models used early return and we didn't enable it in the unit test. I will add support for it in next PRs and then re-enable those tests.	5 years ago
Aurelius84	38d2d13d8b	[Dy2stat] Add CycleGAN model for unitttest (#25072 ) * add cycle_gan_model * align train test=develop * modify image_size into 64 to avoid TimeOut test=develop * TODO in GPU test=develop	5 years ago
Aurelius84	e8134e873a	[Dy2stat]Refine caches of converting function (#25085 ) * Refine caches of converting func test=develop * fix if statement test=develop * refine cache code test=develop * rm unuse import statement test=develop * Polish code comment test=develop	5 years ago
Aurelius84	8d6de44012	Refine check_type Error Message for @declarative (#25098 ) * Refine check_type for @declarative test=develop	5 years ago
liym27	eb1c0901a6	[Dy2Stat]Remove unnecessary vars from gast.comprehension in LoopTransformer. (#25094 )	5 years ago
liym27	db601f70cc	[Dy2Stat] Add test for dygraph seq2seq model. (#25054 ) * The arg of append() can be not Tensor temporarily. * Add Seq2Seq as ProgramTranslator Unit Test. * set dtype of vocab_size_tensor to int64 to pass Windows-CI.	5 years ago
liym27	f16e277859	[Dy2Static]Convert var.shape stmt and Convert the return variables of Tensor-dependent 'if' staments to Tensor if it not (#24911 ) * Support int and long: int or long -> six.integer_types. * Modify test_tensor_shape: fix bug and modify comment. * Support convert_var_shape to convert var.shape stmt * Modify code in ifelse_simple_func.py because don't support return non-Tensor in Tensor-dependent 'if' stament currently. * Convert the return variables of Tensor-dependent 'if' staments to Tensor if it not. test=develop	5 years ago
liym27	2e238c6eed	[[Dy2Static]]convert for stmt and support variable loaded and created in loop(#24901 ) * Move function 'convert_len' to file convert_operators.py * Support that for statements are transformed to while statements. * Fix bug: raise None -> return None. * Support variable loaded and created in loop. * Use int64 in Py2 and Py3 in function to_static_variable.	5 years ago
liym27	a9dca5805a	[Dy2Static] Add convert_ifelse to run the transformed code dynamically (#24866 ) * cast var in convert_logical_XX. * Add convert_ifelse function in convert_operators.py * Add logical_transformer. Remove LogicalTransformer from loop_transformer.py * Revert modified tests in PR24799(convert_while_stmt). * Comment and modify code that doesn't support `return` statement. * Remove unnecessary class: MergeAssignTransformer, NodeTestTransformer and IfConditionVisitor in ifelse_transformer.	5 years ago
Chen Weihang	a1c1b59d48	[Dy2Static] Support for iter & enumerate VarBase (#24856 ) * support for iter & enumerate varbase, test=develop * revert IsControlFlowVisitor change, test=develop	5 years ago
liym27	5ea82e8a45	[Dy2Static]Support return variable created in only one of If.body or If.orelse (#24841 ) * Support return variable in only one of if body or else. * remove after_visit in IfElseTransformer. * Modify the result of get_name_ids in test_ifelse_basic.py * Add unittest to test the new case. * Modify code according to reviews.	5 years ago
liym27	001c9fcca2	[Dy2Static]Convert while stmt and convert logical_XX (#24799 ) * Support convert_while_loop. * Comment code that not supported 'if' in test_break_continue. * Convert int into tensor to support 'if' stmt in for/while loop. * Add unittest to test all cases of convert_logical_XX. * Add unittest to test all cases of convert_while_loop. * Fix bug in LogicalOpTransformer. test=develop	5 years ago
Chen Weihang	1f032c53d5	remove duplicate function, test=develop (#24849 )	5 years ago
Aurelius84	8bbb829a03	[Dy2stat]Support nested input and output (#24752 ) * support nested input and output test=develop * remove code of convert type(output) in unittest test=develop * add warning test=develop	5 years ago
liym27	080d37a501	fix bug in LogicalOpTransformer: Create logic node recursively (#24785 )	5 years ago
Aurelius84	40162227bb	Support save model in dygraph.guard test=develop (#24761 )	5 years ago
liym27	a0846b627a	Remove target vars of gast.For from before_loop_vars or after_loop_vars (#24732 )	5 years ago
Aurelius84	6db0e2b1a9	[Dy2stat] Support len syntax (#24638 ) * [dy2stat] Support len * add convert_call func * refine code test=develop	5 years ago
liym27	824572c144	[Dy2Stat]Support to transform sequence assignments and multi-target assignments to normal assignments (#24643 )	5 years ago
Aurelius84	736d3acc24	[Dy2stat] Support lambda and enhance transformation of IfExpr (#24530 ) * fix bug with `if Tensor` in is_control_flow test=develop * remove continue test=develop * Support lambda and add unittest test=develop	5 years ago
liym27	b3ac1470c5	Support create LoDTensorArray and return LoDTensorArray in control flow (#24609 ) * Support to create LoDTensorArray in control flow (cond and while_loop) * Fix bug: return LoDTensorArray in while_loop * Change code in list_transformer.py to accommodate the new features.	5 years ago
Chen Weihang	d26f581c58	fix some detail problems, test=develop (#24614 )	5 years ago
Chen Weihang	03ba5b748d	[Dy2static] Add for enumerate Variable support (#24398 ) * initial test * for enumerate basic implement, test=develop * update unittests, test=develop * refine unittests to adapt new training mode, test=develop * refactor for node stmts parsing code, test=develop * self-review & polish details, test=develop	5 years ago
Huihuang Zheng	5ff4535781	[Dy2Stat] Fix ProgramTranslator.save_inference_model API Doc (#24584 ) As the title.	5 years ago
Chen Weihang	897cec811a	[Dy2static] fix some print transformer problems (#24516 ) * fix some print transformer problems, test=develop * simplify writing & avoid bud, test=develop * polish detail, test=develop	5 years ago
Aurelius84	db0c1ea851	[Dy2stat] Fix function lookup bug in convert_call (#24567 ) * fix convert call globals_funcs test=develop * add import statement test=develop	5 years ago
Huihuang Zheng	2d0f849e75	[Dy2Stat] Add assert for ProgramTranslator (#24492 ) Add assert grammar for ProgramTranslator	5 years ago
Aurelius84	100914ddbe	Fix bug with `if Tensor` in is_control_flow (#24433 ) * fix bug with `if Tensor` in is_control_flow test=develop * remove continue test=develop	5 years ago
liym27	f9a4f9f4c4	Remove redundant code. test=develop (#24397 )	5 years ago
Aurelius84	9bf70ed752	[dy2stat]Support save_inference_model in program_translator (#24353 ) * support save_inference_model in program_translator test=develop * fix compatibility with OrderedDict.values() in python3 test=develop * synchronized random_seed test=develop * Polish Error Message test=develop	5 years ago
liym27	03f4684d76	[Dy2Stat] Add test for bert pretraining. (#24350 ) * [Dy2Stat] Add test for bert pretraining. * Construct fake data. * Synchronous random seed of program.	5 years ago
Aurelius84	1ed8baf9c8	[dy2static] Support for static graph training with @declarative decorator (#24259 ) * support to train in static * support to independent decorator * remove in_dygraph_mode condition in ProgramTranslator * fix import param_guard and add train/eval test=develop * Modify into ShareVarsFromScope and rm __all__ in partial_program test=develop	5 years ago
liym27	ac9a7eeea4	[Dy2Stat]Support list pop (#24250 ) * Replace dygraph_to_static_func with @declarative or program_translator.get_func in test_list.py * Add comments in ConditionalBlock. * Support list pop last item. * Support pop the i-th item. * Support an empty tensor array as Input in assign op and set the kernel type is float.	5 years ago
liym27	e8869a907b	Fix bug in ProgramTranslator.get_output, convert all items into VarBase in nested list. (#24267 )	5 years ago
Chen Weihang	9b851ba216	[dy2static] Add print transformer and unify print format (#24068 ) * add print transformer & unify print format, test=develop * remove using of dygraph_to_static_func, test=develop * remove python stdout capture, test=develop * fix compatibility problems for PY2, test=develop * fix detail error, test=develop * fix type analysis bug, test=develop * fix print tuple compatible error in PY2, test=develop * replace get_func to declarative, test=develop * fix detail bug, test=develop * fix some detail problems, test=develop * change visit_call in print transformer, test=develop	5 years ago
liym27	2961a4f07d	[Dy2Stat] Optimize loop cond (#24049 ) * Simplify code for gast.If in is_control_flow_to_transform. * Move IsControlFlowVisitor to file utils. * Don't use convert_call for build-in func in CallTransformer. * Optimize api is_control_flow_to_transform. * Polish the document of IsControlFlowVisitor.	5 years ago
liym27	1507f77a18	Fix bug in convert_call because difference exists between python3 and python2. test=develop (#23966 )	5 years ago
liym27	0b0adbf9b6	[dy2static]Support recursive call (#23900 ) * [Dy2Stat]Support recursive call. * Remove Redundant decorator to pass the Py35 unittest temporarily.	5 years ago
Huihuang Zheng	45e48c3c32	[Dy2stat] Add Test and Example Code for Different Access to ProgramTranslator and Fix Related Bug (#23958 ) To prepare for publishing APIs, I added tests for that we can access dy2stat through: @fluid.dygraph.declarative @fluid.dygraph.jit.declarative fluid.dygraph.ProgramTranslator() fluid.dygraph.dygraph_to_static.ProgramTranslator() fluid.dygraph.dygraph_to_static.program_translator.ProgramTranslator() It surprised me that we had bugs on those different usages. I have fixed them. I also added example codes for these new APIs This PR also pulls my current PR https://github.com/PaddlePaddle/Paddle/pull/23880, so the PR history is long. For reviewer information, you could review this PR after https://github.com/PaddlePaddle/Paddle/pull/23880 is merged	5 years ago
Huihuang Zheng	81c4def96a	[Dy2stat] Rename Dygraph To Static Decorators (#23880 ) 1. Rename Dygraph To Static Decorators to declarative 2. dygraph_to_static_func is still using in some training tests, I cannot delete it now. 3. Add some API docs	5 years ago
liym27	37ef7c1351	[dy2static]Fix a bug of is_dygraph_api and move BasicApiTransformer to a separate file(#23923 ) * Move BasicApiTransformer to a separate file. test=develop * Fix a bug: A api in module is not a real dygraph api in dygraph_to_static. test=develop	5 years ago
Chen Weihang	fccbc485f5	remove redundant visit func, test=develop (#23877 )	5 years ago
Aurelius84	d265b16aed	Support transform two independent functions in dygraph_to_static_output (#23652 ) * Spport transform two independed function in dygraph_to_static_output test=develop * fix unittest error test=develop	5 years ago
Aurelius84	d1f9a26c95	Refine mechanism of calling outer function in dy2static (#23688 ) * Refine mechanism of calling outer function test=develop * fix typo test=develop	5 years ago
liym27	f9c9d50e7e	Return VarBase of ProgramTranslator.get_output instead of numpy.ndarray. test=develop (#23663 )	5 years ago
Aurelius84	d37cd74033	Polish set_optimizer Interface (#23588 )	5 years ago
Huihuang Zheng	036121b731	[Dy2stat] Make loop_transformer supports class variable (#23478 ) This CR makes two changes: 1. In old loop_transformer, if a class variable, such as "self.a, foo.bar" is a loop var, the Dy2stat will fail because `def func(self.foo)` is not legal syntax. We support class variable by renaming. 2. After https://github.com/PaddlePaddle/Paddle/pull/22892 is merged, we can support `while x < 10` in dygraph. I enable those tests in corresponding Dy2stat	5 years ago
Aurelius84	4955c97ee8	Add unitTest for `Tensor==constant` for ifElse in dygraph2static (#23407 ) * Add unitTest for `Tensor==constant` for ifElse in dygraph2static test=develop	5 years ago
Huihuang Zheng	1d4d89baf8	[Dy2stat] Add data_layer_not_check (#23351 ) 1. Add data_layer_not_check because it is needed in dygraph_to_static where input can be variable size 2. Remove warnings in static analysis because python cannot do exact static analysis	5 years ago

1 2

91 Commits (02adf68dcc6b1a0d47717b4d386db55d7c74e2e0)