290 Commits (d5e40d1ba911a35f1094e9d04260e6c8d85fa68b)

Author	SHA1	Message	Date
Zhen Wang	2989c012f2	[DygraphToStatic]Add cast transform for dygraph_to_static. (#25325) ... * add cast transform and its UT for dygraph_to_static.	5 years ago
Zhou Wei	b555378e18	fix Layer.__dir__ to show the parameters/sublayers/buffers/attr/method of the Layer (#25197) ... * show the attr and functions of the Layer,test=develop * add buffer for dir,test=develop * fix __dir__,test=develop * fix doc of Layer.__dir__, test=develop	5 years ago
Zhou Wei	8de89e67e9	support tuple/list init for VarBase (#25231) ... * support tuple/list init for VarBase,test=develop * fix doc of fluid.dygraph.to_variable,test=develop * fix doc of fluid.dygraph.to_variable,test=develop	5 years ago
Zhen Wang	dc17ac9199	fix import fluid error in dygraph_to_static. test=develop (#25195)	5 years ago
Zhou Wei	c701588b14	add base class of LearningRateEpochDecay, and API: MultiStepDecay, and API: StepDecay (#24821) ... * add new API: MultiStepDecay, a new learing rate strategy, test=develop * add new API: MultiStepDecay, a new learing rate strategy,test=develop * add new API: MultiStepDecay, a new learing rate strategy,test=develop * add base class of LearningRateEpochDecay, and MultiStepDecay, and StepDecay, test=develop * fix doc to add coverage,test=develop	5 years ago
Huihuang Zheng	5e8e6dad72	[Dy2stat] Support Various-Length Return Grammar in Dy2stat (#25249) ... Support Various-Length Return Grammar in Dy2stat. This PR is a follow-up of https://github.com/PaddlePaddle/Paddle/pull/25176 . The basic idea is putting no-value placeholder variables at `return` statement to make all `return` statement have same length, after that the static graph can have fixed fetch output (code at return_transformer.py). Then remove those no-value placeholder when we finally return dygraph result (code at partial_program.py). However, various length return in Bert model is still not supported. The dy2stat can change the code as I wish but some ops which check shape at compile time (e.g. Reshape, MatMul) will throw error because of the no-value-placeholder may not have the required shape. Is this a matter? To me, those no-value placeholder will be replaced as really values meeting shape requirements at run time, so I think the solution should be some way to do the compile-time checking. By the way, every time when we have dynamic shape, it often causes problem in dy2stat. We should find a way to handle it in the future. Fixing various return in Bert is my TODO thing and I will also find some other existing models for verification.	5 years ago
hong	dbc3fd5eb4	fix LinearLrWarmup bug; test=develop (#24913)	5 years ago
Aurelius84	02adf68dcc	[Dy2stat]Support buffers and register_buffer in Layer (#24888) ... * support to save varBase created in __init__ test=develop * polish code test=develop * refine to_static_var test=develop * refine warning test=develop * add unitteset for to_static_var test=develop * fix logger test=develop * polish buffers en doc test=develop * fix param_guard test=develop * refine en doc test=develop	5 years ago
Huihuang Zheng	6f631a27c7	[Dy2stat] Add Basic Support for Grammar 'return' (#25176) ... This PR added basic support for 'return' grammar in dy2stat. It supports the control flow of 'return'. The basics idea is using a return value variable to store the early return statements and boolean state variables with if-else to skip the statements after the return statements. **This PR is very basic support. There are some corner cases I didn't develop/test**. For example, 'return None', 'return different length of variables', 'return non-tensor and tensor together', 'no return statement'. **These corner cases will be done in my next PRs**. Target date is this week. **Note**: 1. for the unit test, I changed test_program_translator.py because the StaticCode of `dyfunc_with_if_else` will change. To guarantee the correctness of `dyfunc_with_if_else`, I also run it in `TestRecursiveReturn` in test_return.py. 2. I commented the early return code in bert_dygraph_model.py because 'return different length of variables' is unsupported now. I also know that there are some other models used early return and we didn't enable it in the unit test. I will add support for it in next PRs and then re-enable those tests.	5 years ago
Aurelius84	38d2d13d8b	[Dy2stat] Add CycleGAN model for unitttest (#25072) ... * add cycle_gan_model * align train test=develop * modify image_size into 64 to avoid TimeOut test=develop * TODO in GPU test=develop	5 years ago
Zhou Wei	a7cf562447	fix sample code error of fluid.dygraph.NaturalExpDecay,test=develop (#25092) ... fix sample code error of fluid.dygraph.NaturalExpDecay	5 years ago
Aurelius84	e8134e873a	[Dy2stat]Refine caches of converting function (#25085) ... * Refine caches of converting func test=develop * fix if statement test=develop * refine cache code test=develop * rm unuse import statement test=develop * Polish code comment test=develop	5 years ago
Aurelius84	8d6de44012	Refine check_type Error Message for @declarative (#25098) ... * Refine check_type for @declarative test=develop	5 years ago
liym27	eb1c0901a6	[Dy2Stat]Remove unnecessary vars from gast.comprehension in LoopTransformer. (#25094)	5 years ago
liym27	db601f70cc	[Dy2Stat] Add test for dygraph seq2seq model. (#25054) ... * The arg of append() can be not Tensor temporarily. * Add Seq2Seq as ProgramTranslator Unit Test. * set dtype of vocab_size_tensor to int64 to pass Windows-CI.	5 years ago
Leo Chen	fa657b3dbb	fix bug of prelu when rank not equal 4, test=develop (#25067) ... * fix bug of prelu when rank not equal 4, test=develop * fix prelu inference, test=develop * fix api, test=develop * fix shape when mode is chennel, test=develop * remove debug code, test=develop * add unittest, test=develop	5 years ago
liym27	f16e277859	[Dy2Static]Convert var.shape stmt and Convert the return variables of Tensor-dependent 'if' staments to Tensor if it not (#24911) ... * Support int and long: int or long -> six.integer_types. * Modify test_tensor_shape: fix bug and modify comment. * Support convert_var_shape to convert var.shape stmt * Modify code in ifelse_simple_func.py because don't support return non-Tensor in Tensor-dependent 'if' stament currently. * Convert the return variables of Tensor-dependent 'if' staments to Tensor if it not. test=develop	5 years ago
Leo Chen	bfa46c38d5	bn supports reverse_space, test=develop (#24988)	5 years ago
liym27	2e238c6eed	[[Dy2Static]]convert for stmt and support variable loaded and created in loop(#24901) ... * Move function 'convert_len' to file convert_operators.py * Support that for statements are transformed to while statements. * Fix bug: raise None -> return None. * Support variable loaded and created in loop. * Use int64 in Py2 and Py3 in function to_static_variable.	5 years ago
liym27	a9dca5805a	[Dy2Static] Add convert_ifelse to run the transformed code dynamically (#24866) ... * cast var in convert_logical_XX. * Add convert_ifelse function in convert_operators.py * Add logical_transformer. Remove LogicalTransformer from loop_transformer.py * Revert modified tests in PR24799(convert_while_stmt). * Comment and modify code that doesn't support `return` statement. * Remove unnecessary class: MergeAssignTransformer, NodeTestTransformer and IfConditionVisitor in ifelse_transformer.	5 years ago
Chen Weihang	4a702ef361	Support SelelctedRows allreduce in multi-cards imperative mode (#24690) ... * support selectedrows allreduce in multi-cards dygraph, test=develop * remove useless import modules in unittests, test=develop * add nccl cmake to get nccl version, test=develop * add if-condition to compiled correctly, test=develop * add detail version parseing for old nccl, test=develop * polish camke details, test=develop * fix remove test cmake error, test=develop * fix cmake condition, test=develop * change unittest camke list, test=develop * fix unittest cmake rule, test=develop, test=framep0	5 years ago
Chen Weihang	a1c1b59d48	[Dy2Static] Support for iter & enumerate VarBase (#24856) ... * support for iter & enumerate varbase, test=develop * revert IsControlFlowVisitor change, test=develop	5 years ago
liym27	5ea82e8a45	[Dy2Static]Support return variable created in only one of If.body or If.orelse (#24841) ... * Support return variable in only one of if body or else. * remove after_visit in IfElseTransformer. * Modify the result of get_name_ids in test_ifelse_basic.py * Add unittest to test the new case. * Modify code according to reviews.	5 years ago
liym27	001c9fcca2	[Dy2Static]Convert while stmt and convert logical_XX (#24799) ... * Support convert_while_loop. * Comment code that not supported 'if' in test_break_continue. * Convert int into tensor to support 'if' stmt in for/while loop. * Add unittest to test all cases of convert_logical_XX. * Add unittest to test all cases of convert_while_loop. * Fix bug in LogicalOpTransformer. test=develop	5 years ago
Chen Weihang	1f032c53d5	remove duplicate function, test=develop (#24849)	5 years ago
Aurelius84	8bbb829a03	[Dy2stat]Support nested input and output (#24752) ... * support nested input and output test=develop * remove code of convert type(output) in unittest test=develop * add warning test=develop	5 years ago
liym27	080d37a501	fix bug in LogicalOpTransformer: Create logic node recursively (#24785)	5 years ago
Zhou Wei	98da8a295d	add new learing rate strategy to reduce lr when loss reach on plateau (#24322) ... 添加loss自适应的学习率衰减策略。	5 years ago
Aurelius84	40162227bb	Support save model in dygraph.guard test=develop (#24761)	5 years ago
Leo Chen	92e256a86a	Fix bug of different dtype in dygraph math_op_patch, test=develop (#24740) ... * Fix bug of different dtype in dygraph math_op_patch, test=develop * support np.dtype and str, test=develop * add unit test, test=develop	5 years ago
liym27	a0846b627a	Remove target vars of gast.For from before_loop_vars or after_loop_vars (#24732)	5 years ago
Aurelius84	6db0e2b1a9	[Dy2stat] Support len syntax (#24638) ... * [dy2stat] Support len * add convert_call func * refine code test=develop	5 years ago
Leo Chen	9fd1aad6e7	Support NHWC in Pool2D, test=develop (#24240) ... * support NHWC in Pool2D, test=develop * add unittest, test=develop * fix unittest, test=develop * fix typo, test=develop * follow comments, test=develop * refine comments, test=develop	5 years ago
liym27	824572c144	[Dy2Stat]Support to transform sequence assignments and multi-target assignments to normal assignments (#24643)	5 years ago
Leo Chen	9c9e635c00	support tensor to varbase, test=develop (#24660)	5 years ago
Chen Weihang	fa846da53e	Append scale for static runner outputs (#24627) ... * add scale for static runner outputs, test=develop * fix import relation, test=develop * remove len limit, test=develop	5 years ago
Aurelius84	736d3acc24	[Dy2stat] Support lambda and enhance transformation of IfExpr (#24530) ... * fix bug with `if Tensor` in is_control_flow test=develop * remove continue test=develop * Support lambda and add unittest test=develop	5 years ago
liym27	b3ac1470c5	Support create LoDTensorArray and return LoDTensorArray in control flow (#24609) ... * Support to create LoDTensorArray in control flow (cond and while_loop) * Fix bug: return LoDTensorArray in while_loop * Change code in list_transformer.py to accommodate the new features.	5 years ago
Chen Weihang	d26f581c58	fix some detail problems, test=develop (#24614)	5 years ago
Chen Weihang	03ba5b748d	[Dy2static] Add for enumerate Variable support (#24398) ... * initial test * for enumerate basic implement, test=develop * update unittests, test=develop * refine unittests to adapt new training mode, test=develop * refactor for node stmts parsing code, test=develop * self-review & polish details, test=develop	5 years ago
Huihuang Zheng	5ff4535781	[Dy2Stat] Fix ProgramTranslator.save_inference_model API Doc (#24584) ... As the title.	5 years ago
Chen Weihang	897cec811a	[Dy2static] fix some print transformer problems (#24516) ... * fix some print transformer problems, test=develop * simplify writing & avoid bud, test=develop * polish detail, test=develop	5 years ago
Aurelius84	db0c1ea851	[Dy2stat] Fix function lookup bug in convert_call (#24567) ... * fix convert call globals_funcs test=develop * add import statement test=develop	5 years ago
Cindy Cai	86ca31ab58	English API Docs Optimization Part 1 (#24536) ... * test=develop, test=document_fix * test=develop, test=document_fix Co-authored-by: swtkiwi <1208425345@qq.com>	5 years ago
Huihuang Zheng	2d0f849e75	[Dy2Stat] Add assert for ProgramTranslator (#24492) ... Add assert grammar for ProgramTranslator	5 years ago
Aurelius84	100914ddbe	Fix bug with `if Tensor` in is_control_flow (#24433) ... * fix bug with `if Tensor` in is_control_flow test=develop * remove continue test=develop	5 years ago
liym27	f9a4f9f4c4	Remove redundant code. test=develop (#24397)	5 years ago
Aurelius84	9bf70ed752	[dy2stat]Support save_inference_model in program_translator (#24353) ... * support save_inference_model in program_translator test=develop * fix compatibility with OrderedDict.values() in python3 test=develop * synchronized random_seed test=develop * Polish Error Message test=develop	5 years ago
liym27	03f4684d76	[Dy2Stat] Add test for bert pretraining. (#24350) ... * [Dy2Stat] Add test for bert pretraining. * Construct fake data. * Synchronous random seed of program.	5 years ago
hong	6d8dcc7407	Fix np ndarray mul varbase (#24331) ... * fix numpy ndarray mul var base error; test=develop * add comment for __array_ufunc__ ; test=develop * move unitest from imperative math op path to test_math_op_patch_var_base; test=develop	5 years ago