Paddle

Commit Graph

Author	SHA1	Message	Date
Peihan	6e13e86ab3	verify correctness of dy2static model by using paddle-inference api (#26372 ) * verify correctness of dy2static model by using paddle-inference api * update python doc style	5 years ago
liym27	ac2010f4b6	[Fix test_resnet timeout] Reduce batch_size to 2 to avoid unittest timeout.(#26449 )	5 years ago
liym27	168ea22351	[Dy2Stat-ErrorMessage]Optimize error value to improve readability when error raised in runtime. (#25970 ) * don't remove op_callstack * [Dy2Stat-ErrorMessage] Optimize error value to improve readability if error raised in run-time. 1. update op_callstack with original information; 2. simplify error value to improve readability if error raised in run-time. * Fix error in Python3.	5 years ago
liym27	12bf9d7168	[Dy2Stat-ErrorMessage]Enhance original error and create new exception (#25798 ) * [Dy2Stat-ErrorMessage]Enhance original error and create new exception. test=develop * Delete redundant code and change func name to create_and_update_origin_info_map. * optimize loop_transformer. * fix bug in print_transformer. * Modify code according to the comments.	5 years ago
Chen Weihang	36027490d8	Verify correctness of jit.save/jit.load - part 1 (#25915 )	5 years ago
Aurelius84	8ec4af278d	【Dy2stat】Fix is_test switch incorrectly in PartialProgram (#25809 ) * fix eval() sync problem * add unittest * modify according reviewer * fix unittest failed	5 years ago
liym27	452be8950a	[Dy2Stat-ErrorMessage] Add interface:create_origin_info_map and attach_origin_info for AST node (#25627 ) * Add interface:create_origin_info_map and attach_origin_info for AST node. test=develop * Fix code according to comments from reviewers. test=develop	5 years ago
Chen Weihang	23d1228c4d	remove ProgramTranslator.save_inference_model (#25740 ) * remove ProgramTranslator.save_inference_model * adapt save_quantized_model * revert buffer check implemention * remove useless import function	5 years ago
Aurelius84	ca1185d06b	[Dy2Stat] Fix scope in run_program_op (#25579 ) * add reinforcement learning model test=develop * align backward test=develop * add gym in paddle_build.sh test=develop * rm pip install in script test=develop * refine paddle_build.sh test=develop * fix sed error in macOS test=develop * polish code test=develop * fix scope problem * refine code by reviewer comment	5 years ago
Huihuang Zheng	a0b3c0dde8	Write Simnet Correctly and Enable Multiple Return Test (#25574 ) We found that the reason of multiple return error in SimNet is that I wrote wrong task_mode. If we set task_mode as "pairwise" correctly, which is a format of the model input data, the multiple return won't have problem in the unit test. In this PR we corrected the task_mode and enable multiple return in SimNet unit test.	5 years ago
Aurelius84	1a5d3defb1	[Dy2stat] Add Reinforcement learning unittest (#25445 ) * add reinforcement learning model test=develop * align backward test=develop * add gym in paddle_build.sh test=develop * rm pip install in script test=develop * refine paddle_build.sh test=develop * fix sed error in macOS test=develop * polish code test=develop	5 years ago
Huihuang Zheng	0d8545f818	Enable MNIST Multiple 'return' as Unit Test (#25556 ) Enable multiple "return" statement in MNIST as Unit test in dy2stat.	5 years ago
Huihuang Zheng	d8fe517bf8	Add Support for SelectedRows for Transpose OP and Fix a Bug That SelectedRows Cannot be Supported in SimNet (#25536 ) This PR fixes a bug that SelectedRows cannot be supported in SimNet. The reason of this bug is that dygraph basic_engine didn't copy var's type when the var needs to be accumulated during backward. So when a var is SelectedRows and needs to be accumulated, like SimNet which calls net for two times, the var's type will be changed to default LoDTensor thus bug happens. To fix it, we just also copy the type. Without this PR, the accumulated SelectedRows parameters in dygraph will be changed into LoDTensor. So when we fixed the bug of supporting SelectedRows in SimNet, we found `test_imperative_lod_tensor_to_selected_rows` failed and threw the error that SelectedRows was not supported for Transpose OP. To fix it, too, this PR also added support for SelectedRows for Transpose OP.	5 years ago
liym27	10d572a707	[Dy2stat] Add Seq2Seq Attention model as ProgramTranslator Unit Test (#25422 )	5 years ago
Chen Weihang	41d2247275	[Dy2static] Refactor ProgramTranslator save_inference_model API (#24989 ) * experimental refactoring, test=develop * add TranslatedLayer & remove StaticModelRunner, test=develop * revert tracedlayer change, test=develop * fix test_mnist unittest error, test=develop * add doc & examples, test=develop * polish doc details, test=develop * add imperative.jit module, test=develop * change TranslatedLayer pos, test=develop * adjust jit module import path, test=develop * polish doc based review result * add SaveLoadConfig.separate_params to save paraams separately * add Layer.buffer support, test=develop * polish doc details based review result, test=develop * polish details baesd review comments, test=develop * add empty str check for param, test=develop * add unittests, test=develop * polish details based review comment, test=develop * remove blanks in comment, test=develop * polish doc details, test=develop * update imperative doc link, test=develop * add api attr for load, test=develop	5 years ago
Huihuang Zheng	f9ac5fb992	[Dy2stat] Fix Memory Optimization in run_program_op and Add SimNet as Unit Test (#25383 ) Add Similarity Net as unit test. During the unit test, we found three problems: 1. The run_program_op has memory optimization error when running dy2stat net multiple times. 2. The support for SelectedRows can cause problem in dy2stat. 3. The return grammar has problem. This PR fixes the 1. problem but modify codes for the 2. 3. problems to make PR smaller. I will fix those two problems in the next PR(s)	5 years ago
Aurelius84	619848fa3a	fix timeout test=develop (#25412 )	6 years ago
Huihuang Zheng	30185efdae	Add If-Else-Return of Yolov3 as Unittest (#25385 ) As the title	6 years ago
Aurelius84	23a958cdf1	fix unittest failed test=develop (#25392 )	6 years ago
Zhen Wang	2989c012f2	[DygraphToStatic]Add cast transform for dygraph_to_static. (#25325 ) * add cast transform and its UT for dygraph_to_static.	6 years ago
Aurelius84	bdad383c1d	fix test_mobile_net random failed test=develop (#25364 )	6 years ago
Aurelius84	a3dfff51ad	[Dy2stat] Disable test_lac on windows (#25359 ) * fix test_lac timeout test=develop * disable it on windows test=develop	6 years ago
Aurelius84	ed262b804c	[Dy2stat] Add Sentiment and LAC model for unittest (#25071 ) * add sentiment unittest * add LAC model * add test=develop * rename tmp test=develop * fix timeout test=develop * undo tmp_var test=develop	6 years ago
Aurelius84	82ec247a02	fix random failed on GPU test=develop (#25293 )	6 years ago
Huihuang Zheng	5e8e6dad72	[Dy2stat] Support Various-Length Return Grammar in Dy2stat (#25249 ) Support Various-Length Return Grammar in Dy2stat. This PR is a follow-up of https://github.com/PaddlePaddle/Paddle/pull/25176 . The basic idea is putting no-value placeholder variables at `return` statement to make all `return` statement have same length, after that the static graph can have fixed fetch output (code at return_transformer.py). Then remove those no-value placeholder when we finally return dygraph result (code at partial_program.py). However, various length return in Bert model is still not supported. The dy2stat can change the code as I wish but some ops which check shape at compile time (e.g. Reshape, MatMul) will throw error because of the no-value-placeholder may not have the required shape. Is this a matter? To me, those no-value placeholder will be replaced as really values meeting shape requirements at run time, so I think the solution should be some way to do the compile-time checking. By the way, every time when we have dynamic shape, it often causes problem in dy2stat. We should find a way to handle it in the future. Fixing various return in Bert is my TODO thing and I will also find some other existing models for verification.	6 years ago
Aurelius84	de27569eca	[Dy2Stat] fix diff of cycle GAN model on GPU (#25233 ) * fix GPU diff test=develop * refine code test=develop	6 years ago
Aurelius84	02adf68dcc	[Dy2stat]Support buffers and register_buffer in Layer (#24888 ) * support to save varBase created in __init__ test=develop * polish code test=develop * refine to_static_var test=develop * refine warning test=develop * add unitteset for to_static_var test=develop * fix logger test=develop * polish buffers en doc test=develop * fix param_guard test=develop * refine en doc test=develop	6 years ago
Huihuang Zheng	6f631a27c7	[Dy2stat] Add Basic Support for Grammar 'return' (#25176 ) This PR added basic support for 'return' grammar in dy2stat. It supports the control flow of 'return'. The basics idea is using a return value variable to store the early return statements and boolean state variables with if-else to skip the statements after the return statements. This PR is very basic support. There are some corner cases I didn't develop/test. For example, 'return None', 'return different length of variables', 'return non-tensor and tensor together', 'no return statement'. These corner cases will be done in my next PRs. Target date is this week. Note: 1. for the unit test, I changed test_program_translator.py because the StaticCode of `dyfunc_with_if_else` will change. To guarantee the correctness of `dyfunc_with_if_else`, I also run it in `TestRecursiveReturn` in test_return.py. 2. I commented the early return code in bert_dygraph_model.py because 'return different length of variables' is unsupported now. I also know that there are some other models used early return and we didn't enable it in the unit test. I will add support for it in next PRs and then re-enable those tests.	6 years ago
Aurelius84	cb0472b05a	merge into one function test=develop (#25184 )	6 years ago
Aurelius84	38d2d13d8b	[Dy2stat] Add CycleGAN model for unitttest (#25072 ) * add cycle_gan_model * align train test=develop * modify image_size into 64 to avoid TimeOut test=develop * TODO in GPU test=develop	6 years ago
Aurelius84	e8134e873a	[Dy2stat]Refine caches of converting function (#25085 ) * Refine caches of converting func test=develop * fix if statement test=develop * refine cache code test=develop * rm unuse import statement test=develop * Polish code comment test=develop	6 years ago
Chen Weihang	509d3ec5b7	[Dy2static] Add for iterate or enumerate variable list unittest (#25100 ) * add for iter var list, test=develop * add enumerate unittest, test=develop	6 years ago
liym27	eb1c0901a6	[Dy2Stat]Remove unnecessary vars from gast.comprehension in LoopTransformer. (#25094 )	6 years ago
liym27	db601f70cc	[Dy2Stat] Add test for dygraph seq2seq model. (#25054 ) * The arg of append() can be not Tensor temporarily. * Add Seq2Seq as ProgramTranslator Unit Test. * set dtype of vocab_size_tensor to int64 to pass Windows-CI.	6 years ago
Huihuang Zheng	21138c05a8	Add test_yolov3 and test_se_resnet Timeout (#25076 ) Some big models can timeout on Windows CPU machine. I added some timeout properties.	6 years ago
Huihuang Zheng	9b5b726729	[Dy2stat] Add TSM as ProgramTranslator Unit Test. (#25008 ) Add TSM as ProgramTranslator Unit Test. The TSM code is referred from PaddlePaddle/models#4229	6 years ago
Aurelius84	0b6145e056	[Dy2stat] Add MobileNet model unittest (#25018 ) * add MobileNet unittest test=develop * fix cudnn random test=develop	6 years ago
liym27	f16e277859	[Dy2Static]Convert var.shape stmt and Convert the return variables of Tensor-dependent 'if' staments to Tensor if it not (#24911 ) * Support int and long: int or long -> six.integer_types. * Modify test_tensor_shape: fix bug and modify comment. * Support convert_var_shape to convert var.shape stmt * Modify code in ifelse_simple_func.py because don't support return non-Tensor in Tensor-dependent 'if' stament currently. * Convert the return variables of Tensor-dependent 'if' staments to Tensor if it not. test=develop	6 years ago
Huihuang Zheng	28d074e956	[Dy2stat] Decrease test_yolov3 GPU usage (#24955 ) [Dy2stat] decrease the batch size to decrease GPU usage.	6 years ago
liym27	2e238c6eed	[[Dy2Static]]convert for stmt and support variable loaded and created in loop(#24901 ) * Move function 'convert_len' to file convert_operators.py * Support that for statements are transformed to while statements. * Fix bug: raise None -> return None. * Support variable loaded and created in loop. * Use int64 in Py2 and Py3 in function to_static_variable.	6 years ago
Huihuang Zheng	97708add66	[Dy2stat] Add word2vec as unittest (#24944 ) [Dy2stat] Add word2vec as unittest	6 years ago
liym27	a9dca5805a	[Dy2Static] Add convert_ifelse to run the transformed code dynamically (#24866 ) * cast var in convert_logical_XX. * Add convert_ifelse function in convert_operators.py * Add logical_transformer. Remove LogicalTransformer from loop_transformer.py * Revert modified tests in PR24799(convert_while_stmt). * Comment and modify code that doesn't support `return` statement. * Remove unnecessary class: MergeAssignTransformer, NodeTestTransformer and IfConditionVisitor in ifelse_transformer.	6 years ago
Huihuang Zheng	71fb62c298	[Dy2stat] Fix windows dy2stat test_yolov3 random failure (#24908 ) The random failure at Windows may due to some random gt_boxes can cause some numbers in YoloV3 to be negative thus access the invalid memory. This PR tries to solve it.	6 years ago
Huihuang Zheng	5a5497a5e4	[Dy2stat] Add Yolov3 as Unit Test (#24879 ) Add Yolov3 as ProgramTranslator Unit Test. The YoloV3 code is referred from PaddlePaddle/models/dygraph/yolov3	6 years ago
Aurelius84	9bbb9542ca	[Dy2stat]Add BMN model for unittest (#24839 ) * add test_bmn_model test=develop * remove random test=develop	6 years ago
Chen Weihang	a1c1b59d48	[Dy2Static] Support for iter & enumerate VarBase (#24856 ) * support for iter & enumerate varbase, test=develop * revert IsControlFlowVisitor change, test=develop	6 years ago
liym27	5ea82e8a45	[Dy2Static]Support return variable created in only one of If.body or If.orelse (#24841 ) * Support return variable in only one of if body or else. * remove after_visit in IfElseTransformer. * Modify the result of get_name_ids in test_ifelse_basic.py * Add unittest to test the new case. * Modify code according to reviews.	6 years ago
liym27	001c9fcca2	[Dy2Static]Convert while stmt and convert logical_XX (#24799 ) * Support convert_while_loop. * Comment code that not supported 'if' in test_break_continue. * Convert int into tensor to support 'if' stmt in for/while loop. * Add unittest to test all cases of convert_logical_XX. * Add unittest to test all cases of convert_while_loop. * Fix bug in LogicalOpTransformer. test=develop	6 years ago
Aurelius84	8bbb829a03	[Dy2stat]Support nested input and output (#24752 ) * support nested input and output test=develop * remove code of convert type(output) in unittest test=develop * add warning test=develop	6 years ago
liym27	080d37a501	fix bug in LogicalOpTransformer: Create logic node recursively (#24785 )	6 years ago

1 2 3

126 Commits (dea7d7d1739d6463258fcc3670e343cb55de781c)