190 Commits (12e4be038262fcb33b089710edaed2fe62320e3d)

Author	SHA1	Message	Date
Guo Sheng	bd99df715a	Fix basic_gru and docs of gru_unit and dynamic_gru (#19393) ... * Fix docs of gru_unit and dynamic_gru. Fix basic_gru in rnn_impl.py. Add error messages for param_attr setting in layer_norm api. Add int64 dtype for expand. test=develop * Reopen unit-tests of basic_gru/basic_lstm in rnn_impl.py. test=develop * Add unit test for layer_norm api. test=develop * Remove the deprecated gru doc fix. test=develop * Fix basic_gru test coverage. test=develop * Update API.spec. test=develop * Update API.spec. test=develop * Fix test_basic_gru coverage test. test=develop * Update test_basic_gru in test_layers to use fluid.data test=develop * Update test_basic_gru for coverage. test=develop	7 years ago
bingyanghuang	a5f530a8f9	Update QAT MKL-DNN readme doc (#20029)	7 years ago
Liufang Sang	86c2c362ae	fix fuse_reduce_op quantization bug (#20306) ... * fix fuse_reduce_op quantization bug test=develop * close fuse_all_reduce_ops in PaddleSlim, test=develop	7 years ago
Michał Gallus	540935a825	[Bug-fix][1.6] Improve QAT accuracy (#20174) ... * Leave fake quantization around mul * Replace Fake with Real Quantized Mul * Gather all scales from fake_quantize_ops * Enable uint8 in conv_relu tensors * Disable int8 mul and restore fake mul * Fix buf for running QAT on VGG16 and 19	7 years ago
gongweibao	7b9e33972a	delete backward return list test=develop (#20294)	7 years ago
xiteng1988	3785f08f68	fix next_tokens of controller (#20060) ... * fix next_tokens of controller	7 years ago
bingyanghuang	9de6772510	Follow comment of Merged QAT PR 18970 (#19979) ... * Follow Wangzhen's comment in PR 18970, test=develop * Review comments, test=develop * Leave fake quantization around mul test=develop * Replace Fake with Real Quantized Mul test=develop * Fix bug in quantize placement pass Nodes in the graph now have checked type instead of node name when they are to be marked for quantization test=develop	7 years ago
Bai Yifan	28a559de12	fix PyReader._iterable usage, test=develop (#20045)	7 years ago
whs	3ea2b661c0	Make PaddleSlim support PyReader (#19995) ... * Make PaddleSlim support PyReader. * Fix unittest of sensitive pruning. * Add some assert.	7 years ago
Wojciech Uss	4286a6270d	Add support for new QAT models (#18970) ... * Add support for new QAT models test=develop Co-Authored-By: Michał Gallus <michal.gallus@intel.com> Co-Authored-By: Wojciech Uss <wojciech.uss@intel.com> * fixed fps results test=develop * fix top5 accuracy drop problem * updated for new QAT models * skip quantizing average pooling - dirty but working * add missing pass * added missing conv+brelu fuse pass * removed a call to non-existent pass test=develop * renamed pass test=develop * Adjust finding pooling scale to newest QAT models * Remove unnecessary code from quantization_mkldnn_pass * Copy Pooling input scale to output scale in QAT * Refactor & remove unused code in QAT * Incorporate fp32 FC into QAT test=develop * Enable graph drawing with debug flag test=develop * Add tests for QATv2 * Fix paths for QATv2 models test=develop * Add option to save transformed int8 qat model test=develop * Remove redundant lines from qat mkldnn pass test=develop * Delegate disablement of avg pooling to qat test=develop * fix CI bug, test=develop * Follow Wangzhen's Review, test=develop * Update API.spec test=develop * Name False in (is_unsigned, TensorScale) tuple test=develop	7 years ago
jhjiangcs	766bd529d1	add optimizer:dpsgd,test=develop (#19915)	7 years ago
whs	bdb3e376d0	[PaddleSlim] Enhence compressor api in PaddleSlim (#19894) ... 1. Support customize eval function instead of eval program. 2. Fix loading checkpoint in quantization strategy. 3. Support saving eval model when saving a checkpoint. 4. Fix decoder of loading context in PaddleSlim. 5. Fix restoring from the checkpoint of uniform prune strategy. 6. Support saving eval model and infer model during training. 7. Add ‘unitest’ for saving eval model, saving infer model and uniform pruning restoring from the checkpoint. 8. Fix pruning of depthwise_conv_grad op by updating the groups.	7 years ago
juncaipeng	b0ceed6fb4	add fake_quant_dequant_op for average pool2d, test=develop (#19880) ... * add fake_quant_dequant_op for average pool2d * add test	7 years ago
Tao Luo	a4919d3688	move tree_conv to fluid.contrib.layers (#19918) ... * move tree_conv to fluid.contrib.layers test=develop * update API.spec for tree_conv test=develop * update tree_conv api to increase unit coverage test=develop	7 years ago
Aurelius84	418a0967f3	move match_matrix var_conv2d et.al api into fluid.contrib test=develop (#19859)	7 years ago
Jie Fang	d9db94d752	Optimize amp for multi-gpu to enable FP16 gradients transfer across gpus. (#19714) ... Optimize amp for multi-gpu to enable FP16 gradients transfer across gpus	7 years ago
Bai Yifan	e2c6bada36	Support dispensable student_loss in PaddleSlim distillation (#19824) ... * support_dispensable_student_loss, test=develop * add distillation test, test=develop * fix distillation test non convergence problem, test=develop * fix test_distillation fail problem, test=develop	7 years ago
Bai Yifan	aa63d5ac6d	Make the distillation process not save teacher variables in PaddleSlim (#19633) ... * split teacher checkpoints with student checkpoints, test=develop * add unittest for graph.merge(), test=develop	7 years ago
gongweibao	6c2bc29cc0	Fix float16 optimizer. (#19682) ... Fix float16 optimizer	7 years ago
Chen Weihang	73daa3d6c0	Code Cleanup: delete three useless raw variables in Conv2D (#19644) ... * delete useless raw variables in Conv2D, test=develop * adjust the vars number in test_graph_wrapper to pass unittest, test=develop	7 years ago
Jie Fang	c6a598a276	init new amp, optimize inserting cast op for batchnorm (#18596) ... init new amp, optimize inserting cast op for batchnorm	7 years ago
123malin	2f037c3189	fix the diff between async mode and async_half mode (#19535) ... * test=develop, communicator merge add => merge average	7 years ago
whs	1c2aae567a	Skip start epoch and end epoch when dumping strategy in PaddleSlim (#19580) ... test=develop	7 years ago
gongweibao	abaf87be2b	Change backward_guard to optimize_guard to maximize the allreduce overlap. (#19506) ... Change backward_guard to optimize_guard to maximize the allreduce overlap	7 years ago
Zeng Jinle	5dce1da680	remove reset recordio usage (#19519)	7 years ago
lidanqing	ba368bf696	clean up intel labeled TODOs (#19476) ... test=develop	7 years ago
Leo Chen	6fb310ae29	Fix bug of getting bool Flags from os.environ (#19349) ... * fix bug of getting bool Flags from os.environ, test=develop * add empty loss_name in CompiledProgram for inplace grad test, test=develop	7 years ago
liu zhengxi	32598ffd8f	Python infer api update and add unit test (#19353) ... * python inference api supports numpy and add unit test, fix unit test fail in test_slim_int8_googlenet and test_slim_int8_mobilenet	7 years ago
Jiancheng Li	1799c257ad	Update Light-NAS to support latency-aware search (#19050) ... * update light_nas_strategy: add latency constraint test=develop * update light_nas_strategy: update get_model_latency test=develop * update light_nas_strategy: add more check test=develop * update light_nas test test=develop * update light_nas test test=develop * minor update light_nas test test=develop * minor update light_nas test test=develop * update light_nas test test=develop * update _constrain_func of light_nas_strategy test=develop * update _constrain_func of light_nas_strategy test=develop * remove unused code test=develop	7 years ago
Zhen Wang	0fe72469ea	Add the max-pool2d quantization support and the partial quantization support. (#19310) ... * add pool2d quantization support, only for max-pooling. * add the partial quantization support.	7 years ago
Tao Luo	2f8c7e021f	remove unused inference_transpiler unit-tests (#19130) ... * remove unused inference_transpiler unit-tests test=develop * remove InferenceTranspiler usage in quantize_transpiler.py test=develop	7 years ago
yaoxuefeng	9150cf50fc	add save cache model api in fleet& add slots shuffle in dataset module & add metric op to calculate ctr related metrics (#18871) ... * add ctr related metric layer test=develop * add save cache and slots shuffle test=develop * add save cache and slots shuffle test=develop * fix error * fix error * fix style for ci * fix for comments * change SlotsShuffle input to std::strinf for generality * fix style * fix style * fix style * fix style * fix style * fix style * fix stylr * fix style * fix style * fix style * fix style * fix style * fix style * fix style * fix style * fix style * fix style * fix style * fix style * fix style * change non-const reference to pointer * fix style * fix style * fix style test=develop * fix style test=develop * add return ins num in ctr metric op * change dtype to float in metric_op.py * fix error test=develop * fix style test=develop * fix API spec * fix API spec * fix API spec test=develop * add UT test=develop	7 years ago
chengduo	01c7daade7	Add checking for the fetch_list of Executor.run (#18957) ... * update exe.run	7 years ago
whs	c92b78b060	Fix unitest of light nas. (#18931) ... test=develop	7 years ago
tangwei12	d845848341	do some odd jobs (#18641) ... do some odd jobs, test=develop	7 years ago
guru4elephant	5ed713d519	remove ctr reader, all functions are satisfied in dataset (#18672) ... * remove ctr reader, all functions are satisfied in dataset	7 years ago
bingyanghuang	a25be53cb5	QAT int8 MKL-DNN transformation pass with MUL (#18322)	7 years ago
Jie Fang	2b4ef509ea	init custom black white list (#18377) ... test=develop	7 years ago
Wojciech Uss	8ed819d8e4	Call the test_slim_int8_* tests through absolute path (#18386) ... test=develop	7 years ago
翟飞跃	19da59ed3f	Remove all the code, API and doc of MKL-DNN INT8v1 (#18347)	7 years ago
whs	1bdfd2eb85	Fix checkpoint of Light-NAS (#18330) ... Socket can't be pickled. test=develop	7 years ago
Hongyu Liu	df2eee71d8	Sequence mask support tensor (#18249) ... * sequnce mask support max length tensor input; test=develop * add rnn_impl.py; test=develop * add basic gru lstm unittest; test=develop * fix api spec; test=develop * fix sequence_mask op bug; test=develop test=document_preview * change +-*x to elmentwise_op; test=develop * add mkl flag; test=develop * fix rnn impl bug; test=develop * update api spec; test=develop * fix doc bug; test=develop * fix lstm bugs; test=develop	7 years ago
Jie Fang	172c2facef	init black/white lists (#17847) ... test=develop	7 years ago
songhao	6b3d96254d	fix some bug when merge sparse embedding parameters, test=develop (#18223) ... 1. fix the bug that out_put_var in SaveSelectedRows would be empty string 2. use merge_sparse_lookup_table to replace sum op for load_persistables_for_inference 3. fix the bug in _clone_var_in_block_ when the var is SELECTED_ROWS.	7 years ago
Wojciech Uss	36b60e240a	Enable MKL-DNN for slim FP32 vs. INT8 tests (#18214) ... * Enable MKL-DNN for slim FP32 vs. INT8 tests test=develop * added test for MobileNetV1 with MKL-DNN test=develop	7 years ago
bingyanghuang	976cf46010	slim QAT MKL-DNN readme (#18187) ... * QAT doc first version * follow the comments, test=develop * update the benchmark, test=develop * Change to channel-wise, test=develop	7 years ago
chengduo	5588b923f3	Add multi process reader (#18115) ... * add multi process reader test=develop	7 years ago
翟飞跃	802ea50956	fix spelling errors (#17941) ... * fix spelling errors; test=develop * Update API.spec update md5 * Update API.spec * change the order of api;test=develop	7 years ago
翟飞跃	78441c5449	add mkldnn Int8v2 slim doc (#17909)	7 years ago
翟飞跃	c2fb9b906a	change dirname mobilenet to mobilenetv1 (#18160)	7 years ago