27 Commits (edc06c6a1b688dd8528be376fe459598c90fc5e5)

Author	SHA1	Message	Date
jakpiase	edc06c6a1b	Added fc + activation fuse pass (currently only gelu, sigmoid and tanh are supported) (#29772)	5 years ago
石晓伟	bd77a4258d	error messages of inference/tests, test=develop (#27259)	5 years ago
Zhaolong Xing	bcddefef39	[Fix Ut]: fix inference ut which exist bug on windows. (#25814) ... * fix windows test test=develop * fix ci test=develop	5 years ago
Zhaolong Xing	e89b12884a	FIx C++ inference BUG: When open memory optim and enable trt subgraph at the same time, there is a bug (#19969) ... * fix memory optimization type test=develop * 1. fix BUG: open trt and memory optim will trigger bug. 2. Clean memory optim bug. test=develop	6 years ago
Tao Luo	b4b169467b	add fc_mkldnn_pass in compare_mkldnn (#17712) ... test=develop	6 years ago
Michał Gallus	0c39b97b4e	[MKL-DNN] Add Fully Connected Op for inference only(#15226) ... * fuse mul and elementwise add to fc * Reimplement the FC forward operator * Fix FC MKLDNN integration by transposing weights * Add FC MKLDNN Pass test=develop * FC MKLDNN Pass: change memcpy to std::copy * Fix MKLDNN FC handling of mismatch input and weights dims * Lower tolerance for MKL-DNN in resnet50 test test=develop * Adjust FC to support MKLDNN Op placement test=develop * Adjust Placement Op to set use_mkldnn attribute for graph test=develop * MKLDNN FC: fix weights format so that gemm version is called test=develop * FC MKLDNN: Remove tolerance decrease from tester_helper * FC MKL-DNN: Refactor the code, change input reorder to weight reorder * MKL-DNN FC: Introduce operator caching test=develop * FC MKL-DNN: Fix the tensor type in ExpectedKernelType test=develop * FC MKL-DNN: fix style changes test=develop * FC MKL-DNN: fallback to native on non-supported dim sizes test=develop * FC MKLDNN: fix CMake paths test=develop * FC MKLDNN: Refine placement pass graph mkldnn attribute test=develop * Fix Transpiler error for fuse_conv_eltwise test=develop * Fix missing STL includes in files test=develop * FC MKL-DNN: Enable new output size computation Also, refine pass to comply with newest interface. test=develop * FC MKL-DNN: enable only when fc_mkldnn_pass is enabled * FC MKL-DNN: Allow Weights to use oi or io format * FC MKL-DNN: Adjust UT to work with correct dims test=develop * Enable MKL DEBUG for resnet50 analyzer test=develop * FC MKL-DNN: Improve Hashing function test=develop * FC MKL-DNN: Fix shape for fc weights in transpiler * FC MKL-DNN: Update input pointer in re-used fc primitive * Add log for not handling fc fuse for unsupported dims test=develop * FC MKL-DNN: Move transpose from pass to Op Kernel test=develop * FC MKL-DNN: Disable transpose in unit test test=develop * FC MKL-DNN: Remove fc_mkldnn_pass from default list * Correct Flag for fake data analyzer tests test=develop * FC MKL-DNN: Add comment about fc mkldnn pass disablement test=develop * FC MKL-DNN: Disable fc in int8 tests test=develop	6 years ago
lijianshe02	daf88968e2	fix bug that saved optimal model path in test_analyzer_save_model con… (#17555) ... * modify saved model path in analyzer_save_model.cc test=develop	6 years ago
tensor-tang	79ed1c76cd	fix bn fuse vardesc and add model saver (#17143) ... * fix bn fuse vardesc and add model saver test=develop * unify save model in test helper test=develop * fix mkdir on windows test=develop * remove magic number use bn bias var desc test=develop	6 years ago
lijianshe02	de26df440b	add SaveOptimModel interface in analysis_predictor.h and test it in a… (#16441) ... * add SaveOptimModel interface in analysis_predictor.h and test it in analyzer_dam_tester and analyzer_resnet50_tester test=develop	6 years ago
Wojciech Uss	9b6a029666	fix dataset reading and add support for full dataset (#16559)	6 years ago
Yan Chunwei	655179089f	AnalysisConfig remove contrib namespace (#15540)	6 years ago
Yan Chunwei	e2818c8608	add dynamic memory optim (#15457)	6 years ago
Yan Chunwei	885c4e57ab	fea/infer memory optim2 (#14953)	6 years ago
bingyanghuang	a152a5c731	Disable conv3d mkldnn in dam (#15335) ... * disable conv3d mkldnn in dam * Add some comments test=develop	6 years ago
Yan Chunwei	875a07c32d	refactor inference analysis api (#14634)	7 years ago
luotao1	13367866cd	add deterministic result unit-test ... test=develop	7 years ago
bingyanghuang	943ad4781f	One possible solution to add flexibility for mkldnn placement pass (#14768) ... * Choose to turn on use_mkldnn attribute v1 * Fix mkldnn_op empty bug * format change test=develop * fix ci test=develop * fix ci test and add test in dam test=develop * add example to dam compare test test=develop * review changes test=develop	7 years ago
Yihua Xu	82eefceabe	Add the profile_mkldnn flag for profile function(test=develop)	7 years ago
Yihua Xu	64e261c6cd	Implement the fusion of convolution and bias for mkldnn ... (test=develop)	7 years ago
ZhenWang	e1da6cd754	add the normal dam and the small dam	7 years ago
ZhenWang	33b4963505	unify the normal and small dam model.	7 years ago
ZhenWang	8f2e556e65	support the small dam model. test=develop	7 years ago
Tao Luo	5ef123c778	Merge branch 'develop' into dam_fc	7 years ago
Yiqun Liu	9e6b1c5f97	Refine tester of TensorRT engine (#14390) ... * Refine the tester for MixedRTPredictor. test=develop * Enable the profiler in TensorRT engine. * Support the use of combined inference model in TensorRT unittest, and print the shape of feed targets.	7 years ago
Tao Luo	e0d4e04bdd	fix some compiler warning ... test=develop	7 years ago
Tao Luo	8ea13e336a	add in_num_col_dims for fc	7 years ago
Zhen Wang	4dbc01841d	Nlp dam (#14248) ... * add dam test * update fuse_statis * use separated dam model. * Revert "use separated dam model." This reverts commit 13e775c86f909b164b7cc1d35a8a24b964ec622e. * test=develop * modify the cmake file about infer test, test=develop. * remove one comment, test=develop.	7 years ago