ab610a34ff
transpose_mkldnn code change to meet Paddle standards ( #22591 )
5 years ago
8f035fb637
Add TopK Op Grad CPU&GPU Kernel test=develop ( #22628 )
...
* Add TopK Op Grad CPU&GPU Kernel test=develop
* Add TopK Op Grad, modify grad op maker test=develop
* Add TopK Op Grad, modify grad op maker test=develop
* Add TopK Op Grad, modify PADDLE_ENFORCE test=develop
* Add TopK Op Grad, modify PADDLE_THROW test=develop
* Add TopK Op Grad, modify unittest test=develop
* fix ngraph top k op unittest test=develop
5 years ago
90ee366653
update ops's unittest data type from float32 to float64 and shape over 100 ( #22544 )
...
* update ops's unittest of elementwise_pow, elementwise_max, elementwise_min, scale and sqrt
1. update elementwise_pow, elementwise_max and scale's unitests with input data type (float32 -> float64)
2. fix bug that the elementwise_pow doesn't meet threshold requirements with tackling float64 data
3. remove sqrt from op_accuracy_white_list.py
4. update the unittests of elementwise_pow, elementwise_max and elementwise_min ops that their input data shape over 100
5. test=develop
* modify the writing style according suggestions
test=develop
5 years ago
f7eafca828
remove python inference warning ( #22602 )
5 years ago
fe685cc185
fix enforce test error, test=develop ( #22610 )
5 years ago
9a8203aa25
fix fc_lstm_fuse when multi sub-graph use same fc_bias. test=develop ( #22551 )
...
当一个模型中有多个fc_lstm子图的时候，且其中fc共用了同一个persistable的bias，此时不应该将bias节点删除，只将非persistable的节点去除即可。
5 years ago
266106da75
Fix mismatch with plus sign in the line ( #22588 )
...
* reproduce match error, test=develop, test=document_fix
* fix mismatch error, test=develop, test=document_fix
5 years ago
1d503e6a9e
Golang inference API ( #22503 )
...
* support golang inference
5 years ago
8acd745c25
[Ernie GPU Optim]: Fuse three fc to multihtead matmul ( #22486 )
...
* 1. optim multihead matmul: fuse three fc to multihtead matmul
test=develop
* fix conflict
test=develop
* fix comments
test=develop
5 years ago
96770f519e
Disable fusion_group for windows and mac in build_strategy. ( #22549 )
...
test=develop
5 years ago
08033c8634
fix traced layer with non persistable vars, test=develop ( #22552 )
5 years ago
31b5464632
Add support for dynamic_decode(while) training. ( #22231 )
...
* Add support for dynamic_decode(while) training. test=develop
* Fix assign_op and tensor_array_read_write_op after solving conflict. test=develop
* Fix test_rnn_decode_api.py. test=develop
* Refine docs for apis in rnn.py. test=develop
* Adjust outputs of dynamic_decode. test=develop
* Remove the force_cpu update in assign_op. test=develop
* Remove the force_cpu update in assign_op. test=develop
* Make RNNCell.get_initial_states support batch_dim_idx argument. test=develop
* Rename _create_array_outof_while as _create_array_out_of_while in rnn.py.
test=develop
5 years ago
b0675c8193
fix bug with compiledProgram ( #22495 )
...
* add thread barrier for the compiled program
5 years ago
4cddb43c5c
Add support for Ernie NLP model to the Slim QAT ( #22506 )
...
* a test for Ernie QAT INT8 accuracy check
test=develop
* Remove NLP comparison test to split PRs
test=develop
* Fix typo and tabs, delete commented lines
test=develop
* re-combine the 2 PRs, test=develop
Co-authored-by: Michał Gallus <sand3r@interia.eu>
Co-authored-by: bingyanghuang <33643817+bingyanghuang@users.noreply.github.com>
5 years ago
58d99247f4
support slice double grad, test=develop ( #22166 )
...
* support slice double grad, test=develop
* merge two doublegradopmaker to one doublegradopmaker,test=develop
* change the shape of slice_OP's unittest, test=develop
5 years ago
1a7962be97
Paddlebox about box_wrapper ( #22497 )
...
Refine PaddleBox Framework, Main functions:
* Add MetricMsg util class, which can calculate metrics like AUC, bucket_error, COPC.
* Replace FeedPass with new interface: BeginFeedPass & EndFeedPass
* Refactor Pull/Push Sparse Function in box_wrapper.
* Use CUDA Kernel to copy keys and copy feasign between tensor and boxps struct.
* Cache copied keys in pull sparse in order to reuse it in push period.
5 years ago
9e29d3ebed
【OpPorting Example】DEMO OF FIX COMPILE&RUNTIME LOD_EQUALITY ( #22460 )
5 years ago
2235ee1a5e
multi-loss optimization by adding a DownpourOpt worker ( #22025 )
...
* update
* update test=develop
* update compile set test=develop
* update compile set test=develop
* update test=develop
* update test=develop
* update test=develop
* update compile setting test=develop
* update compile setting test=develop
* update run demo test=develop
* update test=develop
* update test=develop
* fix test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update format test=develop
* update format test=develop
* update style test=develop
* update style test=develop
* change style test=develop
* change style test=develop
* change style test=develop
* add dataset unittest test=develop
* update test=develop
* update for record test=develop
* udpate style for record test=develop
* update for record test=develop
* update for record test=develop
* update for record test=develop
* fix format test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
5 years ago
54970444ce
Improve transpose performance with tile sm copy, test=develop ( #22311 )
...
* Refine code, fix select tile error,test=develop
* Refine element type and some comments, test=develop
* Refine comments and gpu utils, test=develop
* Remove some useless condition
* Refine floor and ceil, test=develop
* refine for loop. test=develop
Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com>
5 years ago
a90fa54092
Compile without nccl deps. [1/2] ( #22509 )
...
支持不依赖nccl进行编译。[1/2]
多卡下，如果没有打开WITH_NCCL开关编译，多卡不能通信，则只能选择一张卡使用。
Co-authored-by: 石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>
5 years ago
3a59a7a11f
Make assign op support LoDTensorArray and modify while_loop API ( #22309 )
...
This PR makes assign op support LoDTensorArray and enable the loop_vars in
while_loop to support tuple or list.
5 years ago
54a325a52f
[Refine Paddle-TRT INT8]: Support PaddleSlim's Resnet50, Mobilenetv1, Yolov3 models for Inference. ( #22483 )
...
* add int8 op teller for trt.
* refine trt int8
* add int8 op teller for trt.
test=develop
5 years ago
5739eeb9fa
add cp27-cp27m-gcc82 and cp27-cp27mu-gcc82 branch to support gcc8.2 compile for paddle, test=develop ( #22504 )
5 years ago
de009152a7
Compile without nccl deps. [2/2] ( #22484 )
...
Compile without nccl deps. [1/2]
Co-authored-by: 石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>
5 years ago
4b2227e958
Fix dismatch of std::max's arguments type on windows. ( #22507 )
...
test=develop
5 years ago
870f465887
fix test_fusion_seqpool_concat lod level between compile and runtime ( #22488 )
5 years ago
a61d09527b
Fix the integer overflow problem of sequence2batch ( #22479 )
...
Fix the integer overflow problem in the op of sequence2batch, change the int32_t to size_t，
In the /paddle/fluid/operators/math/sequence2batch.h#L122.
5 years ago
197913ebe1
Add weight quantization in post_training_quanzitaion ( #22445 )
...
* support weight quantization in post_training_quanzitaion, test=develop
* add test for weight quantization, test=develop
5 years ago
dcfb603897
Enable the detection of subgraph composed of grad ops ( #21223 )
...
* Add the first implememtation of fusion_group op #19621 (#3 )
* Add the dynamic load of nvrtc, and support runtime compiling of CUDA kernel using nvrtc.
test=develop
* Call CUDA driver api to launch the kernel compiled by nvrtc.
test=develop
* Disable for mac and windows.
test=develop
* Refine the codes to support manually specified num_threads and workload_per_thread.
test=develop
* Refine the CUDA kernel to support large dims.
test=develop
* Add DeviceCodePool to manage all device codes.
* Add the first implementation fusion_group op.
* Add unit-test for fusion_group op.
* Add the check of result.
* Add the check of nvrtc in unit-test.
test=develop
* Add comment to explain the inputs, outputs and features of fusion_group op.
test=develop
* Disable fusion_group op for mac and windows.
test=develop
* Make the compiling of device code return status instead of hanging up.
test=develop
* Add the check of whether there is CUDA driver library, and do not core dump when failing to call the CUDA driver API.
* Unify fusion_group_op's input and output names.
test=develop
* Add the check of CUDA driver library in unittest.
test=develop
* Enable generating code for a given subgraph. #21126 (#4 )
* Enable generating code for a given subgraph.
* Support sorting the subgraph.
* Remove the rearange of expressions because we use the sorted subgraph directly.
* Enable generating code for a subgraph which is composed of grad ops.
* Use expression information to check the accuracy in unittest.
* Separate load and store from computation expressions.
test=develop
* Improve the loading statements in generated codes.
test=develop
* Remove unused arguments from formal list.
test=develop
* Enable the detection of subgraph of grad ops.
* Generate code for detected subgraph in fusion_group_pass.
* Add an option in BuildStrategy to enable fusion_group_pass and add unittest.
test=develop
* Fix a bug when checking whether the shape of all inputs are the same.
* Add debug information.
* Remove subgraph_detector from inference/analysis to the common framework/ir directory. (#5 )
test=develop
* Call subgraph_detector in fusion_group pass.
test=develop
* Disable fusion_group when WITH_GPU is OFF.
test=develop
* Refine all PADDLE_ENFORCE message.
test=develop
* Fix the case that some inputs are not defined in grad ops, and set op_role for fused op.
test=develop
* Follow review comments.
test=develop
5 years ago
7c9ce097f1
refine reshape_op shape error message ( #22480 )
...
test=develop
5 years ago
2b1386b2b2
optimize performance of interpolate op ( #22436 )
...
* optimize interpolate op, test=develop
5 years ago
77dd0d97bb
use enum class to replace the usage of enum in some condition test=develop ( #22464 )
5 years ago
44b45b9f07
Correct the use of DeviceContext in unittest sequence_pooling_test and sequence_padding_test ( #22456 )
...
* Add log in memory::Copy for debug purpose.
* Change to use context in DeviceContextPool directly in sequence_pooling_test, instead to new one.
* Change to use context in DeviceContextPool directly in sequence_padding_test, instead to new one.
test=develop
* Change the type of second_dim from size_t to int64_t.
test=develop
5 years ago
17f2c0899f
Add dequant-scale squash ( #22409 )
...
* Add dequant scale squash
test=develop
* Correct dequant-scale squash test
test=develop
5 years ago
9c4deedbc2
update readme of imdb training demo ( #22455 )
...
* update readme
* test=develop
5 years ago
ceda0b9b1a
[Fix BUG]: Core when multi thread + clone + paddle-trt ( #22442 )
...
* add mutex for trt engine
test=develop
* add the test for copy_to_cpu
test=develop
5 years ago
7bc4b09500
add WITH_NCCL option for cmake. ( #22384 )
...
cmake选项中添加了WITH_NCCL，显示指定是否编译NCCL的部分代码，WITH_NCCL默认打开，但如果WITH_GPU为OFF，则关闭WITH_NCCL
添加了PADDLE_WITH_NCCL定义
单机单卡能够关闭NCCL编译，多卡的话需要默认打开NCCL，如果关闭NCCL，则只能使用单卡
Co-authored-by: 石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>
5 years ago
943cb8c664
fix sigmoid cudnn bug ( #22439 )
...
* Sigmoid bug fix, test=develop
* fix code format
test=develop
Co-authored-by: Manjunath Bhat <manjunathbhat9920@gmail.com>
5 years ago
d51ffe860a
fix copy table bug ( #22432 )
...
* fix copy table bug of lost some feasign
* test=develop
5 years ago
822e5b36ec
Support int16 for Tensor ( #22423 )
...
* add int16 support, test=develop
* add test, test=develop
* fix typo, test=develop
* fix dtype error in slice, test=develop
5 years ago
e1b0d7cbb1
remove anakin from code, test=develop ( #22420 )
5 years ago
0404e7a985
Update the precision of pad, pad2d, pad_constant_like's unit tests from fp32 to fp64 ( #22394 )
...
* update the ut precision of pad pad2d pad_constant_like from fp32 to fp64, test=develop
5 years ago
371f377bea
add GeneralRoleMaker ( #22295 )
...
* add GeneralRoleMaker which is for general usage
* test=develop
5 years ago
269db0d1d1
[DNNL] Fix accuracy in INT8 FC ( #22404 )
...
* Enable quantize to reorder to nchw as well
* Correct FC MKL-DNN input dim requirements to accept 3D
* Improve DNNL FC format, error and 3D input handling
test=develop
* Improve error checking in FC
test=develop
* Improve PADDLE_ENFORCE messages in fc-related files
* Remove data layout attribute from obligatory pass args
test=develop
* Fix message in fc_mkldnn_pass to be logically correct
test=develop
5 years ago
fb3086fd57
[UT coverage]Remove unnecessary transpose op registration ( #22402 )
5 years ago
ade5022681
[UT Coverage]Improve sum_mkldnn_op line coverage ( #22275 )
5 years ago
3099d9d47c
Restore requantize squash ( #22399 )
5 years ago
92462e948d
improve elementwise_add_mkldnn_op test code coverage ( #22359 )
5 years ago
20f30dd604
add benchmark flag for conv_transpose ( #22389 )
5 years ago
b96c7c9a7a
polish code, test=develop ( #22380 )
...
remove unnecessary template.
5 years ago
8f36c39537
Fix GEO-SGD init & send Bug ( #22375 )
...
* test=develop, fix geo Send & Init
5 years ago
c6f888e5a5
update unittest accuracy to float64 for relu, prelu, maxout ( #22273 )
5 years ago
0d8b222b79
Optimize the depthwise op test=develop ( #22265 )
5 years ago
aaa4fe491a
use function instead of lambda, test=develop ( #22348 )
...
* use function instead of lambda, test=develop
* follow comments, test=develop
5 years ago
e7a9f6bbb7
[Bugfix] Preserve shape in inpalce operators ( #22360 )
5 years ago
2d20869c94
Fix infer_shape in compling for elementwise_op ( #22291 )
5 years ago
b7cac50b64
Implement a common python unittest to test the ir passes. ( #22209 )
...
* Implement a common python unittest to test the ir passes.
test=develop
* Save the results in np.array and support to startup on CPU.
test=develop
* Fix the unittest.
test=develop
* Add check_program to check whether the optimized program is different from the origin one.
test=develop
* Remove the inferface all_ops.
test=develop
* Add exception test in pass_test.
test=develop
5 years ago
82bc814a57
integrated HALF_ASYNC to communicator ( #21869 )
...
* add half_async in the communicator
* fix DistributedStrategy
5 years ago
1e932eccfa
remove unused code test=develop ( #22327 )
5 years ago
3e5744aa65
Remove unused inputs for some operators ( #22284 )
...
* remove unused inputs, test=develop
* remove unused inputs, test=develop
* update dtype, test=develop
* remove unused inputs, test=develop
* update op_use_default_grad_op_maker, tese=develop
* resolve conflicts, test=develop
* follow comments, test=develop
* update center_loss_grad, test=develop
5 years ago
805328e13b
fix typo in error message ( #22312 )
5 years ago
895f8da7d6
change std::cout to log(INFO), vlog ( #22316 )
5 years ago
8cb04664b9
revert paddle_fluid.map, test=develop ( #22236 )
5 years ago
35efbe6d95
Speeding up dygraph DataLoader with multiprocessing ( #21762 )
...
* add multiprocess for dygraph data loader, test=develop
* polish code & add safe gurad, test=develop
* refactor dygraph dataloader & add signal handler, test=develop
* fix member initializer compile error on ci, test=develop
* fix member initializer compile error one more, test=develop
* remove useless config, test=develop
* skip windows incompatible problem, test=develop
* add unittest for coverage, test=coverage
* add more exception unittest case, test=develop
* deal with signal handler coverage, test=develop
* polish code & add signal handler tests, test=develop
* deal with coverage ci problem, test=develop
* split data loader test & coverage ci fix, test=develop
* remove test_imperative_data_loader_with_exception, test=develop
* remove singal process except test case, test=develop
* add exception tests again & remove sample list test, test=develop
* split normal and exception unittests to diff class, test=develop
* polish doc for use_multiprocess effect in static mode, test=develop
5 years ago
9435533adf
remove op_use_default_grad_op_maker.spec, test=develop, test=document_fix ( #22300 )
5 years ago
7b76a76495
fix the conda build confilict test=develop ( #22279 )
5 years ago
5e601a92ad
polish grad op check ( #22290 )
...
* polish grad op check, test=develop, test=document_fix
* keep op_use_default_grad_maker.spec to avoid conflict, test=develop, test=document_fix
5 years ago
faba4b116a
Remove disable flag in test_fsp_op.py ( #22171 )
...
* fix fsp_op, test=develop
* fix fsp grad op maker, test=develop
* update op_use_default_grad_op_maker.spec, test=develop
5 years ago
e40cfb1010
fix the bug of assert_is_op_output. test=develop ( #22262 )
5 years ago
d3a6647372
improve placement pass tests code coverage ( #22197 )
5 years ago
07afc29e90
Make api.cc malloc consistent with paddle_api.h for PaddleBuf ( #22255 )
5 years ago
4f1da4adcb
remove the useless third_party library from C++ inference library ( #22021 )
...
* remove the useless third_party library from C++ inference library
* revert removing the install directory
5 years ago
549e6de7ac
faster build by reduce by-product, reduce linking library and fix compile warning of std=c++11 ( #22164 )
5 years ago
e3a457d34b
add collective communication library in fleet ( #22211 )
...
* add collective communication library in fleet to replace mpi
* test=develop
5 years ago
f2522e91c4
fix the type error caused by setting bool attr in OpDesc. test=develop ( #22257 )
5 years ago
0ba1d140d4
Add CI check for sequence ops' unittests ( #21615 )
5 years ago
1b76e789cf
remove cuda allocator ctor, test=develop ( #22212 )
5 years ago
9942d9ed5c
Add caching mechanizm to requantize_mkldnn_op ( #22223 )
5 years ago
1230c110cb
[fluid-lite] adjust to relative error ( #22232 )
...
- fluid和lite精度比较替换为相对误差
5 years ago
985bceac53
Bug fix for sparse recorder ( #21969 )
...
* test=develop, bug fix for sparse recorder
5 years ago
fc0b21e17b
Polish fetch error message of parallel executor ( #22206 )
...
* polish error message of parallel executor, test=develop
* change PADDLE_ENFORCE, test=develop
5 years ago
2e90c4eb0a
improve mkldnn_quantizer_config test code coverage ( #22216 )
5 years ago
5750152e80
support fluid-lite subgraph run resnet test=develop ( #22191 )
...
- 添加了fluid-lite子图方式运行resnet的单测
- 修改了依赖Lite的git commit id
5 years ago
621d3e0b66
fix the bug of profile update ( #22207 )
...
* fix the bug of profile update test=develop
5 years ago
443a713c9e
add backward gradient computation for op argsort ( #22203 )
...
* add backward gradient computation for op argsort test=developo
* use pre-commit test=develop
5 years ago
46189b166d
Add bn and relu fuse pass ( #22048 )
...
* add bn and relu fuse pass
* add op attr assert and dtype assert
* fix some inputs&&outputs bugs for the fused op and pattern.
* add the unittest for fuse_bn_act_pass. test=develop
* use normative enforce statements. test=develop
* add the cpu test. test=develop
* add the support of batch_size=1 for the bn with relu op. test=develop
* add the error type for paddle throws. test=develop
* add fused_batch_norm_act and fused_batch_norm_act_grad to op_has_unsed_vars_white_list. test=develop
5 years ago
2f3e2a84af
fix ci rule to show Shell variables ( #22177 )
5 years ago
298ee7d28a
Improve ngraph file line coverage ( #22155 )
5 years ago
d0f0a2520c
test Optimizer in dygraph ( #21949 )
...
* test Optimizer in dygraph, test=develop
* add optest for Optimizer in dygraph, test=develop
* fix adagrad optimizer, test=develop
* fix dpsgd optimizer, test=develop
* fix test_optimizer.py, test=develop
* fix dpsgd optimizer, this op only support cpu, test=develop
* add optest for optimizer, test=develop
* add description for dpsgd, test=develop
* add rmsprop to white_list in unused_var_check.cc, test=develop
* polish code style, test=develop
* polish code style, test=develop
* delete seed attribute for DpsgdOptimizer, test=develop
* change testing to debugging, test=develop
5 years ago
ad0dfb17c1
[Feature] Lite subgraph ( #22114 )
5 years ago
5b2e98aa17
Add multiple quantize operators fuse ( #22062 )
5 years ago
96980c2244
Polish the PADDLE_ENFORCE in fusion_group pass related codes. ( #22144 )
...
* Polish the PADDLE_ENFORCE in fusion_group pass related codes.
test=develop
* Correct the unittest because of the change relu_grad's formula.
test=develop
5 years ago
c3876cf82d
add support for nested profiling event and printing in different level ( #22061 )
...
* add support for nested profiling event and printing in different level
5 years ago
c3bcd3c1e2
fix dygraph non zero gpu bug, test=develop ( #22165 )
5 years ago
3d4f2aa689
Refine stack op to improve xlnet performance, test=develop ( #22142 )
...
stack's wait cost a lot of cpu time, use cuda kernel to do memory copy
will reduce cpu time.
Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com>
5 years ago
cf475f95df
Remove FC in dygraph, modify FC to Linear in sample code ( #22082 )
...
* modify fc to linear in sample code, test=develop
* remove FC, test=develop
* remove warnings, test=develop
* drop fluid/imperative/README.md , test=develop
* change fc to linear, test=develop
* polish code style, test=develop
5 years ago
64a4044292
add double register op_data_type of pad2d and fix compile error, test=develop ( #22075 )
5 years ago
7ba7acd197
Add coverage tools ( #21975 )
...
Add coverage data processing tools.
5 years ago
6ea3809143
Support prroi_pool_op with Tensor and LoDTensor rois ( #20649 )
...
1. Add a new input named batch_roi_nums for prroi_pool_op. batch_roi_nums includes the number of roi for each image in batch when rois is Tensor. This information is saved in rois's lod when rois is LoDTensor.
2. add grad check to prroi_pool_op and solve unnormal X grad diff in CPU.
5 years ago
d8a9b134e3
fix trt instance_norm serialize bug. test=develop ( #22152 )
5 years ago
cc1a9f4238
fix sample code in paddle/fluid/imperative/README.md ( #22141 )
...
* fix sample code, test=develop
* polish code style, test=develop
5 years ago
4c2df8e4d4
fix allocator strategy comment, test=develop, test=document_fix ( #22121 )
5 years ago
7872d06ff4
Add explanation on conv grad for dims<3 ( #22125 )
5 years ago
724b13e459
fix xception precision problem, test=develop ( #22124 )
5 years ago
b1401fb74d
Remove subgraph_detector from inference/analysis to the common framework/ir directory. ( #22094 )
...
test=develop
5 years ago
50bee83f71
add TRT support for instance_norm op ( #21928 )
...
* add TRT support for instance_norm op
5 years ago
3dbd4087fe
Fix windows build not kernel issue, test=develop ( #22105 )
...
windows conv_fusion failed as no kernel， explicit declare lambda
Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com>
5 years ago
418abc92f4
Update pyramid related OP ( #21372 )
...
* add special way to add distribute vars， Update Pyramid hash op
5 years ago
4b4a9cc88f
fix format in operator.cc ( #22101 )
5 years ago
14aebc7a95
add erf op ( #21785 )
...
* add erf op and python interface.
* add fp16 support for erf op.
* add unitests for erf op and its python interface.
5 years ago
ba8414d3a5
replace CUDNN_ENFORCE with PADDLE_ENFORCE_CUDA_SUCCESS, test=develop ( #22109 )
5 years ago
6c20e7c4e6
test=develop, remove unused parameter from class RuntimeInferShapeContext constructors ( #22046 )
5 years ago
fab4b0765a
support elu_op double grad ( #21822 )
...
* support elu activation double grad,test=develop
* delete the code commit in .cc,test=develop
* fix relu test unpass, test=develop
* add elu double grad kernel and unit test
* add caculate dX in elu double grad functor, test=develop
* update the commit code,test=develop
5 years ago
0a51098a71
Add TRT support for BERT ( #21135 )
...
* add gelu plugin
* align trt bert with gpu
* add support for fused fc with relu,
* add unittest for bert trt
5 years ago
b0b27ff699
[MKL-DNN] Conv grad and Batch Norm grad NHWC support ( #22088 )
5 years ago
dd4361568e
Add ParallelExecutor Test for Cond API and Fix PE Checks Shape Bug ( #22029 )
5 years ago
9587249442
polish allocator strategy doc, test=develop, test=document_fix ( #22095 )
5 years ago
d9f5d1eb29
ag allocator by default, test=develop ( #21837 )
5 years ago
7fb817d447
add distributed_strategy ( #21710 )
...
* add distributed_strategy
5 years ago
ad8a9cb82c
[MKL-DNN] Pool & LRN Grad Ops NHWC support ( #21747 )
5 years ago
34c57120eb
polish cross_entropy ENFORCE ( #22056 )
5 years ago
7f4abaf2f5
register int/int64_t/float16 in pow/square kernel,test=develop ( #22023 )
...
* register int/int64_t/float16 in pow/square kernel,test=develop
* add abs/square/exp type,test=develop
5 years ago
3f653c8323
register NoNeedBufferVarsInference for max_pool_grad_op, test=develop ( #22055 )
...
* fix test_conv2d_ngraph for grad diff, test=develop
* register NoNeedBufferVarsInference for max_pool_grad_op, test=develop
* refine error message, test=develop
* fix numpy, test=develop
* disable test conv2d_ngraph_op, test=develop
Co-authored-by: Zhang Ting <709968123@qq.com>
5 years ago
d48320777e
Add the first implememtation of fusion_group op ( #19621 )
...
* Add the dynamic load of nvrtc, and support runtime compiling of CUDA kernel using nvrtc.
test=develop
* Call CUDA driver api to launch the kernel compiled by nvrtc.
test=develop
* Disable for mac and windows.
test=develop
* Refine the codes to support manually specified num_threads and workload_per_thread.
test=develop
* Refine the CUDA kernel to support large dims.
test=develop
* Add DeviceCodePool to manage all device codes.
* Add the first implementation fusion_group op.
* Add unit-test for fusion_group op.
* Add the check of result.
* Add the check of nvrtc in unit-test.
test=develop
* Add comment to explain the inputs, outputs and features of fusion_group op.
test=develop
* Disable fusion_group op for mac and windows.
test=develop
* Make the compiling of device code return status instead of hanging up.
test=develop
* Add the check of whether there is CUDA driver library, and do not core dump when failing to call the CUDA driver API.
* Unify fusion_group_op's input and output names.
test=develop
* Add the check of CUDA driver library in unittest.
test=develop
* Refine the calling of PADDLE_ENFORCE.
test=develop
5 years ago
6192108408
[DNNL] 3D Fully-Connected ( #21746 )
5 years ago
aa2ed0dcc6
fix generate_proposal_labesl op ( #21793 )
...
* test=develop fix generate_proposal_labesl op
5 years ago
95d79b6d00
update error log for batch_norm_grad ( #22017 )
...
* update error information about batch_norm_grad
* update bn,test=develop
5 years ago
c53b62eb8e
fix integer overflow in match_matrix ( #22036 )
...
* fix integer overflow in match_matrix test=develop
* fix integer overflow in match_matrix test=develop
* fix typo test=develop
5 years ago
2e9082250d
polish default error msg & cublas error hint, test=develop ( #22032 )
5 years ago
64baee4144
polish code test=develop ( #22014 )
5 years ago
35ff1568e9
Add error message for cublas inItizalize failed ( #21995 )
5 years ago
fbb42173a9
fix no hint problem when use ENFORCE for cuda, test=develop ( #21994 )
5 years ago
e66f92d1ae
Modify demo_ci to support Windows, prepare for PR_Windows_Inference ( #21873 )
5 years ago
b7697f6218
fix broadcast bug;test=develop ( #21898 )
5 years ago
196e20dfbb
Fix multi-threads memory out of bounds error for passes ( #21920 )
...
* fix seqconv_eltadd_relu pass during multi-threads predictor, test=develop
* fix attention_lstm_fuse_pass during multi-threads inference, test=develop
* fix embedding_fc_lstm_fuse_pass during multi-threads inference, test=develop
* fix fc_lstm_fuse_pass during multi-threads inference, test=develop
* fix seq_concat_fc_fuse_pass during multi-threads inference, test=develop
5 years ago
8859ddd6cf
Refine multihead kernel, align block to 32 ( #21961 )
...
* Refine multihead kernel, align block to 32
test=develop
Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com>
* Refine log comments
test=develop
Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com>
5 years ago
fd9b00df4b
test=develop, remove unused variable ( #21974 )
5 years ago
cee2ccb078
add shuffle batch op ( #21674 )
...
* add shuffle batch op, test=develop, test=document_preview
* fix size_t conflict and check_output test=develop, test=document_preview
* fix bug test=develop, test=document_preview
* add unittest of shuffle_batch layer test=develop, test=document_preview
* fix py coverage and op input type, test=develop, test=document_preview
* fix py coverage, test=develop
* fix en doc, test=develop
* move to contrib test=develop
* add unique_name test=develop
* invoke shuffle_batch in contrib.layers test=develop
5 years ago
c3e1954918
make reverse op support negative axis ( #21925 )
...
* make reverse op support negative axis
5 years ago
03479469a7
fix multi-thread error of fc_gru_fuse_pass.cc, test=develop ( #21841 )
...
* fix multi-thread error of fc_gru_fuse_pass.cc, test=develop
* export FLAGS and GLOG symbols, test=develop
5 years ago
de9ba01f11
add conda build python script test=develop ( #21943 )
...
* add script for conda package build
5 years ago
10d6846900
Remove double registered dataType in Pad2d ( #21942 )
...
* fix compile error in CUDA10 test=develop
* remove double in pad2d test=develop
5 years ago
2df4be5d35
Fix openblas bug to support compile on windows when WITH_MKL=OFF ( #21902 )
...
* Fix openblas to support compile on Windows when WITH_MKL=OFF
5 years ago
27decacb8a
fix aucop stat shape ( #21846 )
...
* fix stat shape back in global auc scenario
* add UT to cover global auc
5 years ago
3e5008ad01
fix trt calib not working bug, test=develop ( #21934 )
5 years ago
5cb2c74127
add register op_data_type of pad/expand_as et.al ( #21718 )
...
* add register op_data_type test=develop
* fix register bug in isfinite op test=develop
* rm int int64_t in pad2d gradKernel test=develop
5 years ago
2066745847
Pack imperative/layer into paddle_framework.so ( #21921 )
...
* Pack imperative/layer into paddle_framework.so
5 years ago
30d000f8c2
fix matmul error message; test=develop ( #21885 )
5 years ago
a01663ca1f
remove patch command and file of cares to Improved quality of Paddle Repo ( #21776 )
5 years ago
2bbc0d7d60
python zero copy inference, delete pass ( #21897 )
...
* python zero copy inference
* support delete inference pass
5 years ago
51a86d2b6b
Optimize adam speed ( #21777 )
...
* optimize adam speed by removing _finish_update test=develop
* fix SparseAdamFunctor param list test=develop
* Remove scale_op in expect_list of adam_op test=develop
* fix test optimizer loss assert error test=develop
* fix test optimizer loss assert error test=develop
* modify PADDLE_ENFORCE usage test=develop
* fix op_type in lamb_op.cc test=develop
* fix errors ostream format bug test=develop
* add betaPowOut in ngraph op test=develop
* fix ngraph::op api for gcc8 test=develop
* clean code test=develop
* modify struct into class test=develop
* remove code of beta1Tensor in lamb_op test=develop
5 years ago
310edc0d0c
Update layers used in ptb model to use auto-generated op functions in dygraph mode ( #21724 )
...
* update layers, test=develop
* fix input numpy, test=develop
* fix bugs, test=develop
* follow commments, test=develop
* update getitem, test=develop
5 years ago
9dff56e8e2
change qat_performance with mobilenet, change batch_size of qat2_resnet50 ( #21895 )
...
test=develop
5 years ago
6b9fbcf3ad
Update iou_similarity op to support non-normalized bbox ( #21671 )
...
Update iou_similarity op to support non-normalized bbox
5 years ago
46f9184aff
Modify the while_loop API ( #21844 )
5 years ago
7689b6aaa4
Fix default label dim of label_smooth_op. test=develop ( #21862 )
5 years ago
13e4756f18
change ci check rule of deleting unit-test ( #21876 )
5 years ago
d4dda8628e
optimize fc jit ( #21878 )
...
test=develop
5 years ago
013225bb68
fix Execution order of ci_check_unittest, and add it to Linux_py35 ( #21640 )
5 years ago
2b941736f3
fix softmax_with_cross_entropy_fix bug, test=develop ( #21810 )
5 years ago
c3cf42d0f7
add table id in cache shuffle ( #21585 )
...
* general table
* add sparse table
test=develop
* no cvm
test=develop
* add no_cvm
test=develop
* add note
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* add key of optimizer
test=develop
* solve pslib stop core
test=develop
* barrier
test=develop
* add notes
test=develop
* add table id in cache shuffle
test=develop
* table id
test=develop
* code style
test=develop
5 years ago
253e664275
Disable memory opt pass when DNNL is on ( #21826 )
...
* Disable memory opt pass when DNNL is on
* Refine comment above mem optimization pass enablement
test=develop
5 years ago
a86f11b5f5
Speed GEO dense calc & communication ( #21579 )
...
* test=develop, speed dense calc & communication
5 years ago
666c3bb9b0
handle multi-inputs with empty inputs for mkldnn_concat_op ( #21827 )
...
test=develop
5 years ago
aa4d6a5d6c
Add some debug flags to auto growth allocator ( #21766 )
...
* add some debug flags to auto growth allocator, test=develop
* add comments about auto growth, test=develop
5 years ago
8b7c50f49a
Make While Op could run on GPU place and add while_loop unittest ( #21672 )
...
1. Make while_op accept GPU conditional data
2. Add more complex test cases for while_loop API
5 years ago
17299b8d21
fix batch_norm_grad infer shape=0 & add allreduce enforce shape, test=develop ( #21801 )
5 years ago
557bce77da
Fix Backward Bugs in Conditional Block ( #21809 )
...
The fixed bugs:
1. The condition sub-graph is not pruned
2. When backward graph is extremely simple, the whole backward ops are pruned.
5 years ago
0eb4d990c4
fix compiled error when with_pslib=on ( #21769 )
...
* fix compiled error of butil when with_pslib=on and with_testing=on
* test=develop
5 years ago
0677a1c1c1
Fix That conditional_block_op Doesn't Have InferShape ( #21733 )
5 years ago
a5a8d14414
Fix softmax cuda bug ( #21720 )
...
* Fix softmax cuda bug
* Refine multihead log and softmax logic
5 years ago
943a44492b
yolo_box OP add Attr(clip_bbox). ( #21620 )
...
* yolo_box OP add Attr(clip_bbox). test=develop
5 years ago
a5159d8480
Re-anble vgg and resnet101 models download ( #21713 )
...
test=develop
5 years ago
7181afd75c
Fix elementwise_pow bug on CUDA place with integer ( #21675 )
...
* fix elementwise_pow bug on integer, test=develop
* use llrint to support elementwise_pow_grad, test=develop
* add some tests, test=develop
* revert grad functor, test=develop
5 years ago
2bb135825e
fix analysis_predictor when func is called multiple times, test=release/1.6 ( #21665 )
5 years ago
d3a96632fa
Add fc-dequantize squash in cpu_quantize_squash_pass for ernie model ( #21714 )
...
* fc-dequantize squash
test=develop
* change according to reviews
test=develop
* change PADDLE_ENFORCE
test=develop
* add second test when fc-dequant do not fuse
test=develop
* change all related PADDLE_ENFORCE
test=develop
5 years ago
1fd1f06f11
Rename paddle throw error macro ( #21657 )
...
* rename paddle throw error macro, test=develop
* fix new error use case, test=develop
5 years ago
8754cbd1f2
fix std::min type in nan_inf, test=develop ( #21725 )
5 years ago
fbe3ac217e
polish cmake, test=develop ( #21681 )
...
* polish cmake, test=develop
* add current directory to LD_LIBRARY_PATH, test=develop
5 years ago
d419b859c0
Add reshape int8 mkldnn op ( #21428 )
...
* Add reshape int8 op
test=develop
* Change test to CPUPlace
test=develop
* Correct tests
test=develop
5 years ago
8a0f611b64
Rewrite check nan inf tools ( #21076 )
5 years ago
9ad940fdfe
memory leak for cpu ( #21174 )
...
* add fake init for the trainer, fix large memory hold in the trainer
* do not merge recv vars from a remote endpoint, test=develop
* add recv and save op, merge slice var in one op, save memory
* remove hsigmoid with pull sparse, test=develop
5 years ago
fbbd94a6ce
there is bug for inference using auto grwoth allocator ( #21621 )
...
test=develop
5 years ago
73461a7ae6
Make OperatorWithKernel::InferShape abstract ( #21633 )
...
* make OperatorWithKernel::InferShape virtual, test=develop
* fix test_prepare_op by relu, test=develop
5 years ago
686f0ecb6a
add `no_need_buffer_slots` interface to pybind ( #21575 )
...
* add no_need_buffer_slots interface to pybind
5 years ago
6828f3684b
fix op_registry, add ignore op_function_impl.h, test=develop ( #21654 )
5 years ago
5af0c7ba89
Modify padding strategy: remove weight copy in fc padding ( #21650 )
...
test=develop
5 years ago
d96acc3363
Refine dygraph DataLoader implementation ( #21634 )
...
* refine dygraph dataloader & polish related code, test=develop
* refine code based review comment, test=develop
5 years ago
5eec8cf5af
fix the mean grad OP performance improvement test=develop ( #21658 )
5 years ago
29f64c8c9e
refine some grad op makers, test=develop ( #21629 )
5 years ago
e2d849b989
Dropout with seed ( #21590 )
...
* add seed op
5 years ago
e81f0228df
MKL-DNN 1.0 Update ( #20162 )
...
* MKLDNN v1.0 rebase to Paddle 1.6
test=develop
* Add hacky paddle::string::to_string() implementation
* vectorize<int64-t>() -> vectorize() cleanup
test=develop
* PADDLE_ENFORCE and void_cast fixes
test=develop
* Rebase changes
test=develop
* Cosmetics
test=develop
* Delete MKL from mkldnn.cmake
test=develop
* CMake debug commands
test=develop
* Delete MKLDNN_VERBOSE and rebase fixes
test=develop
* Rebase fixes
test=develop
* Temporarily disable int8 resnet101 vgg16 and vgg19 tests
test=develop
* Add libmkldnn.so.1 to python setup
test=develop
* Add libmkldnn.so.1 to inference_lib cmake after rebase
test=develop
* Post rebase fixes + FC int8 changes
test=develop
* Fix LRN NHWC
test=develop
* Fix NHWC conv3d
test=develop
* Windows build fix + next conv3d fix
test=develop
* Fix conv2d on AVX2 machines
test=develop
5 years ago
7f5d532a9c
fix: fail to call ZeroCopyTensor::mutable_data() when device_id is no… ( #21461 )
...
* ZeroCopyTensor::mutable_data in the right device, test=develop
* add unittest for zerocopy, test=develop
5 years ago
f404157205
fix master patch when slot is dense ( #21580 )
...
* fix master patch when slot is dense
* test=develop
5 years ago
c05706fe73
fix code style of fleet_wrapper ( #21639 )
...
* fix code style of fleet_wrapper
* test=develop
5 years ago
95b95a284b
Mean gpu optimize ( #21643 )
...
* accelerate mean op test=develop
5 years ago
48600d7f17
Add op function generator for dygraph ( #21569 )
...
* add op function generator, test=develop
* add unittest, test=develop
* follow comments, test=develop
* fix windows compilation problem, test=develop
5 years ago
fbf9eca0d3
QAT Int8 document ( #21360 )
...
* update benchmark for int8v2, QAT1, QAT2 accuracy and performance
test=document_fix
* change according to reviews
test=develop test=document_fix
* improve some descriptions and some models
test=develop test=document_fix
* update models benchmark data
test=develop test=document_fix
* update int8v2 and qat2 performance
test=develop test=document_fix
5 years ago
be6a639655
Add CI for checking Input/Output/Attr of modified Ops ( #21522 )
...
* add shell scripts. test=develop
* rename test_pybind_inference to test_pybind_interface and print repeat process in check_op_desc.py. test=develop
* add approval RD. test=develop
5 years ago
4f81d1bd5f
Refine VarBase init function ( #21587 )
...
* refine init function, test=develop
* add tests, test=develop
* remove extern, which may cause symbol error in gcc-4.8, test=develop
5 years ago
Adam
Jiawei Wang
Steffy-zxf
flame
Chen Weihang
Wilber
Zhaolong Xing
Yiqun Liu
Zeng Jinle
Guo Sheng
tangwei12
Wojciech Uss
Double_V
hutuxian
huzhiqiang
yaoxuefeng
zhaoyuchen2018
guofei
zhongpu
Zhong Hui
cc
Tao Luo
LielinJiang
wangchaochaohu
joanna.wozna.intel
mapingshuo
xujiaqi01
Leo Chen
石晓伟
liu zhengxi
Michał Gallus
lidanqing
ceci3
Chengmo
zhupengyang
qingqing01
zhangchunle
Bai Yifan
Zhen Wang
silingtong123
zhouwei25
songyouwei
123malin
FlyingQianMM
baojun
Liu Xudong
Pei Yang
bingyanghuang
Feiyu Chan
Jacek Czaja
Huihuang Zheng
Kaipeng Deng
SunAhong1993
FDInSky
Aurelius84
danleifeng
zhoushiyu
hong
Aurelius84
GaoWei8
Thunderbrook
WangXi
rensilin
liym27