7821759d48
Add bfloat16 softmax and gelu ( #28394 )
...
* Add bfloat16 softmax and gelu
* Add pass attr bfloat16_enabled_op_types
* Changes from review
5 years ago
c41fd033e5
check op_version_registry in CI test, test=develop ( #28402 )
5 years ago
ca41541472
[oneDNN]Sum bf16 kernel ( #28382 )
...
* - Added sum bf16 oneDNN
test=develop
* - Fix to UT of sum bf16
test=develop
5 years ago
12b9587be5
Add conv_bias pass version python test ( #28278 )
...
* add conv_bias pass version test
* update according to reviews
5 years ago
21a63f6f90
enhance the op_version_registry, test=develop ( #28347 )
...
* enhance the op_version_registry, test=develop
* add unittests, test=develop
* enhance the op_version_registry, test=develop
* fix bugs, test=develop
* revert pybind_boost_headers.h, test=develop
* fix a attribute bug, test=develop
5 years ago
571a63e7ec
Add bf16 transpose2, reshape2, concat ops ( #28195 )
5 years ago
fdc06f2158
add Fuse bn add act pass ( #28196 )
...
* add fuse_bn_add_act pass
5 years ago
813b2ade34
Enrich the python error types of paddle & polish format ( #28124 )
...
* add multiple exception type
* define all exception & polish compile pystack
* mapping paddle error to python exception
* polish static mode error format
* fix failed unittests
* fix dytostatic test_error
* fix check_nan_inf failed
* add unittest for coverage
* revert some code try to solve compile error
* refactor enforce & error change
* polish code & add unittest
5 years ago
7db747d9e8
oneDNN BatchNorm + Act fusion pass. ( #27912 )
5 years ago
81244fbfab
add sharding strategy in fleet( #27900 )
...
* add sharding
5 years ago
2babd6ff67
Add compile limit for PADDLE_ENFORCE without error message ( #28221 )
...
* add compile limit for paddle enforce
* polish elementwise_op_function.cu.h
* fix failed unittest
* fix windows compile failed
* detail polish
* revert no type constructor
5 years ago
1f3be85914
Fix bug of fetch_async_op_handle when fetching the feed variable ( #28194 )
...
* fix bug of fetch_async_op_handle
* revert some changes of test_buffer_shared_memory_reuse_pass
* revert some changes of test_buffer_shared_memory_reuse_pass
5 years ago
7cb4a8b8f2
[oneDNN] Conv dilation support ( #27914 )
...
* conv dilated mkldnn support: forward and backward pass
* add mkldnn conv_transpose dilation UT
test=develop
* remove unnecessary PADDLE_ENFORCE
* add int8 and bf16 dilated conv UT
* update according to reviews
5 years ago
2ac6c6c3af
fix bug of tensor copy of CUDAPinnedPlace ( #27966 )
5 years ago
6bbb6e7f45
Implement the function of OutScaleForTraining/OutScaleForInference in dygraph ( #26601 )
...
* Implement the function of OueScaleForTraining/OutScaleForInference in dygraph
test=develop
5 years ago
3ee6ad6ec5
solve bug in pull_dense_worker ( #27918 )
...
* op error info
* style
* code format
* create pin var bug
5 years ago
5a83496c8d
Multi task ( #26002 )
...
* add multitask
* add multitask, test=develop
* fix code style, test=develop
* add partail push dense, test=develop
* fix has_kay in py3, test=develop
* fix, test=develop
* fix, test=develop
* fix, test=develop
5 years ago
41aad9bfcd
revert 4 files, from clear include by iwyu, test=develop ( #27895 )
5 years ago
049696bf67
Refine the format of printing tensor ( #27673 )
...
* add sumary feature
* refine printting tensor
* add sci_mode
* add sample code
* fix indent error
* fix _format_item
* polish code
* support item indent
* add ut
* set place for ut
* fix py2 issue
* fix ut
5 years ago
c5f2802d56
【paddle.fleet】Update fleetrun & ps-heter ( #27472 )
...
* refine fleetrun.ps_launch
* update fleet run for multi device support
* ps_graph support ps-gpu
* fix heter save
* add heter save unittest
* fix unittest & simple code
* update fleetrun
* fix fleetrun
* fix launch barrier
* fix role maker
* add paddlecloud rolemaker unittest
* rename heter_worker_device_guard
5 years ago
0d27591642
save operator version infomation to program desc, test=develop ( #27668 )
5 years ago
631c1f3018
- Fix to 27398 ( #27770 )
...
test=develop
- compilation fix
test=develop
5 years ago
606611d351
[oneDNN] GRU BF16 kernel ( #27731 )
5 years ago
b9fda2ff09
Fix to issue #25537 ( #27546 )
...
* - condidate fix to issue #25537
test=develop
* - UT for transpose NHWC
test=develop
5 years ago
966447e338
Added support for quantization of fusion_gru ( #27518 )
5 years ago
8a4f85feb9
Add unittests and OP version registry for quant_conv2d_dequant_fuse_pass ( #27689 )
5 years ago
c3a3df6466
Add cuda support for unique op ( #27646 )
...
* unique op for cuda is added
* add support for cuda
* Add cuda support for unique op.
* Add support for int32_t and int64_t.
* For old version, process by cpu
* Add VisitDataType for thrust
5 years ago
35074963e3
Refine error msg in paddle/fluid/framework/details [part 2] ( #27429 )
...
* refine broadcast_op_handle
* refine some error messages
* refine some files
* fix bug
* fix bug
* fix bug
* follow comments
* follow comments
5 years ago
0e101c4f6f
Fix test dist fleet heter ctr ( #27513 )
...
* fix test_dist_fleet_heter_ctr & peformance update
5 years ago
b0ee1405f7
Add conv2d bfloat16 support ( #27325 )
5 years ago
6f69a4cb05
add xpu in heter mode ( #27000 )
...
* add xpu in heter mode
test=develop
* BOOST_CONST_GET; PADDLE_THROW
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* refine
test=develop
* refine
test=develop
* refine
test=develop
* refine code
test=develop
5 years ago
e550fc02ae
fleet2.0 add fp16 grad compression ( #27480 )
5 years ago
c5c13473c6
Add compatibility check for four mkldnn pass ( #27364 )
...
* Add pass compatibility check for four mkldnn pass, test=develop
5 years ago
3d5522146e
register seq_concat_fc_fuse pass. ( #27479 )
5 years ago
df43905f12
use iwyu clean include ( #27267 )
...
* use iwyu clean include, test=develop, test=win
* compilation error, test=develop
* fix compilation error2, test=develop
* fix compilation error3, test=develop
* fix compilation error4, test=develop
* fix compilation error5, test=develop
* fix compilation error6, test=develop
* fix compilation error7, test=develop
* fix compilation error8, test=develop
* fix compilation error8, test=develop
* fix compilation error10, test=develop
* fix compilation error11, test=develop
5 years ago
8182337096
clear pass logs ( #27434 )
5 years ago
d93661942e
fix bug sequececonv_eltadd_relu_fuse_pass ( #27404 )
...
* fix bug sequececonv_eltadd_relu_fuse_pass, output error when sequence_conv's padding_start > 0
* fix seqconv_eltadd_relu_fuse_pass unitest error
5 years ago
aba759ba16
[Feature] Enhance inplace addto strategy for gradient accumulation in static graph ( #27112 )
...
* support use add instead of sum to do gradient accumulation
* add inplace addto pass
* add grad_add op and inplace addto pass
* remove debug code
* code refine
* fix bug when sereral sum ops inserts at same op_idx
* fix Flags type
* add addto attribute for conv3d
* fix ut
* code clean
* fix type
5 years ago
39546aa2f3
Add pass compatible and unit test. ( #27377 )
5 years ago
bbc84e0fe0
Refine error msg in paddle/fluid/framework/details [part 1] ( #25631 )
...
* refine error msg in var_handle.h, test=develop
* refine all_reduce_op_handle
* fix some error msg
* refine variable_visitor
* refine threaded_ssa_graph_executor
* refine inplace related files
* refine executor related files
* refine fetch_op_handle.cc
* fix bug
* follow comments
5 years ago
99626502f7
【paddle.fleet】gloo and util ( #27213 )
...
* fix worker endpoints
* fix gloo wrapper for hdfs
* GPU fleetrun support gloo
* parameterserver fleetrun support gloo
* fix get server endpoint
5 years ago
d726fd5e86
enhance dataset err msg ( #27363 )
5 years ago
fd7ab4e63c
register pass compatibility ( #27357 )
...
* pass compatibility
* add compatibility registry
* add unittests for different padding
* add assert
* drop errmsg
5 years ago
7e6dfcf9b2
Add 3 pass version check ( #27283 )
5 years ago
3c11717988
add op version checker to ir passes ( #27329 )
5 years ago
9f9d15e285
fix the bug of non-exit, test=develop ( #27350 )
5 years ago
54b81fa32c
add adaptivelsgd in meta_optimizer ( #27289 )
...
* add adaptivelsgd
* Todo fix the code to avoid the conflict.
5 years ago
4f9d6529fe
Polish framework error message part 7 ( #27266 )
...
* polish framework error message part 7
* fix typo
* polish by reviewes comment
5 years ago
f827665ae6
[Pass Compatible] Bind python compatible. ( #27262 )
5 years ago
dafb0e3bb7
Polish framework error message part 6 ( #27257 )
...
* polish framework error msg part 6
* polish lossed item
* fix failed unittest
* polish by reviewer comments
5 years ago
1483ea2304
Add bfloat16 passes ( #26999 )
5 years ago
79149c8ee6
polish framework error message part 8 ( #27269 )
5 years ago
2b6a5793fe
remove auto mode from localsgd optimizer ( #27237 )
...
* rm auto from localsgd
5 years ago
5d039f4086
modified the implement of Lars optimizer ( #26733 )
...
add lars to fleet meta optimizer
5 years ago
13804ed80c
Error msg/polish tensor error msg ( #26976 )
...
* polish one line error message in tensor.cc
* polish error messages in tensor.cc,tensor.h tensor_impl.h
* polish error messages in tensor.cc tensor.h tensor_impl.h
* polish error messages in tensor.cc,tensor.h tensor_impl.h
* polish error messages in tensor.cc tensor.h tensor_impl.h tensor_test.cc
* polish error messages in tensor.cc tensor.h tensor_impl.h
5 years ago
5fb8c92054
fix multihead matmul shared params ( #27121 )
5 years ago
7f3e6ca596
add cuda generator ( #26786 )
5 years ago
c8cc094576
add template specialization for bfloat16 for gcc 4.8 compatability ( #26985 )
5 years ago
95e1434bb2
Add bfloat16 data type ( #25402 )
5 years ago
61fc7a3e45
Pass version check ( #26887 )
5 years ago
2d2c31a63a
Add FetchAsyncOpHandle, and use it in FastThreadedExecutor ( #26643 )
...
* optimized transformation form tensor to numpy, test=develop
* Modify fetch op handle, from memcpy Sync to memcpy Async, test=develop
* modify CUDAPinnedPlace to CPUPlace, test=develop
* modify CPUPlace to CUDAPinnedPlace, and set default inplace to false, test=develop
* revert fetch_op_handle, add fetch_async_op_handle, test=develop
* revert fetch_op_handle, add fetch_async_op_handle, test=develop
* fix error msg report, test=develop
* fix bug in cpuplace, test=develop
* fix bug in unmerge and tensorarray modle, test=develop
* fix bug, double copy gpu memory, test=develop
* fix chenweihang¡¯s review advice, test=develop
5 years ago
5205748481
fix eigen in push sparse; fix hadoop command ( #26872 )
...
* fix eigen in push sparse; fix hadoop command
test=develop
* add log in load_combine_op
test=develop
5 years ago
a47d92d868
fleet add save with whitelist test=develop ( #23376 )
5 years ago
8bcb1f29d9
Add conv+affine_channel fuse pass to MKLDNN pass strategy and fix it ( #26779 )
5 years ago
844583c8fd
Refine paddle.manual_seed ( #26496 )
...
* refine manual seed
* fix ci problem
* fix unittests
* fix unittest
* set is_init_py=false in manual_seed
* fix unittest
* fix bernoulli_op
* fix(unittest): change random_seed to manual_seed
* 🐞 fix(unittest): fix manual_seed
* trigger ci
* fix test_sentiment
* fix test_imperative_save_load
* fix test_uniform_random_op
* fix test_uniform_random_op
* fix test_jit_save_load
* merge develop
* fix manual_seed
* fix manual_seed
* use global engine
* use shared_ptr
* fix double free
* fix bug
* fix bug
* fix bug
* fix test bug
* fix test bug
* fix test bug
* fix ci
5 years ago
e3f8e5cf5c
trt int8 support conv2d_transpose ( #26636 )
5 years ago
623a4c2e56
fix ci coverage build error ( #26761 )
5 years ago
eb097d64f6
Fix int8 performace drop cpu_quantize_placement_pass ( #26715 )
...
* Fix cpu quantize placement pass
* Include string lib
5 years ago
1c898b66d6
add bug fix enum. ( #26736 )
5 years ago
8071d23073
fix bug that can't print int8_t ( #26712 )
...
fix bug that can't print int8_t
5 years ago
c2c689582e
Update Paddle-Lite commit hash. ( #26413 )
...
* Update Paddle-Lite commit hash.
* Add BF16 data type to VarTyp protobuf message.
5 years ago
1c68138327
[api 2.0] add collective op for cpu using gloo and paddle.distributed.* apis ( #26552 )
...
add collective op for cpu using gloo and paddle.distributed.* apis
5 years ago
559e43eee4
Small change in conv2d and quantize pass ( #26671 )
5 years ago
32ceacf317
update op_version_registry, test=develop ( #26644 )
5 years ago
08d736ad78
【paddle.fleet】add cudnn related strategies to DistributedStrategy ( #26598 )
...
* add cudnn related strategies to DistributedStrategy
5 years ago
c1f5df5269
optimized transformation form tensor to numpy ( #26447 )
...
* optimized transformation form tensor to numpy, test=develop
* optimized transformation form tensor to numpy, pass pre-commit, test=develop
* modify fetchophandle zerocopy to deepcopy in PE&CUP, test=develop
* modify py:array construct, test=develop
* fix _fetch_var to use deep copy, test=develop
5 years ago
fa08a834be
update op_version_registry, test=develop ( #26592 )
5 years ago
656e60b18f
new class: op_version_registry, test=develop ( #26542 )
5 years ago
199b0c7c1b
Add isfinite v2 op ( #26344 )
...
add the isnan, isfinite, isinf api for the paddle 2.0
5 years ago
138ecf24aa
support Baidu Kunlun AI Accelerator ( #25959 )
...
* support Baidu AI Accelerator
* test=kunlun
* minor
* test=kunlun
* support xpu op in separate file
* test=kunlun
* update XPU error message and remove duplicated code
* test=kunlun
* minor
* test=kunlun
* minor
* test=kunlun
5 years ago
9108282883
Polish framework error message part 5 ( #26204 )
...
* polish framework error msg part 5
* revert enforce change
* refine error type
* trigger ci check
* polish details by review comment
5 years ago
b757466b0d
fix trt dynamic ernie serialization unit test ( #26228 )
5 years ago
3ec0bcbbb8
[Bug] Fix prune for save_inference_model about transformer ( #25347 )
5 years ago
3f816bc8b4
[Quantization] Conv2d_transpose and mul support channnelwise quantization ( #25639 )
...
* Conv2d_transpose and mul support channnelwise quantization, test=develop
* Skip collecting out threshold for output tensor of which the type is not fp32 or fp64, test=develop
* Fix error in test_user_defined_quantization, test=develop
* Add depthwise_conv_bn_fuse, test=develop
* Add conv_transpose_bn_fuse_pass for post_training_quant, test=develop
5 years ago
a83e0f264c
fix heter proto ( #26093 )
...
test=develop
5 years ago
23261ff44b
add cpu random Generator ( #26013 )
5 years ago
6de463d3d1
expose and unify the Tensor concepts to the user ( #25978 )
...
* expose and unify the Tensor concepts to the user
* expose tensor to user
* add copy place for Tensor
* add copy place for Tensor
* add note
* add macro PADDLE_WITH_CUDA
* remove RUN_TYPE=DIST
* fix some error
5 years ago
50a5bcfc9d
【paddle.fleet】paddle.fleet -> paddle.distributed.fleet. ( #26186 )
...
* move paddle.fleet to paddle.distributed.fleet
5 years ago
ffe52b4452
[OpDevOptimize] Add common infershape functions ( #26096 )
...
* add unchaged infershape function
* add broadcast infershape function
* fix bug
* rename infershape functions
* add UnaryOpUnchangedInferShapeCheckAxis
* add error message
* add test for common infer shape functions
* dont update existed ops
* dont update op_desc.h
* add more test
* add error check, refine error message
5 years ago
838e36e9ed
Fix loaded variable suffix repeat error ( #26169 )
...
* fix loaded var suffix repeat error
* use new dygraph name for loaded param
5 years ago
54003b873e
【paddle.fleet】add lamb to fleet meta optimizer ( #26025 )
...
add lamb to fleet meta optimizer
5 years ago
1be6bf45ae
Add assign to fusion_group and enhance inplace execution in fusion_group. ( #26121 )
5 years ago
6559229b7e
fix encryption infer ( #25979 )
...
* add encrypt for inference lib
* fix code;test=develop
* fix test; test=develop
* bug fix; test=develop
* add MakeCipher;test=develop
* fix bug;test=develop
* move MakeCipher to paddle space; test=develop
* fix include dir ;test=develop
* add include dir; test=develop
* move include; test=develop
* move include; test=develop
* fix for windows ci
* fix cmake; test=develop
* fix bug
bug fix
5 years ago
c14ec8782b
【paddle.fleet】Feature/fleet ps api 2.0 ( #25857 )
...
* add paddle.fleet.AsyncOptimizer
Co-authored-by: dongdaxiang <dongdaxiang@baidu.com>
5 years ago
734cf1c3e9
Change use_quantizer attribute name and data type ( #25838 )
...
* Change use_quantizer attribute name and data type
* Fix problem with setting attribute
* Add changes due to review
* Small change in function
* Restore use_quantizer attr for compatibility
5 years ago
3755564ae1
Fix/large scale fix ( #25999 )
...
* fix large scale KV
* fix single training using async ssa graph
5 years ago
fd2947babf
fix compile error with mkl ( #26030 )
...
test=develop
5 years ago
0a47387bd8
Use static local variable instead of global variable for safty ( #26018 )
...
* remove global variable
* refine code
5 years ago
2191a08317
【paddle.fleet】fleet_util move to paddle.fleet ( #25805 )
...
* test=develop,test=document_fix, remove the out args
* fleet_util move to paddle.fleet
Co-authored-by: WuHaobo <wuhaobo1994@gmail.com>
Co-authored-by: tangwei12 <tangwei12@baidu.com>
5 years ago
0cb60c700d
add heter ps mode ( #25682 )
...
* add heter ps mode
* code style
test=develop
* add with_pslib
test=develop
* unitest
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* test monitor
test=develop
* prepare trainer
test=develop
* code style
test=develop
5 years ago
2c9d0f3cb9
【paddle.fleet】Add dgc to fleet meta optimizer ( #25738 )
...
Add dgc to fleet meta optimizer, rm dgc from optimizer all
5 years ago
a6c87fd091
Add amp to fleet meta optimizer, test=develop ( #25770 )
5 years ago
d11c140e28
fix dump, fix cvm check ( #25400 )
...
* fix dump, fix cvm check
test=develop
* fix
test=develop
* fix
test=develop
* fix
test=develop
5 years ago
8ebffc78c9
add lars to fleet meta optimizer ( #25884 )
5 years ago
8d2896f1fe
【paddle.fleet】Fleet run graph in Executor and add two more strategies ( #25844 )
...
* split meta optimizer files
* add graph execution in execution, update two properties in DistributedStrategy, unit tests for these features
5 years ago
48b9a56f1c
Polish framework error message - part 4 ( #25807 )
...
* polish framework error message part 4
* fix type error
* fix message error
* polish by review comments
5 years ago
5f30e57cdd
fix test_pipeline, test=develop ( #25808 )
...
* fix test_pipeline, test=develop
5 years ago
d47304e6d9
Refine paddle error stack format ( #25790 )
...
* refine error stack format
* polish compile traceback format
* polish detail format
5 years ago
caa90a6510
Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) ( #22957 )
...
* Integrated Trainer of Parameter Server
5 years ago
a96d54ac19
Generate final strategy ( #25782 )
...
* refine strategy compiler and meta optimizers
make async as a_sync
5 years ago
1b3081b1b4
Simplify BufferedReader to improve DataLoader performance ( #25648 )
...
* simplify buffered reader to improve DataLoader performance
* fix 22 failed unittests
* fix cuda pinned context condition
* fix test_reader_reset failed
* fix two failed unittests
* change unittest place
* polish error messaage
* polish cast op GetExpecctedKernelType
* remove debug info in unittest
5 years ago
e0a9115e28
fix random compile failure due to missing file ( #25661 )
5 years ago
920d998f1e
add more settings for distributed strategy ( #25685 )
...
* add more settings for distributed strategy
Basically, DistributedStrategy has several parts of configurations:
- BuildStrategy: the same as paddle.fluid.BuildStrategy, but the distributed arguments are moved out of BuildStrategy
- ExecutionStrategy: the same as paddle.fluid.ExecutionStrategy
- collective communication configs: nccl_comm_num, hierarchical allreduce and so on
- distributed algorithms: async_update(mainly used in PS), lars, lamb and so on
5 years ago
c34c80d302
Polish framework error message part3 ( #25701 )
...
* polish framework error message part3
* polish details
* fix error message print error
5 years ago
e52df3b125
Added DNNL cache management for DyGraph ( #25624 )
...
* Added DNNL cache management for DyGraph
* move FLAGS_use_mkldnn to more general CMakeLists, getu use of the flag in ClearGradients
* missing file
* Fixes after review
* Bringing back original idea of place for 'use_mkldnn' flag to be accessible from platform nad imperative.
* Removed duplicate and added docs
* Fixes for CI
5 years ago
364cc53618
Polish paddle fluid framework error message - part2 ( #25667 )
...
* polish framework error meg part2
* polish details
5 years ago
98899b73d2
Fix FC + GRU fuse pass ( #25687 )
5 years ago
1917b38099
fix some errmsg report,in framework/ir/, about 21 files ( #25525 )
...
* fix error msg report in ir/, about 19 files, test=develop
* modified some unclear descriptions, test=develop
* modified some unclear descriptions, test=develop
* modify unit test pass_test.cc, because the error report in pass.cc is used by pass_test.cc, test=develop
5 years ago
e5bbffa84c
Add NOMINMAX define due to windows.h max/min macro conflict ( #25637 )
...
test=develop
5 years ago
7206417259
supports xpu runtime, test=develop ( #25554 )
...
* update ResetHolder, test=develop
* add TensorShare for lite engine, test=develop
* tensor data changed from copying to sharing, test=develop
* supports xpu runtime, test=develop
* fix code styles, test=develop
5 years ago
dfb3ae1b9b
Polish some error message in framework holder - Part 1 ( #25509 )
...
* polish some error message in framework, test=develop
* fix unittest error, test=develop
* replace PADDLE_ENFORCE, test=develop
* polish details based review comment, test=develop
5 years ago
9b46fe0440
fix some errmsg report,in framework/ir/, about 5 files ( #25539 )
...
* fix error msg report in ir/, about 5 files, test=develop
* fix error msg report in ir/, about 5 files, test=develop
* fix error msg report in ir/, about 5 files, test=develop
5 years ago
e657d7062d
fleet base initial implementation and the API ( #25442 )
...
refactor fleet api under paddle.fleet
update DistributedStrategy
5 years ago
e65c5b8e83
fix some errmsg report, in framework/ir/ ( #25471 )
...
* fix paddle/fluid/framework/ir/ error msg reoprt, test=develop
* modify error msg reoprt in ir/, about errortype, grammar, supplementary infor, test=develop
* modified some unclear descriptions, test=develop
* Modify the problem that report msg is less than 20 characters, test=develop
5 years ago
6c0982b942
fix some errmsg report, in framework/ir/mkldnn ( #25467 )
...
* fix paddle/fluid/framework/ir/mkldnn/ error msg reoprt, test=develop
* modify error msg reoprt, about errortype, grammar, supplementary infor, test=develop
* modified some error descriptions, test=develop
5 years ago
fce6466217
fix some errmsg report, in framework/ir/ subdir(memory,optimizer,multi_device) ( #25460 )
...
* fix paddle/fluid/framework/ir/multi_devices_graph_pass/ error msg reoprt, test=develop
* fix paddle/fluid/framework/ir/memory_optimize_pass/ error msg reoprt, test=develop
* fix paddle/fluid/framework/ir/fuse_optimizer_ops_pass/ error msg reoprt, test=develop
* fix paddle/fluid/framework/ir/memory_optimize_pass/ error msg reoprt about PADDLE_ENFORCE, test=develop
* modify error msg reoprt,about errortype，grammar. test=develop
* modify error msg reoprt,about PADDLE_ENFORCE to PADDLE_ENFORCE_XXX, test=develop
* modify error msg reoprt,about PADDLE_ENFORCE to PADDLE_ENFORCE_XXX, and %s to %d, test=develop
* modified some error descriptions, test=develop
5 years ago
0b54d54fd8
Fix index overflow bug of the CUDA kernel loop increment ( #25435 )
...
* fix softmax_with_cross_entropy cuda kernel overflow bug, test=develop
* replace old macro & for condition, test=develop
* polish details, test=develop
5 years ago
4061aa6488
Polish ParallelExecutor exception process logic ( #25449 )
...
* polish pe exception process logic, test=develop
* fix unittest, test=develop
* add unittests, test=develop
5 years ago
e39aa70ec7
add the support for pipeline ( #24560 )
...
* add device_worker for pipeline, test=develop
5 years ago
70d7d07fea
catch bad alloc exception ( #25140 )
...
* cat bad alloc exception; test=develop
* add unitest; test=develop
* move bad alloc catch to the first place; test=develop
* polish error message; test=develop
* polish error message; test=develop
* add mutex header; test=develop
5 years ago
80f1c50738
Fix typo in interface. ( #24779 )
5 years ago
7b7e605189
[Fix BUGs]: fix multhead matmul pass's instable bug ( #25123 )
...
* fix multhead matmul's instable
test=develop
* fix multihead matmul bug
test=develop
* fix converage problem
test=develop
5 years ago
d5e40d1ba9
Paddle fleet distributed strategy ( #25379 )
...
* add paddle.fleet.DistributedStrategy for 2.0
5 years ago
d0a921ba98
Quant2 updates and fixes ( #25313 )
5 years ago
17c751bec6
[oneDNN] Fix to #25078 ( #25256 )
5 years ago
3b8f0a64c2
Encryption infer ( #25119 )
...
* add encrypt api for inference lib
5 years ago
36abeff44f
adding elementwiseadd quantization ( #25178 )
5 years ago
b2f5a149e7
[Paddle-TRT] Better Paddle-TensorRT support for PaddleSlim quant models ( #25097 )
...
* Paddle-TensorRT support slim QAT. test=develop
* add comments. test=develop
* use RenameInput instead of ResetInputs. test=develop
5 years ago
19c4db1b56
don't re-generate header file if content doesn't change ( #25130 )
...
* don't re-generate header file if content doesn't change. test=develop
* add copy_if_different function. test=develop
5 years ago
a7944904d3
[oneDNN]elementwise_add and elementwise_mul int8 support ( #24984 )
...
* Start implementing int8 eltwise add
test=develop
* - Fix to Michal PR
* - Fix
test=develop
* - Lint fixes
test=develop
* - Added checking if elementwise_mul can be used
test=develop
* - Added attribs to skip_attrs_set
test=develop
* - Improved broadcasting
test=develop
- fixes to compilation
- fix
- fix
- Lint fixes
test=develop
* - removed redundant condition
test=develop
Co-authored-by: Michal Gallus <michal.gallus@intel.com>
5 years ago
5822862d8a
Monitor Framework ( #24079 )
...
* Add a StatValue class in the backend to represent a stat.
* Add a singleton StatRegistry to maintain the collection of stats.
* For the sake of code neatness, we only support type of int and float, which can cover most of the scenarios.
5 years ago
25a4dac4c2
Use allow list instead of white list ( #25002 )
...
* use allow list instead of white list, test=develop
* reduce include, test=develop
5 years ago
1c224e26af
support CMatchAuc ( #24990 )
...
Support CMatchAucCalculator based on CMatchRankAucCalculator with a new parameter ignore_rank
5 years ago
53d563a0fe
Reshape transpose matmul coverage ( #24970 )
...
* remove gmock from ut
test=develop
* coverage enabled for r+t+m fuse pass
test=develop
5 years ago
a7ee634b45
fix WARNING: ThreadSanitizer: heap-use-after-free ( #24929 )
...
test=develop
5 years ago
4058e736ff
temporarily disable these unittests failed on windows ( #24942 )
5 years ago
29de0d97a5
add the support to specify device index for device_guard ( #24555 )
...
* add the support of device index for device_guard.
5 years ago
b8f17a049d
fix problem in dump and add log ( #24891 )
...
* Fix the field length in LoD scenario
* Fix the missed lod info when copy tensor in dump field
* Add some log to make debug easy
5 years ago
6aae034f8d
add dep for fs.cc, test=develop, test=document_fix ( #24881 )
5 years ago
40a5f3fd86
[oneDNN] Clearing mkldnn cache in naiveexecutor destructor ( #24756 )
5 years ago
d1062d5278
Replace all errors thrown by LOG(FATAL) with PADDLE_THROW ( #24759 )
...
* remove REPLACE_ENFORCE_GLOG compile option & add ci rule prohibit LOG(FATAL) using, test=develop
* remove ci test case, test=develop
* replace all LOG(FATAL) & polish message, test=develop
* fix typo, test=develop
* polish error info detail, test=develop
5 years ago
9d2bd0ac38
downpour_worker增加try_catch机制，打印program所有参数 ( #24700 )
...
* test=develop, add try_catch for debug
5 years ago
b2ba830eeb
Fix bug in ShareBufferWith causing eltwise_add inplace ut to fail ( #24853 )
5 years ago
78d4f0cc91
add option to exclude ops by id from quantization ( #24689 )
5 years ago
62b4ff7dd2
Aes_cipher_test and cipher_utils_test failed fixed ( #24816 )
5 years ago
5a7a517cde
Add crypto api ( #24694 )
5 years ago
19e5f7879c
Append error op hint for GradOpMaker ( #24750 )
...
* append error op hint for grad op maker, test=develop
* add unittests for coverage, test=develop
5 years ago
950892044f
fix conflict, test=develop ( #24238 )
5 years ago
e6b87b3193
Support AucRunner in PaddleBox ( #22884 )
...
* Support AucRunner in PaddleBox
* update some code style
5 years ago
dbfe5333c5
Add pe profiler Event ( #24611 )
5 years ago
ba2f8f0ce4
fix embedding_eltwise_layernorm_fuse_pass. test=develop ( #24592 )
5 years ago
0ec3a42e97
Random Dump ( #24477 )
...
* Refactor code for dump_field & dump_param: abstracting the common function in base class.
* Support dump randomly & random with lineid
* Support specify the random interval, which avoids printing too much logs.
5 years ago
6b464f969a
Add an operator node in unittest to make the fusing result unique. ( #24617 )
5 years ago
560c815390
Add some check for CUDA Driver API and NVRTC ( #22719 )
...
* Add the check for whether CUDA Driver and NVRTC is available for the runtime system.
* Call cuInit to initialize the CUDA Driver API before all CUDA callings.
test=develop
* Change the behavior when libnvrtc.so can not be found, printing a warning instead of exiting.
test=develop
* Do not initialize CUDA Driver API for windows and macos.
test=develop
* Remove the call of cuInit when entering paddle and enable the test_code_generator.
test=develop
* Add some built-in functions for __half.
test=develop
* Change save_intermediate_out to false in unittest.
test=develop
* Fix error reference to tempropary variable when seting including path for device_code.
test=develop
5 years ago
db2b6b6568
Hide globals & redesign restore PR ( #24279 )
...
test=develop
5 years ago
8b88cd5167
[oneDNN] Fix to inplace pass ( #24442 )
...
* - Disabling inplace pass
test=develop
- Disable cycles
test=develop
- fix
test=develop
- Enhancement to in-place
- Lint fixes
test=develop
* - Lint fixes
test=develop
5 years ago
123255cf9f
change InitializeGPU to InitializeGPUAndLoadModel ( #24377 )
...
* Add InitializeGPUAndLoadModel to solve random hang when downloading sparse parameters.
* Update SaveBase to solve test problem.
5 years ago
aa0f254fbe
Add macro BOOST_GET to enrich the error information of boost :: get ( #24175 )
...
* add new macro BOOST_GET_SAFELY & unittests, test=develop
* add different macro type, test=develop
* fix get macro type in executor, test=develop
* four macro part change backup
* using one macro for all case, test=develop
* revert attribute change, test=develop
* change to three func to solve gcc4.8 bug, test=develop
* polish some details, test=develop
5 years ago
db052009c7
Enabled quantize all and skip missing in QAT ( #24281 )
...
* Enabled quantize all and skip missing in QAT
5 years ago
8a1a2af82e
Add Assert Op ( #24280 )
...
1. To make ProgramTranslator to support `assert` grammar, this PR adds `assert` python API and C++ code.
2. Fix a bug: graph_pattern_detector.h #include <gtest/gtest_prod.h> but didn't declared dependency at CMakeLists, which can cause single build failure.
3. Refactoring `Formatter` in print_op to make it reusable and reuse the formatter to print in assert op.
5 years ago
356f5ee220
[Refactoring] Unify op-dequant squashes ( #24277 )
5 years ago
ac9a7eeea4
[Dy2Stat]Support list pop ( #24250 )
...
* Replace dygraph_to_static_func with @declarative or program_translator.get_func in test_list.py
* Add comments in ConditionalBlock.
* Support list pop last item.
* Support pop the i-th item.
* Support an empty tensor array as Input in assign op and set the kernel type is float.
5 years ago
1034ca316f
add timeout and http store in communication ( #23436 )
...
* add timeout and http store in communication, add revert and confirm in fleet
* test=develop
5 years ago
d1e1d85881
add the graph batch reader for pslib mode ( #24178 )
...
Add the pslib graph batch reader mode, add the test case for this change
5 years ago
b43b46e619
[INT8] Add requant-op squash ( #24143 )
5 years ago
3e2bc8715f
Try to fix UT Random Fail ( #24223 )
5 years ago
e1a7a88057
added reshape transpose matmul fuse pass ( #23754 )
5 years ago
9b851ba216
[dy2static] Add print transformer and unify print format ( #24068 )
...
* add print transformer & unify print format, test=develop
* remove using of dygraph_to_static_func, test=develop
* remove python stdout capture, test=develop
* fix compatibility problems for PY2, test=develop
* fix detail error, test=develop
* fix type analysis bug, test=develop
* fix print tuple compatible error in PY2, test=develop
* replace get_func to declarative, test=develop
* fix detail bug, test=develop
* fix some detail problems, test=develop
* change visit_call in print transformer, test=develop
5 years ago
fa43d74a3a
fix the intermediate node of graph for fusion group test=develop ( #24184 )
5 years ago
ecfddebbef
Add the implementation of inverse ( #23310 )
5 years ago
9a93f6aae0
improve efficiency of runtime InferVarType ( #22778 )
...
* save InferVarType changes, test=develop
* remove code comments, test=develop
* tweak code, test=develop
* fix compilation warning, update merge_ids_op split_ids_op to new interface, test=develop
* modify fused_bn_activation_op, test=develop
* fix error of fused_bn_activation_op, test=develop
* fix PADDLE_ENFORCE and unittest coverage issue, test=develop
* tweak PADDLE_ENFORCE messages, test=develop
* improve unittest coverage, test=develop
* add StaticGraphInferVarType class, test=develop
* rebase develop branch, test=develop
* fix unittest error, test=develop
* remove comments, test=develop
* improve unittest coverage, test=develop
* imporve error message and imporve unittest coverage, test=develop
* upgrade InferVarType API, test=develop
* tweak pyfunc error message, test=develop
* fix compilation conflict - save_combine_op, test=develop
5 years ago
2270864019
Fusion group optimize for cuda codegen( #23940 )
5 years ago
94dfb7d770
opt the postprocess, test=develop ( #24155 )
5 years ago
eb411613e9
[DNNL] refine activations Inplace support ( #24145 )
5 years ago
461e6a01ec
[DNNL] activations Inplace support ( #24123 )
5 years ago
fb0729ee7f
avoid warnings in MAC compile ( #24124 )
5 years ago
d31a174f51
added fusing matmul-transpose-reshape pass ( #23866 )
5 years ago
a67eea9f00
polish code by adding final, test=develop, test=develop ( #24114 )
5 years ago
acef55df04
fix isolated var fetch bug, test=develop ( #24070 )
5 years ago
c6c65c65c7
[DNNL] Added elementwise_add mkl-dnn inplace ( #23477 )
5 years ago
9ff558a46f
Optimize DataFeed ( #23957 )
...
* Make batch_float_feasigns & batch_uint64_feasigns as member variable
5 years ago
7817003795
Optimize the error messages of paddle CUDA API ( #23816 )
...
* Optimize the error messages of paddle CUDA API, test=develop
* fix the error messages of paddle CUDA API, test=develop
* Refactoring PADDLE_ENFORCE_CUDA_SUCCESS, and apply to curand/cudnn/cublas/NCCL,test=develop
* remove build_ex_string,test=develop
* merge conflict,test=develop
5 years ago
7f0b2c7407
fix memory leaking problem of dataset, test=develop ( #23955 )
5 years ago
2b896c1f6b
Support LoDTensorArray in fetch ( #23645 )
...
* Support LoDTEnsorArray in fetch op
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
5 years ago
071a702060
Fix the error misjudgment when there are control nodes in graph. ( #23943 )
5 years ago
df64a96686
support set_test_mode and set comlog level( #23905 )
5 years ago
b88662254b
use 32 bit index to improve expand op ( #23899 )
...
* use 32 bit index to improve expand op, test=develop
* remove redundant code, test=develop
5 years ago
a1e7387919
Variable error message enhancement, test=develop ( #23548 )
5 years ago
5b69242fab
modify datanorm op test=develop ( #23030 )
5 years ago
c49791362f
Correct reader device index ( #23802 )
...
* correct reader device index, test=develop
* fix async executor scope var initialization, test=develop
5 years ago
joanna.wozna.intel
石晓伟
Jacek Czaja
lidanqing
Zhang Ting
Chen Weihang
Adam Osewski
mapingshuo
Leo Chen
Zhou Wei
guofei
Thunderbrook
zhang wenhui
wanghuancoder
Chengmo
Wojciech Uss
Pei Yang
AshburnLee
WangXi
cc
Wilber
Shang Zhizhou
tangwei12
yaoxuefeng
haozech
lilong12
ShenLiang
JZ-LIANG
WeiXin
Feiyu Chan
Adam
zhangchunle
Dong Daxiang
Jack Zhou
QingshuChen
Yiqun Liu
MRXLT
123malin
xujiaqi01
arlesniak
wanghuancoder
hong
gongweibao
Zhaolong Xing
Sylwester Fraczek
Shibo Tao
hutuxian
Michał Gallus
Yanghello
Yanghello
ShenLiang
wangchaochaohu
pawelpiotrowicz
Huihuang Zheng
liym27
wawltor
liuwei1031
Zhang Ting
Zeng Jinle
yiicy