dca075839b
remove params in Tracer object (in dygraph) ( #20815 )
...
* remove params in Tracer object, test=develop
* Repair failed optest, test=develop
* remove build_once & name_scope (Conv2D)
test=develop
* fix unittest
test=develop
* Conv2DTranspose
* Conv3D & Conv3DTranspose
test=develop
* Pool2D & BatchNorm
* Embedding
* LayerNorm
* GRUUnit & NCE
* PRelu
* BilinearTensorProduct
* GroupNorm & SpectralNorm
* TreeConv
test=develop
* fix LayerNorm in transformer unnittest
test=develop
* disable LayerNorm or BatchNorm in multicard
test=develop
* refine Layer.create_parameter api
test=develop
* refine LayerNorm, remove begin_norm_axis param, add normed shape check
test=develop
* LayerNorm bug fix
test=develop
* fix optest,test=develop
* fix optest, test=develop
* fix optest for pass parameter_list when constructing an Optimizer class instance, test=develop
* polish code for better code style, test=develop
* fix se_resnext optest, test=develop
* polish code for better code style, test=develop
Co-authored-by: songyouwei <youwei0314@gmail.com>
6 years ago
c3e1954918
make reverse op support negative axis ( #21925 )
...
* make reverse op support negative axis
6 years ago
911e4c7db6
Fix the bug in sequence_scatter unitest ( #21960 )
...
* test=develop
* test=develop
* test=develop
* change the check_shape_white_list in web
* test=develop
* test=develop
6 years ago
2687f2afec
fix input shape of test_log_loss_op ( #21953 )
6 years ago
b1ec1d54cf
Delete check grad for int, collect op for now ( #21922 )
6 years ago
2df4be5d35
Fix openblas bug to support compile on windows when WITH_MKL=OFF ( #21902 )
...
* Fix openblas to support compile on Windows when WITH_MKL=OFF
6 years ago
27decacb8a
fix aucop stat shape ( #21846 )
...
* fix stat shape back in global auc scenario
* add UT to cover global auc
6 years ago
0d61653c8e
Revert to run distributed unittest serially, test=develop ( #21924 )
6 years ago
cff7a49856
Add ParameterList ( #21056 )
...
* add ParameterList container
* add unittest
test=develop
* fix container, rebase remove build_once
test=develop
* add parameters None check
test=develop
* update Sequential unittest
test=develop
* use Linear in Sequential sample code
test=develop
* fix Sequential arg type doc
test=develop
6 years ago
8439384e25
Move sequence op unittest files to a separate folder sequence ( #21842 )
...
* move sequence op unittests to a separate folder
test=develop
* add missing CMakeList file
test=develop
* fix relative path import
test=develop
* fix relative import
test=develop
* use sys.path.append
test=develop
6 years ago
2690ddb558
Use skip_check_grad_ci to skip grad check ( #21907 )
6 years ago
1f3029cb54
ci check for check_shape_white_list.py ( #21859 )
6 years ago
51a86d2b6b
Optimize adam speed ( #21777 )
...
* optimize adam speed by removing _finish_update test=develop
* fix SparseAdamFunctor param list test=develop
* Remove scale_op in expect_list of adam_op test=develop
* fix test optimizer loss assert error test=develop
* fix test optimizer loss assert error test=develop
* modify PADDLE_ENFORCE usage test=develop
* fix op_type in lamb_op.cc test=develop
* fix errors ostream format bug test=develop
* add betaPowOut in ngraph op test=develop
* fix ngraph::op api for gcc8 test=develop
* clean code test=develop
* modify struct into class test=develop
* remove code of beta1Tensor in lamb_op test=develop
6 years ago
310edc0d0c
Update layers used in ptb model to use auto-generated op functions in dygraph mode ( #21724 )
...
* update layers, test=develop
* fix input numpy, test=develop
* fix bugs, test=develop
* follow commments, test=develop
* update getitem, test=develop
6 years ago
f17bd1786a
add decorator skip_check_grad_ci for test_group_norm ( #21910 )
...
* add decorator skip_check_grad_ci for test_group_norm test=develop
6 years ago
feabed1309
Modify op test ( #21835 )
...
* remove return in op_test teardown, test=develop
* add check_grad for fp64 and other type
* update white list
6 years ago
53c16eabe4
test the compatibility between execution time and compiling time ( #21511 )
...
* test the equality between running-time and compiling time
* add white_list for compile_vs_runtime check test=develop
* add check of new-registered op on compile&runtime-lodEquality test=develop
* test=develop
* test=develop
* update white-list test=develop
* merge with new code test=develop
* fix code style test=develop
* test=devleop
* test=develop
* test=develop
* test=develop
* add more ops to white_list test=develop
* test=develop
* test=develop
* test=develop
* test=develop
* test=develop
* fix code_style: add comments test=develop
* test=develop
6 years ago
9dff56e8e2
change qat_performance with mobilenet, change batch_size of qat2_resnet50 ( #21895 )
...
test=develop
6 years ago
5b282a8157
skip check_grad of TestHSigmoidOpSparse ( #21888 )
6 years ago
6b9fbcf3ad
Update iou_similarity op to support non-normalized bbox ( #21671 )
...
Update iou_similarity op to support non-normalized bbox
6 years ago
d053561d84
use large input size in tree_conv and teacher_student_sigmoid_loss ( #21896 )
...
test=develop
6 years ago
46f9184aff
Modify the while_loop API ( #21844 )
6 years ago
7689b6aaa4
Fix default label dim of label_smooth_op. test=develop ( #21862 )
6 years ago
c63ce41102
resolve #21799 ( #21872 )
...
fix flip comments, test=develop
closes:#21799
6 years ago
52a61edaad
rename test_dist_mnist & run dist parallel, test=develop ( #21874 )
6 years ago
879e3074ea
fix the unittest of test_check_import_scipy on V100 ( #21853 )
6 years ago
a25418b32c
Set dtype of compare op's output to bool ( #21864 )
...
* add unittests, test=develop
* set dtype of compare op to bool, test=develop
6 years ago
934d99867a
add selected rows supported in framework ( #21808 )
...
* add selected rows supported in framework
6 years ago
855ed5fb3d
revert parallel test=develop ( #21856 )
6 years ago
25e765a4fe
Copy stop_gradient property of variable in clone ( #21825 )
...
* copy stop_gradient property in clone, test=develop
* fix pruning issue, test=develop
* fix kLookupTablePath issue, test=develop
* sync program, test=develop
* copy subblocks, test=develop
* add unittests, test=develop
6 years ago
957e182a90
revert a+b axis change; test=develop ( #21821 )
6 years ago
6624ea7673
skip test_fetch_handler, will investigate it later, test=develop ( #21845 )
6 years ago
2b941736f3
fix softmax_with_cross_entropy_fix bug, test=develop ( #21810 )
6 years ago
f4379a9149
Update the precision of some op tests from fp32 to fp64 ( #21847 )
6 years ago
538c848958
add decorator skip_check_grad_ci ( #21836 )
6 years ago
bf9c5de752
Update test precision from fp32 to fp64 ( #21848 )
6 years ago
2b1f08c76c
Remove self-set accuracy parameters of op tests: max_relative_error ( #21815 )
6 years ago
9bb1e3ea16
add shape_check for op tests ( #21391 )
6 years ago
63a5fb4cac
tmp fix depthwise_conv2d in dygraph ( #21840 )
...
test=develop
6 years ago
5bb9deb335
Update the precision of some op tests from fp32 to fp64 ( #21774 )
6 years ago
a86f11b5f5
Speed GEO dense calc & communication ( #21579 )
...
* test=develop, speed dense calc & communication
6 years ago
666c3bb9b0
handle multi-inputs with empty inputs for mkldnn_concat_op ( #21827 )
...
test=develop
6 years ago
a9af87edbc
Remove self-set accuracy parameters of op tests: max_relative_error ( #21823 )
...
* Remove self-set accuracy parameters of op tests: max_relative_error
test=develop
* fix error
test=develop
6 years ago
e53d5967c9
Remove self-set accuracy parameters of op tests: max_relative_error ( #21816 )
...
* Remove self-set accuracy parameters of op tests: max_relative_erro
test=develop
* fix error
test=develop
6 years ago
1395828408
Add dygraph Linear layer ( #21265 )
...
* add Linear layer
test=develop
* update unittest for coverage
test=develop
6 years ago
d683b65b1a
Remove self-set accuracy parameters of op tests: atol ( #21711 )
...
* Remove self-set accuracy parameters of op tests:atol
test=develop
* keep smaller parameters
test=develop
* fix error
test=develop
6 years ago
8b74fc4fa7
Fix post training quantization ( #21745 )
...
* fix post training quantization bug of memory constrained, support the input be different, test=develop
6 years ago
aa4d6a5d6c
Add some debug flags to auto growth allocator ( #21766 )
...
* add some debug flags to auto growth allocator, test=develop
* add comments about auto growth, test=develop
6 years ago
c50ebeac12
add comments of inplace_atol ( #21819 )
6 years ago
8b7c50f49a
Make While Op could run on GPU place and add while_loop unittest ( #21672 )
...
1. Make while_op accept GPU conditional data
2. Add more complex test cases for while_loop API
6 years ago
a3a3558dd0
Remove self-set accuracy parameters of op tests: max_relative_error ( #21817 )
...
test=develop
6 years ago
187d1c38ef
Remove self-set accuracy parameters of op tests: max_relative_error ( #21744 )
...
* Remove self-set accuracy parameters of op tests: max_relative_error
test=develop
* fix errors
test=develop
6 years ago
3c33417905
modify the method of skipping CI in distributed unittests ( #21764 )
6 years ago
fb067fa4d2
Modify test framework, test=develop ( #21789 )
...
*use dtype to determine whether check_grade is needed, and delete useless class
6 years ago
557bce77da
Fix Backward Bugs in Conditional Block ( #21809 )
...
The fixed bugs:
1. The condition sub-graph is not pruned
2. When backward graph is extremely simple, the whole backward ops are pruned.
6 years ago
eab124ba98
fix accuracy parameters of op tests ( #21813 )
...
test=develop
6 years ago
642b33564e
Update test precision from fp32 to fp64 ( #21805 )
6 years ago
04909137f5
fix lr assert, test=develop ( #21780 )
6 years ago
9894a4fb35
update test precision from fp32 to fp64, test=develop ( #21783 )
6 years ago
c96f06f2f6
add unary operator __neg__, test=develop ( #21787 )
...
adds unary operator __neg__ for VarBase in dygraph mode, and for Variable in static graph mode.
6 years ago
65c8eac9fe
Remove self-set accuracy parameters of op tests: max_relative_error ( #21741 )
...
* Remove self-set accuracy parameters of op tests: max_relative_error
test=develop
* Remove self-set accuracy parameters of op tests: max_relative_error
test=develop
* Remove self-set parameters of op tests: max_relative_error
test=develop
6 years ago
579a159a7b
Remove self-set accuracy parameters of op tests: max_relative_error ( #21739 )
...
* Remove self-set accuracy parameters of op tests: max_relative_error
test=develop
* Remove self-set accuracy parameters of op tests
test=develop
* keep smaller parameters
test=develop
6 years ago
ecb2419e5c
increase the explanation doc of py_func ( #21631 )
...
* increase example code of py_func, fix some wrong description of English API doc
6 years ago
b976ba3e83
fix unittests ( #21786 )
...
test=develop
6 years ago
73e97d39b4
add check for check_grad in Op unittests ( #21383 )
6 years ago
0677a1c1c1
Fix That conditional_block_op Doesn't Have InferShape ( #21733 )
6 years ago
ac666b8ac3
Remove self-set accuracy parameters of op tests: atol ( #21731 )
...
* Remove self-set accuracy parameters of op tests
test=develop
* add cast
test=develop
* Remove self-set accuracy parameters of op tests:atol
test=develop
* lrn_ngraph_op
test=develop
* Keep smaller parameters
test=develop
6 years ago
c924353d4f
Remove self-set accuracy parameters of op tests: max_relative_error ( #21740 )
6 years ago
f6144d8463
remove build_once & name_scope ( #21131 )
...
* remove build_once & name_scope (Conv2D)
test=develop
* fix unittest
test=develop
* Conv2DTranspose
* Conv3D & Conv3DTranspose
test=develop
* Pool2D & BatchNorm
* Embedding
* LayerNorm
* GRUUnit & NCE
* PRelu
* BilinearTensorProduct
* GroupNorm & SpectralNorm
* TreeConv
test=develop
* fix LayerNorm in transformer unnittest
test=develop
* disable LayerNorm or BatchNorm in multicard
test=develop
* refine Layer.create_parameter api
test=develop
* refine LayerNorm, remove begin_norm_axis param, add normed shape check
test=develop
* LayerNorm bug fix
test=develop
6 years ago
0fe16539ef
Fix dgc & launch tests in cpu ci ( #21759 )
6 years ago
a5a8d14414
Fix softmax cuda bug ( #21720 )
...
* Fix softmax cuda bug
* Refine multihead log and softmax logic
6 years ago
943a44492b
yolo_box OP add Attr(clip_bbox). ( #21620 )
...
* yolo_box OP add Attr(clip_bbox). test=develop
6 years ago
c4f8f3bddc
use large input shape for accuracy test ( #21758 )
...
- ngarph: elementwise_sub, elementwise_mul
- mkldnn: transpose, sum
- others: scatter_nd
test=develop
6 years ago
92f83e46aa
fix accuracy parameters of op tests ( #21729 )
...
test=develop
6 years ago
e92d113590
fix bug that tuple(Variable) is converted to list(Variable) uncorrectly ( #21687 )
6 years ago
7181afd75c
Fix elementwise_pow bug on CUDA place with integer ( #21675 )
...
* fix elementwise_pow bug on integer, test=develop
* use llrint to support elementwise_pow_grad, test=develop
* add some tests, test=develop
* revert grad functor, test=develop
6 years ago
68999b6c7a
simplify dygraph data loader code, test=develop ( #21722 )
6 years ago
9c481e12ba
Patch math method for VarBase using auto-generated op functions ( #21656 )
...
* patch math method for varbase using auto-generated op functions, test=develop
* clean code that handles batch_size, test=develop
* follow comments, test=develop
* follow comments, test=develop
* code clean, test=develop
6 years ago
aa287e19fe
remove the dependency on ssl ( #21712 )
6 years ago
1ee5ba1c58
Enhance checking on sub branch of backward ( #21582 )
...
* add backward unittest test=develop
* add sub-branch in test_backward.py test=develop
* refine code, add comment test=develop
* reconstruct TestBackward Class test=develop
* fix typo of comment test=develop
6 years ago
4570295122
fix assert in nan inf tests, test=develop ( #21742 )
6 years ago
549f24b5f1
run dist tests parallel( #21751 )
6 years ago
a6e935f424
Update op test framework ( #21599 )
...
* update op test framework
6 years ago
7c38612347
disable op test of kldiv_loss ( #21749 )
6 years ago
d528ffaa04
use large input shape for accuracy test ( #21716 )
...
affine_grid, label_smooth, spectral_norm, warpctc,
nearest_interp, data_norm, match_matrix_tensor,
var_conv_2d, fused_embedding_seq_pool
test=develop
6 years ago
a2175cfc96
Tmp fix fleet bug in py35 gcc8 CI, test=develop ( #21703 )
6 years ago
227edfe9da
use large input shape for op tests ( #21705 )
...
sequence_expand_as, squared_l2_distance, gather_nd,
center_loss, rank_loss, conv_shift, spp,
modified_huber_loss, smooth_l1_loss, multiplex,
sequence_softmax, nce, huber_loss, group_norm,
kldiv_loss, hinge_loss, expand_as
test=develop
6 years ago
d419b859c0
Add reshape int8 mkldnn op ( #21428 )
...
* Add reshape int8 op
test=develop
* Change test to CPUPlace
test=develop
* Correct tests
test=develop
6 years ago
c047e713b0
make nGraph ut py3 compatible ( #21679 )
6 years ago
3b915741b2
Fix nGraph UT for PY3 - Part I ( #21678 )
...
* fix test for PY3 test=develop
* reduce file changes test=develop
6 years ago
8a0f611b64
Rewrite check nan inf tools ( #21076 )
6 years ago
019147eb8b
use large input shape for accuracy test, ( #21693 )
...
sequence_unpad, expand, pad, pad_constant_like,
norm, bilinear_tensor_product, flatten2, im2sequence,
unpool, cos_sim, strided_slice, flatten, elementwise_min,
abs, acos
test=develop
6 years ago
5c4106023c
disable qat int8 test for now, test=develop ( #21696 )
6 years ago
9ad940fdfe
memory leak for cpu ( #21174 )
...
* add fake init for the trainer, fix large memory hold in the trainer
* do not merge recv vars from a remote endpoint, test=develop
* add recv and save op, merge slice var in one op, save memory
* remove hsigmoid with pull sparse, test=develop
6 years ago
4c987a6003
fix input shape of op tests ( #21682 )
...
* fix input shape of op tests for elementwise_sub,
gather, pad2d, transpose, softmax, scale,
elementwise_max, hierarchical_sigmoid, reshape2,
sign, squeeze, reduce_sum, sum, squeeze2,
unsqueeze, unsqueeze2, cast, reverse
test=develop
* fix cast, elementwise_mul, gather, scale, sign,
softmax, transpose
test=develop
6 years ago
f64d006622
Change several tests to inherit the right parent class, test=develop ( #21652 )
...
* change several tests to use the right parent class, test=develop
* add dtype for TestLoDTensorAndSelectedRowsOp, test=develop
6 years ago
686f0ecb6a
add `no_need_buffer_slots` interface to pybind ( #21575 )
...
* add no_need_buffer_slots interface to pybind
6 years ago
52f38877e4
Fix ci bug for deleting data files when other test is running ( #21661 )
...
* fix ci bug for deleting data files, test=develop
* update, test=develop
6 years ago
99331fa113
Fix current block in math_patch_op ( #21189 )
6 years ago
d96acc3363
Refine dygraph DataLoader implementation ( #21634 )
...
* refine dygraph dataloader & polish related code, test=develop
* refine code based review comment, test=develop
6 years ago
e2d849b989
Dropout with seed ( #21590 )
...
* add seed op
6 years ago
e81f0228df
MKL-DNN 1.0 Update ( #20162 )
...
* MKLDNN v1.0 rebase to Paddle 1.6
test=develop
* Add hacky paddle::string::to_string() implementation
* vectorize<int64-t>() -> vectorize() cleanup
test=develop
* PADDLE_ENFORCE and void_cast fixes
test=develop
* Rebase changes
test=develop
* Cosmetics
test=develop
* Delete MKL from mkldnn.cmake
test=develop
* CMake debug commands
test=develop
* Delete MKLDNN_VERBOSE and rebase fixes
test=develop
* Rebase fixes
test=develop
* Temporarily disable int8 resnet101 vgg16 and vgg19 tests
test=develop
* Add libmkldnn.so.1 to python setup
test=develop
* Add libmkldnn.so.1 to inference_lib cmake after rebase
test=develop
* Post rebase fixes + FC int8 changes
test=develop
* Fix LRN NHWC
test=develop
* Fix NHWC conv3d
test=develop
* Windows build fix + next conv3d fix
test=develop
* Fix conv2d on AVX2 machines
test=develop
6 years ago
f404157205
fix master patch when slot is dense ( #21580 )
...
* fix master patch when slot is dense
* test=develop
6 years ago
48600d7f17
Add op function generator for dygraph ( #21569 )
...
* add op function generator, test=develop
* add unittest, test=develop
* follow comments, test=develop
* fix windows compilation problem, test=develop
6 years ago
9a4dd1bc25
support float64 for GradClipByGlobalNorm in dygraph, test=develop ( #21401 )
...
* support float64 for GradClipByGlobalNorm in dygraph, test=develop
* fix comment for GradClipByGlobalNorm, test=develop
6 years ago
8777e8c1e9
fix Conv2DTranspose API, test=develop ( #21403 )
6 years ago
fbf9eca0d3
QAT Int8 document ( #21360 )
...
* update benchmark for int8v2, QAT1, QAT2 accuracy and performance
test=document_fix
* change according to reviews
test=develop test=document_fix
* improve some descriptions and some models
test=develop test=document_fix
* update models benchmark data
test=develop test=document_fix
* update int8v2 and qat2 performance
test=develop test=document_fix
6 years ago
a1a5adc9b8
Refine English Doc of cond API ( #21609 )
...
As the title
6 years ago
548efcd2e4
Fix unit tests to avoid check_grad checking failures ( #21554 )
...
* fix python API tests that do not need to inherit OpTest, test=develop
* fix fp16 cases that will only be enabled in GPU mode, test=develop
* remove TestSoftmaxFP16Op from test cases of softmax_mkldnn_op, test=develop
* fix tests so that the cases are only created in GPU mode, test=develop
6 years ago
4ad9b755c7
fix paddle compile errors under some python versions ( #21616 )
...
* fix compile error in some python version, test=develop
* remove redudant code, test=develop
6 years ago
be6a639655
Add CI for checking Input/Output/Attr of modified Ops ( #21522 )
...
* add shell scripts. test=develop
* rename test_pybind_inference to test_pybind_interface and print repeat process in check_op_desc.py. test=develop
* add approval RD. test=develop
6 years ago
835ea12cde
Control flow API: while_loop ( #21276 )
...
Add basic while_loop
6 years ago
4f81d1bd5f
Refine VarBase init function ( #21587 )
...
* refine init function, test=develop
* add tests, test=develop
* remove extern, which may cause symbol error in gcc-4.8, test=develop
6 years ago
56882ce432
change input data type and decrease max_relative_error value in test_check_grad for grop_nom_op test test=develop ( #21608 )
6 years ago
1dcf6a7212
Add Much Complex Test and Fix Bugs for Control Flow cond API ( #21532 )
...
Add tests to use dy/dx to make sure the gradient values calculated by the control flow backward is correct. Also fixed bugs detected by those tests.
Fix bugs:
1. Unlike sum_op, optimizer ops don't allow uninitialized input tensor. But in conditional_block_grad_op, since the conditional_block may not run, the output gradient tensor may be uninitialized, which will cause the optimizer op error. To fix it, we should let optimizer ops support uninitialized input like sum_op or assign the uninitialized gradient to 0 when the conditional_block_grad_op doesn't run. I found there are about 10+ optimizer ops. **To be simpler, I just assign output gradient of the conditional_block_grad_op to 0 in this PR**. But it can be further explored whether we can make optimizer ops like sum_op to support uninitialized input tensor because theoretically we can speed up without the assigning in conditional_block_grad_op.
2. Infer parameter shapes during append_backward. I didn't know that all our parameters are in global block. When op_desc is inferring shapes at the sub-block, it may not know the shape of gradients of parameters whose shape information is at global block. I fixed it by inferring shapes of gradients from forward var.
This PR also did some code clean up:
1. Print the var name when sgd_op catches shape error so that it is easier to debug
2. Fix a typo: dicta -> dict
6 years ago
c5aec2fe68
Paddlebox Related to Framework ( #21586 )
...
* Add a single_process_multi_thread transpiler.
* Add some UTs.
* Fix some API description.
6 years ago
9da7e6b4d4
add file check_op_desc.py and add interface to get default value. ( #21530 )
...
* add file check_op_desc.py and add interface to get default value. test=develop
* add test for c++ coverage rate. test=develop
* Correct typo. test=develop
6 years ago
2057df7ac0
add fluid.layers.gelu & doc ( #21515 )
...
Add a python interface for Gelu.
Add documentation for fluid.layers.gelu.
6 years ago
29c3844585
fix doc typo test=develop ( #21566 )
6 years ago
9ce0e29dc3
[MKL-DNN] Batch norm mkl-dnn NHWC support ( #21553 )
...
* - BAtch norm mkl-dnn NHWC
test=develop
- compilation fix
test=develop
- UT fix
- cosmetics
test=develop
- Fix to Batch Norm MKL-DNN NHWC UT
test=develop
Conflicts:
paddle/fluid/operators/batch_norm_op.h
* - Lint fixes
test=develop
6 years ago
657053f262
remove elementwise x_should_larger_than_y restriction;test=develop ( #21517 )
6 years ago
08483a6819
Add dygraph linear warm up decay ( #21186 )
...
* dygraph mode support linear lr warm up; test=develop
* add unitest for linear warmup; test=develop
* add input type check; test=develop
* fix type check assert error; test=develop
* change type error; test=develop
6 years ago
da75ac8b6c
bugfix: construct a DistributedStrategy instance if the passed one is None ( #21545 )
6 years ago
de46b15951
Unify the rank of prelu alpha to 4, corresponding to [N, C, H, W], except for the all mode
6 years ago
cdd46d7e02
Split VarBase from Python Variable for Dygraph ( #21359 )
...
* test=develop, fix docker with paddle nccl problem
* don't expose numerous Tensor.set(), test=develop
* fix condition, test=develop
* fix float16 bug, test=develop
* feed should be Tensor or np.array, not Variable or number, test=develop
* use forcecast to copy numpy slice to new array, test=develop
* remove float16-uint16 hacking, test=develop
* add variable method to varbase and refactor to_variable to support return varbase
* support kwargs in varbase constructor
* add VarBase constructor to support default python args
* refine varbase initial method
* reset branch
* fix ut for change VarBase error info to PaddleEnforce
* cherry is parameter change before
* overload isinstance to replace too many change of is_variable
* rm useless files
* rm useless code merged by git
* test=develop, fix some ut failed error
* test=develop, fix test_graph_wrapper
* add some tests, test=develop
* refine __getitem__, test=develop
* add tests, test=develop
* fix err_msg, test=develop
6 years ago
cdba41af4d
dygraph Embedding layer use lookuptable v2 ( #21209 )
...
* dygraph Embedding layer use lookuptable v2
test=develop
* fix test_nce
test=develop
6 years ago
4c9b3dafa7
fill_constant_batch_size_like OP precious problem fix ( #21337 )
...
* fix fill_constant_batch_size_like_op precious problem test=develop
6 years ago
b1da35261b
fix unit tests that do not need to inherit OpTest ( #21460 )
...
* fix PythonAPI test in Op unittest, test=develop
* fix unit tests that do not need to inherit OpTest, test=develop
6 years ago
768f9242e9
Fix dgc clip & rampup step, test=develop ( #21491 )
6 years ago
54382ce497
Add get_all_kernels api of registered data_type in pybind.cc ( #21499 )
...
* add _get_all_register_op_kernels api test=develop
* refine usage of check_op_register_type test=develop
* add import in core test=develop
6 years ago
e75ded08a0
fix the compatiable problem between PY2 and PY3 (issue#20749) ( #20942 )
...
* fix the compatiable problem between PY2 and PY3.
* add ut, test=develop
* add proxy, test=develop
* download dataset before test, test=develop
6 years ago
a3535812f6
add _use_system_allocator to some op tests, test=develop ( #21504 )
6 years ago
18a5d30754
[MKL-DNN] Conv2d and Conv2d transpose MKL-DNN NHWC support ( #21466 )
6 years ago
2445fef386
Fix density sample ( #21506 )
6 years ago
6ebf0f47b8
support SelectedRows in dygraph, test=develop ( #21078 )
...
* support SelectedRows in dygraph, test=develop
* fix bug of _grad_ivar interface, test=develop
* add optest for support seletedrows, test=develop
* fix bug for gradient_accumulator in GPU mode, test=develop
* fix error when Selectedrows addto LodTensor in sorted_gradient mdoe in dygraph, test=develop
* refine and simplify gradient accumulator code, test=develop
* add optest, test=develop
* add optest and simplify code, test=develop
* fix bug for test_imperative_selected_rows, test=develop
* add optest for Coverage, test=develop
* fix gradient interface and simplify code, test=develop
* update api for gradient, test=develop
* fix ShareDim's bug in DygraphExecutionContext class, test=develop
* add optest, test=develop
6 years ago
0bc8bdf724
set dim[0] to -1 if dim[0] < 0 during compiling for c_allgather op ( #21402 )
...
* set dim[0] to -1 if dim[0] < 0 and remove assertion to runtime, test=develop
* modify ENFORCE message, test=develop
* add validation for x.shape[0] > 0, test=develop
* add ut, test=develop
6 years ago
4bf115b42d
Fix AdamOptimizer and Scale sample code Bug ( #21478 )
...
* fix adam sample code bug test=document_fix
* fix sample code bug in scale test=document_fix
6 years ago
94bef03539
Revert "Add masked select api ( #21172 )" ( #21456 )
...
This reverts commit 007c997572
6 years ago
3706ea67f8
fix sample code in density prior box
6 years ago
87ab93af01
fix adam fp64, test=develop ( #21423 )
6 years ago
beec87b911
fix bug in example codes of API case and switch_case. test=develop,test=document_fix ( #21477 )
6 years ago
7e68bc896b
refactor AUC OP and add its CUDA Kernel ( #21336 )
...
* refactor AUC OP and add its CUDA Kernel
* the layout of global auc doesn't change
6 years ago
1f57ac1241
delete concat in AddQuantDequantPass, test=develop ( #21454 )
6 years ago
2a54c359f0
add fraction of cpu memory to use, test=develop ( #21453 )
6 years ago
101240d2c1
fix PythonAPI test in Op unittest, test=develop ( #21462 )
...
There are PythonAPI tests in Op's unittest which don't need to inherit OpTest class.
6 years ago
dbbe6e9cb6
fix the device supported of the op unique and unique_with_counts. ( #21395 )
...
* fix the device supported of the op unique and unique_with_counts.
test=develop
test=document_fix
* Fix the precision of test in the op of unique and unique_with_counts.
test=develop
test=document_fix
6 years ago
32959e031e
Add English Document for cond API ( #21452 )
...
Add English doc for cond
6 years ago
3df13ab40c
fix PythonAPI test in Op unittest, test=develop ( #21455 )
...
There are PythonAPI tests in Op's unittest which don't need to inherit OpTest class.
6 years ago
5e813b53c5
nhwc optimization for batchnorm ( #21090 )
6 years ago
e0c9d856fb
add unused input vars check for OpWithKernel, test=develop ( #21169 )
...
* add unused input vars check for OpWithKernel, test=develop
* remove unused vars in some ops, test=develop
* fix batch_norm, test=develop
* add white list, test=develop
* add CI check for white list, test=develop
* :ove white list to c++, test=develop
* solve failure of CI, test=develop
* add unittest for unused_var_check, test=develop
* refine code, enable check in operator_test, test=develop
* skip mkldnn, test=develop
* extend white list, test=develop
* refine condition of mkldnn, test=develop
* fix paddle_build, test=develop
* follow comments, test=develop
* fix GetExpectedKernelType
* add wiki ref to err_msg, test=develop
* follow comment, test=develop
6 years ago
664f958a02
Fix optimizer op infershape failed in dygraph multi-cards mode ( #21374 )
...
* add param & grad shape check for sgd op
* add _reshape_inplece interface for dygraph parallel
* refine unittest based paddle/models scripts, test=develop
* add unittest for parallel grad fuse, test=develop
6 years ago
630be31952
Fix Cond Bug for Nested Control Flow ( #21340 )
...
* Commit before merging develop
test=develop
* Backup after working with Huihuang logs
* Commit before deleting Huihuang debug loggings
* Commit before debug
test=develop
* Fix bug commit
test=develop
* Backup of fixing bugs
test=develop
* Clean up code
test=develop
* Fix a bug in sum_op
test=develop
6 years ago
cd43c4440e
[MKL-DNN] LRN and Pool2d (FWD) NHWC support ( #21375 )
6 years ago
ca879e5a77
fix skip_op bug ( #21418 )
...
test=develop
6 years ago
b16274556a
Add dscending for argsort ( #21400 )
...
* Add ascending for argsort
* Refine api doc description.
* Refine descending description
* Add int32 logic to speedup when data is small size.
* Remove int32 opt as not support in python
6 years ago
ac8546701d
Add dygraph execution context ( #20157 )
...
* add_dygraph_execution_context
* add dygraph infershape context and execution context; test=develop
* fix imperative bug; test=develop
* remove inputs outputs interface from execution context,
because it have same function with inputNames;
test=develop
* remove tracer_test ctest; test=develop
* fix split op bug; test=develop
* fix unitests bug; test=develop
* fix distribute test bug; test=develop
* fix ngraph compile bug; test=develop
* fix grad maker bug; test=develop
* fix load op bugs; test=develop
* fix operator.cc construct bug; test=develop
* remove useless name find in operator; test=develop
* add tracer_test; test=develop
* fix concat, split bug; test=develop
* remove tracer_test unitest; test=develop
* fix attribute check bug; test=develop
* add test code to fix converage; test=develop
* remove useless code, change check backward input in engin; test=develop
* unlock var type infer shape;test=develop
* add ShareAllLoD api; test=develop
* add dygraph infershape context unitest; test=develop
* remove increase and decrease lod in dygraph; test=develop
* addd override; test=develop
* fix increase descrease lod; test=develop
* fix paddle_enforce; test=develop
* disable lod op dygraph check; test=develop
* fix paddle enforce error; test=develop
* add comment for op_registry and OperatorBase; test=develop
* optimize the comment of op_registry; test=develop
* fix format of comment; test=develop
* fix format of comment; test=develop
* optimize the format of comment; test=develop
* optimize the format of the comment; test=develop
* optimize comment of op_registry; test=develop
6 years ago
a6b089c614
add macro to ban windows ( #21422 )
...
remove nccl related code in windows
6 years ago
ebfb720a63
add Adam beta1/beta2 support Variable ( #21234 )
...
* add Adam beta1/beta2 support Variable. test=develop
6 years ago
09696d5df8
Use system allocator in OpTest ( #21335 )
...
* use system allocator in unittests, test=develop
* fix op bugs, test=develop
* fix tensor copy bug when src and dst are the same, test=develop
6 years ago
007c997572
Add masked select api ( #21172 )
6 years ago
67c836fb5c
batch_norm momentum support variable ( #21246 )
...
* batch_norm momentum support variable. test=develop
* fix format. test=develop
* add batch_norm momentum variable example. test=develop
* move MomentumTensor to training branch. test=develop
* split example. test=develop
* fix doc. test=develop
* fix PADDLE_ENFORCE ci. test=develop
* fix format. test=develop
6 years ago
c0aa13672e
Fp32 vs int8 qat C++ performance ( #21244 )
...
* add ut for comparing FP32 and QAT INT8
* add save qat transformed model python script
test=develop
* updated
* added missing file
* add "with_label"
test=develop
* performance benchmark as unit test
test=develop
* change names of unnecessary thing
* Change CMakeList.txt for model downloading and UT
test=develop
* change names of functions and params for more readable code
test=develop
* Change PADDLE_ENFORCE messages
test=develop
* fix indent problems
test=develop
* indent problems
test=develop
6 years ago
f1178e9d79
fix fleet save bug ( #21362 )
...
* fix fleet save bug of save_infernece_model
* test=develop
6 years ago
Liufang Sang
1840c1652c
add config file to avoid load checkpoint test=develop ( #21373 )
6 years ago
b97fc16d21
fix lod_reset bug, test=develop ( #21392 )
6 years ago
47a82e38e3
Support data_norm gpu kernel ( #21325 )
...
* support data_norm_op run in CUDA
* add two parameters sync_stats & summary_decay_rate
* add UT
6 years ago
d5ff79e55e
Support numpy bridge (enabled by default in dygraph mode) ( #20983 )
...
* add numpy bridge
* fix template compile
* add unittest, add default
test=develop
* fix unittest
test=develop
* fix unittest
test=develop
* zero_copy=True for to_variable,
test=develop
* bug fix
test=develop
* disable deprecated NumPy API
test=develop
* use better design of NumpyAllocator
test=develop
* fix Py_None check
test=develop
* reset c++ tracer when jump out dygraph guard
test=develop
* refine PADDLE_ENFORCE_xx format
test=develop
* bug fix of tracer switch
test=develop
* update decref
test=develop
6 years ago
5d7d548275
INT8 Fully-connected ( #17641 )
...
* Implement Int8 FC
* Integrate FC into INT8v2
test=develop
* int8 FC: transpose weights before computing scales
test=develop
* Add support for activation_type string in FC
test=develop
* Disable MKL-DNN's FC in VGG16 and 19
test=develop
* Disable FC quantization when mkldnn FC is disabled
test=develop
* Solve PADDLE_ENFORCES in FC int8
* Fix Paddle enforces and remove const cast
test=develop
* Fix style changes
test=develop
* Fix quantizer_tester test and add fc quantization
test=develop
* Fix FC test fail on CUDA
* Remove unnecessary log from quantize placement pass
test=develop
* Add Thread ID to FC hash key
test=develop
* Add comments to MKL-DNN FC Kernel
test=develop
* Refactor quantizer
test=develop
* Fix linter issues
test=develop
* Fix crash in slim googlenet
test=develop
* Fix PADDLE_ENFORCE messages
test=develop
6 years ago
07e6a94268
paddleslim quantization skip pattern support list of string ( #21141 )
6 years ago
be2e3e67d9
Fix some typos in AMP. ( #21354 )
...
* fix some typos in AMP. test=develop
* delete useless codes. test=develop
6 years ago
41d13209d7
add the framework support for distfc ( #21197 )
...
* add the framework support for distfc and ut, test=develop
* fix the implementation of shard_index_op, test=develop
6 years ago
a214a3081b
change download log format ( #21290 )
...
* change download log formate; test=develop
* add unittest for data download; test=develop
* remove cache before download; test=develop
6 years ago
234060f88f
Add fc padding to improve mkl GEMM's performance when N and K are multiple of 128. ( #20972 )
...
* Add fc padding to solve mkl performance
test=develop
* fix gpu pass and error information
test=develop
* fix fc_fuse_pass_test
test=develop
* fix error information
test=develop
* fix error information
test=develop
* fix name and add fc op padding test
test=develop
* fix attributes
test=develop
* optimize fc padding
test=develop
* fix test
test=develop
6 years ago
6cfcbe0510
reduce interp op input size to pass CI, test=develop ( #21341 )
6 years ago
f4cf028a8c
[MKL-DNN] Error throwing for NHWC layout for MKL-DNN ops ( #21207 )
6 years ago
ed9ceb9f98
Refactor MKL-DNN ElementwiseMul ( #21061 )
...
* Refactor MKL-DNN ElementwiseMul
remove manual fallback, remove format attrs
test=develop
* Refine PADDLE_ENFORCEs in eltwise_mul_op.h
test=develop
* Make ElementwiseMulOp inherit from ElementwiseOp
* Change type of simd_width to int
test=develop
* Remove Constructor extensions in ElementwiseOp and ElementwiseMulOp
test=develop
* Restore attributes
test=develop
* Fix test coverage for mkldnn eltwise mul
test=develop
* Conform to new is_run_common_broadcast API
test=develop
* Add UT for AreDimsAndFormatCorrect
test=develop
6 years ago
0a93635b5f
fix logger problem ( #21342 )
...
* fix logger problem
test=develop
* refine logger
test=develop
6 years ago
6514f52e46
fix the fill_constant op precious problem ( #21322 )
...
* fix the fill_constant op precious problem test=develop
6 years ago
08c19c585d
Improve argsort performance. ( #21267 )
...
* Improve argsort performance.
- Give 200000 data to compute argsort on v100,
can speed up ~190x
before opt cost: 0.53s
after opt cost:0.0027s
- Add fp16 support
* Refine error message
* Refine code
test=develop
Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com>
6 years ago
7fcaa39b36
fix Print_op input dtype list error test=develop ( #21326 )
6 years ago
84865b806b
add resnet50 test for post trainint quantization, test=develop ( #21272 )
6 years ago
9a7832f8be
print table stat info for pslib ( #21296 )
...
* print table stat
test=develop
* notes
test=develop
* notes
test=develop
6 years ago
8ac7687e36
Fix dgc accuracy by mv regularization to local ( #21278 )
6 years ago
b9f8ae8494
Add global value getter setter ( #21285 )
...
* add global value getter setter, test=develop
* fix error messages, test=develop
6 years ago
691ced87c0
Refactor fetch handler ( #21264 )
...
* fix fetch handler problem and refactor
when a user define FetchHandler class, he or she should initialize a handler
with variable dict. the key of a variable dict is a user defined name,
the value of a variable dict is a Varaible generated from python API.
For each fetching, a user should implement handler function in which
fetched_result_dict will be available and the user can access the fetched value
with user defined keys.
6 years ago
f1b09ba30e
adapt test_collective_base.py for only two GPU cards available. ( #21307 )
...
* adapt test_collective_base.py for only two GPU cards available.
test=develop
* fix bug of issue #21259
test=develop
6 years ago
ed2a185248
optimize nhwc for tensor core in ConvOp and ConvGradOp ( #20597 )
6 years ago
Liufang Sang
f0b1518438
add dequantize_abs_max op and modify lookup_table op ( #20899 )
...
* add int8 kernel to lookup_table op and add dequantize op test=develop
* change paddle_enforce to paddle_enforce_eq test=develop
* change copyright and change some not suitable code test=develop
* remove debug log test=develop
* replace GetInputType with IndicateVarDataType test=develop
* fix EmptyGradMaker test=develop
* fix diff between cpu and gpu test=develop
* use memcopy when int8_t test=develop
6 years ago
a6ce2306f9
support cvm_op run in gpu ( #21300 )
...
Previously, CVM OP was only able to run in CPU. This PR implements its GPU kernel.
What's more, we improve the UTs about CVM OP.
6 years ago
952508527a
Polish some PE code details ( #21274 )
...
* polish code details, test=develop
* futher polish hint msg, test=develop
6 years ago
0fd1281ef8
fix bug of issue #21259 ( #21287 )
...
pass the argument `allow_out_of_range` of one_hot op to c++ back end.
6 years ago
319d2ba925
fix fs_client_param bug ( #21212 )
...
* fix fs_client_param bug， user can set this config through fleet_desc_file or fleet config
* test=develop
6 years ago
0d17c1b816
solve pslib core in stop worker ( #21263 )
...
* general table
* add sparse table
test=develop
* no cvm
test=develop
* add no_cvm
test=develop
* add note
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* add key of optimizer
test=develop
* solve pslib stop core
test=develop
* barrier
test=develop
* add notes
test=develop
6 years ago
fa4d055098
fix bug for python/paddle/fluid/tests/unittests/test_elementwise_mul_op.py, test=develop ( #21289 )
6 years ago
c4ede95c74
open dygraph op test, test=develop ( #19787 )
...
* open dygraph op test, test=develop
* modify to_variable, test=develop
* modify input and output for dygraph, test=develop
* modify input and output for dygraph(fix bug), test=develop
* fix input processing of dygraph op test, test=develop
* fix bug, test=develop
* fix op test, test=develop
* fix forward bug for dygraph, test=develop
* fix mkldnn op test for forward, test=develop
* update nn.py for dygraph, test=develop
* fix crop_tensor_op, test=develop
* fix elementwise_mul_op, test=develop
* fix fill_op, test=develop
* fix some mkldnn op, test=develop
* open backward op test for dygraph, test=develop
* delete log, test=develop
* close backward op test for dygraph, test=develop
* fix bug for edit_distance_op and test_lstm_cudnn_op, test=develop
* fix optest backward bug for dygraph, test=develop
* fix optest backward bug for dygraph, test=develop
* close backward op test for dygraph, test=develop
* close backward op test for dygraph, test=develop
* open dygraph op test, test=develop
* fix op test for dygraph, fix GradOpDescMaker, test=develop
* fix bug for linear_chain_crf_op.h, test=develop
* remove log, test=develop
* remove log, test=develop
* remove log for op_test.py, test=develop
* remove log for op_test.py, test=develop
* fix bug for var_conv_2d_op, change PADDLE_ENFORCE, test=develop
* fix PADDLE_ENFORCE_EQ for hierarchical_sigmoid_op.cc, test=develop
* fix bug for test_increment_ngraph_op.py, test=develop
* fix lod for op test in dygraph, test=develop
* refactor op_test.py to reduce redundant code, test=develop
* fix lod optest, modify InputVar/OutputVar to HasInput/HasOutput, test=develop
* remove debug log, test=develop
* remove redundant code in base.py, test=develop
* fix some error in optest, test=develop
* fix ClearNoNeedBufferInputs function's bug for LoDTensor, test=develop
* refactor op_test.py, test=develop
* remove redundant writing, test=develop
* fix error(get tensor of the grad variable), test=develop
* fix test_concat_mkldnn test_conv2d_mkldnn, test=develop
* fix optest.py for get tensor of LoDTensor, test=develop
* fix optest.py for get tensor of LoDTensor, test=develop
* fix optest.py for get tensor of LoDTensor, test=develop
* fix some redundant code, test=develop
* reslove conflict and rewrite paddle error message, test=develop
6 years ago
3ab60f5bf9
fix mkldnn include. test=develop ( #21247 )
...
* fix mkldnn include. test=develop
* fix mkldnn inlcude. test=develop
6 years ago
eca66f317e
fix fleet util bug ( #21254 )
...
* fix fleet util bug in save paddle inference model
* test=develop
6 years ago
1f39a9f17e
fix the bug of scatter_nd, test=develop ( #21257 )
6 years ago
382cf5d7e3
add input type and input data type check for Print_op test=develop ( #21250 )
...
* add input type and input data type check for Print_op test=develop
6 years ago
349e82d669
support general embedding params ( #21217 )
...
* general table
* add sparse table
test=develop
* no cvm
test=develop
* add no_cvm
test=develop
* add note
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* add key of optimizer
test=develop
6 years ago
zhongpu
mapingshuo
pkpk
lijianshe02
juncaipeng
zhouwei25
hutuxian
WangXi
songyouwei
GaoWei8
zhupengyang
Aurelius84
Leo Chen
huzhiqiang
lidanqing
FDInSky
guofei
Guo Sheng
Galden
silingtong123
tangwei12
gongweibao
hong
Chen Weihang
Zhang Ting
Chengmo
Wojciech Uss
Zeng Jinle
Huihuang Zheng
zhaoyuchen2018
Kaipeng Deng
lilong12
Aurelius84
joanna.wozna.intel
baojun
Adam
xujiaqi01
liym27
Feiyu Chan
wangchaochaohu
Jacek Czaja
danleifeng
ruri
wawltor
Jie Fang
Liufang Sang
Michał Gallus
itminner
Zhen Wang
Dong Daxiang
Thunderbrook
Yi Liu
ShenLiang