Zhen Wang
2989c012f2
[DygraphToStatic]Add cast transform for dygraph_to_static. ( #25325 )
...
* add cast transform and its UT for dygraph_to_static.
5 years ago
Aurelius84
bdad383c1d
fix test_mobile_net random failed test=develop ( #25364 )
5 years ago
Aurelius84
a3dfff51ad
[Dy2stat] Disable test_lac on windows ( #25359 )
...
* fix test_lac timeout test=develop
* disable it on windows test=develop
5 years ago
lilong12
3d96601b82
modify pipeline optimizer to only support the mode of sync pipeline training ( #25065 )
...
* modify pipeline optimizer, test=develop
5 years ago
Zhou Wei
b555378e18
fix Layer.__dir__ to show the parameters/sublayers/buffers/attr/method of the Layer ( #25197 )
...
* show the attr and functions of the Layer,test=develop
* add buffer for dir,test=develop
* fix __dir__,test=develop
* fix doc of Layer.__dir__, test=develop
5 years ago
Kaipeng Deng
74468bf428
add mish op. ( #24565 )
...
* add mish op. test=develop
5 years ago
Zhou Wei
8de89e67e9
support tuple/list init for VarBase ( #25231 )
...
* support tuple/list init for VarBase,test=develop
* fix doc of fluid.dygraph.to_variable,test=develop
* fix doc of fluid.dygraph.to_variable,test=develop
5 years ago
Zhen Wang
dc17ac9199
fix import fluid error in dygraph_to_static. test=develop ( #25195 )
5 years ago
Yi Liu
b0f18947f3
fix the compatibility of PY2 and PY3 in paddle.distributed.launch ( #25304 )
...
* fix the compatibility of PY2 and PY3 in paddle.distributed.launch
test=develop
* only pull log of local rank 0
test=develop
* log exception if UnicodeEncodeError occurs when pulling log in
paddle.distributed.launch
test=develop
Co-authored-by: SunGaofeng <peakbee@gmail.com>
5 years ago
Yang Zhang
6d6efafeeb
Add `matrix_nms_op` ( #24400 )
...
* Add `matrix_nms_op`
test=develop
* Make ci happy
test=develop
* Exit early when no detection
test=develop
* Fix license year
test=develop
* Output index as well
test=develop
* Match nms2 lod behavior and add `return_index` flag
test=develop
* Make CI happy
test=develop
* Fix wording
test=develop
5 years ago
danleifeng
064d0ce386
fix check_type bug and example code in hash api; test=develop ( #25253 )
5 years ago
tangwei12
9825a9f3ca
disable distributed UT temporary ( #25300 )
...
* disable distributed UT temporary,enable it soon, test=develop
5 years ago
chalsliu
46214e5937
Disable test_conv3d_transpose_op ( #25298 )
...
test=develop
5 years ago
Kaipeng Deng
826c607e0c
Fix test multiprocess dataloader static ( #25287 )
...
* fix test_multiprocess_dataloader_static random fail. test=develop
5 years ago
Aurelius84
ed262b804c
[Dy2stat] Add Sentiment and LAC model for unittest ( #25071 )
...
* add sentiment unittest
* add LAC model
* add test=develop
* rename tmp test=develop
* fix timeout test=develop
* undo tmp_var test=develop
5 years ago
Chengmo
e85fcaa712
Fix fluid.embedding in Distributed Training ( #25174 )
...
* test=develop, fix_embedding
5 years ago
Zhou Wei
c701588b14
add base class of LearningRateEpochDecay, and API: MultiStepDecay, and API: StepDecay ( #24821 )
...
* add new API: MultiStepDecay, a new learing rate strategy, test=develop
* add new API: MultiStepDecay, a new learing rate strategy,test=develop
* add new API: MultiStepDecay, a new learing rate strategy,test=develop
* add base class of LearningRateEpochDecay, and MultiStepDecay, and StepDecay, test=develop
* fix doc to add coverage,test=develop
5 years ago
Aurelius84
494cb36d09
Modify tmp var name prefix in dygraph ( #25280 )
...
* Modify tmp var name prefix in dygraph test=develop
* refine comment test=develop
5 years ago
Aurelius84
82ec247a02
fix random failed on GPU test=develop ( #25293 )
5 years ago
Zhou Wei
c505c4dbea
add new API: optimizer.set_lr ( #24455 )
...
* add new api: optimizer.set_lr, test=develop
* add API doc and example code for optimizer.set_lr,test=develop
* add API doc and example code for optimizer.set_lr,test=develop
* Modified doc to :api_attr: imperative,test=develop
5 years ago
WuHaobo
6bf7df475c
Fix English doc of the activation OPs, such as exp, rsqrt, abs....... ( #25258 )
5 years ago
Kaipeng Deng
001c0674ee
disable test_multiprocess_dataloader_static for random fail in Py35 CI. test=develop ( #25265 )
5 years ago
Huihuang Zheng
5e8e6dad72
[Dy2stat] Support Various-Length Return Grammar in Dy2stat ( #25249 )
...
Support Various-Length Return Grammar in Dy2stat. This PR is a follow-up of https://github.com/PaddlePaddle/Paddle/pull/25176 .
The basic idea is putting no-value placeholder variables at `return` statement to make all `return` statement have same length, after that the static graph can have fixed fetch output (code at return_transformer.py). Then remove those no-value placeholder when we finally return dygraph result (code at partial_program.py).
However, various length return in Bert model is still not supported. The dy2stat can change the code as I wish but some ops which check shape at compile time (e.g. Reshape, MatMul) will throw error because of the no-value-placeholder may not have the required shape. Is this a matter? To me, those no-value placeholder will be replaced as really values meeting shape requirements at run time, so I think the solution should be some way to do the compile-time checking. By the way, every time when we have dynamic shape, it often causes problem in dy2stat. We should find a way to handle it in the future.
Fixing various return in Bert is my TODO thing and I will also find some other existing models for verification.
5 years ago
Aurelius84
de27569eca
[Dy2Stat] fix diff of cycle GAN model on GPU ( #25233 )
...
* fix GPU diff test=develop
* refine code test=develop
5 years ago
Wojciech Uss
23a4f54b73
rename qat into quant ( #24948 )
...
test=develop
5 years ago
123malin
f1a9593d69
test=develop, bug fix for index_select and roll op ( #25251 )
5 years ago
Yi Liu
5209b9a510
cat log to stdout when setting log_dir in launch ( #25147 )
...
test=develop
5 years ago
hong
dbc3fd5eb4
fix LinearLrWarmup bug; test=develop ( #24913 )
5 years ago
tangwei12
f6f7df9cd5
decrease test data, test=develop ( #25252 )
5 years ago
Tao Luo
2d5aa74321
add test_parallel_executor_profiler.py ( #25200 )
...
* add test_parallel_executor_profiler.py
test=develop
* set exec_strategy.num_threads=1
* skip check_profile_result
* add TODO for test_profiler
test=develop
5 years ago
Wojciech Uss
56fa3880e3
rename qat into quant in filenames only ( #25194 )
...
test=develop
5 years ago
Aurelius84
02adf68dcc
[Dy2stat]Support buffers and register_buffer in Layer ( #24888 )
...
* support to save varBase created in __init__ test=develop
* polish code test=develop
* refine to_static_var test=develop
* refine warning test=develop
* add unitteset for to_static_var test=develop
* fix logger test=develop
* polish buffers en doc test=develop
* fix param_guard test=develop
* refine en doc test=develop
5 years ago
Wilber
4c964abdf7
support build on arm. test=develop ( #25212 )
5 years ago
Huihuang Zheng
6f631a27c7
[Dy2stat] Add Basic Support for Grammar 'return' ( #25176 )
...
This PR added basic support for 'return' grammar in dy2stat. It supports the control flow of 'return'.
The basics idea is using a return value variable to store the early return statements and boolean state variables with if-else to skip the statements after the return statements.
**This PR is very basic support. There are some corner cases I didn't develop/test**. For example, 'return None', 'return different length of variables', 'return non-tensor and tensor together', 'no return statement'. **These corner cases will be done in my next PRs**. Target date is this week.
**Note**:
1. for the unit test, I changed test_program_translator.py because the StaticCode of `dyfunc_with_if_else` will change. To guarantee the correctness of `dyfunc_with_if_else`, I also run it in `TestRecursiveReturn` in test_return.py.
2. I commented the early return code in bert_dygraph_model.py because 'return different length of variables' is unsupported now. I also know that there are some other models used early return and we didn't enable it in the unit test. I will add support for it in next PRs and then re-enable those tests.
5 years ago
Aurelius84
cb0472b05a
merge into one function test=develop ( #25184 )
5 years ago
liu zhengxi
68e93d8a17
Fix beam_search InferShape ( #25169 )
...
* fix beam_search infershape, test=develop
* fix beam search op unittest, test=develop
5 years ago
chalsliu
cd4d9122e7
Remove RUN_SERIAL TRUE ( #25179 )
5 years ago
Aurelius84
38d2d13d8b
[Dy2stat] Add CycleGAN model for unitttest ( #25072 )
...
* add cycle_gan_model
* align train test=develop
* modify image_size into 64 to avoid TimeOut test=develop
* TODO in GPU test=develop
5 years ago
FDInSky
1f24c84a3f
fix conv3d_transpose_test timeout error ( #25004 )
...
* test=develop fix conv3d_transpose_test error
5 years ago
Tao Luo
a965ac4c61
disable PE usage in test_profiler.py ( #25172 )
...
test=develop
5 years ago
LielinJiang
b6e4be178d
fix test download, test=develop ( #25158 )
5 years ago
Zhou Wei
a7cf562447
fix sample code error of fluid.dygraph.NaturalExpDecay,test=develop ( #25092 )
...
fix sample code error of fluid.dygraph.NaturalExpDecay
5 years ago
Tao Luo
9ba585f5bf
fix PE in test_profiler.py ( #25144 )
5 years ago
iducn
f282599229
disable unitest for gcc8( #25134 )
5 years ago
Aurelius84
e8134e873a
[Dy2stat]Refine caches of converting function ( #25085 )
...
* Refine caches of converting func test=develop
* fix if statement test=develop
* refine cache code test=develop
* rm unuse import statement test=develop
* Polish code comment test=develop
5 years ago
Aurelius84
8d6de44012
Refine check_type Error Message for @declarative ( #25098 )
...
* Refine check_type for @declarative test=develop
5 years ago
Chen Weihang
b23801a262
polish tensor set error messag, test=develop ( #25113 )
5 years ago
Zhou Wei
542a226c3e
add new API: set_global_initializer ( #24378 )
...
* add new api (set_global_initializer/reset_global_initializer),test=develop
* add new api (set_global_initializer/reset_global_initializer),test=develop
* fix doc and example code of set_global_initializer,test=develop
5 years ago
Chen Weihang
509d3ec5b7
[Dy2static] Add for iterate or enumerate variable list unittest ( #25100 )
...
* add for iter var list, test=develop
* add enumerate unittest, test=develop
5 years ago
liym27
eb1c0901a6
[Dy2Stat]Remove unnecessary vars from gast.comprehension in LoopTransformer. ( #25094 )
5 years ago
Jacek Czaja
a7944904d3
[oneDNN]elementwise_add and elementwise_mul int8 support ( #24984 )
...
* Start implementing int8 eltwise add
test=develop
* - Fix to Michal PR
* - Fix
test=develop
* - Lint fixes
test=develop
* - Added checking if elementwise_mul can be used
test=develop
* - Added attribs to skip_attrs_set
test=develop
* - Improved broadcasting
test=develop
- fixes to compilation
- fix
- fix
- Lint fixes
test=develop
* - removed redundant condition
test=develop
Co-authored-by: Michal Gallus <michal.gallus@intel.com>
5 years ago
LielinJiang
a01113c338
Add relu layer for lenet ( #24874 )
...
* add relu for lenet, test=develop
* fix test model, test=develop
5 years ago
FlyingQianMM
3b28629ee8
fix dtype error in retinanet_target_assgin example codes. test=develop ( #25091 )
5 years ago
liym27
db601f70cc
[Dy2Stat] Add test for dygraph seq2seq model. ( #25054 )
...
* The arg of append() can be not Tensor temporarily.
* Add Seq2Seq as ProgramTranslator Unit Test.
* set dtype of vocab_size_tensor to int64 to pass Windows-CI.
5 years ago
cc
8fc31d501b
Support conv2d_traspose quantize, test=develop ( #25084 )
5 years ago
Leo Chen
fa657b3dbb
fix bug of prelu when rank not equal 4, test=develop ( #25067 )
...
* fix bug of prelu when rank not equal 4, test=develop
* fix prelu inference, test=develop
* fix api, test=develop
* fix shape when mode is chennel, test=develop
* remove debug code, test=develop
* add unittest, test=develop
5 years ago
Huihuang Zheng
2c500c30bd
Handle Windows flaky test ( #25070 )
...
As the title
5 years ago
hutuxian
5822862d8a
Monitor Framework ( #24079 )
...
* Add a StatValue class in the backend to represent a stat.
* Add a singleton StatRegistry to maintain the collection of stats.
* For the sake of code neatness, we only support type of int and float, which can cover most of the scenarios.
5 years ago
Huihuang Zheng
21138c05a8
Add test_yolov3 and test_se_resnet Timeout ( #25076 )
...
Some big models can timeout on Windows CPU machine. I added some timeout properties.
5 years ago
Leo Chen
028de857d4
fix dtype error of compare op, test=develop ( #25059 )
5 years ago
Yiqun Liu
9ed16a4347
Fix random fail because of precision problem in unittest of fusion_group ( #25051 )
5 years ago
Divano
67fb840cd2
update scipy version test=develop ( #25007 )
5 years ago
Huihuang Zheng
9b5b726729
[Dy2stat] Add TSM as ProgramTranslator Unit Test. ( #25008 )
...
Add TSM as ProgramTranslator Unit Test. The TSM code is referred from PaddlePaddle/models#4229
5 years ago
Leo Chen
c7a63908b0
replace some logging.warn() with warings.warn(), test=develop ( #25025 )
5 years ago
lilong12
ab5a1fb853
add device attr for regularizer, test=develop ( #24981 )
5 years ago
Aurelius84
0b6145e056
[Dy2stat] Add MobileNet model unittest ( #25018 )
...
* add MobileNet unittest test=develop
* fix cudnn random test=develop
5 years ago
tangwei12
be6a315fbd
Fix/sync barrier ( #25016 )
...
* fix sync barrier with barrier monitor, test=develop
5 years ago
hong
c85c7b2264
Enable load program state in imperative mode ( #24998 )
...
* enable load_program_state run in imperative mode; test=develop
* remove useless code; test=develop
5 years ago
liym27
f16e277859
[Dy2Static]Convert var.shape stmt and Convert the return variables of Tensor-dependent 'if' staments to Tensor if it not ( #24911 )
...
* Support int and long: int or long -> six.integer_types.
* Modify test_tensor_shape: fix bug and modify comment.
* Support convert_var_shape to convert var.shape stmt
* Modify code in ifelse_simple_func.py because don't support return non-Tensor in Tensor-dependent 'if' stament currently.
* Convert the return variables of Tensor-dependent 'if' staments to Tensor if it not. test=develop
5 years ago
liu zhengxi
971ebb2657
decrease the input size for test_transpose_flatten_concat_fuse_pass, test=develop ( #24992 )
5 years ago
Huihuang Zheng
28d074e956
[Dy2stat] Decrease test_yolov3 GPU usage ( #24955 )
...
[Dy2stat] decrease the batch size to decrease GPU usage.
5 years ago
Leo Chen
bfa46c38d5
bn supports reverse_space, test=develop ( #24988 )
5 years ago
liym27
2e238c6eed
[[Dy2Static]]convert for stmt and support variable loaded and created in loop( #24901 )
...
* Move function 'convert_len' to file convert_operators.py
* Support that for statements are transformed to while statements.
* Fix bug: raise None -> return None.
* Support variable loaded and created in loop.
* Use int64 in Py2 and Py3 in function to_static_variable.
5 years ago
wawltor
9a2c1aedcc
Fix the elementwise_div op broadcast failed in some shape
...
Fix the bug for elementwise_div op, when the first var is scalar; Use the shape 1 replace the -1 in shape.
5 years ago
Huihuang Zheng
97708add66
[Dy2stat] Add word2vec as unittest ( #24944 )
...
[Dy2stat] Add word2vec as unittest
5 years ago
wawltor
0eb1b0bc01
Add support the 5d, 6d tensor support for the reduce ops
...
Add the support the 5d,6d tensor support for the reduce ops;
Add the same time, the compile time, it was 22 minutes, it was 21 minutes after fixed.
5 years ago
silingtong123
640196c446
test=develop, remove the tensorrt dll file from windows package ( #24922 )
5 years ago
Michał Gallus
570b7389c2
Fix OpTester from incorrectly converting uint8 data to utf-8 string ( #24854 )
...
test=develop
5 years ago
Aurelius84
6be0ee159e
Support LoDTensorArray in reverse_op ( #24797 )
...
* Support LoDTensorArray in reverse_op test=develop
* polish en doc and unittest code test=develop
* refine sample code test=develop
* add example of LoDTensorArray test=develop
* fix typo test=develop
5 years ago
Leo Chen
6190023ac9
Refine error message in pybind folder ( #24886 )
...
* refine err_msg of pybind.cc, test=develop
* refine err_msg in tensor_py.h, test=develop
* refine error msg, test=develop
* fix test_exception, test=develop
* follow comments, test=develop
5 years ago
Zhou Wei
4058e736ff
temporarily disable these unittests failed on windows ( #24942 )
5 years ago
hong
c233328c58
change zero copy from true to false; test=develop ( #24946 )
5 years ago
liym27
a9dca5805a
[Dy2Static] Add convert_ifelse to run the transformed code dynamically ( #24866 )
...
* cast var in convert_logical_XX.
* Add convert_ifelse function in convert_operators.py
* Add logical_transformer. Remove LogicalTransformer from loop_transformer.py
* Revert modified tests in PR24799(convert_while_stmt).
* Comment and modify code that doesn't support `return` statement.
* Remove unnecessary class: MergeAssignTransformer, NodeTestTransformer and IfConditionVisitor in ifelse_transformer.
5 years ago
whs
4c01d6d53e
Enhance checking in some operator. ( #24473 )
5 years ago
Chen Weihang
4a702ef361
Support SelelctedRows allreduce in multi-cards imperative mode ( #24690 )
...
* support selectedrows allreduce in multi-cards dygraph, test=develop
* remove useless import modules in unittests, test=develop
* add nccl cmake to get nccl version, test=develop
* add if-condition to compiled correctly, test=develop
* add detail version parseing for old nccl, test=develop
* polish camke details, test=develop
* fix remove test cmake error, test=develop
* fix cmake condition, test=develop
* change unittest camke list, test=develop
* fix unittest cmake rule, test=develop, test=framep0
5 years ago
FlyingQianMM
a359cade74
rewrite the sigmoid_focal_loss code example ( #24889 )
...
* rewrite the sigmoid_focal_loss code example. test=develop
* fix spelling mistake in comments of code example.test=develop
5 years ago
Huihuang Zheng
71fb62c298
[Dy2stat] Fix windows dy2stat test_yolov3 random failure ( #24908 )
...
The random failure at Windows may due to some random gt_boxes can cause some numbers in YoloV3 to be negative thus access the invalid memory. This PR tries to solve it.
5 years ago
Liufang Sang
b174b99764
support user defined quantization func and preprocess ( #24720 )
...
* add user defined func test=develop
* update test=develop
* update test=develop
* fix name conflicts test=develop
* add unittest test=develop
* change 2018 to 2020 test=develop
* add comment test=develop
* add comment for function test=develop
* fix details test=develop
* fix details test=develop
5 years ago
wangchaochaohu
f8ac6c2c58
fix fp16 support of assgin Op and squeeze Op test=develop ( #24862 )
5 years ago
Huihuang Zheng
5a5497a5e4
[Dy2stat] Add Yolov3 as Unit Test ( #24879 )
...
Add Yolov3 as ProgramTranslator Unit Test. The YoloV3 code is referred from PaddlePaddle/models/dygraph/yolov3
5 years ago
lilong12
29de0d97a5
add the support to specify device index for device_guard ( #24555 )
...
* add the support of device index for device_guard.
5 years ago
xujiaqi01
3016a4ac27
add mock barrier all ( #24786 )
...
* add mock barrier all
test=develop
* fix
test=develop
* fix
test=develop
* fix
test=develop
5 years ago
lilong12
6e10022781
add queue_generator_op, dequeue_op, enqueue_op and ut ( #24481 )
...
* add queue_generator_op, dequeue_op, enqueue_op and ut, test=develop
5 years ago
hutuxian
b8f17a049d
fix problem in dump and add log ( #24891 )
...
* Fix the field length in LoD scenario
* Fix the missed lod info when copy tensor in dump field
* Add some log to make debug easy
5 years ago
Leo Chen
1e818158f5
Feature/add amp_checkout_finite_and_scale op ( #24875 )
...
* add amp_check_finite_and_scale op, test=develop
* add cpu kernel, test=develop
* use bool, test=develop
* follow comments, test=develop
5 years ago
leesusu
a6beb96dd0
FTRL with sparse update, test=develop ( #22092 )
5 years ago
LielinJiang
3792a49d81
Fix bilinear_initializer bug when type of input data is float64 ( #24771 )
...
* fix bilinear initializer, test=develop
5 years ago
Aurelius84
9bbb9542ca
[Dy2stat]Add BMN model for unittest ( #24839 )
...
* add test_bmn_model test=develop
* remove random test=develop
5 years ago
xujiaqi01
63fedfd4fc
fix logger ( #24682 )
...
* fix logger of FetchHandler,which may print log twice
* test=develop
5 years ago
Chen Weihang
a1c1b59d48
[Dy2Static] Support for iter & enumerate VarBase ( #24856 )
...
* support for iter & enumerate varbase, test=develop
* revert IsControlFlowVisitor change, test=develop
5 years ago
liym27
5ea82e8a45
[Dy2Static]Support return variable created in only one of If.body or If.orelse ( #24841 )
...
* Support return variable in only one of if body or else.
* remove after_visit in IfElseTransformer.
* Modify the result of get_name_ids in test_ifelse_basic.py
* Add unittest to test the new case.
* Modify code according to reviews.
5 years ago
Yang Zhang
0494239b1f
Reduce logging verbosity when loading checkpoints ( #24287 )
...
test=develop
5 years ago
liym27
001c9fcca2
[Dy2Static]Convert while stmt and convert logical_XX ( #24799 )
...
* Support convert_while_loop.
* Comment code that not supported 'if' in test_break_continue.
* Convert int into tensor to support 'if' stmt in for/while loop.
* Add unittest to test all cases of convert_logical_XX.
* Add unittest to test all cases of convert_while_loop.
* Fix bug in LogicalOpTransformer. test=develop
5 years ago
Yanghello
aa47356b74
Add crypto python ( #24836 )
...
* add crypto helper for paddle, test=develop
* cryptopp.cmake bug fixed, test=develop
* remove debug build type, test=develop
* fixed CMakeLists for new target, test=develop
* fix CI bug, test=develop
* add cmake option flag DWITH_CRYPTO, test=develop
* add crypto api for python, test=develop
* Revert "add crypto api for python, test=develop"
This reverts commit 3a1cfa9d055fab357f46e653a8786f96336f6b47.
* Revert "Add crypto api (#24694 )"
This reverts commit 5a7a517cde
.
* Revert "Revert "Add crypto api (#24694 )""
This reverts commit f952b19fa7e8b7f9c57d31d78b9ffee1041c43ed.
* fixed cryptopp cmake building error, test=develop
* change WITH_CRYPTO building option to OFF, test=develop
* âfixed cipher test failed, test=develop
* "add crypto api for python, test=develop"
This reverts commit 83fb55c0668d59afad2ad1e7e04d425c7c7dd189.
* travis CI bug fixed, test=develop
* fixed test in python3
* test=develop
* fixed unittest, test=develop
5 years ago
Qi Li
704cad6a66
Add histc op ( #24562 )
...
* add histc operator, test=develop
* update english doc to 2.0 API, test=develop
* update API from histc to histogram, test=develop
Co-authored-by: root <root@yq01-gpu-255-129-15-00.epc.baidu.com>
5 years ago
Chen Weihang
1f032c53d5
remove duplicate function, test=develop ( #24849 )
5 years ago
Qi Li
a125697e2c
fix ut test_recognize_digits ( #24794 )
5 years ago
cc
75eec3d1f6
Post training quantization supports optimize model by fusing ( #24822 )
...
* Post_training_quantization supports optimize model by fusing, test=develop
5 years ago
Yi Liu
12bffdc086
Enhance error message of checkpoint_notify_op, fake_init_op gen_nccl_id_op and listen_and_serv_op ( #24554 )
...
test=develop
5 years ago
Wojciech Uss
78d4f0cc91
add option to exclude ops by id from quantization ( #24689 )
5 years ago
Huihuang Zheng
9d66385f8e
[FixUnitTest] Fix a Batch Size Random Unit Test Failure ( #24718 )
...
The PR: https://github.com/PaddlePaddle/Paddle/pull/24651 seems causes new random failure of unit test test_parallel_executor_seresnext_base_cpu. The reason is that smaller batch size causes random optimization of neural network. I distinguished cpu/gpu batch size to fix the unittest.
5 years ago
Zhou Wei
d1047d0a69
add WITH_GPU for cudaerror download ( #24056 )
5 years ago
mapingshuo
9388a6381c
fix popen error ( #24767 )
...
replace join to terminate
5 years ago
Aurelius84
8bbb829a03
[Dy2stat]Support nested input and output ( #24752 )
...
* support nested input and output test=develop
* remove code of convert type(output) in unittest test=develop
* add warning test=develop
5 years ago
wangchaochaohu
d160e57a5c
fix the full error message test=develop ( #24773 )
5 years ago
liym27
080d37a501
fix bug in LogicalOpTransformer: Create logic node recursively ( #24785 )
5 years ago
Zhou Wei
98da8a295d
add new learing rate strategy to reduce lr when loss reach on plateau ( #24322 )
...
添加loss自适应的学习率衰减策略。
5 years ago
cc
dbcd7c69e9
Update sigmoid output from Y to out, test=develop ( #24765 )
5 years ago
Aurelius84
40162227bb
Support save model in dygraph.guard test=develop ( #24761 )
5 years ago
wangchaochaohu
355caee18b
fix conv_transpose Op fp16 error test=develop ( #24695 )
5 years ago
Leo Chen
92e256a86a
Fix bug of different dtype in dygraph math_op_patch, test=develop ( #24740 )
...
* Fix bug of different dtype in dygraph math_op_patch, test=develop
* support np.dtype and str, test=develop
* add unit test, test=develop
5 years ago
liym27
a0846b627a
Remove target vars of gast.For from before_loop_vars or after_loop_vars ( #24732 )
5 years ago
cc
88e9d74a75
Collecting concat output threshold, test=develop ( #24742 )
5 years ago
Aurelius84
6db0e2b1a9
[Dy2stat] Support len syntax ( #24638 )
...
* [dy2stat] Support len
* add convert_call func
* refine code test=develop
5 years ago
ShenLiang
950892044f
fix conflict, test=develop ( #24238 )
5 years ago
cc
6c89ca2157
Add output threshold for ops that have several output activations, test=develop ( #24726 )
5 years ago
Chen Weihang
e251df83dd
[Dy2static] Fix random bug in bert unittest ( #24727 )
...
* Revert "Fix test_bert on GPU (#24692 )"
This reverts commit 62222bf461
.
* fix random bug in bert unittest, test=develop
5 years ago
hutuxian
e6b87b3193
Support AucRunner in PaddleBox ( #22884 )
...
* Support AucRunner in PaddleBox
* update some code style
5 years ago
Bai Yifan
c417f991c1
fix teacher_student_sigmoid_loss dtype check, test=develop ( #24586 )
5 years ago
Liufang Sang
55b664a131
remove pow to speed up in dequantize_log op ( #24607 )
...
* remove pow in speed up in dequantize_log test=develop
* remove pow in speed up in dequantize_log test=develop
* fix unittest test=develop
5 years ago
Leo Chen
9fd1aad6e7
Support NHWC in Pool2D, test=develop ( #24240 )
...
* support NHWC in Pool2D, test=develop
* add unittest, test=develop
* fix unittest, test=develop
* fix typo, test=develop
* follow comments, test=develop
* refine comments, test=develop
5 years ago
liym27
62222bf461
Fix test_bert on GPU ( #24692 )
...
DataLoader makes the data diff even if the data of reader is the same on CUDA place. This PR doesn't use DataLoader to pass the test. we will use DataLoader back after we fix it.
5 years ago
ShenLiang
a6ab43aab4
add type for lsgd, test=develop ( #24702 )
5 years ago
Leo Chen
bcdeadcde9
Fix bug of test_var_vase ( #24703 )
5 years ago
liym27
824572c144
[Dy2Stat]Support to transform sequence assignments and multi-target assignments to normal assignments ( #24643 )
5 years ago
Guo Sheng
a6a6d735ad
Fix _forget_bias.stop_gradient workround in hapi.text.BasicLSTMCell. ( #24655 )
...
test=develop
5 years ago
FDInSky
08e9cf4af8
update interpolate & upsample api's doc ( #24553 )
...
* test=develop update interpolate & upsample api
5 years ago
Huihuang Zheng
01294ff9b6
Decrease the batch size of se-resnext in unittest. ( #24651 )
...
As discussed with QA, we will use p4 machine for unit test and the GPU on those machine may not have enough GPU, which can cause "test_parallel_executor_seresnext_base_gpu" failed. So I decrease the batch size.
5 years ago
Leo Chen
9c9e635c00
support tensor to varbase, test=develop ( #24660 )
5 years ago
Leo Chen
14dd6388c5
fix bug of varbase.__getitem__, test=develop ( #24642 )
...
* fix bug of varbase.__getitem__, test=develop
* fix bug of float and other type, test=develop
5 years ago
jinyuKING
6ca44cbaa3
API/OP(sequence_first_step, sequence_last_step, sequence_mask, beam_search, beam_search_decode) error message enhancement ( #24590 )
5 years ago
Huihuang Zheng
00c8ee18ce
Fix test_cond flaky test under Windows ( #24633 )
...
In the past, the test_cond will fail with 2% probability and easy to re-produce.
Now I re-run 300 times and no failure occurs. The probability of still has the failure is (1 - 2%) ^ 300 ~= 0.00004. We can say the random failure disappears. Maybe someone fixed some bugs in PE.
5 years ago
Chen Weihang
2e7e69d0cb
remove imperative data loader place limit, test=develop ( #24641 )
5 years ago
Chen Weihang
fa846da53e
Append scale for static runner outputs ( #24627 )
...
* add scale for static runner outputs, test=develop
* fix import relation, test=develop
* remove len limit, test=develop
5 years ago
hutuxian
0ec3a42e97
Random Dump ( #24477 )
...
* Refactor code for dump_field & dump_param: abstracting the common function in base class.
* Support dump randomly & random with lineid
* Support specify the random interval, which avoids printing too much logs.
5 years ago
Aurelius84
736d3acc24
[Dy2stat] Support lambda and enhance transformation of IfExpr ( #24530 )
...
* fix bug with `if Tensor` in is_control_flow test=develop
* remove continue test=develop
* Support lambda and add unittest test=develop
5 years ago
liym27
b3ac1470c5
Support create LoDTensorArray and return LoDTensorArray in control flow ( #24609 )
...
* Support to create LoDTensorArray in control flow (cond and while_loop)
* Fix bug: return LoDTensorArray in while_loop
* Change code in list_transformer.py to accommodate the new features.
5 years ago
Chen Weihang
d26f581c58
fix some detail problems, test=develop ( #24614 )
5 years ago
Yiqun Liu
6b464f969a
Add an operator node in unittest to make the fusing result unique. ( #24617 )
5 years ago
Aurelius84
85ff797494
[Dy2stat] Add GPU unittest of test_se_resnet ( #24582 )
...
* test_seresnet support gpu test=develop
* Set the Flag by core.globals test=develop
* modify into set_flags test=develop
5 years ago
Jacek Czaja
3292f0ef58
[onednn] elementwise add broadcasting support ( #24594 )
5 years ago
Guo Sheng
fe8d006f7e
API/OP(sequence_expand_as) error message enhancement ( #23712 )
...
* API/OP(sequence_expand_as) error message enhancement.
test=develop
Co-authored-by: FrostML <380185688@qq.com>
5 years ago
Chen Weihang
03ba5b748d
[Dy2static] Add for enumerate Variable support ( #24398 )
...
* initial test
* for enumerate basic implement, test=develop
* update unittests, test=develop
* refine unittests to adapt new training mode, test=develop
* refactor for node stmts parsing code, test=develop
* self-review & polish details, test=develop
5 years ago
liu zhengxi
fff9faae72
API(dynamic_gru, chunk_eval, BeamSearchDecoder) error message enhancement ( #24513 )
...
* dynamic_gru err_msg enhancement, test=develop
* chunk_eval err_msg enhancement and fix crf_decoding output type, test=develop
* BeamSearchDecoder err msg enhancement, test=develop
* fix doc for chunk_eval, test=develop
* refine lod err msg for chunk_eval, test=develop
5 years ago
Huihuang Zheng
5ff4535781
[Dy2Stat] Fix ProgramTranslator.save_inference_model API Doc ( #24584 )
...
As the title.
5 years ago
wangchaochaohu
c4dd596de6
cusum op optimization for GPU kernel ( #24321 )
5 years ago
Leo Chen
d43e4047ff
refine err msg, test=develop ( #24550 )
5 years ago
liym27
615a8bfcf4
Support int32 int64 and fix bug ( #24407 )
...
* Compatible int32 and int64 for attr in op slice/strided_slice. test=develop
* Polish code in nn.py test=develop
* Fix bug: set the same dtype for the inputs of elementwise_add. test=develop
* Convert int32 to int64 in slice op to avoid data overflow. test=develop
* Convert int32 to int64 in strided_slice_op to avoid data overflow. test=develop
5 years ago
lilong12
a13a4dbc7b
Improving error reporting messages for ops ( #24438 )
...
* improve error reporting message
5 years ago
Chen Weihang
897cec811a
[Dy2static] fix some print transformer problems ( #24516 )
...
* fix some print transformer problems, test=develop
* simplify writing & avoid bud, test=develop
* polish detail, test=develop
5 years ago
Aurelius84
db0c1ea851
[Dy2stat] Fix function lookup bug in convert_call ( #24567 )
...
* fix convert call globals_funcs test=develop
* add import statement test=develop
5 years ago
XiaoguangHu
217ca776cc
[for 2.0-alpha] add alias in paddle.nn and paddle.tensor test=develop ( #24561 )
...
* add alias in paddle.nn and paddle.tensor test=develop
* add alias in paddle.nn and paddle.tensor dir test=develop
* fix same conflict manually test=develop
* update fc and dygraph alias test=develop
* fix initalizer.py typo test=develop
5 years ago
hong
2b6d00496e
Api move 20a ( #24559 )
...
* add base name alias; test=develop
* fix embedding bug; test=develop
* fix io error; test=develop
* add metric; test=develop
* add import palce; test=develop
* add setup; test=develop
* fix incubate reader; test=develop
* fix initializer error; test=develop
5 years ago
silingtong123
ca29abc813
test=develop, test=document_fix, modify the code example of randont ( #24533 )
...
Co-authored-by: root <root@yq01-gpu-151-22-00.epc.baidu.com>
5 years ago
lidanqing
8ef3c02e90
Update DNNL QAT document 2.0-alpha ( #24494 )
...
Update DNNL QAT document 2.0-alpha
5 years ago
Cindy Cai
86ca31ab58
English API Docs Optimization Part 1 ( #24536 )
...
* test=develop, test=document_fix
* test=develop, test=document_fix
Co-authored-by: swtkiwi <1208425345@qq.com>
5 years ago
Huihuang Zheng
2d0f849e75
[Dy2Stat] Add assert for ProgramTranslator ( #24492 )
...
Add assert grammar for ProgramTranslator
5 years ago
ruri
ea2c498712
Fix err message ( #24507 )
...
* fix error message, test=develop
5 years ago
chajchaj
e5a624935f
Enhance error message of cross_entropy_op, sigmoid_cross_entropy_with_logits_op ( #24485 )
...
* error message of cross_entropy_op, test=develop
* fix bug : can't use platform::errors::InvalidArgument in HOSTDEVICE, test=develop
* fix bug: recovery the check_variable_and_dtype for rank_loss and bpr_loss, test=develop
5 years ago
Guo Sheng
aa02e347bd
Add hapi.text and corresponding unit test. ( #24457 )
...
* Add hapi.text and corresponding unit test.
test=develop
* Remove hapi.text apis' reuse parameter args for coverage.
test=develop
* Fix TransformerCell and TransformerBeamSearchDecoder example codes.
test=develop
* Fix example codes in hapi.text.
test=develop
* Add some apis in hapi.text into example code white list.
test=develop
* Fix example code of DynamicDecode in hapi.text.
text=develop
* Rename Model.self as model in test_text.py
test=develop
5 years ago
xujiaqi01
c2103c4844
fix error check ( #24483 )
...
* fix error check of stack and space_to_depth
* test=develop
5 years ago
swtkiwi
f5c6dd6def
test=develop ( #24522 )
5 years ago
Yibing Liu
a9520db24e
Format error message for ops ( #24482 )
...
* Format error message for ops, test=develop
* Fix check in sequence_expand, test=develop
5 years ago
hutuxian
7f85dfeb18
Upgrade Error Message for AucOP & MultiplexOP ( #24458 )
5 years ago
danleifeng
d98e1182a1
fix check and error message for flatten hash is_empty op ( #24434 )
...
fix check info for flatten hash is_empty op; test=develop
5 years ago
liu zhengxi
417b576c34
API(dynamic_lstm, dynamic_lstmp) error message enhancement ( #24450 )
...
* update err msg for dynamic_lstm and dynamic_lstmp, test=develop
5 years ago
wangchaochaohu
53bdee64e6
add tensor support for gaussian_random_op test=develop ( #24389 )
5 years ago
qingqing01
da4a1db7bb
Refine error message in some OPs ( #24443 )
...
test=develop
5 years ago
hong
f0df90269a
add enable_imperative, disable_imperative alis; test=develop ( #24392 )
5 years ago
Xing Wu
479c47f316
fix error info for transpose sequence_conv_pool max_sequence_len sequ… ( #24437 )
...
* fix error info for transpose sequence_conv_pool max_sequence_len sequence_erase, test=develop
* fix error info for transpose sequence_conv_pool max_sequence_len sequence_erase, test=develop
* update modify, test=develop
* update modify, test=develop
* fixed some modifications, test=develop
5 years ago
WuHaobo
1c00732dd0
Polish PADDLE_ENFORCE of unfold_op ( #24423 )
5 years ago
cc
4d35112255
[Fix bug] Init scale node in OutScaleForTrainingPass and enable test_quantization_scale_pass UT ( #24393 )
...
* Init scale node in OutScaleForTrainingPass, test=develop
* Enable test_quantization_scale, test=develop
5 years ago
wawltor
d0ef94798d
Fix the elementwise_ops axis bug, add the warning log for paddle 2.0
...
Fix the elementwise_ops axis bug, make elementwise_ops has the same the op function for override ops
5 years ago
Chen Weihang
05d20e5793
API/OP (Some SL API) error message enhancement ( #24441 )
...
* polish some sl api error message, test=develop
* polish python input check of stride slice, test=develop
* fix unittest bugs, test=develop
5 years ago
Aurelius84
100914ddbe
Fix bug with `if Tensor` in is_control_flow ( #24433 )
...
* fix bug with `if Tensor` in is_control_flow test=develop
* remove continue test=develop
5 years ago
LielinJiang
1a0d26a4db
Add vision api for hapi ( #24404 )
...
* add vision
* fix predict, test=develop
* add unittest for vision apis, test=develop
* fix typos
* add hapi models api, test=develop
* fix code format, test=develop
* fix typos, test=develop
* fix sample code import, test=develop
* fix sample codes, test=develop
* add decompress, test=develop
* rm darknet, test=develop
* rm debug code, test=develop
5 years ago
zhang wenhui
621a4085b9
enhance cvm bpr_loss adam adagrad adamax ftrl error message, test=develop ( #24452 )
5 years ago
Li Fuchen
e58619295e
OP(rank_loss, similarity_focus, squeeze) error message enhancement ( #24448 )
...
* enhance rank_loss error message, test=develop
* enhance similarity_focus error message, test=develop
* enhance squeeze error message, test=develop
5 years ago
wangguanzhong
abb49df26f
Enhance yolo_box & yolov3_loss ( #24370 )
...
* add scale_x_y for yolo_box, test=develop
* refine eps in iou_similarity, test=develop
5 years ago
mapingshuo
d1bb76a2f7
fix error log, test=develop ( #24419 )
...
* fix error log: resahpe, range, reverse.
5 years ago
FDInSky
7fedf26b87
add linear interpolate operator ( #23357 )
...
* test=develop add linear interpolate operator
5 years ago
liym27
f9a4f9f4c4
Remove redundant code. test=develop ( #24397 )
5 years ago
wawltor
2de5075a6d
Fix the elementwise ops in broadcast in the process of backward ( #24319 )
...
* Remove the error in the elementwise op, use the backup mode to calculate
5 years ago
Guanghua Yu
988fbf82e2
Fix bug with wrong calculation result in `nn.loss.CrossEntropyLoss` ( #24352 )
...
* fix bug of cross_entropy_loss,test=develop
* fix log_softmax and some comment,test=develop
5 years ago
joanna.wozna.intel
53125c2f6f
Model converter to dot file ( #23169 )
5 years ago
qingqing01
43625bdabd
Add a high-level API with traning and inference into Paddle. ( #24293 )
...
* Merge hapi into Paddle
Hapi is a high level API for training and inference.
The main modules include Model, Loss, Metrics, Dataset.
Also includes common modules and models in NLP and computer vision, such as BERT, ResNet.
These modules are developed by:
0YuanZhang0, guoshengCS heavengate, LielinJiang, qingqing01, xyzhou-puck huangjun12, wangxiao1021, zhangyang.
5 years ago
Xing Wu
4af3ec0f8a
fix rnn check_type list error ( #24346 )
...
* fix rnn check_type list error
* tigger ci, test=develop
* update modify, test=develop
5 years ago
Pei Yang
9c073bbd53
skip pyramid_hash on jetson platforms to avoid compile error. test=develop ( #24371 )
5 years ago
Aurelius84
9bf70ed752
[dy2stat]Support save_inference_model in program_translator ( #24353 )
...
* support save_inference_model in program_translator test=develop
* fix compatibility with OrderedDict.values() in python3 test=develop
* synchronized random_seed test=develop
* Polish Error Message test=develop
5 years ago
Yiqun Liu
5361987361
Implement the new profiler api. ( #24344 )
5 years ago