66cae9157e
Op (lod_reset) error message enhancement ( #23499 )
6 years ago
63bfe0b946
Fix the default value bug of started port in launch.py. ( #23531 )
6 years ago
4cbed3a3f6
API (layers.data/fluid.data) error message enhancement ( #23427 )
...
* Api (fluid.data/layers.data) error message enhancement. test=develop
6 years ago
067134f1b3
API (Switch) error message enhancement. test=develop ( #23459 )
...
* API (Switch) error message enhancement.
* fix bug: dtype of out in api isfinite is set incorrectly. The dtype should be bool.
6 years ago
c068512f34
Implement a new C++ operator where and API tensor.where ( #23220 )
6 years ago
8674a82c03
Op (Scope) error message enhancement ( #23458 )
...
* Op (Scope) error message enhancement test=develop
6 years ago
c435110a3f
support no_grad inplace operating ( #22522 )
...
* support no_grad atomic operating
test=develop
* rm create param api
test=develop
* refine sample code
test=develop
* clean impl
test=develop
6 years ago
42655ef721
Add full_like op. ( #23364 )
...
* add full_like op. test=develop
* add dygraph support. test=develop
* increase coverage. test=develop
6 years ago
d349a622f0
api dygraph batch norm type check, test=develop ( #23525 )
6 years ago
8d95a10906
fix if logic in dygraph, test=develop ( #23512 )
6 years ago
316ea5499f
Revert to usage of 'fill_constant' in test_transformer. test=develop ( #23529 )
6 years ago
ca7bd2beb1
Add a function to update FLAGS ( #22851 )
...
* Add a function to update FLAGS
test=develop
* Add a function to update FLAGS
test=develop
* expr flags
* Add a function to update FLAGS
test=develop
* distinguish public/private vars, test=develop
* fix windows issues, test=develop
* expr flag
* Add functions to get and set FLAGS
test=develop
* Add functions to get and set FLAGS
test=develop
* Add functions to get and set FLAGS
test=develop
* Add functions to get and set flags
test=develop
* Add functions to get and set FLAGS
test=develop
* Add a function to update FLAGS
test=develop
* Add a function to update FLAGS
test=develop
* Add functions to get and set flags in Paddle
test=develop
Co-authored-by: sneaxiy <sneaxiy@126.com>
6 years ago
cb1a2512dc
Make the place parameter default ( #23094 )
...
* Make the place parameter default
test=develop
* Make the place parameter default
test=develop
* Make the place parameter default
test=develop
* Make the place parameter default
test=develop
* Make the place parameter default
test=develop
* Make the place parameter default
test=develop
* Make the place parameter default
test=develop
* Make the place parameter default
test=develop
6 years ago
d085f79228
fix untime fail for output var stop_gradient=True for fusion group ( #23317 )
6 years ago
b76f3b2727
add test for fill_value Tensor and refine the doc of full Op ( #23524 )
6 years ago
62aff0a7ac
Add DNNL GELU kernels ( #22426 )
6 years ago
009c049e82
Add randint op API ( #23337 )
...
* add randint op
6 years ago
ea6a251c0b
fix sample code, test=develop ( #23448 )
6 years ago
25628587f1
Collect output scale for quantized op and fused op ( #23369 )
...
* Collect output scale for quantized op and fused op
* Post_training_quantizaion sets batch_generator to support lod tensor
6 years ago
6162cf2f2e
Make optimizer consistent in dygraph and static-graph and remove some LOG-INFO. ( #23426 )
...
* Make optimizer consistent in dygraph and static-graph and remove some LOG-INFO
6 years ago
118e585b8c
rename op fluid.layers.matmul to paddle.matmul ( #23375 )
...
* rename op paddle.fluid.matmul to paddle.matmul
* modify original API fluid.layers.matmul,and add new API paddle.matmul
6 years ago
29c4fae112
Tensor value support ( #23491 )
...
* add support for value tensor support of fill_constant Op
6 years ago
e8efaee92d
update gradient clip english doc for new gradient clipping strategy
...
梯度裁剪的策略进行了升级，配合修复相应的 裁剪API、minimize、ParamAttr 的API英文文档。
对应API变动的文档： #23224
对应中文文档PR：PaddlePaddle/FluidDoc#1942
6 years ago
426912df5a
Add Index sample OP ( #23218 )
...
* add index_sample op
6 years ago
660489acac
Add log and check predicted scores. test=develop ( #23506 )
6 years ago
9bc223c8a2
fix test_graph_wrapper failure on cudnnv7, test=develop ( #23451 )
6 years ago
c706ff20a3
fix conflict, test=develop ( #23298 )
6 years ago
5223e2bbc4
Add a new DataFeed named PaddleBoxDataFeed ( #23321 )
...
* add paddleboxdatafeed
* add ifdef linux and boxps
* add untest for datafeed
* fix untest of test_paddlebox_datafeed
* fix untest
* rename function
6 years ago
75bd350710
Implement StaticModelRunner to support dygraph fine-tune static graph pre-training model ( #23171 )
...
* static model runner basic implement, test=develop
* add run program op to execute loaded program, test=develop
* refactor static model runner & run program op, test=develop
* reset engine.cc to resolve conflict
* adapt the change of dygraph double grad, test=develop
* refactor impl to solve control flow error, test=develop
* clear debug code, test=develop
* fix ci str compatible error & checkout dygraph grad maker & add example, test=develop
* hide api & add op test, test=develop
* fix run program op test places error, test=develop
* fix program by review comment, test=develop
* delete change var desc name, test=develop
* fix other program by review comment, test=develop
* remove _static_graph_guard, test=develop
* add selectedrows test, test=develop
* remove desc parser, test=develop
* fix detail program, test=develop
* change socpe create & add test, test=develop
6 years ago
9297f49e4b
[OP] Add randperm op ( #23292 )
6 years ago
08e3d9c0dc
Add the matmul, elementwise_euqal, elementwise_sum ops to API2.0 ( #23437 )
...
* Add the matmul, elementwise_euqal, elementwise_sum ops to API2.0
* Fix the import meesage in common_ops_import
* Update the test cast for mm
6 years ago
0b583235f5
Revert "Solve the conflict of ops with the same name. ( #23199 )" ( #23494 )
...
This reverts commit abe3e6906d
6 years ago
6577f91b74
Add the sum op to API 2.0， add some parameters for new api
...
* Add the sum op to API 2.0, test=develop
* Fix the import meesage in common_ops_import
6 years ago
2d0933c378
Add two new ops paddle.tensor.mul(), paddle.tensor.pow() ( #23485 )
...
* add new op paddle.tensor.mul(x, y, x_num_col_dims=1, y_num_col_dims=1, out=None, name=None)
* add new op paddle.tensor.pow(input, exponent, out=None, name=None)
* add the aboved two new ops unittest (test api param out and name)
6 years ago
c4d0305239
add tril op and triu op ( #23469 )
...
add tril op and triu op
6 years ago
3eb12bd100
refine the usage of paddle.full test=develop ( #23484 )
6 years ago
eb035f24d1
add unbind op ( #23359 )
...
* add unbind op
unbind(tensor, dim=0):
说明：移除指定维后，返回一组数组，包含了沿着指定维切片后的各个切片。
tensor(Tensor) -- 输入Tensor
dim(int) -- 删除的维度
示例：
Input = [[1,2],
[3,4],
[5,6]]
axis = 0
Output[0] = [1,2]
Output[1] = [3,4]
Output[2] = [5,6]
6 years ago
4c675a450f
Add 2 new ops: paddle.tensor.div() and paddle.tensor.add() to API2.0( #23352 )
...
* add new op paddle.tensor.div(x, y, out=None, name=None)
* add gpu and dygraph unittests.
* Performance optimization: scale op is not called when alpha=1.
* op error message optimization.
6 years ago
036121b731
[Dy2stat] Make loop_transformer supports class variable ( #23478 )
...
This CR makes two changes:
1. In old loop_transformer, if a class variable, such as "self.a, foo.bar" is a loop var, the Dy2stat will fail because `def func(self.foo)` is not legal syntax. We support class variable by renaming.
2. After https://github.com/PaddlePaddle/Paddle/pull/22892 is merged, we can support `while x < 10` in dygraph. I enable those tests in corresponding Dy2stat
6 years ago
abe3e6906d
Solve the conflict of ops with the same name. ( #23199 )
...
* solve the conflict of ops with the same name. test=develop
6 years ago
0b092d05f1
Add the argmax op to API 2.0， and update some parameters
...
* Add the argmax op to API 2.0, test=develop
* Fix the compiler problem in arg_max op, test=develop
* Fix the import meesage in common_ops_import, test=develop
* Fix the default dtype of arg_min_max, test=develop
6 years ago
f297a33285
Dev/fix init flags ( #23465 )
...
* fix init_gflags with 'python -c', test=develop
* add test, test=develop
* use sys.executable instead of python, test=develop
* keep dummy, test=develop
6 years ago
1a8d6ee371
add a new op paddle.sort() to API 2.0 test=develop ( #23470 )
...
* add a new op paddle.tensor.sort(), test=develop
* add a new op paddle.sort(), test=develop
6 years ago
915341e3de
Add the zeros, ones, ones_like, zeros_like for api 2.0, test=develop ( #23471 )
...
Update the new api ops of creation ops to the api 2.0
6 years ago
56b50c97f8
Add allclose_op ( #23335 )
...
* Add allclose Op, and its function is analogous to numpy.allclose. It returns True if two tensors are elementwise equal within a tolerance.
6 years ago
948c57d84b
move sin, sqrt, tanh, atan to paddle.tensor.math and add a new parameter "out" ( #23387 )
...
* sin sqrt tanh atan add out, test=develop
* optimize doc, test=develop
* add dygraph test, test=develop
6 years ago
a2e9af5663
Add Tdm child OP in contrib ( #23241 )
...
* add tdm child op
6 years ago
4955c97ee8
Add unitTest for `Tensor==constant` for ifElse in dygraph2static ( #23407 )
...
* Add unitTest for `Tensor==constant` for ifElse in dygraph2static test=develop
6 years ago
9676ac1c5c
Add flip op. ( #23255 )
...
* add flip op
6 years ago
81f1402f6c
Add functional convolutions in paddle.nn.functional ( #23408 )
...
* add functional conv
* add test and doc for function convs, test=develop
* update ConvTransposeOp's InferShape and error message, test=develop
6 years ago
24a063f6ac
Add fleet checkpoint on local fs and remote fs(such as hdfs) for EDL ( #22586 )
6 years ago
ebae6fb6b9
fix gen_worker_desc in hogwild ( #23423 )
...
* fix gen_worker_desc in hogwild, it may cause error in transpile mode
* test=develop
6 years ago
a2e10930cf
update linspace, equal operators to API 2.0 ( #23274 )
...
* update linspace, equal operators to API 2.0, test=develop
* equal support higher performance CUDA kernel, test=develop
* update comment of equal&linspace operator, test=develop
* update comment of equal&linspace operator, test=develop
6 years ago
03deb41d73
API (switch_case) error message enhancement. test=develop ( #23429 )
6 years ago
cd348dc467
API (case) error message enhancement. test=develop ( #23428 )
6 years ago
3ea7c59f76
Set fuse_all_reduce_ops=false for quantization test, test=develop ( #23413 )
6 years ago
7ca836d3da
support if logic for Variable in dygraph ( #22892 )
...
* support if logic for Variable in dygraph, test=develop
* fix test_learning_rate_scheduler.py, test=develop
* fix optest, test=develop
* fix error message, test=develop
* fix optest,test=develop
* fix comment, test=develop
6 years ago
166a1ae902
support forward hook for dygraph ( #22443 )
...
* support forward hook for dygraph, test=develop
* add optest for forward_hook in dygraph, test=develop
* add optest, test=develop
* polish code, test=develop
* add sample code, test=develop
* rename forwrd_hook to forward_post_hook, test=develop
* fix the api description, test=develop
* fix api description, test=develop
6 years ago
a62599a888
[feature] prune program by feed and fetch_list automatically ( #22474 )
...
* prune train program by fetch_list, test=develop
* add unittest for prune, test=develop
* fix pruned feed, test=develop
* support ParallelExecutor and feed prune, test=develop
* add comments, test=develop
* update unittest, test=develop
* update unittests, test=develop
* remove debug code, test=develop
* support cond in clone, test=develop
* support cond in prune, test=develop
* support multiple minimize, test=develop
* support cache, test=develop
* fix _copy_param_info_from, test=develop
* support python2 str, test=develop
* remove debug code, test=develop
* fix bug of caching CompiledProgram, test=develop
* fix multi_device issue, test=develop
* tmp
* support tuple in fetch_list and overriding use_prune, test=develop
* dont use nonlocal in python2, test=develop
* remove nonlocal, test=develop
* code clean, test=develop
* code clean, test=develop
* feed list, test=develop
* test adam, test=develop
* follow comments, test=develop
* reduce duplicate code, test=develop
* update comments, test=develop
6 years ago
7c55a94de5
Disable test_quantization_scale_pass unittest for random error, test=develop ( #23441 )
6 years ago
bc2981e998
Disable test_code_generator and test_post_training_quantization_mobilenetv1 ( #23440 )
6 years ago
29337f4e17
fix conflict of inferne partial feed with gpu parallel ssa graph executor, test=develop ( #23400 )
6 years ago
8cf2c38ccb
fix error in paddle.tensor test=develop ( #23433 )
6 years ago
ee58ad62b6
import core in rnn.py ( #23394 )
6 years ago
21f59779ea
fix dump slot in strategy ( #23398 )
6 years ago
f217837654
fix gc transformer ut, test=develop ( #23421 )
6 years ago
17babe4d55
add full op API ( #23112 )
6 years ago
7fda333ac1
add new method of gradient_clip, better to use,test=develop ( #23224 )
6 years ago
b7b0b3595b
Add unittest for transformer prediction in dygraph_to_static ( #23207 )
...
* Add unittest for transformer prediction in dygraph_to_static.
* fix bug in fill_constant api.
* Make transpose support size 0. test=develop
6 years ago
738c84644b
support tensor array create read write in dygraph ( #23200 )
...
* support tensor array create read write in dygraph
test=develop
* minor fix
test=develop
* support tensor_array_to_tensor
test=develop
* add while loop case and err msg
test=develop
* refine ut
test=develop
6 years ago
f944b0f6fc
Dev/add l1 loss ( #23322 )
...
* add L1Loss
* support L1Loss, test=develop
* add test, test=develop
* fix batch, test=develop
* follow comments, test=develop
6 years ago
93ea9dd27a
fix stat var in hogwild worker ( #23367 )
...
* fix stat var in hogwild worker
* test=develop
6 years ago
9fd9067455
handle conv2d activations in older QAT models ( #23202 )
6 years ago
21d95be0db
Add inplace abn op ( #22806 )
...
* add inplace_abn_op. test=develop
6 years ago
3a21980b78
add reader dependency pass, test=develop ( #23301 )
6 years ago
2fe0758f67
fix the doc of fill_constant test=develop ( #23336 )
6 years ago
1d4d89baf8
[Dy2stat] Add data_layer_not_check ( #23351 )
...
1. Add data_layer_not_check because it is needed in dygraph_to_static where input can be variable size
2. Remove warnings in static analysis because python cannot do exact static analysis
6 years ago
d280106007
Add support for attr type Op and add fill_constant Op and scale Op ( #23163 )
...
* add attr support for fusion group and add support for fill_constant and scale Op
6 years ago
3a45767d49
add fleet pslib pull and push sparse op and push dense op ( #23139 )
...
* add fleet pslib pull and push sparse op and push dense op
* test=develop
6 years ago
0536b5263d
fix test_launch_ps test=develop ( #23333 )
6 years ago
8c594a84e1
fix double grad 2, test=develop ( #23332 )
6 years ago
8814853d82
Remove Read-Only Basic Type Variable in loop_vars ( #23299 )
...
* Remove Read-Only Basic Type Variable in loop_vars
test=develop
* Put class support in loop for future thing
test=develop
* Modify based on reviewer's comment
test=develop
6 years ago
8473854547
Add dygraph_to_static training unitTest of transformer model ( #23316 )
6 years ago
420944e514
enhance load dygraph; test=develop ( #23167 )
6 years ago
a7b0ff33ce
rm gc transformer ut, test=develop ( #23308 )
6 years ago
488b2387e2
Feature/expand params in auto-generated pybind functions for dygraph operators ( #23181 )
...
* expand parameters, test=develop
* support resnet, test=develop
* fix resnet, test=develop
* support duplicable out, test=develop
* support ptb
* fix bugs, test=develop
* support null input, test=develop
* fix bugs, test=develop
* fix batchNorm is_test, test=develop
* refine code, test=develop
* follow comments, test=develop
* follow comments, test=develop
* follow comments, test=develop
* follow comments, test=develop
6 years ago
9474d140de
Support Parameter type determination in StaticAnalysis ( #23302 )
...
* Support Parameter type determination test=develop
6 years ago
20eed5401a
Change fluid.layers.where‘s C++ operator name ( #23250 )
6 years ago
12355cccfd
add clear_gradients to star gan ut, test=develop ( #23296 )
6 years ago
a582f10501
test=develop fix generate_proposal_labels unit test ( #23154 )
6 years ago
af0ad915ea
fix testlaunch test=develop ( #23304 )
6 years ago
dc24f38a9f
support math operator for variable ( #23063 )
...
* support math operator for variable, test=develop
* polish code, test=develop
* polish code, test=develop
6 years ago
baec0a0713
define alias in paddle dir and paddle.nn dir test=develop ( #23282 )
...
* define alias in paddle dir and paddle.nn dir test=develop
* define alias in paddle.nn.functional dir test=develop
* define alias in paddle.tensor.__init__.py test=develop
6 years ago
f8205ffa82
fix conflict var bug in loop_transformer test=develop ( #23287 )
6 years ago
16e74f1185
fix is_controw_flow bug with `if Tensor.numpy()` ( #23251 )
6 years ago
be2ac9cc3a
separated QAT1 and QAT2 ( #23284 )
6 years ago
c524b930e7
Update QAT INT8 related code ( #23104 )
6 years ago
f836c8aa8f
add check for scales and a message ( #23119 )
6 years ago
8bfd62ffb7
Expose dygraph.grad api ( #23124 )
...
* expose dygraph.grad api, test=develop, test=document_fix
* add more parameter in dygraph.grad API, test=develop
* add only_inputs=True parameter, test=develop
* follow comments, test=develop, test=document_fix
* fix typo, test=develop, test=document_fix
6 years ago
c8f9e66b71
fix no_cvm in config_fleet ( #22818 )
...
* fix no cvm, when accessor is DownpourSparseValueAccessor, set no_cvm=True
* test=develop
6 years ago
d0413e58d3
support get pslib version ( #22835 )
...
* get pslib version
* test=develop
6 years ago
8f2f977345
support feeding scalar when runing program , test=develop ( #23214 )
...
* support feed_python_builtin, test=develop
* add test, test=develop
* support CompiledProgram, test=develop
* support fluid.data, test=develop
* fix ci problems, test=develop
* follow comments, test=develop
6 years ago
68ea1ad55b
add clear one table ( #23089 )
...
* add clear_one_table
* test=develop
6 years ago
4a54a46419
Add UT for SGD operator with large inputs ( #23195 )
6 years ago
e3a078fb4a
remove check_dygraph=False in test_data_norm_op optest ( #22335 )
...
* fix bug when grad_op's output not be used in compute kernel in dygraph mode, test=develop
* fix test_data_norm_op.py, test=develop
* polish code style, test=develop
* fix error of data_norm's infershape, test=develop
* polish comment, test=develop
6 years ago
e5af90aa28
Add Decorator 'dygraph_to_static_program' and ProgramTranslator.save_inference_model ( #23227 )
...
1. Add Decorator 'dygraph_to_static_program'
2. Add corresponding ProgramTranslator.get_program
3. Add ProgramTranslator.save_inference_model
4. Modified some warning information of dy2stat
5. Change program cache to contain startup_program because for users who gets program to run, they may like to initialize startup program
6 years ago
a647bcd355
Add convert_function_with_cache in dygraph_to_static_func ( #23190 )
...
* add unittest test=develop
* add function cache test=develop
6 years ago
bd80903333
Add activation_type in AddQuantDequantPass to be compatible with paddleslim, test=develop ( #23221 )
6 years ago
6af480ca33
Support int64 for op assign_value. test=develop ( #23179 )
6 years ago
d6f72c4fcc
Add parameter(learning_rate) in NoamDecay ( #23156 )
...
* Add parameter(learning_rate) in NoamDecay test=develop
6 years ago
af92630666
fix bug of loop_vars in loop_transformer.test=develop ( #23180 )
6 years ago
ebe4eab985
fix bug of ListTransformer in dygraph_to_static. test=develop ( #23153 )
6 years ago
e9b18c7402
Rename Decorator "dygraph_to_static_graph" to "dygraph_to_static_func" ( #23150 )
...
This PR does exact the thing as the title. The reason is that we plan to develop 4 decorators
"dygraph_to_static_code"
"dygraph_to_static_program"
"dygraph_to_static_func"
"dygraph_to_static_output"
The 4 decorators will emphasize different part when translating dygraph to static graph. Decorator name "dygraph_to_static_graph" is too big for the function it implements.
6 years ago
bba740710d
add cuda resource pool for BufferedReader, test=develop ( #23152 )
6 years ago
07a1df8f50
fix double grad ut, test=develop ( #23155 )
6 years ago
05c00af5f1
Add dygraph_to_static_code and get_code in ProgramTranslator ( #23162 )
...
As the title, we add decorator "dygraph_to_static_code", and add related "get_code", "get_func", "get_output" for ProgramTranslator. Next step will be adding "dygraph_to_static_program"
6 years ago
cc8ca8cea9
Polish error Info in while_loop ( #23183 )
...
* Polish error Info in while_loop test=develop
6 years ago
e83af01922
fix ut by serial run, test=develop, test=document_fix ( #23213 )
6 years ago
2787041246
bug fix ( #23193 )
...
test=develop
6 years ago
092a62e205
remove crf ut, test=develop, test=document_fix ( #23205 )
6 years ago
07395dde7d
fix ut by serial run, test=develop ( #23173 )
6 years ago
11f94cdce9
Improve function is_control_flow_to_transform. test=develop ( #23109 )
6 years ago
573d2faacd
fix bug in function `is_to_variable`. test=develop ( #23147 )
6 years ago
589cd8782f
Post_training_quantizaion supports min_max methon ( #23078 )
...
* Post_training_quantizaion supports min_max methon
6 years ago
194a22c5a8
reorganize the paddle api test=develop ( #23151 )
6 years ago
6fc6bb3e78
Refactoring Program Cache Related Code ( #23118 )
...
1. Rename AutoTracer to ProgramTranslator
2. Rename cached_program to program_cache
3. Remove some functor style __call__
4. Dict key should be string but not hash code of string
6 years ago
Liufang Sang
4db031902d
add dequantize_log_op and make pyramid hash support int8 weight ( #22548 )
...
* add dequantize_log_op and make pyramid hash support int8 weight test=develop
* add unittest and update pyramid hash op test=develop
* remove paddle_enforce test=develop
* fix error message test=develop
* remove incorrent commit test=develop
* fix error message in log_dequantize test=develop
* change 2019 to 2020 test=develop
* remove useless check_grad test=develop
6 years ago
acfc9b8a70
Reader sequential and inference partial feed ( #22699 )
...
* sequential reader stage 1, test=develop
* fix ut, test=develop
* fix iterable=False reset bug, add some logs and polish code, test=develop
* inference feed partial data, test=develop
* Turn on keep_order=True for test, test=develop
* enhance ut to test more cases, test=develop
* test commit for reverting
* Revert "test commit for reverting", test=develop
This reverts commit 80aef42ef52ba1ee79627d6f663a624ec4f12f58.
* add ut of merged and unmerged results, test=develop
* add more uts for coverages and add en doc of api, test=develop
* follow comments, test=develop
* change note style, test=develop
6 years ago
95b356a069
update embedding_eltwise_layernorm fuse and kernel. test=develop ( #23114 )
...
update embedding_eltwise_layernorm fuse pass and fused kernel, to support multi input
6 years ago
a31d7328b7
Add dygraph double grad implementation ( #22939 )
...
* add double grad implementation for dygraph, test=develop
* polish code, add uts, test=develop
* fix place bug, test=develop
* polish codes, add more uts for coverages, test=develop
* add no_grad_set, test=develop
* add star gan ut, test=develop
* follow comments, test=develop
6 years ago
995a6376f7
add pslib SparseDoubleTable test=develop ( #23053 )
6 years ago
3af4771122
Add the detection and code-generation of sqrt and square in fusion_group ( #23095 )
6 years ago
d066d6f994
[Dy2Stat] Change layers.data to fluid.data and Test Var Created In Loop ( #23103 )
...
As the title
6 years ago
0c30098f8b
Add need_save_delta parameter to solve OOM ( #23097 )
6 years ago
2e2da7124b
high-performance dygraph slice ( #22879 )
...
* move __getitem__ to cpp
* bug fix
* add type check and gil release
* support negative step with omitted ends
test=develop
* code refine
test=develop
* bug fix
test=develop
* slice always return different pyobj
test=develop
6 years ago
26bc953b3f
Fix returned arguments in IfElse_fn test=develop ( #23102 )
6 years ago
0d8f40d2b2
remove init_on_cpu and force_init_on_cpu APIs, test=develop ( #22202 )
6 years ago
abee05a8c8
added mkldnn swish activation ( #23041 )
6 years ago
31fc3ab79a
Support to use external function ( #23057 )
...
* Support to use external function test=develop
* refine the parms of ast_to_func test=develop
6 years ago
3f371db82a
add op_device attr for backward op_desc, test=develop ( #23062 )
6 years ago
9ef7f6e898
support to modify dict and list in while_loop ( #23083 )
...
* support to modify dict and list in while_loop test=develop
* polish code test=develop
6 years ago
Liufang Sang
915b892a15
Fix div zero in fake quantize op ( #22966 )
...
* fix div zero test=develop
* fix div zero test=develop
* add hostdevice function test=develop
* add eps when is zero test=develop
6 years ago
fb7b008acc
Add Support for Break and Continue in Dygraph to Static ( #23067 )
...
1. Add support for Break and Continue in Dygraph to Static
2. Also add support for gast.Not in NodeTestTransformer
3. Also add support for logical op transformation in LoopTransformer
6 years ago
853f2e5272
fix bug at sync with communicator ( #23077 )
6 years ago
5a202af90b
Support slice write in dygraph_to_static. test=develop ( #23055 )
6 years ago
5257530492
don't add unregisterd attr, test=develop ( #23047 )
...
* don't add unregisterd attr, test=develop
* add some unittests,test=develop
6 years ago
91a2627251
fix bug in select_input: set var type of output to be the same as input. test=develop ( #23076 )
6 years ago
c4a6a0e2e4
Revert "Integrated API of Parameter Server ( #22710 )" test=develop ( #23071 )
...
This reverts commit 66fce9e824
6 years ago
2403362d06
BugFix for parsing Arguments and inserting funcs in IfElseTransormer ( #23035 )
...
* Support and/or in controlFlow if test=develop
6 years ago
01ab8a0619
add approximation for gelu, test=develop ( #22961 )
...
add approximation for gelu, default value is False (only kernel with eigen is added, remove code for computing gelu with MKLDNN temporarily)
6 years ago
eec10aaba2
set op_device for loss_op_desc ( #23027 )
6 years ago
9203aaf185
fix unittest for coverage ( #23007 )
...
test=develop
6 years ago
1dc1f9270e
Fix lod error of concat op for axis = 0 ( #22538 )
6 years ago
66fce9e824
Integrated API of Parameter Server ( #22710 )
...
Fleet Parameter Server API Integrated
6 years ago
d9d314d56a
Improve stability through the use of caching ( #22922 )
...
* Improved stability through the use of caching
test=develop
* fix style
test=develop
* Fix syntax error
test=develop
* Fix syntax error
test=develop
6 years ago
4af491c2bb
Tensor.shape support control flow if/for/while and bugfix ( #22866 )
...
* Support Tensor.shape in control flow if/for/while and separate TensorShapeTransformer from BasicApiTransformer. test=develop
6 years ago
91b0a9ab23
remnove the unsed unittest test=develop ( #22999 )
...
* remove the fill_constant_batch_size_like, gaussian_random_batch_size_like and uniform_random_batch_size_like_cn three Op unittest
6 years ago
f2265d9ffd
Fix problem use recompute and dgc same time ( #23010 )
6 years ago
8fb8b95286
Add transpose_flatten_concat_fuse_pass tests for gpu and trt ( #22976 )
...
* add transpose_flatten_concat_fuse_pass tests for gpu and trt, test=develop
* update test_inference_api.py, test=develop
6 years ago
ab473357a2
Support and/or in dygraph_to_static control_flow_if ( #22967 )
...
* Support and/or in controlFlow if test=develop
* Refine IsControlFlow interface test=develop
6 years ago
2a7791a815
Fix travic ci ( #23002 )
...
* fix the travic ci problem
6 years ago
3757e0687c
Add Unittest for backward of fusion group ( #22932 )
...
* add fusion group test for backward and refine code
6 years ago
44b1343aab
Support LoDTensorArray in stack/concat api for transformation of list dygraph_to_static ( #22987 )
...
* Support that the input(x) of stack api is a LoDTensorArray. test=develop
* Support that the input of concat api is a LoDTensorArray. test=develop
* Add tests to test stack/concat called in dygraph_to_static. test=develop
6 years ago
3dfaf44adc
Rename dygraph parallel env & add doc ( #22925 )
...
* add dygraph parallel env doc, test=develop
* polish details, test=develop, test=document_fix
* fix examples error in other apis, test=develop
* fix more example error in other api, test=develop
* add white list for gpu examples, test=develop, test=document_fix
6 years ago
08e80d170b
Support list in control flow for dygraph_to_static ( #22902 )
...
* support list in control flow if. test=develop
* support list in for/while and supplement tests. test=develop
6 years ago
f0d193a23c
Cast fusion for fusion group ( #22876 )
...
* add support for expression type convert and add cast Op support in fusion group
6 years ago
29a7a52d38
Fix instag ( #22632 )
...
* update
* update test=develop
* update compile set test=develop
* update compile set test=develop
* update test=develop
* update test=develop
* update test=develop
* update compile setting test=develop
* update compile setting test=develop
* update run demo test=develop
* update test=develop
* update test=develop
* fix test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update format test=develop
* update format test=develop
* update style test=develop
* update style test=develop
* change style test=develop
* change style test=develop
* change style test=develop
* add dataset unittest test=develop
* update test=develop
* update for record test=develop
* udpate style for record test=develop
* update for record test=develop
* update for record test=develop
* update for record test=develop
* fix format test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* fix compile warning test=develop
* add attr default test=develop
* add unittest test=develop
* fix style test=develop
* fix style test=develop
* change out_val_ifempty to out_val_if_empty test=develop
6 years ago
d7a7c5f0bf
Support Simple For Range Loop in Dygraph to Static ( #22867 )
...
1. Add basic support for `for in range` loop
2. Move `test_dygraph_to_static_*` to `dygraph_to_static` dir and rename them
3. Add test case for dict in while_loop
6 years ago
f70f1cf122
test=develop, speed create clip program ( #22950 )
...
speed create clip op
6 years ago
ff3ddbb502
add skip_layernorm pass. test=develop ( #22895 )
...
* add skip_layernorm pass. test=develop
6 years ago
8f541027a8
Move DygraphToStatic Unit Tests into Its Folder ( #22945 )
...
As the title
6 years ago
432a4b2789
Changes QAT MKL-DNN documents ( #22840 )
6 years ago
8d6dc102fe
[Ernie GPU Optimize]: Embedding_eltwise_layernorm Fuse ( #22494 )
...
* 1. add embedding eltwise layernorm fuse
2. add embedding eltwise layernorm op
3. refine inplace_add_relu
4. refine fc_eltwise_layernorm
test=develop
* 1. refine fc
test=develop
* fix comments
test=develop
* fix comments
test=develop
6 years ago
4ff2915d1f
Refine code of IfElseTransformer and rename unittest files ( #22930 )
...
+ Refine code structure and move code related with control flow `if` into `ifelse_transformer.py`
+ Merge code of `ast_utils.py` into `utils.py`
6 years ago
3d8571e884
modify assign op and add unittest of assign op ( #22769 )
...
As the title.
6 years ago
e081c7a05d
skip type/dtype check in dygraph mode, test=develop ( #22915 )
6 years ago
c5cbe7f07b
fix add grad bug test=develop ( #22924 )
...
* fix add grad bug test=develop
* update style test=develop
6 years ago
8d47162e03
Close fuse when use dgc & move DGC strategy from PE to compiler, test=develop ( #22914 )
6 years ago
ba65e4ebef
support Tensor.shape in control_flow_if test=develop ( #22916 )
6 years ago
d33c4343e1
Imperative tracer refactoring ( #22457 )
...
* refine grad maker, test=develop
* refactor tracer stage 1, test=develop
* merge develop to solve conflict third times, test=develop
6 years ago
08a772cb46
fix API param bug of recompute.backward() ( #22582 )
...
* fix API param bug of recompute.backward(), test=develop
6 years ago
4b40edf359
Use available ports instead of static ports. ( #22553 )
6 years ago
5ba9dfc16a
add lookup_table_dequant_op ( #22900 )
...
add lookup_table_dequant_op
6 years ago
62fd3209e1
Fix dgc param regularizer, test=develop ( #22888 )
6 years ago
b290420fc4
fix bug in the transformation from to_variable to assign. test=develop ( #22885 )
6 years ago
4ea95b6fe5
Support Tensor.shape in dygraph_to_static ( #22830 )
...
* support basic tensor.shape.
* Support tensor.shape with dependencies.
6 years ago
1644926a6c
Polish detail implement of dygraph data loader ( #22878 )
...
* polish detail implement of data loader, test=develop
* solve coverage ci problem, test=develop
6 years ago
1daa66559f
Fix the elementwise_min API BUG, use the elementwise_min replace elementwise_max. ( #22880 )
...
In elementwise_min api doc has the error, all the api just use the elementwise_max op, we just correct the doc.
6 years ago
0d463d3bf7
Fix NameVisitor bugs ( #22847 )
...
1. copy.deepcopy in NameVisitor should be changed to copy.copy to make hash or set work
2. read_context should be type of gast.Load()/gast.AugLoad(), not gast.Load/gast.AugLoad
6 years ago
de1b390b79
Add unittest for dict in dygraph_to_static test=develop ( #22854 )
6 years ago
aca3f5311d
Support "while" in Dygraph to Static ( #22841 )
...
Add basic support for while in translating dygraph to static
1. Analysis the variable liveness in class NameVisitor
2. Replace while key word using while_loop API
6 years ago
b6717faf80
Added an option to use external FP32 model in QAT comparison test ( #22858 )
...
* Added an option to use external FP32 model in QAT comparison test
6 years ago
2e9e8c056a
add platform limit for cleanup function, test=develop ( #22846 )
6 years ago
1217a52155
Modify the way of inserting newly defined func_nodes ( #22837 )
...
* Modify the way of inserting newly defined func_nodes test=develop
6 years ago
d41d802ba3
Add flags to limit gpu memory ( #22793 )
...
* add recorded cuda memory apis, fix typo, test=develop
* add more ut, test=develop
* follow comments, test=develop
* fix py35 incompatible issues, test=develop
6 years ago
a5036775a9
Add program_cache in dygrapht_to_static ( #22766 )
6 years ago
5ff2439f51
fixed save qat2 model resnet50 and ernie ( #22822 )
6 years ago
4e8bc02461
add fluid.device_guard to specify the device type for Op ( #22254 )
...
* add fluid.device_guard to specify the device type for Op
6 years ago
df87e79f54
Add functional dygraph mode api ( #22745 )
...
* functional dygraph enable/disable
test=develop
* use context manager instead
test=develop
* refine sample code
test=develop
* rename api & expose to fluid
test=develop
* fix sample code
test=develop
6 years ago
0f9d40816e
test=develop, optimize distributedstrategy ( #22677 )
...
* test=develop, optimize distributedstrategy
6 years ago
5ee29c67b8
Set run exclusive for data loader unittest ( #22831 )
6 years ago
0c617377a9
add case and switch_case unittests for dygraph mode ( #22790 )
...
test=develop
6 years ago
2b8640962a
Fix the big shape and precision op test, remove those from the white list ( #22788 )
...
Fix the big shape op test, elementwise_mul, elementwise_div, mul op
Fix the precision op test, mul op
6 years ago
0c55c79fb7
Polish profiler doc ( #22815 )
...
* polish the profiler doc
6 years ago
15e59c310d
cleanup mmap files in unittest, test=develop ( #22814 )
6 years ago
89cfa49156
Unmerged fetch list ( #22635 )
...
* update ScopeBufferedSSAGraphExecutor&AsyncSSAGraphExecutor&ThreadedSSAGraphExecutor&FastThreadedSSAGraphExecutor&ParallelSSAGraphExecutor&ParallelExecutor for fetching unmerged results.
* add the unit test for fetch_unmerged.
* update ut for multi-card and multi-cpu.
* add the error message and the user suggestion in FetchOpHandle. test=develop
6 years ago
f05c213f98
fix basic gru lstm parameter attr bug; test=develop ( #22508 )
...
* fix basic gru lstm parameter attr bug; test=develop
* fix bias attr bug; test=develop
* add basic lstm gru name unitest; test=develop
6 years ago
cde5378955
upgrade fp32 to fp64, enlarge input shape for hsigmoid unittest ( #22773 )
...
* upgrade fp32 to fp64, remove no_grad_set, enlarge input shape for hsigmoid unittest test=develop
* revert "remove no_grad_set" test=develop
6 years ago
7d8d573453
Speed up dygraph DataLoader based on shared memory and LoDTensor serialization ( #22541 )
...
* add lodtensor share memory & serialization, test=develop
* fix windows compile error, test=develop
* deal vartype pickle & fix unittest matching error message, test=develop
* update timeout variable name, test=develop
* refactor memory map implement, test=develop
* clear mmap file discripter when exit unexpectedly, test=develop
* remove the child process fd in advance, test=develop
* remove mmap fds after Queue.put in child process, test=develop
* add hard unittests for register exit func, test=develop
* fix python2 compatibility problem in unittest, test=develop
* fix exception unittest error, test=develop
* polish code based review comment, test=develop
6 years ago
b7782ea7c3
sync program when need, test=develop ( #22803 )
6 years ago
53a2b68f4e
support customized download command in dataset ( #22782 )
...
* user can call dataset.set_download_cmd to set its customized download cmd
* add UT to cover this scenario
6 years ago
1a2baa1834
test ResNet decorated by dygraph_to_static_output in static mode. ( #22779 )
...
* test ResNet decorated by dygraph_to_static_output in static mode. test=develop
* Follow comments and change dygraph_to_static_output to dygraph_to_static_graph.test=develop
6 years ago
ca9e77a8d4
add sum op support for fusion group ( #22771 )
...
* Add the codegen and auto fusion for sum Op in fusion group
6 years ago
b681215aa3
Add @skip_check_grad_ci to UT conv_mkldnn and int8_mul_mkldnn ( #22760 )
6 years ago
68a92e4674
fix dygraph_to_static_ouput and add a new decorator. ( #22785 )
...
* change dygraph_to_static_output to dygraph_to_static_graph. test=develop
* Remove duplicate code. test=develop
* Follow comments from Liujie. test=develop
* change dygraph_to_static_output to dygraph_to_static_graph. test=develop
6 years ago
Liufang Sang
5dbafe3805
fix smooth l1 loss op shape > 100 test=develop ( #22605 )
...
* fix smooth l1 loss op shape > 100 test=develop
* remove from white list test=develop
6 years ago
433cef03e5
fix typo word ( #22784 )
6 years ago
ebc7ffc300
fix detection_map. test=develop ( #22705 )
6 years ago
ee8b22fbec
Add unittest with mnist model to test dygraph_to_static ( #22777 )
...
* add mnist to test dygraph_to_static test=develop
6 years ago
72dde4abde
Refine adam op to improve performance, test=develop ( #22346 )
...
* Refine adam op, test=develop
* Fuse kernels together to reduce cpu time.
* Refine paddle enforce, test=develop
* Remove some comments, test=develop
* Refine code,test=develop
* Refine cuda kernel, test=develop
* Refine code according to comments, test=develop
6 years ago
8c381cd957
support fetch feed in dygraph to static graph ( #22767 )
...
* Support fetch and run program in the process of dygraph_to_static_output. test=develop
* fix to_source(gast) and remove dygraph API such as Conv2D, Linear. test=develop
6 years ago
88776e40b9
fix SyntaxError in examples in retinanet_target_assign English API, test=develop ( #22774 )
6 years ago
f2d1cd119a
fix lod level, test=develop ( #22755 )
6 years ago
79d712346f
Correct CPU gradients of the argsort op ( #22739 )
...
* Correct CPU gradients of the argsort op, form a network to test its forward and backward process, test=develop
* fix dynamic threshold error in test_argsort_op, test=develop
6 years ago
0cb121cf1c
test=develop, bug fix for trainer_factory ( #22751 )
6 years ago
b813c948f0
support control flow cond in dygraph mode ( #22693 )
...
* dygraph support cond op
test=develop
* unittest coverage
test=develop
* fix coverage
test=develop
* fix for coverage
test=develop
* refine TypeError msg
test=develop
* remove restrict
test=develop
6 years ago
b2c1be851a
support cond in clone, test=develop ( #22657 )
...
* support cond in clone, test=develop
* refine code, test=develop
* refine code, test=develop
* follow comments, test=develop
* refine code, test=develop
6 years ago
2143bd5738
enhance shape check if use user_defined_grads in check_grad ( #22722 )
6 years ago
fa449c886f
fix typo word ( #22761 )
6 years ago
66991218ec
Add Basic Function Return Type Analysis ( #22747 )
...
1. Considering functions, I have to change the node type from single value to a set. Because python function is allowed to return different types. The set represent all possible types
2. I added scope_name and scope_type for AstVarScope, because in python functions, variable may have different scope. For example:
```
a = 3
def foo(b):
a = 9
return a + b
```
the `a` in `foo` is different to the `a` out of `foo`. Similar to class field. The scope_name will help me to know the function name when static analysis finds a `return` sentence.
6 years ago
60aaa7158b
dygraph support while_loop op ( #22714 )
...
* dygraph support while_loop op
test=develop
* refine assign
test=develop
6 years ago
15c2667143
register fp16 for assign op ( #22744 )
...
* register fp16 for assign op, test=develop
* add op test for fp16, test=develop
6 years ago
fb15aa1c5b
Ngraph op tests skip check grad ci ( #22688 )
...
* ngraph op test skip check grad ci, test=develop
6 years ago
1b561da1f7
Change API doc example code to python3 style print ( #22735 )
...
As the title
6 years ago
1c0653462d
fix generate_mask_labels lod level ( #22743 )
6 years ago
ba140222d6
fix compile&runtime lod_equality of lod_reset ( #22737 )
6 years ago
175954d894
PaddleBox Framework Part2 ( #22466 )
...
* Add two types of Metric Calculator: MultiTaskCalculator & CmatchRankCalculator.
* Add a config for DynamicAdjustChannelNum function to denote whether we will discard the remaining instances when they are not be distributed evenly.
* Remove CPU code in Pull/PushSparse and we will add it back when testing it fully.
* Fix some known issues: such as copying persistable vars after one epoch running.
6 years ago
3132681e8a
add partial_sum op in contrib ( #22292 )
...
* add partial_sum_op, test=develop
* modify the Paddle Error Message, test=develop
* modify the Paddle Error Message, test=develop
* modify the bug for python3, test=develop
* modify the ut for ci, test=develop
* mv to contrib, test=develop
* use check_variable_and_dtype, test=develop
* fix ci, test=develop
* fix conflict, test=dvelop
* add partial concat, test=develop
* fix the conflict, test=develop
* fix the error, test=develop
* rm SSE4, test=develop
6 years ago
163a3ddfe3
fix row_conv_op small size unittest cases ( #22606 )
6 years ago
e136661304
add partial_concat op in contrib ( #22528 )
...
* add partial_concat, test=develop
* fix the grids and blocks, test=develop
* fix the Paddle_Enforce, test=develop
* fix the doc of op, test=develop
* fix the doc, test=develop
* fix the doc of the op, test=develop
* replace -1 with None, test=develop
6 years ago
dab5e5d8bc
Add IsControlFlowIfVisitor in ast_transformer ( #22709 )
...
* add is_control_flow_if test=develop
6 years ago
68c76793ca
support dygraph basic api transformed to static api ( #22678 )
...
* support dygraph to static graph for simple case.
* add test for dygraph API recognition. test=develop
* support basic to_variable api. test=develop
* update dict: dygraph_class_to_static_api
* add all tests of dygraph api. test=develop
* use gast/astor instead of ast/codegen for the compatibility of PY2 and PY3. test=develop
* add arg 'num_flatten_dims' for fc ast node. test=develop
* Modify names of class by Camel-Case.
6 years ago
3f7f922d6c
about set no_grad_set, move row_conv to NOT_CHECK_OP_LIST ( #22721 )
6 years ago
9b8caaa220
remove unnecessary cases with no_grad_set for prelu ( #22707 )
...
test=develop
6 years ago
a5b0758ff7
fix the doc in elementwise_add elementwise_sub elementwise_mul elementwise_div
...
fix the doc in elementwise ops，add the override function in the doc
6 years ago
d2ba91aad1
fix typo words ( #22653 )
6 years ago
66a3150135
SYNC with communicaotor ( #22344 )
...
* add sync communicator and implement
6 years ago
22bbd54719
Add the support of fp16 in fusion_group ( #22239 )
6 years ago
769c032fc4
fix spp test ( #22675 )
6 years ago
1a595d8e90
Remove `no_grad_set` usage from "conv_shift" op tests ( #22683 )
6 years ago
d39d8bee4e
unexpose tracer, test=develop ( #22661 )
6 years ago
08b09f6447
Support if/else in dygraph_to_static ( #22540 )
...
* support nested if/else
* support to derivate returns the parameter list automatically
* polish tranform function of slice
* fix modify x.numpy()[i] slice function
* support to transform ast.node into callable function
* fix get_name_ids bug and add more unittest test=develop
* fix requirements.txt test=develop
* remove useless import statement test=develop
* Fixed version compatibility issues in param of function test=develop
* use decorater to test ast_to_func test=develop
* add textwrap.dedent for source_code test=develop
* polish code comment
* fix compatibility with python2 and python3 test=develop
* fix gast version error test=develop
* fix gast repo test=develop
* polish transfer_from_node_type code test=develop
* add nested_if_else unittest test=develop
* split IfElseTransformer test=develop
* specify gast version test=develop
* fix ast_to_func root type test=develop
6 years ago
7a4c29e0e0
add fuse_group python unitest ( #22532 )
...
* add fuse_group python unintest
6 years ago
405bb94bd1
Fix batch_num default value ( #22682 )
6 years ago
14672a6364
Add Basic Node Var Type Analysis ( #22603 )
...
1. Move AstNodeWrapper, StaticAnalysisVisitor to a new python file: static_analysis.py
2. Add basic node var type analysis
6 years ago
6abeb5c54d
fix ernie accuracy doc ( #22671 )
6 years ago
0aee43005a
Linear use mul op ( #22662 )
...
* Linear use mul op
test=develop
* fix unittest
test=develop
6 years ago
df144e2188
add no_check_list for no_grad_set rule ( #22571 )
6 years ago
d926214535
[UT coverage] improve the mul_mkldnn_op line coverage ( #22408 )
...
* improve the mul_mkldnn_op line coverage
test=develop
* remove fp32 mul mkldnn kernel
test=develop
* locally refactoring
test=develop
* change according to reviews
test=develop
6 years ago
c65c6ae534
add flag to control profile level in python API ( #22319 )
...
* add python flag to control profile level test=develop
6 years ago
fce37bc593
Doc update with Ernie QAT INT8 benchmarking ( #22519 )
...
* Doc update with Ernie QAT INT8 benchmarking
test=develop
* fixes after review
test=develop
* remove ernie part, test=develop test=document_fix
* Fix model name for qatv2
test=develop test=document_fix
* Add Ernie data
test=develop test=document_fix
* update ERNIE benchmark with baidu QA results, test=develop test=document_fix
Co-authored-by: bingyanghuang <33643817+bingyanghuang@users.noreply.github.com>
Co-authored-by: Michał Gallus <sand3r@interia.eu>
6 years ago
17a6b50fe3
support num_flatten_dims=-1 of API fc. ( #22634 )
...
* support num_flatten_dims=-1 of API fc. test=develop
* fix name of class Test* and add CUDAPlace test. test=develop
6 years ago
8b41e2b3d1
add gast to replace ast test=develop ( #22630 )
6 years ago
00594c1c88
support dumping params/grads in transpiler mode ( #22490 )
6 years ago
d86007775f
fix py_func bug when out is list and add unittest case ( #22595 )
6 years ago
d9f0c9f51c
support set param with None value ( #22418 )
...
* support reset param with None value
* add unittest
test=develop
* update unittest
test=develop
6 years ago
192110725a
Add Queue.get delay for multiprocess data loader ( #22604 )
...
* add get delay for multiprocess data loader, test=develop
* add unittest for coverage ci, test=develop
* add timeout unittest, test=develop
* increase the delay time, test=develop
6 years ago
f5db451d3b
fix compute priority. test=develop ( #22619 )
6 years ago
8f035fb637
Add TopK Op Grad CPU&GPU Kernel test=develop ( #22628 )
...
* Add TopK Op Grad CPU&GPU Kernel test=develop
* Add TopK Op Grad, modify grad op maker test=develop
* Add TopK Op Grad, modify grad op maker test=develop
* Add TopK Op Grad, modify PADDLE_ENFORCE test=develop
* Add TopK Op Grad, modify PADDLE_THROW test=develop
* Add TopK Op Grad, modify unittest test=develop
* fix ngraph top k op unittest test=develop
6 years ago
3f0ca61a82
fix noam decay example, test=develop,test=document_fix ( #22557 )
6 years ago
9ed59da443
Modify english document and unittest of while_loop ( #22615 )
...
Modify english document and unittest of while_loop
6 years ago
fc645d8a47
Fix data loader test failed problem in release 1.7 ( #22624 )
...
* split unittests in data loader test, test=release/1.7
* split unittests to different files, test=develop
* remove repeat unittest, test=develop
6 years ago
e59463efc7
test=develop, add distributed tools ( #22623 )
6 years ago
1aab3e61c9
add texttable for pretty flag output ( #22584 )
...
pretty print for communicator flag
6 years ago
b768708e5d
fix pickle load encoding between python 2 and 3 ( #22621 )
...
test=develop
6 years ago
cb4560b79d
python 2 and 3 compatible pickle ( #22555 )
...
test=develop
6 years ago
90ee366653
update ops's unittest data type from float32 to float64 and shape over 100 ( #22544 )
...
* update ops's unittest of elementwise_pow, elementwise_max, elementwise_min, scale and sqrt
1. update elementwise_pow, elementwise_max and scale's unitests with input data type (float32 -> float64)
2. fix bug that the elementwise_pow doesn't meet threshold requirements with tackling float64 data
3. remove sqrt from op_accuracy_white_list.py
4. update the unittests of elementwise_pow, elementwise_max and elementwise_min ops that their input data shape over 100
5. test=develop
* modify the writing style according suggestions
test=develop
6 years ago
57de4842e6
optimizer var exlcude fluid.data var. test=develop ( #22594 )
6 years ago
948299aec8
deprecated for distribute transpiler api ( #22513 )
...
* add deprecated for distribute transpiler, will delete it after 2.0.0, test=develop
6 years ago
ec90742708
Adjust sleep time of main process in signal handler test ( #22597 )
6 years ago
614a2a4f98
modify English document while_loop ( #22573 )
...
As the title.
6 years ago
e28833a80e
Fix doc of detection's img_info param ( #22458 )
...
* test=develop fix doc of detection's img_info param
6 years ago
6980239632
Enhance load program state ( #22546 )
...
* enhance load program state; test=develop
* optimize commet; test=develop
6 years ago
8acd745c25
[Ernie GPU Optim]: Fuse three fc to multihtead matmul ( #22486 )
...
* 1. optim multihead matmul: fuse three fc to multihtead matmul
test=develop
* fix conflict
test=develop
* fix comments
test=develop
6 years ago
a8dd425aa3
Add Static Analysis to Construct AstNodeWrapper ( #22569 )
...
As the title
6 years ago
146ed4099d
Add test with reused requantize op ( #22482 )
...
test=develop
6 years ago
08033c8634
fix traced layer with non persistable vars, test=develop ( #22552 )
6 years ago
31b5464632
Add support for dynamic_decode(while) training. ( #22231 )
...
* Add support for dynamic_decode(while) training. test=develop
* Fix assign_op and tensor_array_read_write_op after solving conflict. test=develop
* Fix test_rnn_decode_api.py. test=develop
* Refine docs for apis in rnn.py. test=develop
* Adjust outputs of dynamic_decode. test=develop
* Remove the force_cpu update in assign_op. test=develop
* Remove the force_cpu update in assign_op. test=develop
* Make RNNCell.get_initial_states support batch_dim_idx argument. test=develop
* Rename _create_array_outof_while as _create_array_out_of_while in rnn.py.
test=develop
6 years ago
b0675c8193
fix bug with compiledProgram ( #22495 )
...
* add thread barrier for the compiled program
6 years ago
4cddb43c5c
Add support for Ernie NLP model to the Slim QAT ( #22506 )
...
* a test for Ernie QAT INT8 accuracy check
test=develop
* Remove NLP comparison test to split PRs
test=develop
* Fix typo and tabs, delete commented lines
test=develop
* re-combine the 2 PRs, test=develop
Co-authored-by: Michał Gallus <sand3r@interia.eu>
Co-authored-by: bingyanghuang <33643817+bingyanghuang@users.noreply.github.com>
6 years ago
58d99247f4
support slice double grad, test=develop ( #22166 )
...
* support slice double grad, test=develop
* merge two doublegradopmaker to one doublegradopmaker,test=develop
* change the shape of slice_OP's unittest, test=develop
6 years ago
9e29d3ebed
【OpPorting Example】DEMO OF FIX COMPILE&RUNTIME LOD_EQUALITY ( #22460 )
6 years ago
00c110f3ff
Fix bilinear import math ( #22523 )
6 years ago
d69df9bf26
Add wrong info when use DGC in cpu ( #22515 )
6 years ago
2235ee1a5e
multi-loss optimization by adding a DownpourOpt worker ( #22025 )
...
* update
* update test=develop
* update compile set test=develop
* update compile set test=develop
* update test=develop
* update test=develop
* update test=develop
* update compile setting test=develop
* update compile setting test=develop
* update run demo test=develop
* update test=develop
* update test=develop
* fix test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update format test=develop
* update format test=develop
* update style test=develop
* update style test=develop
* change style test=develop
* change style test=develop
* change style test=develop
* add dataset unittest test=develop
* update test=develop
* update for record test=develop
* udpate style for record test=develop
* update for record test=develop
* update for record test=develop
* update for record test=develop
* fix format test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
6 years ago
54970444ce
Improve transpose performance with tile sm copy, test=develop ( #22311 )
...
* Refine code, fix select tile error,test=develop
* Refine element type and some comments, test=develop
* Refine comments and gpu utils, test=develop
* Remove some useless condition
* Refine floor and ceil, test=develop
* refine for loop. test=develop
Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com>
6 years ago
3a59a7a11f
Make assign op support LoDTensorArray and modify while_loop API ( #22309 )
...
This PR makes assign op support LoDTensorArray and enable the loop_vars in
while_loop to support tuple or list.
6 years ago
14b6133b45
Implement InferencePassTest for testing precision of inference passes ( #22387 )
...
* add InterencePassTest for testing precision of inference passes, test=develop
6 years ago
e7bbad6c49
Fix the leaving out of rnn_memory_helper_grad's output vars. test=develop ( #22499 )
6 years ago
d143f70a09
Post_training_quantization support set quant 8/16 bits ( #22492 )
...
* post_training_quantization support set bits, test=develop
* up, test=develop
6 years ago
870f465887
fix test_fusion_seqpool_concat lod level between compile and runtime ( #22488 )
6 years ago
903039a3c6
Add Simple Framework for Transforming Dygraph to Static Graph ( #22491 )
...
This PR provides very basic and simple framework for transforming Dygraph to Static Graph.
API names, final outputs are not determined yet. Feel free to modify or add class/function/type when you think the framework is not extendable for you.
6 years ago
197913ebe1
Add weight quantization in post_training_quanzitaion ( #22445 )
...
* support weight quantization in post_training_quanzitaion, test=develop
* add test for weight quantization, test=develop
6 years ago
dcfb603897
Enable the detection of subgraph composed of grad ops ( #21223 )
...
* Add the first implememtation of fusion_group op #19621 (#3 )
* Add the dynamic load of nvrtc, and support runtime compiling of CUDA kernel using nvrtc.
test=develop
* Call CUDA driver api to launch the kernel compiled by nvrtc.
test=develop
* Disable for mac and windows.
test=develop
* Refine the codes to support manually specified num_threads and workload_per_thread.
test=develop
* Refine the CUDA kernel to support large dims.
test=develop
* Add DeviceCodePool to manage all device codes.
* Add the first implementation fusion_group op.
* Add unit-test for fusion_group op.
* Add the check of result.
* Add the check of nvrtc in unit-test.
test=develop
* Add comment to explain the inputs, outputs and features of fusion_group op.
test=develop
* Disable fusion_group op for mac and windows.
test=develop
* Make the compiling of device code return status instead of hanging up.
test=develop
* Add the check of whether there is CUDA driver library, and do not core dump when failing to call the CUDA driver API.
* Unify fusion_group_op's input and output names.
test=develop
* Add the check of CUDA driver library in unittest.
test=develop
* Enable generating code for a given subgraph. #21126 (#4 )
* Enable generating code for a given subgraph.
* Support sorting the subgraph.
* Remove the rearange of expressions because we use the sorted subgraph directly.
* Enable generating code for a subgraph which is composed of grad ops.
* Use expression information to check the accuracy in unittest.
* Separate load and store from computation expressions.
test=develop
* Improve the loading statements in generated codes.
test=develop
* Remove unused arguments from formal list.
test=develop
* Enable the detection of subgraph of grad ops.
* Generate code for detected subgraph in fusion_group_pass.
* Add an option in BuildStrategy to enable fusion_group_pass and add unittest.
test=develop
* Fix a bug when checking whether the shape of all inputs are the same.
* Add debug information.
* Remove subgraph_detector from inference/analysis to the common framework/ir directory. (#5 )
test=develop
* Call subgraph_detector in fusion_group pass.
test=develop
* Disable fusion_group when WITH_GPU is OFF.
test=develop
* Refine all PADDLE_ENFORCE message.
test=develop
* Fix the case that some inputs are not defined in grad ops, and set op_role for fused op.
test=develop
* Follow review comments.
test=develop
6 years ago
50af6b5d79
polish no_grad_set of gradient and append_backward ( #22440 )
...
* polish backward api doc test=develop, test=document_preview,
test=document_fix
* polish backward api doc test=develop, test=document_preview, test=document_fix
* no_grad supports set of Variable test=develop, test=document_preview
* polish sample code of append_backward test=develop, test=document_preview
* modify assert into Raise TypeError test=develop,test=document_preview
* fix unittest failed test=develop
* rm useless file test=develop
* polish en doc test=develop
* polish code of no_grad_set test=develop
* polish code of no_grad_set test=develop
6 years ago
6b7bb6b54a
change check_type_and_dtype to check_variable_and_dtype ( #22465 )
6 years ago
c2f39431aa
add skip_check_grad_ci of var_conv_2d ( #22451 )
...
* add skip_check_grad_ci of var_conv_2d test=develop
* modify check_shape_white_list test=develop
6 years ago
7bc4b09500
add WITH_NCCL option for cmake. ( #22384 )
...
cmake选项中添加了WITH_NCCL，显示指定是否编译NCCL的部分代码，WITH_NCCL默认打开，但如果WITH_GPU为OFF，则关闭WITH_NCCL
添加了PADDLE_WITH_NCCL定义
单机单卡能够关闭NCCL编译，多卡的话需要默认打开NCCL，如果关闭NCCL，则只能使用单卡
Co-authored-by: 石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>
6 years ago
c8b90d8f9a
fix deformable_conv small cases, test=develop ( #22441 )
6 years ago
6e4f39a061
add hdfs ls retry time and sleep time, fix save inference ( #22433 )
...
* add hdfs ls retry time and sleep time, fix save inference
* test=develop
6 years ago
822e5b36ec
Support int16 for Tensor ( #22423 )
...
* add int16 support, test=develop
* add test, test=develop
* fix typo, test=develop
* fix dtype error in slice, test=develop
6 years ago
0a678ca045
fix chain doc, test=develop, test=document_preview ( #22070 )
...
* fix chain doc, test=develop, test=document_preview
6 years ago
7e2665c58b
fix bug with half ( #22378 )
...
* fix bug with half communicator
6 years ago
0404e7a985
Update the precision of pad, pad2d, pad_constant_like's unit tests from fp32 to fp64 ( #22394 )
...
* update the ut precision of pad pad2d pad_constant_like from fp32 to fp64, test=develop
6 years ago
371f377bea
add GeneralRoleMaker ( #22295 )
...
* add GeneralRoleMaker which is for general usage
* test=develop
6 years ago
ade5022681
[UT Coverage]Improve sum_mkldnn_op line coverage ( #22275 )
6 years ago
3099d9d47c
Restore requantize squash ( #22399 )
6 years ago
92462e948d
improve elementwise_add_mkldnn_op test code coverage ( #22359 )
6 years ago
e6ca512af1
refine convert type for numpy type ( #22386 )
6 years ago
6d325a9470
enable test_dist_se_resnext_nccl.py, test=develop ( #22067 )
6 years ago
a392b77785
add no_grad_set value check in op_test, test=develop ( #22370 )
...
* add no_grad_set value check in op_test, test=develop
* update ops list, test=develop
6 years ago
8f36c39537
Fix GEO-SGD init & send Bug ( #22375 )
...
* test=develop, fix geo Send & Init
6 years ago
39bdefd875
open depthwise_conv2d in dygraph ( #22373 )
...
test=develop
6 years ago
ad2bc0c364
Fix a distribution bug and cleanup some not need logs. ( #22381 )
6 years ago
7b0692a610
remove skip_check in test_activation_mkldnn_op, test=develop ( #22376 )
...
* remove skip_check in test_activation_mkldnn_op, test=develop
6 years ago
5f655d2cef
Refine unitest im2seq op. ( #22372 )
6 years ago
039bb5050c
Polish backward.py to prune more ops ( #22246 )
...
* polish backward prune, test=develop
* fix control flow op bug, test=develop
* add some unittests, test=develop
* fix unittest args, test=develop
* follow huihuang's comments, test=develop
6 years ago
26da700ab2
Fix static graph dataloader early reset bug ( #22365 )
...
* fix dataloader early reset bug, test=develop
* change implementation, test=develop
* fix ut, test=develop
6 years ago
c6f888e5a5
update unittest accuracy to float64 for relu, prelu, maxout ( #22273 )
6 years ago
325f0722bd
skip all mkldnn op test ( #22363 )
6 years ago
a22aaf7078
test=develop, fix test dist fleet geo unittest ( #22287 )
...
fix timeout of test_dist_fleet_geo
6 years ago
b7cac50b64
Implement a common python unittest to test the ir passes. ( #22209 )
...
* Implement a common python unittest to test the ir passes.
test=develop
* Save the results in np.array and support to startup on CPU.
test=develop
* Fix the unittest.
test=develop
* Add check_program to check whether the optimized program is different from the origin one.
test=develop
* Remove the inferface all_ops.
test=develop
* Add exception test in pass_test.
test=develop
6 years ago
99f5907e02
Fix layer & dygraph circular dependent ( #22334 )
...
* fix circular dependent
* try import layers.nn from dygraph
test=develop
6 years ago
4dec15999f
Allow Layer attr shadow ( #22333 )
...
* allow sublayer or param shadow attrs
* add unittest
test=develop
* change remove fn name
test=develop
6 years ago
cf0e264e63
all cases use large shape and skip special cases ( #22332 )
6 years ago
82bc814a57
integrated HALF_ASYNC to communicator ( #21869 )
...
* add half_async in the communicator
* fix DistributedStrategy
6 years ago
00c0139e6e
add learning rate api of optimizer ( #22080 )
...
* add learning rate api; test=develop
* fix uni test converage; test=develop
* fix travis ci error; test=develop
* fix comment; test=develop
* fix example error; test=develop
* polish the api description, test=develop
Co-authored-by: zhongpu <2013000149@qq.com>
6 years ago
51e147a130
fix the en doc and example code of warpctc ( #22325 )
...
* Fixed warpctc, test=develop
* Set lod level of sequence_unpad's output to 1 in compile time
test=develop
* fix the en doc and example code of warpctc, test=develop, test=document_fix
6 years ago
805328e13b
fix typo in error message ( #22312 )
6 years ago
b339dff231
fix use cache file, test=develop ( #22240 )
6 years ago
cb5e0d20c2
skip cases with small shape ( #22318 )
6 years ago
b1c081f4c7
polish Optimizer's API description, test=develop ( #22314 )
6 years ago
008ea1ae2e
Fix test layers 单测随机挂问题 ( #22278 )
...
* fix test_layers compare static graph and dygraph result; test=develop
* fix test_layers random error; test=develop
6 years ago
35efbe6d95
Speeding up dygraph DataLoader with multiprocessing ( #21762 )
...
* add multiprocess for dygraph data loader, test=develop
* polish code & add safe gurad, test=develop
* refactor dygraph dataloader & add signal handler, test=develop
* fix member initializer compile error on ci, test=develop
* fix member initializer compile error one more, test=develop
* remove useless config, test=develop
* skip windows incompatible problem, test=develop
* add unittest for coverage, test=coverage
* add more exception unittest case, test=develop
* deal with signal handler coverage, test=develop
* polish code & add signal handler tests, test=develop
* deal with coverage ci problem, test=develop
* split data loader test & coverage ci fix, test=develop
* remove test_imperative_data_loader_with_exception, test=develop
* remove singal process except test case, test=develop
* add exception tests again & remove sample list test, test=develop
* split normal and exception unittests to diff class, test=develop
* polish doc for use_multiprocess effect in static mode, test=develop
6 years ago
7ab44afbcc
check op tests' shape should be 100+ ( #22047 )
6 years ago
8f7372ca81
add mul and matmul quantization, test=develop ( #22054 )
...
* add mul and matmul quantization, test=develop
* add test for matmul, test=develop
6 years ago
737334989b
State dict do not count data parallel layers ( #22169 )
...
* DataParallel state dict don't include _layers.; test=develop
* add unitest of data parallel; test=develop
* add load state test; test=develop
6 years ago
60a6d68fb9
remove _optimized_guard in dygrahpe_mode ( #22143 )
...
* remove _optimized_guard in dygrahpe_mode test=develop
* remove comment code test=develop
* remove list append test=develop
* remove list append test=develop
6 years ago
a2603c5bf4
Remove _optimized_guard of append_regularization_ops in Dgraph mode ( #22271 )
...
* polish regularization test=develop
* add comment of function test=develop
* rm name_scope in dygraph mode test=develop
6 years ago
faba4b116a
Remove disable flag in test_fsp_op.py ( #22171 )
...
* fix fsp_op, test=develop
* fix fsp grad op maker, test=develop
* update op_use_default_grad_op_maker.spec, test=develop
6 years ago
GaoWei8
gongweibao
liym27
Aurelius84
songyouwei
Pei Yang
Chen Weihang
zhongpu
guofei
wangchaochaohu
Adam
silingtong123
cc
qingqing01
David Lin
Zhou Wei
Chengmo
Bai Yifan
ShenLiang
wawltor
Tao Luo
Steffy-zxf
WuHaobo
yongqiangma
LutaoChu
Huihuang Zheng
Zhen Wang
Leo Chen
mamingjie-China
kinghuin
Wilber
Feiyu Chan
xujiaqi01
channings
Yiqun Liu
Zeng Jinle
XiaoguangHu
YuHaoXiang
Wojciech Uss
Kaipeng Deng
hong
FDInSky
lidanqing
Liufang Sang
yaoxuefeng
hutuxian
Zhang Ting
Sylwester Fraczek
tangwei12
chalsliu
WangXi
liu zhengxi
tianshuo78520a
Chengmo
Zhaolong Xing
mapingshuo
123malin
zhupengyang
zhaoyuchen2018
FlyingQianMM
wangguanzhong
chengjuntao
dyning
ShenLiang
Double_V
Yang Zhang
bingyanghuang
HappyAngel
Jiawei Wang
xiaoting
joanna.wozna.intel
Guo Sheng
huzhiqiang
littletomatodonkey
lilong12
石晓伟
whs
Li Fuchen
zhangchunle