e0a2d4dfec
Add elementwise_pow_op backward implementation and the unit test codes of it. ( #18848 )
6 years ago
ecd2bdada6
add CPUInplaceTestWithFuseOptimizationOps ( #18867 )
...
test=develop
6 years ago
8008ab4e6b
Remove legacy C++ memory optimization codes ( #18834 )
...
* remove legacy memory optimization codes, test=develop
* follow huihuang's comments,test=develop
* follow luotao's comments, test=develop
6 years ago
52c1431eee
add clear_model interface in fleetwrapper ( #18815 )
...
* dump slot
* test
* proto
* dump slot
* test
* proto
* code style
* code style
* code style
* style
* add delete after unseen days
* add unseen days
* code style
* conflict solve
test=develop
* add clear model
* code style
test=develop
* code style
test=develop
6 years ago
9a8a7a1ddc
fix affine_channel no_need buffer bug, test=develop ( #18844 )
6 years ago
829ef26281
Fix drop deconv ( #18813 )
...
* replace link
* update api.spec
* fix mistake
6 years ago
4140fe11a4
Open fuse optimization ops ( #18741 )
...
* open fuse optimization ops
test=develop
6 years ago
582cc29799
add warning info for CPU_NUM ( #18840 )
...
test=develop
6 years ago
ee02227949
Add LeakyReLU MKLDNN support ( #18762 )
6 years ago
a802da650b
Feature/mem opt pass refactor ( #18735 )
...
* first version memory optimize pass, test=develop
* remove move_tensor_sharing_pass, test=develop
* refine code comments, add unittests, test=develop
* turn off memory_optimize by default, test=develop
* follow huihuang's comments, test=develop
* follow chengduoZH's comments, test=develop
* fix grammar error, add const qualifier, fix pass_test exception message, test=develop
* follow chengduoZH's comments 2nd, test=develop
6 years ago
9dbb62eeb9
Fix examples of API ( #18092 )
...
* fix logical APIs
test=develop
test=document_preview
* fix isfinite
* update matmul comments
* update API.spec
test=document_preview
test=develop
* update API.spec
test=document_preview
test=develop
* update API.spec
test=document_preview
test=develop
6 years ago
30562e371b
refine launch_ps and role_maker ( #18795 )
...
refine launch_ps and role_maker
6 years ago
c167a4b4dd
Fix shrink-dense and add scale-datanorm ( #18746 )
...
Fix FleetWrapper:
1. fix shrink dense: just scale show
2. add datanorm scale: divide datanorm's gradient by batch_size
6 years ago
2efb282c86
split test_dist_se_resnext.py into 4 testcases ( #18743 )
...
* split test_dist_se_resnext.py into 4 testcases
6 years ago
220eef602e
Extend Matmul to support matrix multiplication with multiple heads ( #18570 )
...
* extend matmul op to support multiple head multiplication
With the support of multiple head, the multiplication of two big matrixes is
split into multiplication of several (head_number) small matrixes. e.g. if
Mat A is [3, 24] and Mat B is [24, 4], when multiple A and B with head_number
as 4, Mat A will be split as 4 matrix of [3, 6] and Mat B will be 4 matrix of
[6, 4]. The result of final matrix will be 4 matrix of [3, 4], i.e. [3, 16].
6 years ago
075e1cf78e
Add python API for appending LoD level ( #18702 )
...
* Make lod reset op support for append lod level.
* Fix API.spec
test=develop
* Fix unitest.
test=develop
* Add python api for lod append.
test=develop
* Fix API.spec
test=develop
* Fix format of doc.
test=develop
* Fix unitest.
test=develop
* Fix doc.
test=develop
6 years ago
8259f1418f
Enhance backward process ( #18700 )
...
* prun backward ops
test=develop
6 years ago
25c9b57bcd
Modify auc doc. Add output variable description, previously was the scalar type, now changed to the tuple type.test=develop ( #18771 )
6 years ago
d8396281ef
add slot to sparse table ( #18686 )
...
The change includes 2 things:
1. save delta model and shrink table are control by the same parameter before, now add delete_after_unseen_days to control shrink table.
2. value in sparse table has no slot before, now add slot in sparse table, and add DownpureCtrAccessor to support the new meta.
test=develop
6 years ago
d18aabb472
support patch data, add load_one_table, fix bug ( #18509 )
...
（1）support patch data （merge slots of instances of same line id, modify dense layer which
changes its size）
（2）add fleet load_one_table interface, support load from paddle model and load from pslib model
（3）fix push sparse bug which cause push sparse cost more time（about 10% in my testcase）
（4）when some slots are not in one of your network (join/update, etc.)，data feed、collect label info、push/pull sparse will skip these slots， instead of throw error.
（5）add more debug info in TrainFilesWithProfiler
6 years ago
fd3aad6cb3
Make fuse_optimizer_op_pass also work when the model contains sparse gradients. ( #18664 )
...
* support sparse gradients
test=develop
6 years ago
157211c4e1
supports distributed classification ( #18690 )
...
* supports distributed classification training
* update API.spec
* fix evenly division in python3
* change "index_range" to "index_num" in shard_index operator
test=document_preview
test=develop
6 years ago
70b03760fd
add parameter server launch ( #18687 )
...
add parameter server launch so that a user can easily launch parameter server
6 years ago
d07ad4c605
add more traceback to py_reader error msg, test=develop ( #18722 )
6 years ago
a3028bb729
Fix random test_recurrent_op failure ( #18718 )
...
The change includes 3 things:
1. Set CPU_NUM to 1 in the tests because the ParallelExecutor will print warning that CPU_NUM is not set and use default 1.
2. Old tests compare two RNNs, hand written simple RNN and same RNN built by Paddle, but initialized RNN weights in numpy random and Paddle random separately. Fixed it by setting weights and bias values.
3. Also set numpy random seed in the tests. Now the two RNNs diff can be smaller (rtol from 0.1, 0.2 to. 0.01) in the tests.
test=develop
6 years ago
bd22453f20
Revert "Add LeakyRelu MKLDNN support ( #18656 )" ( #18723 )
...
test=develop
6 years ago
d845848341
do some odd jobs ( #18641 )
...
do some odd jobs, test=develop
6 years ago
ebf9797ec3
split different comm method for mnist distributed training ( #18715 )
...
* split different comm method for mnist distributed training
6 years ago
89bc3fd841
Support memory eager deletion on recurrent OP ( #17710 )
...
Test PaddingRNN on V100 GPU device.
Test configuration: large model, padding mode (which is the mode using recurrentOp), one GPU.
GPU memory (MiB): 6414 (this PR) vs 6837 (without this PR)
Speed (steps/s): 10.28 (this PR) vs 9.89 (without this PR)
6 years ago
d6b6a337a9
Add LeakyRelu MKLDNN support ( #18656 )
...
test=develop
6 years ago
0b9acb4912
add check of executor ( #17986 )
...
* add check of executor, test=develop
6 years ago
ae58afc546
Feature/auto_growth_allocator ( #18561 )
...
* feature/auto_growth_allocator, test=develop
* add unittest of AlignedAllocator, test=develop
* try to turn on auto_growth to test on CI, test=develop
* fix segmentation fault in mixed_vector.h, test=develop
* add unittests, test=develop
6 years ago
bb2f5d24a2
hash_op support int64 hash_size ( #18674 )
...
* hash_op support int64 hash_size
* add corresponding UT
6 years ago
5ed713d519
remove ctr reader, all functions are satisfied in dataset ( #18672 )
...
* remove ctr reader, all functions are satisfied in dataset
6 years ago
ab57d3893e
make auc op compatible with 1 dim ( #18551 )
...
* make auc op compatible with 1 dim
6 years ago
b71b454328
increase timeout again ( #18628 )
...
test=develop
6 years ago
b414645a65
fix #17430 : int64类型的attr训练非预期 ( #18264 )
...
* fix int64_t
* update fill constant op unittest
* add empty line
6 years ago
995d7d8600
Modify embedding_op input dtype to int64 ( #18598 )
6 years ago
9ad57f2dfd
1）change to parallel mode on python coverage run ( #18594 )
...
2）add pip install coverage in Dockerfile.tmp
test=develop
6 years ago
c0a82748cf
Polish backwards optimizer dependency codes and use more default values. ( #18255 )
6 years ago
d3003a1620
Feature/buffer_shared_inplace ( #17911 )
...
* feature/buffer_shared_inplace, test=develop
* refine code, test=develop
* fix elementwise_add op cpu inplace and sum inplace bug, test=develop
* add unittest and debug log, test=develop
* fix parallel_executor scope bug, polish code, test=develop
* fix sum op, activation op, single_in_place_inference bug, test=develop
* remove kLocalExecScopeName, test=develop
* fix unittest,test=develop
* fix out_var first version bug, test=develop
* follow comments,test=develop
6 years ago
1c10dac4f2
Add code example in CI ( #18228 )
...
* test api example
* update python
* add sampcd_processor.py
* add if 0
* sort
* test paddle
* test paddle
* test paddle
* add whitelist
* change sampcd_processor.py
* change sampcd_processor.py
* change sampcd_processor.py
* add exit
* test=develop
* test=develop
6 years ago
b6d5c74f69
update dygraph api doc for web ( #18550 )
...
remove dygraph.enable from __all__
hidden dygraph. profiler
add doc to dygraph. no_grad
6 years ago
9c17a899d7
upgrade collective fleet api ( #18533 )
...
* upgrade collective fleet api
6 years ago
a25be53cb5
QAT int8 MKL-DNN transformation pass with MUL ( #18322 )
6 years ago
0caa08ea40
Add mkldnn int8 mul-op kernel ( #17834 )
6 years ago
24d1c44a0c
Fix roi_perspective_transform_op bug ( #18522 )
...
* fix transform matrix bug, test=develop
* modify API.spec
6 years ago
1f1cc2221f
add random port ( #18504 )
...
* add random port
6 years ago
832d8191ff
Fix topk cannot handle 1D vector bug ( #18466 )
...
* Fix topk cannot handle 1D vector bug
Add path to handle 1D vector
test=develop
Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com>
* refine code
test=develop
Signed-off-by: zhaoyuchen <zhaoyuchen01@baidu.com>
6 years ago
7586cdd545
Hide no support ( #18515 )
...
* test=develop, fix docker with paddle nccl problem
* test=develop, hide no_support api and add ut for it
6 years ago
43e17c7951
Add distributions of normal and uniform ( #18023 )
...
* add_distributions_of_normal_and_uniform
* paddle/fluid/API.spec
* modify API.spec
* modified paddle/fluid/API.spec, test=develop
* modify paddle/fluid/API.spec, test=develop
* modify paddle/fluid/API.spec, test=develop
* fix some comment, test=develop
* modify API.spec, test=develop
* add comment for init function, modify hard code, test=develop
* modify API.spec, test=develop
* modify API.spec, test=develop
* make unit test function shorter, test=develop
* modify paddle/fluid/API.spec
6 years ago
4828a5e008
core remove pycpuinfo ( #18479 )
...
remove pycpuinfo deps in core
6 years ago
602cb6a5b4
Enhance linear_lr_warmup ( #18463 )
...
* make it support float/int learning as input.
6 years ago
7453857324
Make fuse_all_reduce_op_pass support mix_precision ( #17652 )
6 years ago
55baeceddb
Enhance execution error info ( #18482 )
...
* enhance execution error info
test=develop
6 years ago
e9c7e218f2
Nan debugger init ( #18401 )
...
test=develop
6 years ago
7c6f2350b9
support Tensor input for edit_distance op ( #18162 )
6 years ago
26318544d2
support Tensor input for chunk_eval op ( #18226 )
...
* test=develop
support Tensor input for chunk_eval op
* test=develop
fix testcase for chunk_eval op
* test=develop
fix typos in nn.py
6 years ago
206c44e2a8
add unique kernel and op ( #17557 )
6 years ago
71af72b1c2
upgrade hash op to support Tensor and LoDTensor input ( #17998 )
6 years ago
d3b3443d10
add ones_like op ( #17388 )
6 years ago
67b48d7fe7
add size op ( #17412 )
6 years ago
6e0df3102e
Refactor for Pipeline Thread Check ( #18459 )
...
move the thread-check code from train_from_dataset to a single function
add UT for the thread check function
6 years ago
41ab76e55b
add friendly error msg to py_reader ( #18316 )
6 years ago
823ab5e887
fix load attr error. test=develop ( #18447 )
6 years ago
a873fa84ce
supports collective training with programs ( #18392 )
...
1. Since allreduce op has 4 reduce types, We split these four reduce types into four ops
2. We also refined the collective op code, e.g. we separated the collective op kernel into CPUKernel and CUDAKernel, and remove the device specified DeviceContext parameter in template as we already knew the target DeviceContext
3. We remove the newly added Collective op role to reduce the complexity of program and graph analysis
6 years ago
357311fdb7
make fleet support mpi job submit directly ( #18441 )
...
make fleet support mpi job submit directly.
6 years ago
e0d8c6ac68
Add find_no_grad_vars in backward.py ( #17942 )
...
* add not_been_used_vars to no_grad_set
test=develop
6 years ago
449c7a9f98
Make roi_perspective_transform op return mask and transform matrix ( #18371 )
...
* modify roi_perspective_transform_op to output mask and transform matrix
* modify comment
* modify comment
* modify API.spec
* update API.spec
* remove no use header, test=develop
* resolve conflict
6 years ago
a3bc804f5f
fix mac ci random fail ( #18430 )
...
* fix mac ci random fail
* use platform instead
6 years ago
dd3f9d19cf
replace mnist dataset url, test=develop ( #18429 )
...
replace mnist dataset url
6 years ago
47e2ef38e9
add "import paddle.fluid as fluid" to examples lack of it
6 years ago
8a39e5c110
update api format ( #18413 )
...
* update api format
test=develop
* update API.spec
test=develop
6 years ago
ce7a024c6d
fix py-cpuinfo mac random fail ( #18383 )
...
* fix py-cpuinfo mac random fail
* differentiate version on windows
6 years ago
2b4ef509ea
init custom black white list ( #18377 )
...
test=develop
6 years ago
e83f902b98
add MultiSlotStringDataGenerator for speedup of string based user inp… ( #18390 )
...
* add MultiSlotStringDataGenerator for speedup of string based user input data
6 years ago
43f64a177e
Fix/program doc ( #17908 )
...
* test=develop, add some comments for Program.clone
* test=develop, add API.spec
* test=develop, refine comments
* refine Program doc and clone doc
* test=develop, refine doc
6 years ago
871cc15e6a
Add is_compiled_with_cuda ( #18356 )
...
* add cuda_is_available
test=develop
* Fix api.spec
test=develop
* fix api doc
test=develop
6 years ago
8ed819d8e4
Call the test_slim_int8_* tests through absolute path ( #18386 )
...
test=develop
6 years ago
fd6631ef2f
Fix dygraph show style ( #18297 )
...
Fix dygraph show style for FluidDoc.
6 years ago
19da59ed3f
Remove all the code, API and doc of MKL-DNN INT8v1 ( #18347 )
6 years ago
8ed33bf91f
Fix Bug-prone code of PE ( #18354 )
...
* update pe reduce config
test=develop
* drop the local_exe_scopes of the previous parallel_executor
test=develop
6 years ago
999d9a59a5
fix communicator with pyreader ( #18350 )
...
* add is_runnning in communicator, test=develop
6 years ago
27fb9cad65
add WITH_COVERAGE option, default OFF ( #17872 )
...
* add WITH_COVERAGE option, default OFF
test=develop
* add coverage for python sdk
test=develop
* fix code style
* fix COVERAGE_FILE path
test=develop
* remove coverage package
test=develop
* test = develop, run coverage as module
6 years ago
b7128bac5f
supports collective communicated training ( #18175 )
...
* fix prepare context redundant code problem, optimize executor by caching create_varaiables
test=develop
* supports collective training in executor
* make fetch_list runable with variables, add more unittest for use_program_cache
test=develop
* fix comment
test=develop
* use unique name for nccl_id
* supports output to stream in program_to_code
* insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code
* set op role in collective training
* add collective op role
* remove orig file
* add build optimizer by strategy
* add collective strategy
* refine collective strategy
* add multi-process role maker
* refine strategy building factory so that we can easily plugin more strategy
* scale loss grad in collective sgd transpiler
* add support for distributed fc
* code format
* revert some features for dist fc
* add support for distributed fc training
* fix prepare context redundant code problem, optimize executor by caching create_varaiables
test=develop
* supports collective training in executor
* make fetch_list runable with variables, add more unittest for use_program_cache
test=develop
* use unique name for nccl_id
* supports output to stream in program_to_code
* insert sync_comm_stream before regularization; add skip_op_callstack capability in program_to_code
* set op role in collective training
* add collective op role
* fix comment
test=develop
* remove orig file
* add build optimizer by strategy
* add collective strategy
* refine collective strategy
* add multi-process role maker
* refine strategy building factory so that we can easily plugin more strategy
* scale loss grad in collective sgd transpiler
* add support for distributed fc
* code format
* revert some features for dist fc
* add support for distributed fc training
* test=develop
add collective op unittest standard
* test=develop
remove the test_collective directory
* test=develop
remove the test_collective directory
* remove slicegather test
* code format for reducescatter
* update attr of shard_index_op
* Modify macro nccl_helper
* remove test without distribute
* macro collective_helper
* marcro update
* test=develop
update support python3.5
* test=develop change gpu memory use to 0.1 when test
* test=develop
update ut equal func
* test=develop
set flags to 1.5
* test=develop fix pickle dumple py35
* test=develop
fix divide in slice and add sync_comm_stream
update atol and rtol to 1e-05
rm shard_index op and test
modify read input from file to read from memory
remove origin_program in framework and add i/o in c_sync_calc_stream
* test=develop update unittest sync operator I/O
6 years ago
9047ac687e
Simplify multi_box_head API in detection.py and remove assign op. ( #18310 )
...
* Simplify multi_box_head API in detection.py and remove assign op.
6 years ago
e42057cd1a
add ut for pipeline training ( #18289 )
6 years ago
bd61d89925
test=develop, recover ocr ut on dygraph ( #18166 )
6 years ago
23941e43ec
Update lamb optimizer ( #18333 )
...
* Update lamb optimizer
test=develop, test=document_preview
* Regenerate api spec
test=develop, test=document_preview
6 years ago
1bdfd2eb85
Fix checkpoint of Light-NAS ( #18330 )
...
Socket can't be pickled.
test=develop
6 years ago
79bcdbbf1a
test=develop, disable basic gru related ut ( #18329 )
6 years ago
831a3e62ca
Add install check for multigpu ( #18323 )
...
* test=develop, add_install_check_for_multigpu
* test=develop, refine code to use cuda_devices
6 years ago
f88e07a0d3
fix lod_tensor.py grammar error, test=develop ( #18308 )
6 years ago
df2eee71d8
Sequence mask support tensor ( #18249 )
...
* sequnce mask support max length tensor input; test=develop
* add rnn_impl.py; test=develop
* add basic gru lstm unittest; test=develop
* fix api spec; test=develop
* fix sequence_mask op bug;
test=develop
test=document_preview
* change +-*x to elmentwise_op; test=develop
* add mkl flag; test=develop
* fix rnn impl bug; test=develop
* update api spec; test=develop
* fix doc bug; test=develop
* fix lstm bugs; test=develop
6 years ago
9cb799be50
test=develop, Revert "Add multi gpu install check" ( #18313 )
...
* Revert "Add multi gpu install check (#18229 )"
This reverts commit 61ed06b29a
6 years ago
0e08e91c18
optimize communicator merge sparse gradient test=develop ( #18159 )
...
* optimize communicator merge sparse gradient test=develop
* revert multithread selected rows merge add test=develop
* follow comment test=develop
6 years ago
172c2facef
init black/white lists ( #17847 )
...
test=develop
6 years ago
e06c69c788
Fix default value of fluid.memory_optimize ( #18295 )
...
* fix default value of fluid.memory_optimize
test=develop
* fix api.spec
test=develop
6 years ago
6978b2e48e
fix split and sampled softmax ( #18280 )
...
test=develop
6 years ago
6ed73830c2
add api desc for pipeline training ( #18293 )
6 years ago
a736c03b10
improve doc of lstm, sequence_enumerate, softmax_with_cross_entropy, space_to_depth APIs ( #18261 )
...
* improve doc of lstm, sequence_enumerate, softmax_with_cross_entropy, space_to_depth APIs, test=develop
* update API.spec, test=develop
6 years ago
d54e13bbec
add random seed for recurrent op test ( #18274 )
...
test=develop
6 years ago
4151d90c16
improve the hint message of memory optimize, test=develop ( #18260 )
6 years ago
ff399fd720
fix paddle cloud role maker bug ( #18269 )
...
* fix paddle cloud role maker bug
6 years ago
412951d7d2
Fix ema's example & fp16 update ( #18273 )
...
test=develop, test=document_preview
6 years ago
fdf798f95a
fix double buffer example ( #18169 )
...
test=develop
test=document_preview
6 years ago
23b8b18e56
fix api doc example, test=develop ( #18266 )
6 years ago
cd9d57f5e0
fix a bug in examples of metrics.Acc
6 years ago
68da8b2a01
refine core cmake warning and print more info ( #18248 )
...
* refine core cmake warning and print more info
test=develop
* fix comments
test=develop
6 years ago
32c95f1752
Add StaticRNN.output code example ( #18251 )
...
refine StaticRNN api doc
test=develop
test=document_preview
6 years ago
2f0d68261c
fix yolo_box example,test=develop ( #18247 )
6 years ago
6b3d96254d
fix some bug when merge sparse embedding parameters, test=develop ( #18223 )
...
1. fix the bug that out_put_var in SaveSelectedRows would be empty string
2. use merge_sparse_lookup_table to replace sum op for load_persistables_for_inference
3. fix the bug in _clone_var_in_block_ when the var is SELECTED_ROWS.
6 years ago
3f8031e256
dataset ( #17973 )
...
(1) use channel instead of vector/BlockingQueue in Dataset，to keep same with existing implementation, and make code more readable and flexible (dataset single output channel or multi output channel). one previous memory out of limit problem is cause by not release memory after training.
(2) add Record because MultiSlotType costs too much memory (80B)，fix memory out of limit problem.
(3) add Channel, Archive in paddle/fluid/framework
(4) change dataset from shared_ptr to unique_ptr in pybind
(5) move create/destroy readers from trainer to dataset
(6) move shuffle from datafeed to dataset. dataset holds memory, datafeed is only for load data and feed data to network.
(7) fix thread num bug of Dataset when filelist size < thread num
(8) support set_queue_num in InMemoryDataset
6 years ago
5d54ed4a84
improve the doc of DataFeeder and default_main_program ( #18241 )
...
* improve the doc of DataFeeder and default_main_program
* update API.spec, test=develop
6 years ago
4f3acb392f
fix BilinearInitializer doc ( #18242 )
6 years ago
432fda51aa
fix bug in Class MultiSlotDataGenerator's function _gen_str, test=develop ( #18222 )
6 years ago
61ed06b29a
Add multi gpu install check ( #18229 )
...
* test=develop, add add_multi_gpu_install_check
* test=develop, refine warning doc
* test=develop, refine warning doc
* test=develop, refine warning doc
* test=develop, support multi cpu
* test=develop, find right num of cuda device
* test=develop, find right num of cuda device
* test=develop, fix multigpu processing and fix type bug in dygraph
* test=develop, fix multigpu processing and fix type bug in dygraph
6 years ago
b58bb80248
set src_idx > 0 for bilinear_interp_op ( #18238 )
...
* set src_idx > 0, test=develop
* add unittest and cu, test=develop
6 years ago
7d76e34ec2
add more print function for timeout issue, make timeout value larger ( #18219 )
...
* add more print function for timeout issue, make timeout value larger
6 years ago
cf15c3ff1e
fix errors in python3 ( #18239 )
...
* fix relative import error in python3
* fix debug string info
6 years ago
222c9fe57e
fix doc for LarsMomentumOptimizer test=develop ( #18208 )
6 years ago
9a32dad811
[DOC] Fix comment code of API create_py_reader_by_data ( #18193 )
...
* [DOC] Fix comment code of API create_py_reader_by_data. test=develop, test=document_preview
* Fix code style of API comment. test=develop,test=document_preview
Fix code style of API comment. test=develop,test=document_preview
* update api spec of api create_py_reader_by_data
* remove default config code. test=develop
* remove useless code. test=develop
* update create_py_reader_by_data api. test=develop
6 years ago
ec970f1270
Fix create_lod_tensor ( #18196 )
...
* fix_create_lod_tensor, test=develop
* remove program_guard import,test=develop
* fix windows numpy default int32 error, test=develop
6 years ago
cefd0fb598
Fix slice op shape=-1 bug ( #18107 )
...
* fix slice op bug; test=develop
* fix variabel test bug; test=develop
* remove slice while true; test=develop
6 years ago
b3cbc5be76
test=develop, fix test_imperative_transformer and ocr ( #18127 )
...
* test=develop, fix test_imperative_transformer and ocr
* test=develop, remove ocr recovery part
6 years ago
ff4279e3b2
fix paddle.fluid.layers.io.open_files api doc bug test=develop ( #18203 )
...
* fix paddle.fluid.layers.io.open_files api doc bug test=develop
6 years ago
36b60e240a
Enable MKL-DNN for slim FP32 vs. INT8 tests ( #18214 )
...
* Enable MKL-DNN for slim FP32 vs. INT8 tests
test=develop
* added test for MobileNetV1 with MKL-DNN
test=develop
6 years ago
976cf46010
slim QAT MKL-DNN readme ( #18187 )
...
* QAT doc first version
* follow the comments, test=develop
* update the benchmark, test=develop
* Change to channel-wise, test=develop
6 years ago
5588b923f3
Add multi process reader ( #18115 )
...
* add multi process reader
test=develop
6 years ago
a9dc534f48
fix API example ( #18153 )
...
* API.spec test=develop
* update
* update test=develop
* update test=develop
* update
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* test=develop
* update
* update test=develop
* update test=develop
* fix test=develop
6 years ago
778f6acf4d
disable test_async_ssa_graph_executor_mnist test=develop ( #18165 )
6 years ago
802ea50956
fix spelling errors ( #17941 )
...
* fix spelling errors; test=develop
* Update API.spec
update md5
* Update API.spec
* change the order of api;test=develop
6 years ago
0569ff78fa
Fix doc example for greater_equal, greater_than, less_equal, not_equal, rank, reduce_all, reduce_any, sign, where, diag ( #18167 )
...
* test=develop
fix greater_than, greater_equal, less_equal, not_equal, rank, reduce_all, reduce_any, sign, where, diag doc example
* test=develop
fix API.spec conflict
6 years ago
991c94f135
test=develop, add add_multi_gpu_install_check ( #18157 )
...
* test=develop, add add_multi_gpu_install_check
* test=develop, refine warning doc
* test=develop, refine warning doc
* test=develop, refine warning doc
* test=develop, support multi cpu
6 years ago
bbc292920c
Fix API example code ( #18176 )
...
The fixed APIs:
6 Methods in paddle.fluid.io.PyReader
paddle.fluid.layers.Preprocessor
paddle.fluid.layers.py_reader
paddle.fluid.io.save_params
paddle.fluid.io.save_persistables
test=develop
test=document_preview
6 years ago
78441c5449
add mkldnn Int8v2 slim doc ( #17909 )
6 years ago
d658f1133b
Fix doc for transpose, conv3d and batch_norm. ( #18035 )
...
* update some op doc, test=develop
6 years ago
c2fb9b906a
change dirname mobilenet to mobilenetv1 ( #18160 )
6 years ago
5cf7e7415d
update mkldnn int8v2 doc ( #18177 )
6 years ago
4978db2c10
Remove nccl dep when the number of GPU is 1 ( #18158 )
...
* remove nccl dep when the number of GPU is 1
test=develop
6 years ago
25ab23be28
Fix dygraph mem leak ( #18082 )
...
* fix dygraph mem leak, test=develop
* polish msg, test=develop
6 years ago
1c6e560607
core replace x86cpu with py cpuinfo ( #18151 )
...
test=develop
6 years ago
23f8a4b1c3
assign role_maker before use ( #18137 )
...
fix role_maker bug
test=develop
6 years ago
6eec66a1b1
Fix py_reader iterable bug ( #18108 )
...
* fix py_reader iterable bug, test=develop
* move data from buffered_reader,test=develop
6 years ago
58f3e1bad7
add paddle cloud role maker for customized usage, note this is only for industrial users that have cloud environment pre-configuration ( #18121 )
...
add paddle cloud role maker for specific cloud usage. This pr will simplifies user's configuration in distributed training.
6 years ago
80d2e66f9e
Update backward appending stragety to support double backward and fix some bug. ( #18104 )
...
* Update backward.py:
- If there is no input grad var in all outputs of previous ops, do not append this op into graph.
- Only apply this stragety when double backward.
* Update some double backward op.
* Update sum_op to judge whether a tensor is empty by numel or IsInitialized().
6 years ago
ca5642c850
unify FP32 vs. INT8 comparison tests output ( #18111 )
...
test=develop
6 years ago
ff83655f7e
add detection output operator for supporting retinanet ( #17896 )
...
* test=develop
add detection output for supporting retinanet
* test=develop
add test_layers.py
* test=develop
add API.spec
* test=develop
alter test_retinanet_detection_output.py
* test=develop
alter round 2
* test=develop
alter retinanet_detection_output
* test=develop
alter paddle/fluid/API.spec
* test=devlop
alter detection.py
* test=develop
alter retinanet_detection_output
* test=develop
alter paddle/fluid/API.spec
* test=develop
alter detection.py
* test=develop
alter API.spec
* test=develop
alter retinanet_detection_output
* test=develop
alter paddle/fluid/API.spec
* test=develop
alter python/paddle/fluid/tests/unittests/test_retinanet_detection_output.py
* test=develop
alter python/paddle/fluid/tests/unittests/test_retinanet_detection_output.py
* test=develop
fix grammer error
* test=develop
fix grammer error
* test=develop
fix grammer error
* test=develop
alter python/paddle/fluid/tests/unittests/test_layers.py
* test=develop
alter paddle/fluid/API.spec
6 years ago
0941e3e013
add class name and timeline for test_dist_base.py ( #18122 )
...
* add class name and timeline for test_dist_base.py
6 years ago
9089774155
fix python ver for matplotlib, test=develop ( #18123 )
...
update config for matplotlib, because python 3.6 is required by 3.1+
6 years ago
0aee1f0074
add sigmoid focal loss operator for supporting retinanet ( #17895 )
...
* test=develop
add sigmoid_focal_loss for supporting retinanet
* test=develop
add test_layers
* test=develop
add API.spc
* test=develop
alter sigmoid_focal_loss_op.cc
* test=develop
alter detection.py
* test=develop
alter API.spec
* test=develop
alter round 1
* test=develop
alter simooid_focal_loss
* test=develop
alter sigmoid_focal_loss_op.cc
* test=develop
alter test_layers.py
* test=develop
alter paddle/fluid/API.spec
* test=develop
alter sigmoid_focal_loss_op.cu
* test=develop
alter paddle/fluid/operators/detection/sigmoid_focal_loss_op.cc
6 years ago
9e4b9d9798
Update generate_proposal_labels_op to support CascadeRCNN. ( #17200 )
...
* Update generate_proposal_labels_op to support CascadeRCNN.
6 years ago
9ed2f936f1
add target assign operator for supporting retinanet ( #17893 )
...
* test=develop add target assign for retinanet
* test=develop
run ci
* test=developp
add test_layers
* test=develop
add APi.spec
* test=develop
alter round 1
* test=develop
alter rpn_target_assign_op.cc
* test=develop
alter test_rpn_target_assign_op.py
* test=develop
alter rpn_target_assign_op.cc
* test=develop
alter API.spec
* test=develop
alter paddle/fluid/operators/detection/rpn_target_assign_op.cc
* test=develop
alter rpn_target_assign_op.cc
* test=develop
alter python/paddle/fluid/layers/detection.py
* test=develop
alter paddle/fluid/API.spec
6 years ago
accb132f0f
fix slim int8 mkldnn multithreading issue ( #18009 )
6 years ago
5c3cbb58e5
Update requirement for py2 and py3 ( #18068 )
...
for py2:
matplotlib<=2.2.3 ; python_version<"3.5"
scipy>=0.19.0, <=1.2.1 ; python_version<"3.5"
nltk>=3.2.2, <=3.4 ; python_version<"3.5"
for py3:
matplotlib ; python_version>="3.5"
scipy ; python_version>="3.5"
nltk ; python_version>="3.5"
update requests version to >=2.20.0
for CEV-2018-18074
6 years ago
24e988a471
Fix bug of scope_buffered_ssa_graph_executor ( #18100 )
...
* fix code bug
test=develop
6 years ago
ff59866502
test=develop, fix mnist will segment fault ( #18083 )
6 years ago
d9270af931
Fix getitems slice bug ( #18053 )
...
* fix get items slice bug; test=develop
* fix unique_name bug; test=develop
6 years ago
26a7c1a396
add unit test to cover all parameters for print op test=develop ( #18089 )
6 years ago
b2cfdc3891
Refine unittest log ( #18084 )
...
* add print log for unittest of distributed training
test=develop
6 years ago
f5caf3443c
Fix reinitialized ncclid error! ( #18025 )
6 years ago
e81756f1ba
Hidden paddle.fluid.layers.detection_map. ( #18033 )
...
* Remove layers.detection_map API
* Since uers can use fluid.metrics.DetectionMAP to calculate mAP of current-batch and cumulative-batch. layers.detection_map only can calculate cur-batch mAP.
6 years ago
8cf25c4310
refine core warning message ( #18063 )
...
test=develop
6 years ago
4c735f24ea
fix bug in fleet, test=develop ( #18058 )
6 years ago
b5a1c1463d
Update CPU_NUM config ( #18059 )
...
* update CPU_NUM config
test=develop
6 years ago
78e932862c
Added unit test for QAT FP32 & INT8 comparison ( #17814 )
...
* added unit test for QAT FP32 & INT8 comparison
test=develop
* enabled other models and updated filenames
test=develop
* added accuracy check and multiple batch handling
test=develop
* removed quantization_mkldnn_pass.py
test=develop
* cleanup
test=develop
* updated model paths
test=develop
* renamed tests without MKL-DNN
test=develop
* fix reusing mkldnn pool2d primitive
test=develop
* add performance measuring
test=develop
* fix accuracy statistics
test=develop
* removed non-mkldnn tests
test=develop
* added conv2d_depthwise->conv2d mkldnn transformation
test=develop
* format update
test=develop
* fixed creating key for pool2d grad
test=develop
* added pass
* Fix the accuracy issue while using float precision to get the scale.
test=develop
* Fix the format issue when 'X' is not nchw.
test=develop
* removed output comparing and changed number of images
test=develop
* cmake and comment fix
test=develop
* updated acc threshold for QAT comparison tests
test=develop
* added OMP_NUM_THREADS setting
test=develop
* enable all QAT INT8 tests
test=develop
* restored upstream version of a file
test=develop
* modified directory names
test=develop
6 years ago
566bf2ec56
concat op support negative axis ( #18045 )
...
test=develop
6 years ago
101f74cb19
fix save/load in fleet ( #17675 )
...
* fix save/load in Fleet
* add UT framework of Fleet
6 years ago
a06b316b94
Fix GetExpectedKernelType of add_position_encoding_op ( #17935 )
...
* Fix the GetExpectedKernelType of add_position_encoding_op.
test=develop
* Fix the doc of lstm_unit outputs in nn.py.
test=develop
6 years ago
5c06bff222
combine noavx and avx package ( #17889 )
...
* support avx and noavx core
* add catch and give some log
test=develop
* fix build
test=develop
* add missing package
test=develop
* fix pybind name
test=develop
* fix import error
test=develop
* conbime noavx core
test=develop
* add requirements
test=develop
* fix unkown message
test=develop
* fix api spec
test=develop
* refine and clean
test=develop
* update
* pass dist ut
* follow comments
test=develop
* refine scripts
test=develop
6 years ago
8eb134c3c1
Fix scatter and gather op when has duplicate index ( #17952 )
...
* test=develop
The scatter op has a calc bug when the indices has same index, the scatter op use overwrite mode to calculate the same index, fix this bug by using the accumulate mode to calculate the same index.At the same time, the gather op has the same bug when the op calc the grad. And we use the lib of open-blas and eigen to optimize the time cost in accumulate mode.
* test=develop
Fix some code format problem, and the same time add the test case in gather and scatter op
6 years ago
0bf2535158
Cherry-pick: fix random CI failure. ( #18011 )
...
* Cherry-pick fix random Python3 CI failure.
In some tests, SWEs used "print('xxx').format('xxx')". The syntax
is only supported in Python2, not python3. However, since those
lines are related to data download, if the CI machines already have
the data, it passes CI tests. That causes random failure.
* Cherry-pick: disable CUDNN case of test_warpctc_op
Also temporary disable a unit test. The test will be fixed under high priority.
6 years ago
9d6640ff44
Fix edit distance doc ( #17947 )
...
* fix im2sequence padding bug, test=develop
* fix edit_distance, test=develop
* add API.spec,test=develop
6 years ago
96ee528e3e
fix logging basicConfig cannot be setting after import paddle ( #17786 )
...
* fix logging unable. test=develop
* unset sys.stdout for stream handler. test=develop
* fix newly add basicConfig. test=develop
* fix import error. test=develop
6 years ago
a1bdf25ecb
Add shape not match doc to data layer ( #17936 )
...
* add shape not match doc to data layer, test=develop
* fix API.spec md5
test=develop
6 years ago
871af28d6c
add deformable psroi pooling ( #17827 )
...
* add deformable psroi pooling
* test=develop
* test=develop
* test=develop
modify format
* fix bug
* test=develop run ci
* test=develop
add API.spec
* add test_layers.py
* run ci again
* test=develop
run ci again
* run ci again
* test=develop
run ci again
* test=develop
run ci again
* test=develop
run ci again
* add space between two lines
* test=develop
add space between two lines
* test=develop
add space between lines
* test=develop
modify comment in nn.py
* test=develop
add space between two lines
* test=develop
add space between two lines
* update API.spec
* run ci again
* test=develop
run ci again
* rerun ci
* test=develop
rerun ci
* change input shape
* run ci
* test=develop
run ci
* modify format of nn.py
* test=develop
* test=develop
* test=develop
update API.spec
* test=develop
fix API doc
* modify API comment
* modift API comment
* test=develop
update API.spec
* test=develop
modify comment
* test=develop
modift comment
* test=develop
modift comment
* test=develop
update API.spec
* test=develop
modify comment
* test=develop
add inference in nn.py
* test=develop
update API.spec
* test=develop
resolve confict
* test=develop
update API.spec
6 years ago
40885c225b
add unfold op (new op),test=develop ( #17944 )
...
* add unfold op
test=develop
* fix divide bug in python3 when calculating output width and height
test=develop
* add name=None in python api, move redundant code into inline function
* try to trigger ci for this code
test=develop
6 years ago
b5c35ae3e7
add UserDefinedCollectiveRoleMaker for collective mode ( #17898 )
...
* add 'UserDefinedRoleMakerNCCL' for collective mode.
* code style
* add the name UserDefinedRoleMakerNCCL to __all__
* rename to UserDefinedRoleMakerCollective
* rename to UserDefinedCollectiveRoleMaker
6 years ago
da9143c1cc
Polish codes of old prs. ( #17938 )
6 years ago
969e6378b9
Pipeline Concurrency ( #17402 )
...
Add Pipeline Concurrency Train Mode:
- Cpp: pipeline_trainer & section_worker
- Python: PipelineOptimizer
- Add a new data_feed type: PrivateInstantDataFeed
- Add a test demo of pipeline trainer and the test model is gnn
- Do not support win32 now
6 years ago
83942c3df2
move warning of ParallelExecutor ( #17945 )
...
test=develop
6 years ago
dcaf60f06c
Fix dygraph doc at nn.py for v1.5 ( #17904 )
...
fix doc: conv3d, layer norm, bilineartensorproduct, conv2dtranspose, conv3dtranspose,rowconv, groupnorm, spectralnorm, treeconv
hidden api: sequenceConv
6 years ago
3559e5a3fa
fix bug when iterate in locals_var.items() in python3 ( #17948 )
...
test=develop
6 years ago
9f519bafe7
Ignore a unit test which failed on cuda9/10 python3 ci task ( #17950 )
...
TODO: it is a temporary fix for Paddle release 1.5. We have to fix
this failed unit test soon.
test=develop
6 years ago
3847d9fc2c
refine sum stack api doc ( #17923 )
...
test=develop
6 years ago
82bfa0a5ba
Enhence auto pruning and fix save/load graph when using py_reader
...
1. Enhence auto pruning.
2. Fix save/load graph when using py_reader.
test=develop
6 years ago
33d1e56506
Enable seq_pool op to accept len 0 input ( #17284 )
...
* Enable seq_pool op to accept len 0 input
test=develop
* Update sequence_pool's api
test=develop
* Add more unittest cases for seq_pool op
test=develop
* Remove legacy comments
test=develop
* Don't use template in op maker
test=develop
6 years ago
90ebce9ead
QAT int8 MKL-DNN transformation pass ( #17819 )
6 years ago
2a9d74f67c
Add comment for dygraph api ( #17869 )
...
* add api commet; test=develop
* fix fc dtype bug; test=develop
* remove float32 in default parameter; test=develop
* fix exmpale bug; test=develop
* fix build once; test=develop
* fix num_chanels bug; test=develop
* fix install check failed bug; test=develop
6 years ago
209a3f4e09
add log into slim mkldnn int8 test ( #17926 )
6 years ago
b888a4c57c
fix regularizer lod bug ( #17848 )
...
* fix regularizer lod bug; test=develop
* fix exception bug and one_hot expand; test=develop
6 years ago
8062bd510c
Reshape support tensor attribute ( #17781 )
...
* add reshape support tensor; test=develop
* fix reshape bug; test=develop
* change reshape attribute default value; test=develop
* fix reshape input name; test=develop
* fix reshape unitest; test=develop
* check dim tensor shape; test=develop
6 years ago
4d5f6937c3
Feature/refine api for dygraph ( #17907 )
...
* WIP
* WIP
* test=develop, add api doc and example code for dygraph
6 years ago
f3e5a5cf67
Unset https_proxy and http_proxy in our launch.py ( #17915 )
6 years ago
5df65e506d
Add Ligth-NAS for PaddleSlim ( #17679 )
...
* Add auto pruning strategy.
1. Fix compressor.
2. Enhence graph executor.
3. Add SAController
4. Add auto pruning strategy.
5. Add unitest for auto pruning strategy.
test=develop
* Init light-nas
* Add light nas.
* Some fix.
test=develop
* Fix sa controller.
test=develop
* Fix unitest of light nas.
test=develop
* Fix setup.py.in and API.spec.
test=develop
* Fix unitest.
1. Fix unitest on windows.
2. Fix package importing in tests directory.
* 1. Remove unused comments.
2. Expose eval_epoch option.
3. Remove unused function in search_agent.
4. Expose max_client_num to yaml file.
5. Move flops constraint to on_epoch_begin function
test=develop
* Fix light nas strategy.
test=develop
* Make controller server stable.
test=develop
* 1. Add try exception to compressor.
2. Remove unitest of light-nas for windows.
test=develop
* Add comments
Enhence controller
test=develop
* Fix comments.
test=develop
6 years ago
fba10b6bb5
test=develop, refine api ( #17883 )
...
* test=develop, refine api
* test=develop, fix bug when error occured on save_persistable with no optimizer
* test=develop, refine waring
* test=develop, refine example code and comments
6 years ago
fbbdc9ccad
Add backward and optimizer operator dependency pass. ( #17746 )
6 years ago
4cb7d32c9b
test=develop, add dygraph_not_support and refine ocr ( #17868 )
...
* test=develop, add dygraph_not_support and refine ocr
* test=develop, shrink name of dygraph_not_support
6 years ago
545afb2d74
Add trainable_statist attr for bn in dygraph ( #17881 )
...
* add import, test=develop
* fix fill_constant
* fix deconv
* add trainable_statist for bn in dygraph
6 years ago
83e51ded21
SERIAL flaky imperative unit tests for CI cuda9 ( #17892 )
...
test=develop
6 years ago
3bfb92c32b
test=develop, hide build_once ( #17871 )
6 years ago
022dfed4fc
Add optimizer save and load ( #16986 )
...
* save optimizer related vars in dygraph
* test=develop, add optimizer save and load
* test=develop, add optimizer save and load
* test=develop, merge code and add multi-optimizer save and load
* test=develop, fix test_imperative_checkpoint
* test=develop, fix include error
* test=develop, fix include error
* test=develop, renew api spec
* test=develop, refine code
* test=develop, set default value for checkpoint
* test=develop, fix ci error
* test=develop, change API.spec and make api more readable
* test=develop, refine version and time stamp
* test=develop, add example code and refine code
* test=develop, refine doc
* test=develop, change version
6 years ago
39bc8a55a4
[NGraph] Enable ngraph layer_norm operator ( #17599 )
...
* Enable ngraph layer_norm operator
test=develop
* Disable/Enable cuda, new unit-test test=develop
* Fix use_cudnn test=develop
* Fixed test_layer test, new funciton is added test=develop
* set use_cudnn by default test=develop
6 years ago
993c703bcc
INT8 MKL-DNN v2 integrate to slim ( #17634 )
...
* refactor PR 16865
* delete mergetool files
* test=develop
* test=develop
* test=develop
* test=develop
* create dir for int8 model before call SaveOptimModel
* test=develop
* mkldnn int8 only support linux; test=develop
* refine code; test=develop
* remove comment; test=develop
* refine code; test=develop
* fix bug; test=develop
* add exception for mkldnn_post_training_strategy
* reuse int8v2 CAPI dataset; test=develop
* fix accuracy check bug; test=develop
* remove tab
* convert files to unix format
* test=develop
* reduce CI time;test=develop
* reduce CI time and refine code;test=develop
* refine comment; test=develop
* add cmake FLAGS;test=develop
* remove predict_num;test=develop
6 years ago
6a1df46991
Fine tuning launch.py ( #17223 )
6 years ago
841553e13f
use pyreader to read data in dygraph mode ( #17314 )
...
* use pyreader to read data
* add return_list to PyReader to support return value represented as list
6 years ago
3d3f5506d2
Feature/Fix recurrent usage of Varbase in Dygraph ( #17838 )
...
* for debug
* test=develop, memory optimize for dygraph using shared_ptr
* test=develop, fix travis ci showed error
* test=develop, fix bug for recurrent usage of varbase
* test=develop, init varbase when it need to be Add
* test=develop, fix problem of recurrent gradient
* test=develop, add gradient test for recurrent varbase usage
6 years ago
60094207cc
fix dataset-flowers random fail. test=develop ( #17836 )
...
fix flower-dataset unclose error
6 years ago
674e0ce2d6
Use Python C-API to speed up dygraph trace ( #17837 )
...
* use python api to reduce python time cost, test=develop
* fix travis ci, test=develop
* fix Py_None error,test=develop
6 years ago
eaf049c4b8
test=develop, refine ocr attention model ( #17763 )
...
* test=develop, refine ocr attention model
* test=develop, refine code, remove cpu only part
test=develop, refine code, remove cpu only part
6 years ago
5e4f99dd74
refine doc for prelu ( #17810 )
...
* refine doc for prelu
6 years ago
557452e778
update and polish hash op doc ( #17809 )
...
* update and polish hash op doc
test=develop
* update api spec
test=develop
6 years ago
92d9bdfce2
fix api doc in slice op, test=develop ( #17804 )
6 years ago
dfec676270
expand op supprt tensor attribute ( #17773 )
...
* expand support tensor attribute; test=develop
* fix bug ; test=develop
* fix uni test bug; test=develop
* fix copy bug; test=develop
* refine expand_times default value; test=develop
6 years ago
3b70f870e2
Using Smart pointer to optimizer memory usage of dyGraph ( #17768 )
...
* for debug
* test=develop, memory optimize for dygraph using shared_ptr
* test=develop, fix travis ci showed error
* test=develop, fix bug for recurrent usage of varbase
* test=develop, init varbase when it need to be Add
6 years ago
82358bfdc1
ont hot support tensor depth ( #16972 )
...
* support some input tensor remain on cpu; test=develop
* fix input = none; test=develop
* fix unfound bug; test=develop
* fix proto None case; test=develop
* fix bug; test=develop
* fix proto null bug; test=develop
* remove conv check; test=develop
* fix test bug; test=develop
* move fill constant; test=develop
* no change in proto; test=develop
* fix bug; test=develop
* change attr detph name; test=develop
* remove remain cpu; test=develop
* fix bug; test=develop
* merge develop; test=develop
* fix one_hot bug; test=develop
* fix bug; test=develop
* fix bug; test=develop
* fix bug; test=develop
* fix python api bug; test=develop
6 years ago
d6d33fd748
Add update method for ema ( #17812 )
6 years ago
4c5df40e22
Fix the data URL in wmt16.py. ( #17775 )
...
test=develop
6 years ago
6a6bf597f7
[NGraph] Enable elementwise_div operator test=develop ( #17515 )
...
* Enable elementwise_div operator test=develop
* Fix update date test=develop
6 years ago
931698a54a
Modify doc of program_guard, py_reader, data, and clone ( #17727 )
...
Note the append_batch_size variable is doing prepend. We should
change the name, but due to backward compatibility, I suggest to
change at v2.0. Not now.
test=develop
6 years ago
3a6ead24ad
Add no_grad decorator to dygraph ( #17790 )
...
* add no_grad decorator to dygraph, test=develop
* add unittest,test=develop
6 years ago
53920f5e8a
fix scipy version for python 2.7, test=develop ( #17719 )
6 years ago
7f1c626921
Fix potential bugs: use numpy assignment to restore parameters at build-once, test=develop ( #17720 )
...
use numpy assignment to restore parameters at build-once
6 years ago
f893914f1f
fix the dll not found issue on windows ( #17750 )
...
* fix the dll not found issue on windows
6 years ago
659b72a97c
fix document of python api get_startup_program() ( #17764 )
...
* add example to get_startup_program()
* fix example to get_startup_program()
6 years ago
bfcc97d924
Split the unittest test_dist_mmist into multiple unittests (test_dist_mnist, test_dist_mnist_nccl and test_dist_mnist_lars) to avoid timeout ( #17707 )
6 years ago
93de124cec
modify some initializer api ( #17301 )
...
* test=develop modify some initializer api
* test=develop modify API.spec
* test=develop modify API.spec
* test=develop modify API.spec
* test=develop modify API.spec
6 years ago
d52391094d
fix prepare context redundant code problem, optimize executor by cach… ( #17743 )
...
* fix prepare context redundant code problem, optimize executor by caching create_varaiables
test=develop
* cache sub_scope, program, var when use_program_cache=True is set
* make fetch_list runable with variables, add more unittest for use_program_cache
6 years ago
2c58f1a83c
[NGraph] Added lookup table to ngraph engine test=develop ( #17647 )
6 years ago
bacc822492
[NGraph] Enable transpose ngraph operator ( #17636 )
...
test=develop
6 years ago
ed9d603a8a
fix api doc: Optimizer.ModelAverage ( #17395 )
6 years ago
90eae0b39a
[NGraph] Addded slice op to ngraph test=develop ( #17648 )
6 years ago
2fbaa5c075
[NGraph] added matmul op to ngraph engine test=develop ( #17645 )
6 years ago
68dcb1bd7b
fix API examples of assign, reverse and array_write, etc. ( #17287 )
...
* fix API examples of assign, reverse and array_write
test=develop
* update API.spec
test=develop
* update API examples for array_length, array_read, array_write, assign, hard_sigmoid, hsigmoid, increment, ones, pow, reverse, uniform_random and zeros
* update API.spec for assign, reverse and array_write, etc.(#17287 )
* test=develop
6 years ago
552f8395a3
remove ocr unit test; test=develop ( #17755 )
6 years ago
bba57cdd82
Add deformable conv v2 op,test=develop ( #17145 )
...
* unit commits, test=develop
* update API.spec, test=develop
6 years ago
aca53535e0
fix bug; test=develop ( #17733 )
6 years ago
0a02451ea0
fix ocr; test=develop ( #17751 )
6 years ago
bd48950c7e
fix paddlepaddle API examples ( #17306 )
...
* API.spec test=develop
* update
* update test=develop
* update test=develop
* update
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* update test=develop
* test=develop
* update
* update test=develop
* update test=develop
6 years ago
8fd39f3e99
Enhance fused_elementwise_activation op and add python api in contrib.layers ( #17236 )
...
* Enhance fused_elementwise_activation op.
test=develop
* Move the api fused_elementwise_activation to contrib.
test=develop
* Add including files.
test=develop
* Add the support of sigmoid in fused_elementwise_activetion op.
* Update API.spec.
test=develop
6 years ago
ac92e4c066
fix distributed_transpiler.py api test=develop ( #17668 )
6 years ago
9b99876442
Enable less_than ngraph operator ( #17642 )
...
* Enable less_than ngraph operator
test=develop
* Added compare unit-tests test=develop
* Update: date && removed import test=develop
6 years ago
a9a531fa5f
Refine python api code example note: ( #17369 )
...
* fix:
1. infernce multi card occupy
2. facebox model inference occupy too much
test=develop
* refine python api comments: shuffle, while, scale, sampled_softmax_with_cross_entropy, scatter,
round, sin, sqrt, shape, split, soft_relu, slice, selu, ifelse, switch.
test=develodp
* fix conflict error.
test=develop
6 years ago
effc555955
test=develop, layz init Grad ( #17653 )
6 years ago
33a791dd81
test=develop, add ocr in dygraph test ( #17470 )
...
* test=develop, add ocr in dygraph test
* test=develop, add cudnn determinist
* test=develop, remove useless code
* test=develop, fix cmake error
6 years ago
70a887af63
[NGraph] Add reduce_sum operator for Ngraph ( #17450 )
...
test=develop
6 years ago
29baca0dd8
add depthwise_conv2d op to ngraph engine ( #17454 )
...
* add depthwise_conv2d test=develop
* use cpu for ngraph test=develop
6 years ago
1735ed324e
fix im2sequence padding bug, test=develop ( #17660 )
...
fix im2sequence padding bug
6 years ago
0d561ef442
fix 2dconn test=develop ( #17681 )
6 years ago
ccf9e2327b
[Lite] Enable cast operator test=develop ( #17294 )
6 years ago
0d3c48e0a8
fix doc in transpiler, test=develop ( #17313 )
...
* fix doc in transpiler, test=develop
6 years ago
0f2e7a48c8
fix:Modify keys in the dictionary of layer.stat_dict in dynamic graph mode, test=develop ( #17700 )
6 years ago
9f85f21880
Add new gard clip [old gradient clip not support in dy graph] ( #17523 )
...
* add gradient clip in minimize; test=develop
* fix bug; test=develop
* fix format; test=develop
* move new grad clip to dygraph/grad_clip.py; test=develop
* fix lr decay and grad clip test; test=develop
* seperate dygraph grad clip; test=develop
* fix grad clip test; develop
* fix api spec bug; test=develop
* add blank line, test=develop,test=document_preview
to fix format problem
6 years ago
acbb4bf38d
update python API examples ( #17351 )
...
* update python APIs
test=document_preview test=develop
* update API.spec
test=document_preview
test=develop
* update merge_selected_rows
* update API.spec
test=document_preview
test=develop
* update API.spec
test=document_preview
test=develop
* fix the comment of less_than
test=develop
test=document_preview
* update API.spec
test=develop
test=document_preview
* update API.spec
test=develop
test=document_preview
* update API.spec
test=develop
test=document_preview
* update API.spec
test=develop
* update API
test=develop
6 years ago
21d7b78602
update parallel_helper ( #17691 )
...
test=develop
6 years ago
41f1186c6b
[DOC][PYTHON] Fix api docs, test=develop, test=document_preview ( #17629 )
...
* [DOC] Fix api docs, test=develop, test=document_preview
* [DOC] Fix api annotation: fluid.layers.tensor_array_to_tensor. test=develop, test=document_preview
* test=develop, test=document_preview
update MD5 of tensor_array_to_tensor
6 years ago
058f1f1e1b
fix the api example for create_global_var, create_parameter, SGDOptim… ( #17371 )
...
* fix the api example for create_global_var, create_parameter, SGDOptimizer, RMSPropOptimizer, MomentumOptimizer, LarsMomentumOptimizer, FtrlOptimizer
test=develop
* add example for adamoptimizer
fix API.spec
test=develop
* test=develop
* test=develop
6 years ago
4f4f0993c1
Bias correction for exponential moving average ( #17677 )
...
* Bias correction for exponential moving average
test=develop, test=document_preview
* Fix docs
test=develop, test=document_preview
6 years ago
962eed6f82
Revert "Enable SQRT operator for the nGraph Bridge ( #17549 )" ( #17680 )
...
This reverts commit f34830e2aa
6 years ago
67a6297a9f
update unique_name notes and examples ( #17671 )
...
test=develop
6 years ago
f34830e2aa
Enable SQRT operator for the nGraph Bridge ( #17549 )
...
* Enable sqrt operator for the nGraph Bridge.
test=develop
* Update activation_op.h
6 years ago
432ac70124
clean code of py_layer in dygraph mode,test=develop ( #17661 )
6 years ago
65bbf950ee
Add multi-ncclcomm and 2D ncclallreduce support. ( #17263 )
6 years ago
b1bd483a7d
[NGraph] Enable gelu operator for the nGraph Bridge. ( #17547 )
...
test=develop
6 years ago
8bd651b7ed
Fix the bug in the AnalysisPredictor and add more directions about io APIs. ( #17639 )
...
* fix the bug that sub_scope_ may be null in AnalysisPredictor::Run.
* add more directions about io APIs' docs.
* update the API.spec. test=develop test=document_preview
6 years ago
bbd6e438fc
fix conflicts,test=develop ( #17186 )
6 years ago
9f85afb7b6
test=develop ( #17643 )
6 years ago
9322216170
Add data distributed_sampler ( #17573 )
...
* add data parallel batch
6 years ago
1670db5e86
Gather Op Index Support int64_t datatype ( #17610 )
...
* gather_op support int64_t index by adding a template typename
* add UT and rename typename
test=develop
6 years ago
2b83d75bfa
Enable elementwise pow operator for ngraph ( #17526 )
6 years ago
0c39b97b4e
[MKL-DNN] Add Fully Connected Op for inference only( #15226 )
...
* fuse mul and elementwise add to fc
* Reimplement the FC forward operator
* Fix FC MKLDNN integration by transposing weights
* Add FC MKLDNN Pass
test=develop
* FC MKLDNN Pass: change memcpy to std::copy
* Fix MKLDNN FC handling of mismatch input and weights dims
* Lower tolerance for MKL-DNN in resnet50 test
test=develop
* Adjust FC to support MKLDNN Op placement
test=develop
* Adjust Placement Op to set use_mkldnn attribute for graph
test=develop
* MKLDNN FC: fix weights format so that gemm version is called
test=develop
* FC MKLDNN: Remove tolerance decrease from tester_helper
* FC MKL-DNN: Refactor the code, change input reorder to weight reorder
* MKL-DNN FC: Introduce operator caching
test=develop
* FC MKL-DNN: Fix the tensor type in ExpectedKernelType
test=develop
* FC MKL-DNN: fix style changes
test=develop
* FC MKL-DNN: fallback to native on non-supported dim sizes
test=develop
* FC MKLDNN: fix CMake paths
test=develop
* FC MKLDNN: Refine placement pass graph mkldnn attribute
test=develop
* Fix Transpiler error for fuse_conv_eltwise
test=develop
* Fix missing STL includes in files
test=develop
* FC MKL-DNN: Enable new output size computation
Also, refine pass to comply with newest interface.
test=develop
* FC MKL-DNN: enable only when fc_mkldnn_pass is enabled
* FC MKL-DNN: Allow Weights to use oi or io format
* FC MKL-DNN: Adjust UT to work with correct dims
test=develop
* Enable MKL DEBUG for resnet50 analyzer
test=develop
* FC MKL-DNN: Improve Hashing function
test=develop
* FC MKL-DNN: Fix shape for fc weights in transpiler
* FC MKL-DNN: Update input pointer in re-used fc primitive
* Add log for not handling fc fuse for unsupported dims
test=develop
* FC MKL-DNN: Move transpose from pass to Op Kernel
test=develop
* FC MKL-DNN: Disable transpose in unit test
test=develop
* FC MKL-DNN: Remove fc_mkldnn_pass from default list
* Correct Flag for fake data analyzer tests
test=develop
* FC MKL-DNN: Add comment about fc mkldnn pass disablement
test=develop
* FC MKL-DNN: Disable fc in int8 tests
test=develop
6 years ago
21138eb12a
[DOC][PYTHON] Fix api comment of paddle.fluid.clip.GradientClipByValue ( #17530 )
...
* BugFix: fix api comment of paddle.fluid.clip.GradientClipByValue
* test=develop, test=document_preview
6 years ago
6724a652f3
add __str__ method for tensor and lodtensor to support print test=dev… ( #17588 )
...
* add __str__ method for tensor and lodtensor to support print test=develop
6 years ago
887a39f050
Fix dygraph unique name bug ( #17592 )
...
* fix unique_name growth bug in dygraph mode,test=develop
* change generate_tmp to generate_with_ignorable_key,test=develop
6 years ago
e9216d0602
Enable logical operators for the nGraph Bridge. ( #17543 )
...
test=develop
6 years ago
cbaf9e5344
Fix api example [ lstm, sequence_enumerate, sequence_expand,sequence_expand_as ] ( #17210 )
...
* fix example; test=develop
* fix api spec; test=develop
* fix api spec; test=develop
* add doc check
test=develop
test=document_preview
* test=develop,test=document_preview
add blank line to fix format, add one more "import"
* fix bug; test=develop
* fix bug; test=develop
6 years ago
e53119f5b1
Fix decayed adagrad example ( #17390 )
...
* fix DecayedAdagrad example;
test=develop
test=document_preview
* add space; test=develop
6 years ago
326bf8291a
add Run Prepared Ctx ( #17616 )
...
add Run Prepared Ctx, fix pybind problem
6 years ago
2a7b321110
Fix the example code in some Python API. ( #17343 )
...
* Fix the example code in some Python API.
test=develop
* Fix the example code in some Python API by adding import.
test=develop
6 years ago
b5f4d5ed0e
Add broadcast operators ( #17503 )
...
* This PR adds broadcast for multi-process. And it could be used in dynamic graph to broadcast parameters.
6 years ago
2280f185d7
BuildStrategy api comment ( #17348 )
...
Python examples of fluid.layers.io.double_buffer and some BuildStrategy's methods.
6 years ago
3db9c8c982
refine shape and split test. test=develop ( #17545 )
6 years ago
0d4cbdad91
[NGraph] Enable elementwise mul operator ( #17552 )
6 years ago
f2694e122d
[NGraph] Enable assign operator for a ngraph, test=develop ( #17437 )
...
* Enable assign operator for a ngraph, test=develop
* Cross_entropy operators needs to be updated
6 years ago
cf02cb5e98
Enable elementwise sub operator for ngraph ( #17527 )
6 years ago
7f8bc49d00
polish_executor_and_add_ctx_cache ( #17536 )
...
* polish_executor_and_add_ctx_cache
6 years ago
8818c94cfb
test=develop ( #17207 )
6 years ago
ca03f4989a
fix distributed launch.py ( #17571 )
...
test=develop
6 years ago
6e11f97708
Add exponential moving average ( #17562 )
...
* Add exponential moving average
test=develop, test=document_preview
* Polish documents
test=develop, test=document_preview
* Update API spec
test=develop, test=document_preview
6 years ago
3ee3611aa7
test=develop, fix test_imperative_resnet failed on CI ( #17583 )
6 years ago
035771512d
Enable elementwise min operator for ngraph ( #17521 )
6 years ago
d817263c80
add unittest of dygraph RL models. ( #17550 )
...
* test=develop
* test=develop
6 years ago
cf60e5a2db
fix API python example ( #17226 )
...
* fix api example. test=develop
* fix API.spec. test=develop
* fix spectral_norm format. test=develpp
* merge develop
* add import. test=develop
* fix indent. test=develop
* fix indent. test=develop
* add import fluid. test=develop
6 years ago
92e7d5d7cc
fix distribute doc test=develop ( #17318 )
...
* fix distribute doc
6 years ago
58f7695ab2
Async exe support communicator ( #17386 )
...
Async exe support communicator
6 years ago
109b5aed5a
[NGraph] Enable reshape operator test=develop ( #17512 )
6 years ago
9bb6a421e3
fix bpr_loss data_norm teacher_student_sigmoid_loss api & fix continuous_value_model ( #17331 )
...
* fix bpr data_norm teacher_student_sigmoid , test=develop test=document_preview
修复了bpr_loss data_norm teacher_student_sigmoid_loss三个api, 同时修复了continuous_value_model文档英文拼写错误
6 years ago
300bd7504d
fix api-doc related bugs test=develop test=document_preview ( #17360 )
...
* fix api doc according to the reviewer's comment test=develop
6 years ago
3bd14263f5
decrease the train loop number to avoid run too long to fail the ci process test=develop ( #17567 )
6 years ago
43d15b9d96
Enable square operator for the nGraph Bridge. ( #17551 )
...
test=develop
6 years ago
danleifeng
chengduo
Zeng Jinle
Thunderbrook
lvmengsi
chengduo
Adam
石晓伟
guru4elephant
fuyinno4
Bob Zhu
whs
JesseyXujin
jiaqi
Yi Liu
Huihuang Zheng
Tao Luo
tangwei12
hutuxian
123malin
Kevin
kh2se2013
gongweibao
tianshuo78520a
lujun
bingyanghuang
Physher
LielinJiang
zhaoyuchen2018
Jiabin Yang
tensor-tang
qingqing01
pkpk
zhoukunsheng
Kaipeng Deng
Yi Liu
xiaoting
xsrobin
Jie Fang
Wojciech Uss
翟飞跃
HaoRen
Yibing Liu
Hongyu Liu
Qiao Longfei
Zhaolong Xing
liuwei1031
flame
Bai Yifan
songhao
AIFollowers
wopeizl
Shuai Yuan
lijianshe02
wangchaochaohu
FlyingQianMM
FDInSky
Sylwester Fraczek
gongweibao
Guo Sheng
wawltor
ruri
cjt222
SunGaofeng
lilong12
pawelpiotrowicz
wopeizl
jerrywgz
mozga-intel
baojun
hong19860320
Bai Yifan
Yiqun Liu
yaoxuefeng
Krzysztof Binias
Zhen Wang
bdzhuxiaoning
Michał Gallus
Guo Sheng
flame
pkpk
zhang wenhui