9a93f6aae0
improve efficiency of runtime InferVarType ( #22778 )
...
* save InferVarType changes, test=develop
* remove code comments, test=develop
* tweak code, test=develop
* fix compilation warning, update merge_ids_op split_ids_op to new interface, test=develop
* modify fused_bn_activation_op, test=develop
* fix error of fused_bn_activation_op, test=develop
* fix PADDLE_ENFORCE and unittest coverage issue, test=develop
* tweak PADDLE_ENFORCE messages, test=develop
* improve unittest coverage, test=develop
* add StaticGraphInferVarType class, test=develop
* rebase develop branch, test=develop
* fix unittest error, test=develop
* remove comments, test=develop
* improve unittest coverage, test=develop
* imporve error message and imporve unittest coverage, test=develop
* upgrade InferVarType API, test=develop
* tweak pyfunc error message, test=develop
* fix compilation conflict - save_combine_op, test=develop
5 years ago
3ca700a987
code clean, test=develop ( #24060 )
5 years ago
80cf3c3c4d
Refine DataLoader support multi-processing ( #23107 )
...
* add DataLoader, Dataset, BatchSampler
5 years ago
8d0b0cb4ae
Op(conv2d_fusion) error message enhancement. ( #23596 )
5 years ago
82f3348ad0
remove useless comment in layer.cc, test=develop, test=document_fix ( #23847 )
5 years ago
54d3b5a1eb
enhance err_msg, test=develop ( #23714 )
5 years ago
b59426b52a
Enhance error msg of imperative code ( #23572 )
...
* fix init_gflags with 'python -c', test=develop
* enhance error msg related Tracer, test=develop
* refine err msg, test=develop
* follow comments, test=develop
5 years ago
ea22515ae4
pimpl to polish code, test=develop ( #23597 )
5 years ago
75bd350710
Implement StaticModelRunner to support dygraph fine-tune static graph pre-training model ( #23171 )
...
* static model runner basic implement, test=develop
* add run program op to execute loaded program, test=develop
* refactor static model runner & run program op, test=develop
* reset engine.cc to resolve conflict
* adapt the change of dygraph double grad, test=develop
* refactor impl to solve control flow error, test=develop
* clear debug code, test=develop
* fix ci str compatible error & checkout dygraph grad maker & add example, test=develop
* hide api & add op test, test=develop
* fix run program op test places error, test=develop
* fix program by review comment, test=develop
* delete change var desc name, test=develop
* fix other program by review comment, test=develop
* remove _static_graph_guard, test=develop
* add selectedrows test, test=develop
* remove desc parser, test=develop
* fix detail program, test=develop
* change socpe create & add test, test=develop
5 years ago
dbfbd7eac4
support Exhaustive search in dygraph ( #23415 )
...
* use global conv cache; test=develop
* use singleton cache; test=develop
* fix format error; test=develop
* add cudnn helper header; test=develop
* fix header error; test=develop
* fix mac unitest; test=develop
* fix mac unitest; test=develop
* fix file format; test=develop
* fix include file error, test=develop
* remove kernel_configs_ in class ExecutionContext and kernel_configs_map_ in class OperatorWithKernel, test=develop
* fix test_elementwise_mul_op_dim, test=develop
* fix compile error, test=develop
Co-authored-by: phlrain <phliuhongyu@126.com>
5 years ago
0c23e3ff4d
fix Tracer::NoGrad, test=develop ( #23443 )
5 years ago
bfb07aafe8
Revert "Exhaustive search ( #22821 )", test=develop ( #23401 )
...
This reverts commit 48144e4099
5 years ago
48144e4099
Exhaustive search ( #22821 )
...
* use global conv cache; test=develop
* use singleton cache; test=develop
* fix format error; test=develop
* add cudnn helper header; test=develop
* fix header error; test=develop
* fix mac unitest; test=develop
* fix mac unitest; test=develop
* fix file format; test=develop
* fix include file error, test=develop
* remove kernel_configs_ in class ExecutionContext and kernel_configs_map_ in class OperatorWithKernel, test=develop
* fix test_elementwise_mul_op_dim, test=develop
Co-authored-by: phlrain <phliuhongyu@126.com>
5 years ago
2169e6fb58
Initialize global nccl_comm in PE ( #23275 )
5 years ago
8bfd62ffb7
Expose dygraph.grad api ( #23124 )
...
* expose dygraph.grad api, test=develop, test=document_fix
* add more parameter in dygraph.grad API, test=develop
* add only_inputs=True parameter, test=develop
* follow comments, test=develop, test=document_fix
* fix typo, test=develop, test=document_fix
5 years ago
e5fef8f38a
[Dygraph double grad]Code polish ( #23121 )
...
* fix dygraph double grad, test=develop
* fix unpack constructor, test=develop
5 years ago
a31d7328b7
Add dygraph double grad implementation ( #22939 )
...
* add double grad implementation for dygraph, test=develop
* polish code, add uts, test=develop
* fix place bug, test=develop
* polish codes, add more uts for coverages, test=develop
* add no_grad_set, test=develop
* add star gan ut, test=develop
* follow comments, test=develop
5 years ago
121b2aed4d
initialize global nccl context in dygraph ( #23037 )
...
initialize global nccl context in dygraph
test=develop
5 years ago
d33c4343e1
Imperative tracer refactoring ( #22457 )
...
* refine grad maker, test=develop
* refactor tracer stage 1, test=develop
* merge develop to solve conflict third times, test=develop
5 years ago
1644926a6c
Polish detail implement of dygraph data loader ( #22878 )
...
* polish detail implement of data loader, test=develop
* solve coverage ci problem, test=develop
5 years ago
5191e54494
reduce default attrs for dynamic graph ( #22850 )
...
* reduce default attrs for dynamic graph, test=develop
* add some explanations for explicit attr, test=develop
* tweak explicit attr comments, test=develop
5 years ago
c736fef93b
dygraph backward engine accelerate ( #22808 )
...
* fix loaded program load bug; test=develop
* first version
* speed backward engin; test=develop
* remove useless code; test=develop
* reconvery io.py; test=develop
* remove useless code; test=develop
* remove useless code; test=develop
5 years ago
433cef03e5
fix typo word ( #22784 )
5 years ago
08033c8634
fix traced layer with non persistable vars, test=develop ( #22552 )
5 years ago
a90fa54092
Compile without nccl deps. [1/2] ( #22509 )
...
支持不依赖nccl进行编译。[1/2]
多卡下，如果没有打开WITH_NCCL开关编译，多卡不能通信，则只能选择一张卡使用。
Co-authored-by: 石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>
5 years ago
7bc4b09500
add WITH_NCCL option for cmake. ( #22384 )
...
cmake选项中添加了WITH_NCCL，显示指定是否编译NCCL的部分代码，WITH_NCCL默认打开，但如果WITH_GPU为OFF，则关闭WITH_NCCL
添加了PADDLE_WITH_NCCL定义
单机单卡能够关闭NCCL编译，多卡的话需要默认打开NCCL，如果关闭NCCL，则只能使用单卡
Co-authored-by: 石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>
5 years ago
b96c7c9a7a
polish code, test=develop ( #22380 )
...
remove unnecessary template.
5 years ago
35efbe6d95
Speeding up dygraph DataLoader with multiprocessing ( #21762 )
...
* add multiprocess for dygraph data loader, test=develop
* polish code & add safe gurad, test=develop
* refactor dygraph dataloader & add signal handler, test=develop
* fix member initializer compile error on ci, test=develop
* fix member initializer compile error one more, test=develop
* remove useless config, test=develop
* skip windows incompatible problem, test=develop
* add unittest for coverage, test=coverage
* add more exception unittest case, test=develop
* deal with signal handler coverage, test=develop
* polish code & add signal handler tests, test=develop
* deal with coverage ci problem, test=develop
* split data loader test & coverage ci fix, test=develop
* remove test_imperative_data_loader_with_exception, test=develop
* remove singal process except test case, test=develop
* add exception tests again & remove sample list test, test=develop
* split normal and exception unittests to diff class, test=develop
* polish doc for use_multiprocess effect in static mode, test=develop
5 years ago
cc1a9f4238
fix sample code in paddle/fluid/imperative/README.md ( #22141 )
...
* fix sample code, test=develop
* polish code style, test=develop
5 years ago
fd9b00df4b
test=develop, remove unused variable ( #21974 )
5 years ago
310edc0d0c
Update layers used in ptb model to use auto-generated op functions in dygraph mode ( #21724 )
...
* update layers, test=develop
* fix input numpy, test=develop
* fix bugs, test=develop
* follow commments, test=develop
* update getitem, test=develop
5 years ago
73461a7ae6
Make OperatorWithKernel::InferShape abstract ( #21633 )
...
* make OperatorWithKernel::InferShape virtual, test=develop
* fix test_prepare_op by relu, test=develop
6 years ago
48600d7f17
Add op function generator for dygraph ( #21569 )
...
* add op function generator, test=develop
* add unittest, test=develop
* follow comments, test=develop
* fix windows compilation problem, test=develop
6 years ago
4f81d1bd5f
Refine VarBase init function ( #21587 )
...
* refine init function, test=develop
* add tests, test=develop
* remove extern, which may cause symbol error in gcc-4.8, test=develop
6 years ago
84b7267100
dygraph_grad_maker supports varbase without grad_var ( #21524 )
...
* dygraph_grad_maker supports varbase without grad_var, test=develop
* fix compile, test=develop
* fix test_tracer, test=develop
* follow comments, test=develop
6 years ago
cdd46d7e02
Split VarBase from Python Variable for Dygraph ( #21359 )
...
* test=develop, fix docker with paddle nccl problem
* don't expose numerous Tensor.set(), test=develop
* fix condition, test=develop
* fix float16 bug, test=develop
* feed should be Tensor or np.array, not Variable or number, test=develop
* use forcecast to copy numpy slice to new array, test=develop
* remove float16-uint16 hacking, test=develop
* add variable method to varbase and refactor to_variable to support return varbase
* support kwargs in varbase constructor
* add VarBase constructor to support default python args
* refine varbase initial method
* reset branch
* fix ut for change VarBase error info to PaddleEnforce
* cherry is parameter change before
* overload isinstance to replace too many change of is_variable
* rm useless files
* rm useless code merged by git
* test=develop, fix some ut failed error
* test=develop, fix test_graph_wrapper
* add some tests, test=develop
* refine __getitem__, test=develop
* add tests, test=develop
* fix err_msg, test=develop
6 years ago
0b75a0c10b
add overrider for virtual function to avoid warning ( #21503 )
...
* add overrider for virtual function; test=develop
* fix layer.h OutputName bug; test=develop
6 years ago
6ebf0f47b8
support SelectedRows in dygraph, test=develop ( #21078 )
...
* support SelectedRows in dygraph, test=develop
* fix bug of _grad_ivar interface, test=develop
* add optest for support seletedrows, test=develop
* fix bug for gradient_accumulator in GPU mode, test=develop
* fix error when Selectedrows addto LodTensor in sorted_gradient mdoe in dygraph, test=develop
* refine and simplify gradient accumulator code, test=develop
* add optest, test=develop
* add optest and simplify code, test=develop
* fix bug for test_imperative_selected_rows, test=develop
* add optest for Coverage, test=develop
* fix gradient interface and simplify code, test=develop
* update api for gradient, test=develop
* fix ShareDim's bug in DygraphExecutionContext class, test=develop
* add optest, test=develop
6 years ago
01fa4ead61
fix -Wno-error=sign-compare warning in gcc8 ( #21434 )
...
* fix -Wno-error=sign-compare warning in gcc8
test=develop
* fix warning in distributed codes
test=develop
6 years ago
5e813b53c5
nhwc optimization for batchnorm ( #21090 )
6 years ago
407f883f5a
Add SelectedRows support for dygraph DebugString ( #21415 )
...
* add selected rows support for debug string, test=develop
* refactor unittest of debug string, test=develop
* polish unittest name, test=develop
6 years ago
ac8546701d
Add dygraph execution context ( #20157 )
...
* add_dygraph_execution_context
* add dygraph infershape context and execution context; test=develop
* fix imperative bug; test=develop
* remove inputs outputs interface from execution context,
because it have same function with inputNames;
test=develop
* remove tracer_test ctest; test=develop
* fix split op bug; test=develop
* fix unitests bug; test=develop
* fix distribute test bug; test=develop
* fix ngraph compile bug; test=develop
* fix grad maker bug; test=develop
* fix load op bugs; test=develop
* fix operator.cc construct bug; test=develop
* remove useless name find in operator; test=develop
* add tracer_test; test=develop
* fix concat, split bug; test=develop
* remove tracer_test unitest; test=develop
* fix attribute check bug; test=develop
* add test code to fix converage; test=develop
* remove useless code, change check backward input in engin; test=develop
* unlock var type infer shape;test=develop
* add ShareAllLoD api; test=develop
* add dygraph infershape context unitest; test=develop
* remove increase and decrease lod in dygraph; test=develop
* addd override; test=develop
* fix increase descrease lod; test=develop
* fix paddle_enforce; test=develop
* disable lod op dygraph check; test=develop
* fix paddle enforce error; test=develop
* add comment for op_registry and OperatorBase; test=develop
* optimize the comment of op_registry; test=develop
* fix format of comment; test=develop
* fix format of comment; test=develop
* optimize the format of comment; test=develop
* optimize the format of the comment; test=develop
* optimize comment of op_registry; test=develop
6 years ago
c0656dcb1a
remove -Wno-error=sign-compare, make warning as error ( #21358 )
...
* remove -Wno-error=sign-compare, make warning as error
test=develop test=document_fix
* fix exist compile warning
test=develop
6 years ago
345b67b5e2
remove warning LNK4006 and warning LNK4221 ( #21226 )
6 years ago
c4ede95c74
open dygraph op test, test=develop ( #19787 )
...
* open dygraph op test, test=develop
* modify to_variable, test=develop
* modify input and output for dygraph, test=develop
* modify input and output for dygraph(fix bug), test=develop
* fix input processing of dygraph op test, test=develop
* fix bug, test=develop
* fix op test, test=develop
* fix forward bug for dygraph, test=develop
* fix mkldnn op test for forward, test=develop
* update nn.py for dygraph, test=develop
* fix crop_tensor_op, test=develop
* fix elementwise_mul_op, test=develop
* fix fill_op, test=develop
* fix some mkldnn op, test=develop
* open backward op test for dygraph, test=develop
* delete log, test=develop
* close backward op test for dygraph, test=develop
* fix bug for edit_distance_op and test_lstm_cudnn_op, test=develop
* fix optest backward bug for dygraph, test=develop
* fix optest backward bug for dygraph, test=develop
* close backward op test for dygraph, test=develop
* close backward op test for dygraph, test=develop
* open dygraph op test, test=develop
* fix op test for dygraph, fix GradOpDescMaker, test=develop
* fix bug for linear_chain_crf_op.h, test=develop
* remove log, test=develop
* remove log, test=develop
* remove log for op_test.py, test=develop
* remove log for op_test.py, test=develop
* fix bug for var_conv_2d_op, change PADDLE_ENFORCE, test=develop
* fix PADDLE_ENFORCE_EQ for hierarchical_sigmoid_op.cc, test=develop
* fix bug for test_increment_ngraph_op.py, test=develop
* fix lod for op test in dygraph, test=develop
* refactor op_test.py to reduce redundant code, test=develop
* fix lod optest, modify InputVar/OutputVar to HasInput/HasOutput, test=develop
* remove debug log, test=develop
* remove redundant code in base.py, test=develop
* fix some error in optest, test=develop
* fix ClearNoNeedBufferInputs function's bug for LoDTensor, test=develop
* refactor op_test.py, test=develop
* remove redundant writing, test=develop
* fix error(get tensor of the grad variable), test=develop
* fix test_concat_mkldnn test_conv2d_mkldnn, test=develop
* fix optest.py for get tensor of LoDTensor, test=develop
* fix optest.py for get tensor of LoDTensor, test=develop
* fix optest.py for get tensor of LoDTensor, test=develop
* fix some redundant code, test=develop
* reslove conflict and rewrite paddle error message, test=develop
6 years ago
67e88424e5
Polish jit trace codes ( #21218 )
...
* polish jit trace codes, test=develop
* polish codes again by removing var_id, test=develop
6 years ago
008ed65fd5
Add c++ global current tracer for dygraph ( #20882 )
...
* Add c++ global current tracer for dygraph, test=develop
* add tracer property in c++, test=develop
* support different place, test=develop
* add unittest for tracer, test=develop
6 years ago
878a40f57d
Support NoNeedBufferVarsInference in dygraph backward ( #20868 )
...
* support no need buffer vars in dygraph, test=develop
* fix inference compilation error, test=develop
* update no_need_buffer_vars_inference, test=develop
* add unittests for no_need_buffer_vars_context, test=develop
* refine no_need_buffer_vars by return ref, test=develop
* polish some codes, test=develop
6 years ago
065804d39e
fix bug in grad_op compute for dygraph, test=develop ( #20975 )
6 years ago
8c4573a3cb
GradMaker for dygraph ( #19706 )
...
* refactor dygraph,test=develop
* fix failed unittest,test=develop
* polish code,test=develop
* check windows ci error,test=develop
try to fix windows ci error by np.allclose,test=develop
* polish vlog and profiler, test=develop
* try to fix preceding ops order,test=develop
* test transformer in windows ci, test=develop
* use python c-api to speed up tracer.trace,test=develop
* test=develop, fix docker with paddle nccl problem
* test=develop, add ut for debug string and gradient_accumulator
* test=develop, add tests for layer/gradient_accumulator/prepared_op
* test=develop, fix complie error for test_prepared_op
* test=develop, add more ut for dygraph
* test=develop, create API.spec for dygraph api change
* optimize grad maker; test=develop
* optimize grad maker
* test
* grad make optim; test=develop
* fix unittest bugs; test=develop
* add dygraph grad op maker and split_op
* grad op maker refactor; test=develop
* add dygraph grad maker; test=develop
* fix op deformable_conv_v1_op bug; test=develop
* fix deformable_conv prroi pool bugs;
* fix new op grad op maker bug; test=develop
* fix split by ref bug; test=develop
* fix dygraph auto prune bug; test=develop
* fix test_trace bug; test=develop
* fix fused emb seq pool bug; test=develop
* remove useless code in op_desc file; test=develop
* remove useless code, StrVarBaseNode; test=develop
* fix review issues; test=develop
* fix rank_loss grad maker; test=develop
* remove flag in VarBase; test=develop
* fix distributed_notify_op compile bug ; test=develop
* fix reshape op double grad; test=develop
* fix expand as op; test=develop
* add impertive type_defs.h for demo_train; test=develop
* fix inference lib cmake; test=develop
* fix inference lib; test=develop
* fix infernce_lib; test=develop
* fix inference cmake; test=develop
* fix inference lib; test=develop
* fix inference lib; test=develop
* remove condition dygraph grad maker, modify local name; test=develop
* fix split grad maker bug; test=develop
* fix pyramid_op bug; test=develop
* change travis time out limit; test=develop
* restore travis; test=develop
* change timeout limit; test=develop
6 years ago
liuwei1031
Zeng Jinle
Kaipeng Deng
Yiqun Liu
Leo Chen
Chen Weihang
zhongpu
Yi Liu
hong
tianshuo78520a
Wilber
silingtong123
Tao Luo
Jie Fang
zhouwei25