Tao Luo
92c32799e7
Merge pull request #4864 from luotao1/maxseq
...
add Max strategy for sequence_pool op
7 years ago
gongweibao
bc0ecf2594
omit test_lstm_unit_op.py
7 years ago
xzl
ebf606a2a0
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add_merge_model_scripts
7 years ago
Yang yaming
fd5199fdf7
Merge pull request #3989 from pkuyym/fix-3923-r
...
Add huber loss operator.
7 years ago
Luo Tao
f086f5649b
Merge branch 'develop' into maxseq
7 years ago
武毅
24d988ce5c
Merge pull request #4063 from typhoonzero/auc_op
...
Auc op
7 years ago
xzl
6c783dc887
modify interface and comments
7 years ago
chengduoZH
df48b43b91
fix clear zero method and remove useless code
7 years ago
caoying03
3afb9dc88a
use double in unittest.
7 years ago
xzl
f08bf453f7
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add_merge_model_scripts
7 years ago
xzl
9545163fdf
add merge model tools
7 years ago
chengduoZH
e5c167dc0b
fix unit test
7 years ago
chengduoZH
0ab012cf7f
fix doc
7 years ago
Abhinav Arora
94fb7ba4fa
Adding L1 norm op for L1 regularization ( #5058 )
...
* Adding L1 norm op for L1 regularization
* Addressing code review feedback
* Address code review feedback
* Change variable names to match google style guide
7 years ago
Yu Yang
9596731348
enhance default param_attrs ( #5142 )
7 years ago
QI JUN
7f8574c0f5
add sparse support for sum op ( #5093 )
...
* add sparse support for sum op
* typo fix
* fix gpu build error
* fix unittest error
* typo fix
* infer var type and shape in op_test
* follow comments
* fix build error
* bypass some unittests depend on NetOp
7 years ago
Yu Yang
2366284165
Python API for save/load variables ( #5136 )
...
* Python API for save/load variables
* Polish names
7 years ago
Dong Zhihong
75eacccd5c
"rerun ci"
7 years ago
Dong Zhihong
f632706c18
fix based on comment
7 years ago
Abhinav Arora
8623e48ba8
Add python API for backward regularization ops ( #5135 )
...
* Add regularizer code
* Fix code
7 years ago
Yu Yang
be00b0c4d6
Gradient check use graph ( #5027 )
...
* Simplize Gradient Check
* Stash
* Extract apply_backward_pass to backward.py
Rename apply_backward_pass to append_backward_ops
* Use graph API to check gradient
* Fix ci
* Fix CI
* Fix backward for double precision
* Stash
* Fix CI
* Fix ci
* Ignore GRU test
* Ignore xe op
* Fix CI
* Fix softmax with xe gradient
The correct equation should be IG = OG * (d_softmax_with_xe())
* Fix typo
* Fix merge error
* Disable LRN
7 years ago
Qiao Longfei
fc68290bcc
update _create_op_func_ and support generate dropout layer ( #5134 )
7 years ago
fengjiayi
aa379ccb5e
Add functions of restoring ProgramDescBind from ProgramDesc ( #5109 )
...
* compelete restoring program_bind from program_desc
* Fix bugs
* fix compile errors
* fix errors and add unit tests
* rename some vars
* Follow comments
7 years ago
Dong Zhihong
16a39d24f3
fix conflict
7 years ago
chengduoZH
25df892932
remove conflict
7 years ago
Siddharth Goyal
66476fc7b7
Add proximal adagrad optimizer ( #5128 )
7 years ago
yangyaming
65dbbd57af
Add and pass unittests.
7 years ago
chengduoZH
db1bb8224a
follow comments
7 years ago
chengduo
8e3ecf5d11
Merge pull request #4814 from chengduoZH/Add_sequence_project_op
...
Add sequence_conv_op and sequence_projection functor
7 years ago
gongweibao
9d142d5060
Local response normalize. ( #4426 )
...
Add local response normalize
7 years ago
dangqingqing
bd680f157f
fix compiling warning.
7 years ago
chengduoZH
99c6f44a5a
follow comments
7 years ago
dangqingqing
bcc0dad7df
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into lstm_bp
7 years ago
dangqingqing
ac3370a467
Add unit testing for gemv and fix the gradien check for bais.
7 years ago
chengduoZH
dcb3da591e
refine code
7 years ago
Yu Yang
aa3de3571d
Polish unit test for xe, generate probablities ( #5096 )
...
* Cross Entropy Wrong
* Fix XE
* Polish gradient check for xe
* Fix compile
7 years ago
chengduoZH
1bb0e2943b
Add pool2d cudnn
7 years ago
dangqingqing
2e0298744e
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into lstm_bp
7 years ago
dangqingqing
cd38286684
Add gradient check unit testing and fix bug.
7 years ago
Yu Yang
efc2464f6c
Feature/save op ( #5090 )
...
* Init
* Stash
* Polish SaveLoadOp
* Fix CI
* Polish code
* Save GPU Tensor
* Stash
* Fix CI
7 years ago
zhouxiao-coder
9b0f092853
change input data type
7 years ago
Abhinav Arora
f8c6dadae1
Implementing the python wrapper for Adamax optimizer ( #5061 )
7 years ago
Yang Yang(Tony)
6cc2ce010a
add fill constant batch size like op ( #5057 )
7 years ago
Luo Tao
368737e41b
Merge branch 'develop' into maxseq
7 years ago
Abhinav Arora
b0a267c0b8
Adding the squared L2 norm operator for L2 regularization ( #5030 )
...
* Adding the L2 loss operator for L2 regularization
* Renaming l2_loss op to squared_l2_norm_op
* Addressing code review feedback
7 years ago
caoying03
4c63086921
Merge branch 'develop' into crf
7 years ago
Tao Luo
b68f2d209a
Merge pull request #5049 from tensor-tang/mkldnn_bn
...
enable mkldnn_batch_norm
7 years ago
Dong Zhihong
2573ac1448
"remove python side test case to another PR."
7 years ago
zchen0211
40483c110d
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into develop
7 years ago
zchen0211
2e417b6011
batch norm
7 years ago
Abhinav Arora
a3842494d3
Adding nesterov momentum to python momentum wrapper ( #5055 )
...
* Adding nesterov momentum to python momentum wrapper
* Fixing optimizer test after merge
7 years ago
Yu Yang
0760043d18
Add retry when download dataset ( #5098 )
7 years ago
zhouxiao-coder
c22f7fcd17
add positive_negative_pair_op evaluator
7 years ago
Dong Zhihong
bab5e53c03
Merge remote-tracking branch 'origin/develop' into feature/multigpu
7 years ago
caoying03
c74107bfdc
fix backward computation.
7 years ago
tensor-tang
5ba1e1e10a
Merge remote-tracking branch 'upstream/develop' into mkldnn_bn
7 years ago
Peng Li
a02ebbb5d8
Merge branch 'develop' into fix-import-bug
7 years ago
chengduoZH
3f8a7b55b8
remove conflict
7 years ago
Yu Yang
6c0b383672
Add VarType::STEP_SCOPES for RNN ( #5056 )
7 years ago
Qiao Longfei
ee998a9c44
CPU Batch Norm Op ( #4964 )
...
* init batch norm op
* prepare input output
* compute mean_out var_out save_mean save_var on CPU
* active is test
* use eigen to do computation
* complete batch norm forward
* set default momentum to 0.9
* add batch norm grad op in CPU
* add tensor_format and NHWC support, add python test
* add test training
* add batch norm gradient test
* improve comment, fix foward Python UnitTest
* add gradient test
* fix eigen warning
* follow name style
* fix a bug
* change float to T
* add simple forward test
* test with different place
* add backward test
* refine python test
* remove old python test code
* code clean
* follow code style
* update comment
7 years ago
Yu Yang
dd0008d57f
Extract apply_backward_pass to backward.py ( #5026 )
...
* Extract apply_backward_pass to backward.py
Rename apply_backward_pass to append_backward_ops
* Fix CI
* Update design doc
7 years ago
Dong Zhihong
026c61c027
"fix allreduce python test"
7 years ago
Dong Zhihong
1e8474b9f1
"delete python ops testcase"
7 years ago
dzhwinter
fd2eb55071
"Serialize LoDTensor, Save/Restore model" ( #4602 )
...
* "add model format design doc"
* "add restore function"
* "add parse protobuf"
* "move necessary information to saver.proto"
* "format code"
* "add gpu option"
* "add lod info"
* "add saveop python test wrapper"
* "checkpoint reuse save operator"
* "rewrite model format design doc"
* "async support needed"
* "fix run once"
* "fix doc based on comments"
* "refine based on comments"
* "fix based comments"
* "remove persistable flag from framework.proto"
* "add IndicateDataType to restore op"
* "add save test"
* "modify save restore code"
* "modified the restore logic"
* rm checkpoint_op.cc
* rm test_checkpoint_op.py
* "get inputs outputs name from execution context"
* Saving each variable to a independent file
* Fix bugs
* Rewrite save_restore_op_test with new Python framework
* Move `SaveOp` and `RestoreOp` from OpWithKernel to OpBase
* Refine unit test of SaveOp and RestoreOp
* fix compile errorwq
7 years ago
Dong Zhihong
0990c87bf6
checkin nccl operator
7 years ago
Abhinav Arora
d78d119346
Adding python wrapper for adam operator ( #5021 )
...
* Adding Adam Python wrapper
* Adding tests for Python Adam wrapper
7 years ago
Dong Zhihong
da1181bfc6
Merge remote-tracking branch 'origin/develop' into feature/multigpu
7 years ago
Dong Zhihong
ef257e6d96
write nccl c++ test case
7 years ago
chengduoZH
08a7b1ded7
fix unit test
7 years ago
tensor-tang
4d7eb09008
add python interface of mkldnn_batch_norm
7 years ago
yangyaming
5939a17c47
Follow comments and adapt to new interface.
7 years ago
caoying03
6a630f2798
Merge branch 'develop' into crf
7 years ago
Peng Li
a050825f00
fix package name bug
7 years ago
dangqingqing
0190d5d644
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into check_out_lod
7 years ago
dangqingqing
2e783663fa
Enable to output LoD in fetch_op and check output LoD in the op unit test.
7 years ago
chengduoZH
6f02fe7dfd
fix unit test
7 years ago
chengduoZH
b15c69f59d
remove conflict
7 years ago
caoying03
427644b2fa
fix the computation kernels.
7 years ago
yangyaming
0521161070
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix-3923-r
7 years ago
yangyaming
9a3f50d806
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix-3923-r
7 years ago
Peng LI
25588a3831
Merge pull request #5033 from pengli09/add-a-warning
...
Add a warning to the docstring of Parameters.to_tar()
7 years ago
wanghaoshuang
97f1b98759
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into seq_expand_op
7 years ago
wanghaoshuang
296167446c
Rewrite sequence expand op
7 years ago
chengduoZH
154dbb4697
Add unit test
7 years ago
Yu Yang
fa72e5443b
Python API for StaticRNN ( #4991 )
7 years ago
Peng Li
4098a03964
refine the warning message
7 years ago
Peng Li
17eef3a3f4
add a warning to docstring of Parameters.to_tar()
7 years ago
Zhuoyuan
8fdc315acc
Merge pull request #4739 from zchen0211/develop
...
deconv op implementing ...
7 years ago
Dong Zhihong
50f04dcae3
"add init allreduce test"
7 years ago
Yu Yang
9023248c6f
Simplize Gradient Check ( #5024 )
7 years ago
Dong Zhihong
f6106ffa7e
merge develop into multigpu
7 years ago
Yang Yang(Tony)
db157eda45
New Op Test framework. ( #4962 )
...
Pass all forward op test
7 years ago
Dong Zhihong
423d7438a1
"add register gpu macro"
7 years ago
Yu Yang
bc15117403
Correct mul_op implementation ( #4988 )
...
* Correct mul_op implementation
* Restore the origin shape after mul
* Fix mul op
* Do not touch math_function
7 years ago
QI JUN
fcd74e06b8
add book04.word2vec train test ( #5002 )
...
* init
* ensure ids in lookup table op must be a column vector
* add book4 configuration in test_layers
* debug test_book4
* add test_word2vec
* follow comments
* follow comments
7 years ago
QI JUN
40e7caf667
ensure ids in lookup table op must be a column vector ( #4987 )
...
* ensure ids in lookup table op must be a column vector
* follow comments
7 years ago
guosheng
4b84f07c70
Merge branch 'develop' of https://github.com/PaddlePaddle/paddle into add-ChunkEvalOp
7 years ago
guosheng
bb9d68dcb3
Add chunk_eval_op
7 years ago
chengduoZH
f2ccef26bf
Add sequence_conv_op
7 years ago
ranqiu
4ad12a0bd5
Fix bugs of dot-product attention
7 years ago
dangqingqing
cf2608e383
update to the develop branch.
7 years ago
peterzhang2029
611ee68b78
add bilinear tensor product op
7 years ago
武毅
154e1d0491
Merge pull request #4972 from typhoonzero/fix_v2_optimizer_order
...
Fix v2 optimizer define order
7 years ago
typhoonzero
023166a820
add ut, follow comments
7 years ago
wanghaoshuang
4e8fccff11
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into seq_expand_op
7 years ago
wanghaoshuang
d697b6a349
Modified code using LoDTensor
7 years ago
chengduoZH
ce960575cd
fix doc format and unit test
7 years ago
Luo Tao
70d9d953e6
rename sparse_vector to sparse_float_vector in tests
7 years ago
Luo Tao
c2feab7ff1
Merge branch 'develop' into sparse_vector
7 years ago
caoying03
c8d0d37c4d
Merge branch 'develop' into crf
7 years ago
caoying03
80a5ee0052
fix forward and add backward.
7 years ago
chengduoZH
4c19f9f429
fix backward
7 years ago
chengduoZH
6246be294f
clean gradient data
7 years ago
chengduoZH
4d112b7d04
remove conflict
7 years ago
chengduoZH
834b82f109
fix sequence_project_op forward and backward
7 years ago
Guo Sheng
d0cfbba429
Merge pull request #4496 from guoshengCS/add-NormOp
...
Add norm_op
7 years ago
kexinzhao
5fd4bee2d3
Merge pull request #4977 from kexinzhao/python_adagrad
...
Adding interface for the adagrad optimizer
7 years ago
zchen0211
cc5e118b1e
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into develop
7 years ago
zchen0211
b3ab3ce0a1
deconv -> conv transpose
7 years ago
Yu Yang
86437a8dda
Global function, op_support_gpu ( #4980 )
7 years ago
Kexin Zhao
7256cbe1de
add default value to epsilon
7 years ago
zchen0211
502e72591f
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into develop
7 years ago
QI JUN
1680903dd4
Merge pull request #4956 from QiJune/test_book2
...
add book02.recognize_digits mlp train test
7 years ago
fengjiayi
05ece8481e
Trainable conv net of MNIST ( #4960 )
...
* Init file
* Update
* Update
* Complete conv net of MNIST
7 years ago
Yan Chunwei
07ea9adec0
feature/dynamic recurrent op forward and backward ( #4799 )
7 years ago
kavyasrinet
5380a5471b
Adding Nesterov Momentum ( #4948 )
7 years ago
typhoonzero
71c2b296eb
update
7 years ago
guosheng
b12988f008
Merge branch 'develop' of https://github.com/PaddlePaddle/paddle into add-NormOp
7 years ago
Luo Tao
36ebf00f98
rename sparse_vector to sparse_float_vector, and fix typo
7 years ago
Kexin Zhao
fdaf0772c4
add adagrad optimizer python implementation
7 years ago
Abhinav Arora
09c0c82ec9
Adding increment op ( #4940 )
...
* Adding incremnt op
* Fixing comment about step attribute
7 years ago
Dong Zhihong
333045d7b2
"move nccl to another directory"
7 years ago
Abhinav Arora
0e31d7d71b
Adding the interface for the momentum optimizer ( #4919 )
...
* Adding the interface for the momentum optimizer
* Adding a comment about accumulators
7 years ago
qijun
8278d97e3a
add book02.recognize_digits mlp train test
7 years ago
Yu Yang
102a5f3499
Feature/remove global scope ( #4950 )
...
* Unify `set_feed_variable` to one method
* Move global scope to python, not in C++
7 years ago
QI JUN
9903e49f94
add test_fit_a_line ( #4936 )
...
* add test_fit_a_line
* Update
* fix persistable bug
* fix elementwise add bug
* set correct attr for bias op in fc layer
* set correct attr for bias op in fc layer
* Update
1. Add init_program to hold initializers
2. bug fix
* add test_fit_a_line
* fix persistable bug
* fix elementwise add bug
* fix type
* add gitignore
* Complete fit_a_line test
* revert code
* Clean up
* Revert "revert code"
This reverts commit eb1aa015cda4fc12b6dc778ada6c3507b98134f5.
* Refine
* Fix unit test
7 years ago
QI JUN
92369177ad
Merge pull request #4941 from QiJune/fix_elementwis_add_bug
...
fix elementwise add bug
7 years ago
zchen0211
7eeaae1695
deconv
7 years ago
Yu Yang
42f2dd4041
Unify `set_feed_variable` to one method ( #4949 )
7 years ago
qijun
9e6404441c
fix elementwise add bug
7 years ago
fengjiayi
1f1be6c97a
Test recognize_digits_conv ( #4926 )
...
* Init
* unify layer names
* Update
* Add pool2d layer
* Test recognize_digits_conv
* Clean up
7 years ago
Abhinav Arora
77cac5cdb8
Removing updates of Beta1 power accumulators outside the op ( #4931 )
7 years ago
Abhinav Arora
11bebeb2dc
Removing updates of Beta1 and Beta2 power accumulators outside the op ( #4925 )
7 years ago
Yu Yang
3db5278301
Feature/py executor test ( #4922 )
...
* Implement FC layer with helper
* Update LayerHelper
* Add debug string for Python ProtoBuf
and Rename `Sync` to `Flush`
* Add check of ProtoBuf initialization
* Layer wrapper for FC
* Fix unittest
* Fix CI
* Add code generator
* AttributeChecker Better error log and speicalize bool
Since lots of types can be cast to bool
* Complete mlp, fit_a_line
* Expose get global scope
* Make global scope not thread-safe
1. It is no need to make global scope thread-safe, since it will be
invoked in Python main thread.
2. Do not free the global scope when C++ exit. Let the OS free memories,
otherwise, we need to handle the destroy dependencies.
See
https://google.github.io/styleguide/cppguide.html#Static_and_Global_Variables
* Fix
* Implementation of simple conv_2d layer
* Stash
* Remove private data members in OpRegister
* Fix bugs
* Stash
* Expose FeedFetchList as VarType
* Change ProgramDesc not a global variable
* Polish code style
* Stash
* Correct implement BlockDesc destructor
* Correct implement BlockDesc destructor
* Unify program as parameter name
* Fix bugs
* Add unittest
* Fix unit test error
* Remove unused functions
* Add clone for Python Program
* Working on executor
* Stash
* Add glog as dependencies of ops
* Use VLOG to logging some information is helpful when we debug Paddle
* Expose VarDesc::persistable to Python
* Test executor
* Complete unittest
* Polish code
* Fix merge error
* Follow comment
* Polish Python Code
7 years ago
dangqingqing
17e33738f2
Enhance unit testing and fix bug.
7 years ago
wanghaoshuang
74b283c9d6
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into seq_expand_op
7 years ago
dangqingqing
b325213150
update to develop branch.
7 years ago
dangqingqing
d1fbf50b9e
Add unit testing for forwad implementation.
7 years ago
Qiao Longfei
d253df742c
remove Program.instance ( #4915 )
...
* remove Program.instance
* fix test_program.py
7 years ago
Yu Yang
47f773ddb2
Copy Constructor for ProgramDesc ( #4895 )
...
* Implement FC layer with helper
* Update LayerHelper
* Add debug string for Python ProtoBuf
and Rename `Sync` to `Flush`
* Add check of ProtoBuf initialization
* Layer wrapper for FC
* Fix unittest
* Fix CI
* Add code generator
* AttributeChecker Better error log and speicalize bool
Since lots of types can be cast to bool
* Complete mlp, fit_a_line
* Implementation of simple conv_2d layer
* Fix bugs
* Change ProgramDesc not a global variable
* Polish code style
* Stash
* Correct implement BlockDesc destructor
* Correct implement BlockDesc destructor
* Unify program as parameter name
* Fix bugs
* Add unittest
* Fix unit test error
* Remove unused functions
* Add clone for Python Program
* Compare OpDescBind directly
7 years ago
Yu Yang
f6e1d959d2
Expose VarDesc::persistable to Python ( #4911 )
7 years ago
QI JUN
7ad13fbfe9
Merge pull request #4876 from QiJune/sgd_op_sparse_kernel
...
add sparse update kernel for sgd operator
7 years ago
fengjiayi
c93596d35b
unify layer names ( #4913 )
7 years ago
kavyasrinet
c10b8e808f
Adding Proximal Gradient Descent ( #4848 )
...
* Adding Proximal Gradient Descent
* Fixing review comments
7 years ago
fengjiayi
a204fefe16
Fix several bugs in compile time backward and Protobuf desc ( #4894 )
...
* Implement FC layer with helper
* Update LayerHelper
* Add debug string for Python ProtoBuf
and Rename `Sync` to `Flush`
* Add check of ProtoBuf initialization
* Layer wrapper for FC
* Fix unittest
* Fix CI
* Add code generator
* AttributeChecker Better error log and speicalize bool
Since lots of types can be cast to bool
* Complete mlp, fit_a_line
* Implementation of simple conv_2d layer
* Fix bugs
* Correct implement BlockDesc destructor
* Fix bugs
* Fix unit test error
* Follow comments
7 years ago
Yu Yang
e747623e86
Change ProgramDesc not a global variable ( #4879 )
...
* Change ProgramDesc not a global variable
* Polish code style
* Correct implement BlockDesc destructor
* Unify program as parameter name
7 years ago
fengjiayi
efd009a063
implementation of simple conv2d layer ( #4868 )
...
* Implement FC layer with helper
* Update LayerHelper
* Add debug string for Python ProtoBuf
and Rename `Sync` to `Flush`
* Add check of ProtoBuf initialization
* Layer wrapper for FC
* Fix unittest
* Fix CI
* Add code generator
* AttributeChecker Better error log and speicalize bool
Since lots of types can be cast to bool
* Complete mlp, fit_a_line
* Implementation of simple conv_2d layer
* Fix bugs
* Remove debug code
7 years ago
wanghaoshuang
31531ab581
Add backward kernel
7 years ago
chengduoZH
91db457fc0
follow comments
7 years ago
xzl
c876dfaa67
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into poolmaxpool_with_mask
7 years ago
xzl
720274da53
add max-pool-with-mask python interface
7 years ago
wanghaoshuang
8de04be786
Fix unitest
7 years ago
dangqingqing
2a8dbd130d
LSTM Operator forward implementation.
7 years ago
chengduoZH
1e60c9b2e8
Add sequence_project_op (use im2col)
7 years ago
wanghaoshuang
555ab3f5af
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into seq_expand_op
7 years ago
wanghaoshuang
23701ffaf0
Refine op
7 years ago
Markus Kliegl
164898277c
MatMul operator ( #4856 )
...
* initial matmul operator
Similar to np.matmul, but also has transpose_X and transpose_Y flags,
and only supports tensors from rank 1 to 3 inclusive.
For GPU, uses cublas?gemmStridedBatched. For CPU, uses
cblas_?gemm_batch if available via MKL; otherwise a simple serial
implementation that loops over the batch dimension is employed for now.
7 years ago
dzhwinter
fd96914d23
Merge pull request #4571 from sidgoyal78/momentum_op
...
Add momentum operator
7 years ago
qijun
f9681459b2
fix gpu build error
7 years ago
qijun
ab8cc401e6
add sparse sgd operator unittest
7 years ago
Qiao Longfei
df0946ebe2
Impl optimizer ( #4734 )
...
* init parameter base class
* optimize the Comments of optimizer
* basic implimentation of optimizer
* add test_optimizer
* add no_grad_set to interface
* update optimizer.py
* python code can run
* fix some problem
* add sync_with_cpp to Python Program and Block
* sync vars and ops in block from cpp
* optimize code and add some comment
* add more check for sync
* update optimizer with return value of Backward
* rm unused code
* infer shape when create gradient vairiable
* update test_optimizer
* update test_program.py
* update backward test
* follow comment
7 years ago
Luo Tao
06456c5f3b
remove test_check_grad for Max strategy to pass the ci
7 years ago
ranqiu
7ad15259fc
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into attention
7 years ago
Luo Tao
426f7eee8e
simplify test_pool_py, add comments for different pooling strategy
7 years ago
ranqiu
78320194aa
refine dot-product attention according to the comments
7 years ago
Luo Tao
a8a63d4c50
add MAX strategy for seqpool op
7 years ago
caoying03
3123e3cf5d
Merge branch 'develop' into crf
7 years ago
caoying03
cc220eec36
add forward computation of crf operator.
7 years ago
QI JUN
cdc236cb82
Merge pull request #4841 from QiJune/pybind_selected_rows
...
export SelectedRows to Python
7 years ago
Yu Yang
8e52b34a0c
Implement FC layer with helper ( #4726 )
...
* Implement FC layer with helper
* Update LayerHelper
* Add debug string for Python ProtoBuf
and Rename `Sync` to `Flush`
* Add check of ProtoBuf initialization
* Layer wrapper for FC
* Fix unittest
* Fix CI
* Add code generator
* AttributeChecker Better error log and speicalize bool
Since lots of types can be cast to bool
* Complete mlp, fit_a_line
7 years ago
QI JUN
9fc593603b
Merge pull request #4837 from QiJune/pybind_feed_fetch_method
...
export feed/fetch variable method to Python
7 years ago
Yu Yang
75d0c79015
Change Name convention of operator attributes ( #4807 )
...
* Change dataType to data_type
Follow PEP8
* Change name_convention to fit PEP8
7 years ago
qijun
219f46ae16
export SelectedRows to Python
7 years ago
qijun
c87e060c18
export feed/fetch method to Python
7 years ago
qijun
517e3c7947
Merge remote-tracking branch 'baidu/develop' into pybind_feed_fetch_method
7 years ago
Luo Tao
216b81ace7
Merge branch 'develop' into seqpool
7 years ago
Tao Luo
aeccaf5631
Merge pull request #4827 from pengli09/ensure-bias-attr-has-no-name
...
Ensure name is not set in bias_attr in gru_step_naive_layer
7 years ago
Peng Li
98a6b85e8b
revise the error message to provide more detailed info
7 years ago
Peng Li
386a0289bd
Ensure name is not set in bias_attr in gru_step_naive_layer
7 years ago
Peng Li
808adc346f
Fix bug in computing output size of IdentityOffsetProjection
7 years ago
Luo Tao
97332d7c0c
Merge branch 'develop' into seqpool
7 years ago
qijun
7c0facd195
init
7 years ago
Qiao Longfei
88b9202c48
Python cpp sync ( #4816 )
...
* add sync_with_cpp to Python Program and Block
* sync vars and ops in block from cpp
* optimize code and add some comment
* add more check for sync
7 years ago
Dong Zhihong
d4d215a514
Merge remote-tracking branch 'origin/develop' into multigpu
7 years ago
Qiao Longfei
a4b172252b
Merge pull request #4809 from jacquesqiao/backward-return-map
...
Backward return map
7 years ago
qiaolongfei
2befb9f972
optimizer backward CreateGradVarInBlock input output order
7 years ago
qiaolongfei
9a0ef7d2aa
append_backward return map to python
7 years ago
Dong Zhihong
d2be7ec370
Merge remote-tracking branch 'origin/develop' into multigpu
7 years ago
Dong Zhihong
5eed0134e6
"refix the python logic"
7 years ago
Dong Zhihong
5bd14f6edb
Merge remote-tracking branch 'origin/develop' into fix/scope
7 years ago
Qiao Longfei
d7383c6dd0
create grad_var when run Backward pass ( #4796 )
...
* add target to Backward, generate var in block when call backward
* modify backward_test
* fix executor_test
* set var desc default type to LOD_TENSOR
* update backward_test
* insert loss in the top level of backward
* create grad vars for all blocks in current program
* optimize code
* update test_program.py
* only create var for newly create blocks when backward
7 years ago
fengjiayi
dbb60572a5
Refine Python operator input/output checks ( #4803 )
7 years ago
Dong Zhihong
b3df1f4a49
"fix tests"
7 years ago
Dong Zhihong
3f4177ea8d
Merge branch 'develop' into fix/scope
7 years ago
chengduoZH
24a796fbc0
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into Add_conv3d_gemm_op
7 years ago
Dong Zhihong
d144310415
"nccl add interface"
7 years ago
fengjiayi
5d9ce04625
Debug string for Python ProtoBuf ( #4800 )
...
* Add debug string for Python ProtoBuf
and Rename `Sync` to `Flush`
* Add check of ProtoBuf initialization
7 years ago
Yu Yang
d17eb73e9f
Update VarDesc from design doc ( #4769 )
...
* Update VarDesc from design doc
* Fix GCC compile
* Fix unittest
7 years ago
Luo Tao
abfa81b106
Merge branch 'develop' into seqpool
7 years ago
Guo Sheng
a0af1eeabf
Merge pull request #4443 from guoshengCS/add-GRUStepOp
...
Add gru_unit_op
7 years ago
chengduoZH
557c7ae37b
remove conflict
7 years ago
Abhinav Arora
3b954e1ddc
Adding Hard Sigmoid Activation ( #4771 )
...
* Adding Hard Sigmoid Activation
* Adding a comment for slope to be only positive
* Fixing grammatical mistake in comment
7 years ago
Yan Chunwei
1c1f73b46d
Feature/dynamic recurrent op forward test ( #4729 )
7 years ago
Luo Tao
4c3ef7fca5
Merge branch 'develop' into seqpool
7 years ago
Dong Zhihong
51abb6c323
add test
7 years ago
Abhinav Arora
116800378a
Adding the Adam Optimizer operator ( #4733 )
...
* add adam op
moment1_out = beta1 * moment1 + (1 − beta1) * grad
moment2_out = beta2 * moment2 + (1 − beta2) * grad * grad
moment1_hat = moment1_out / (1 - beta1^t)
moment2_hat = moment2_out / (1 - beta2^t)
param_out = param - learning_rate * moment1_hat / (sqrt(moment2_hat) +
epsilon)
* fix moment 2
* Adding the Adam optimization operator
* Adding more tests for Adam op
7 years ago
dongzhihong
7da9ab3c6c
Merge remote-tracking branch 'origin/develop' into fix/scope
7 years ago
fengjiayi
36de398924
Rename Python `graph` to `framework` ( #4762 )
7 years ago
dongzhihong
ff0e9d2207
Merge remote-tracking branch 'origin/develop' into fix/scope
7 years ago
fengjiayi
1a87a963e1
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into dev_opdesc_in_python
7 years ago
guosheng
71abb4ceb1
Merge branch 'develop' of https://github.com/PaddlePaddle/paddle into add-NormOp
7 years ago
caoying03
cbcf11d930
Merge branch 'develop' into crf
7 years ago
Luo Tao
393c748c89
add seqlastin/seqfirstin for seq_pool op
7 years ago
chengduoZH
4aae1fff78
fix conv3d_gemm, unit test and follow comments
7 years ago
guosheng
9b4a6af251
Merge branch 'develop' of https://github.com/PaddlePaddle/paddle into add-GRUStepOp
7 years ago
guosheng
0bc5a122d4
Refine gru_unit_op by optional bias
7 years ago
chengduo
487a13bbfa
Merge pull request #4742 from chengduoZH/refine_conv2_naive_func
...
refine conv2d naive function
7 years ago
chengduoZH
db4de4ffd9
follow comments
7 years ago
guosheng
1cabdb8708
Refine gru_unit_op according to comments to support multiple activation types
7 years ago
chengduoZH
5fe68931f6
fix code struce
7 years ago
kexinzhao
d3b8bffaf1
Implementing the Decayed Adagrad optimizer operator ( #4645 )
...
* Implementing the DecayedAdagrad optimizer step operator
* implementing DecayedAdagrad operator
* remove file
* small fix
7 years ago
Luo Tao
e69a565a5b
Merge branch 'develop' into seqpool
7 years ago
chengduoZH
8ad67da9ab
fix conflict
7 years ago
Yu Yang
2daba04042
Merge pull request #4731 from reyoung/feature/fix_ci
...
Feature/fix ci
7 years ago
武毅
a3ccbdb3b6
Cudnn conv op ( #4195 )
...
* add cudnn_conv_op
* WIP
* update
* update
* fix grad check
* use platform::memory
* add support group for cudnn
* update
* follow comments
* fix onlycpu build
* update cuda define
* follow comments
* follow comments
* merge with updates
* fix compile error
* follow comments
* follow comments
7 years ago
chengduoZH
6ef2da2e89
finetune conv2d navie func
7 years ago
Yu Yang
3eac6d9f50
Disable test_seq_concat_op.py temp
7 years ago
chengduoZH
a015ea8f7c
refine conv2d naive function
7 years ago
caoying03
515981d714
Merge branch 'develop' into crf
7 years ago
caoying03
d92c671d5f
add python forward unittest.
7 years ago
chengduoZH
c2fbf8c5a7
Add unit test
7 years ago
dongzhihong
4b6b4bc84a
"change GetOrCreate to Var"
7 years ago
fengjiayi
458a2da3cf
Merge branch 'fix_bugs' into dev_opdesc_in_python
7 years ago
dongzhihong
5d6a3eee5b
new_var to get_or_create
7 years ago
fengjiayi
f8211328e1
Fix bug
7 years ago
Abhinav Arora
b504a2346c
Adding the Thresholded Relu Op ( #4685 )
...
* Adding thresholded_relu op
* Adding test for thresholded relu op
7 years ago
fengjiayi
90fa6db6bd
Add infer_shape to Python Operator and fix bugs
7 years ago
fengjiayi
bf26cc5307
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into dev_opdesc_in_python
7 years ago
fengjiayi
d92f8de431
Merge pull request #4702 from Canpio/fix_expose_checker_to_python
...
Explose check_attr to Python
7 years ago
Qiao Longfei
5e9d43995b
Merge pull request #4699 from jacquesqiao/expose-backward
...
expose AppendBackward of ProgramDesc to python
7 years ago
wanghaoshuang
f984cba0ca
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into seq_expand_op
7 years ago
guosheng
0922fca41e
Add gru_unit_op
7 years ago
wanghaoshuang
901b041196
Add seq_expand op
...
1. Add unitest
2. Add SeqExpandOpKernel
7 years ago
Cao Ying
134a07365b
Merge pull request #4713 from ranqiu92/doc
...
Update annotations of layers.py.
7 years ago
Cao Ying
e9495e7694
Merge pull request #4508 from Yancey1989/seqconcat_op
...
Add the sequence_concat operator.
7 years ago
Luo Tao
c77bd553de
Merge branch 'develop' into seqpool
7 years ago
ranqiu
0402a69694
Update annotations of layers.py
7 years ago
Yibing Liu
240adef1a1
Merge branch 'develop' of upstream into margin_rank_loss_op_dev
7 years ago
qiaolongfei
e8cad5a1d0
add more unit test for test_append_backward
7 years ago
kexinzhao
9995aed114
Implementing Softplus operator ( #4690 )
...
* implementing softplus
* small fix
* small fix
* small fix
* small fix
7 years ago
fengjiayi
f8267db657
Explose check_attr to Python
7 years ago
qiaolongfei
e9a0c4ef87
expose AppendBackward of ProgramDesc to python
7 years ago
kavyasrinet
1397e17f6b
Implemented the hardShrink activation ( #4653 )
...
* Implemented the hardShrink activation
* Fixing the unit test
7 years ago
Luo Tao
67dc606b32
Merge branch 'develop' into seqpool
7 years ago
fengjiayi
e621ff39e5
Follow comments
7 years ago
Siddharth Goyal
6604d7cda2
Add logsigmoid (numerically stable) and softshrink ( #4663 )
...
* Add numerically-stable logsigmoid activation
* Add softshrink operator
* Adjust relative tolerance for grad-check
* Address review comments
7 years ago
fengjiayi
afaac7896e
Refine code
7 years ago
fengjiayi
906f5e8a26
Fix unittest bugs
7 years ago
fengjiayi
e71b836f53
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into dev_opdesc_in_python
7 years ago
fengjiayi
247fb2a086
Add unittests
7 years ago
Yu Yang
f185af8d7b
Complete parameter
7 years ago
Yu Yang
0c37a06117
Merge branch 'feature/change_proto_to_desc' into feature/complete_variable_bind
7 years ago
Yu Yang
fb2ad4c949
Change PythonAPI `.proto` to `.desc`
7 years ago
Yu Yang
7506e4816b
Merge pull request #4660 from reyoung/feature/polish_infer_shape
...
Polish CompileTime InferShape
7 years ago
fengjiayi
cffca923b9
Change Proto to Desc
7 years ago
fengjiayi
5fddd288a6
Merge branch 'feature/add_persistable_in_var_desc' into dev_opdesc_in_python
7 years ago
Yu Yang
83dbc15055
Merge branch 'develop' of github.com:baidu/Paddle into feature/complete_variable_bind
7 years ago
fengjiayi
86451b3064
Update
7 years ago
Markus Kliegl
a281b38393
Conv Shift Operator ( #4591 )
...
* conv_shift_op: initial implementation using Eigen
Limitations:
- both gradient outputs must be specified and are always computed
- explicit for loops => could be optimized in various ways
(e.g., different memory layout)
* conv shift - gradient fixes
fix case when not all output gradients desired
* conv shift: minor cleanup
* conv shift - more minor cleanup
* conv shift: clean up & initial GPU implementation
* fix rebase issue
7 years ago
Yu Yang
7973d3a0ad
Merge pull request #4641 from reyoung/feature/add_persistable_in_var_desc
...
Init Python API
7 years ago
Yu Yang
69fd376bca
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into feature/polish_infer_shape
7 years ago
chengduo
0f1d3af438
Merge pull request #4461 from chengduoZH/Add_maxpool_withIdx_only
...
Add max pool op (with index)
7 years ago
Luo Tao
60f706a1d6
add SQRT strategy for sequence_pool_op
7 years ago
ranqiu
4545a058bd
add dot-product attention
7 years ago
Yancey1989
a4d410aec8
Merge branch 'develop' of github.com:PaddlePaddle/Paddle into seqconcat_op
7 years ago
Yancey1989
d211b51bd4
update comment
7 years ago
zhouxiao-coder
e6421249d5
update to latest
7 years ago
fengjiayi
a427855902
Update
7 years ago
Yu Yang
d350cdbc97
Polish CompileTime InferShape
...
1. InferShape should be a method for `OpDescBind` not `Operator`, since
`OpDescBind` is a compile-time concept.
2. Pre-create operators and store them into a map. Make InferShape
faster
7 years ago
QI JUN
9efd5422f9
Merge pull request #4655 from abhinavarora/fill_constant_op
...
Implementing the fill constant op for the executor
7 years ago
Tao Luo
ceefb555f7
Merge pull request #4500 from luotao1/interp
...
add interpolation op
7 years ago
fengjiayi
53222cb9c3
Add OpProtoHolder
7 years ago
Abhinav Arora
6efacc14d8
Implementing the fill constant op for the executor
7 years ago
Yu Yang
569616b329
Complete Variable for Python API
7 years ago
Yu Yang
1e41a675d4
Convert np.dtype to core.DataType
7 years ago
Yu Yang
68483f95a0
Merge branch 'develop' of github.com:baidu/Paddle into feature/add_persistable_in_var_desc
7 years ago
Yu Yang
61a5181e31
Add skeleton of Operator
7 years ago
Abhinav Arora
4cb5bd9021
Implementing the Adamax optimizer operator ( #4538 )
...
* Implementing the Adamax optimizer step operator
* Adding unit tests for adamax_op
* Changing learning rate and time step to inputs from attributes
* Changing learning rate and time step to input(tensors)
* Making the Adamax operator conform to naming convention
* Removing Tensor<float> from comments
* Rectifying the Adamax implementation
* Changing Unit Test values and adding comments
* Changing Unit Test to test multiple steps
7 years ago
Yu Yang
8f4771be22
Add skeleton of Variable
7 years ago
kavyasrinet
f30a1f42f0
Adding relu6 activation function ( #4607 )
7 years ago
Yu Yang
bedcf074a2
Implementation singleton
7 years ago
Yu Yang
3c39df197e
Init Python API
...
Following the design
* https://github.com/PaddlePaddle/Paddle/blob/develop/doc/design/python_api.md
Just written `Program`, `Block` and unittest of program.
7 years ago
Luo Tao
a06f099d9f
refine comment of interp_op
7 years ago
chengduoZH
fcfce48421
follow coments
7 years ago
typhoonzero
282435204e
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into auc_op
7 years ago
zhouxiao-coder
53574e54a1
reslove merge conflict;reimplement ELU activation with functor
7 years ago
武毅
3f874143fe
fix grad debug event ( #4536 )
7 years ago
Luo Tao
4724bdbe68
Merge branch 'develop' into interp
7 years ago
caoying03
dcfbbd3f1d
Merge branch 'develop' into crf
7 years ago
Yi Wang
99895730f7
Merge pull request #4609 from kavyasrinet/tanhshrink
...
Implementing tanhshrink operator
7 years ago
Yan Chunwei
20a6ae7f1f
Feature/tensor array add python binding ( #4616 )
7 years ago
qiaolongfei
ffe1b69229
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into add_compile_time_infershape
7 years ago
kexinzhao
087addaa76
Merge pull request #4558 from kexinzhao/adagrad_op
...
Implementing the Adagrad optimizer step operator
7 years ago
Kexin Zhao
78f4c803f3
change learning rate and fix format
7 years ago
Kavya Srinet
0336304176
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into rmsprop
7 years ago
Kavya Srinet
154a6ed29c
Implementing tanhshrink operator
7 years ago
qiaolongfei
628715d602
clean code
7 years ago
qiaolongfei
352af966d7
add python unit test
7 years ago
kavyasrinet
3e2be065b9
Merge pull request #4604 from kavyasrinet/activations
...
Added Leaky Relu activation
7 years ago
sidgoyal78
c10da26cf5
Modify implementation
7 years ago
Abhinav Arora
828c5b3e1d
Adding Adadelta optimization operator ( #4576 )
...
* Adding Adadelta optimization operator
* Making inputs and outputs conform to naming convention
* Removing type alias from header files
* Fixing Adadelta documentation in comments
* Addressing code review feedback
7 years ago
Kavya Srinet
11070e5f36
Updated the reltive error
7 years ago
Kavya Srinet
60af56c1b8
Added Leaky Relu activation
7 years ago
qiaolongfei
5917e09cde
tmp work
7 years ago
Kavya Srinet
fa12e51675
Adding the default attribute test case
7 years ago
Kavya Srinet
94855f4af0
Fixed changes proposed in the review
7 years ago
Abhinav Arora
eed2c1e1d6
Changing SGD inputs and outputs to conform to Operator naming convention ( #4586 )
7 years ago
Abhinav Arora
324876bbbf
Changing learning rate from type Input(float) to Input(tensor) ( #4578 )
7 years ago
zchen0211
94b94e5b68
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into develop
7 years ago
sidgoyal78
d28b3094dd
Add momentum operator
7 years ago
Abhinav Arora
42e7fe05a2
Changing learning rate from attribute to input(float) ( #4568 )
...
* Changing learning rate from attribute to input(float)
* Removing obsolete code
7 years ago
Kavya Srinet
163d287143
Made learning rate the input
7 years ago
Kexin Zhao
d1de7ec630
Change learning rate from attribute to input tensor
7 years ago
Kavya Srinet
61c03f9d59
Adding the implementation for rmsprop operator
7 years ago
zchen0211
58174b12f7
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into develop
7 years ago
Kexin Zhao
1ac654a69f
Implementing the Adagrad optimizer step operator
7 years ago
qiaolongfei
32f5c9dd93
recurrent_op pass the unit test
7 years ago
zchen0211
15941dbd8c
solve conflict for cond_op and scatter
7 years ago
qiaolongfei
7163dd0413
revert code
7 years ago
caoying03
be8bef9bdd
Merge branch 'develop' into add_config_helper_for_resize_layer
7 years ago
chengduoZH
14b2c98f90
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into Add_maxpool_withIdx_only
7 years ago
qiaolongfei
af6f3c0423
use float32 in cond_op
7 years ago
Yu Yang
0900aedfa0
Merge pull request #4514 from reyoung/feature/remove_add_op
...
Remove add_op since it can be replaced by sum_op
7 years ago
caoying03
480154896c
add configuration helper for resize layer.
7 years ago
chengduoZH
2ed56df1e6
remove conflict
7 years ago
chengduoZH
6fc44800ed
fix unit test
7 years ago
chengduoZH
bee95fc891
fix code format and some bug
7 years ago
Yancey1989
a35e82a649
Merge branch 'develop' of github.com:PaddlePaddle/Paddle into seqconcat_op
7 years ago
chengduo
4f5491b2b4
Merge pull request #4146 from chengduoZH/Add_pool_op
...
Add pool op
7 years ago
chengduoZH
6abcb74c8f
fix unit test class name
7 years ago