* fix dropout bug in backward when input is 1d tensor, test=develop
* add test case and refine error message, test=develop
* refine error message, test=develop
* Add RNN related apis in paddl.nn
test=develop
* new rnn api, cell almost done
* add new progresses in rnn APIs for 2.0
* refine rnn APIs and docstrings.
* add unittets
* disable gpu tests when paddle is not compiled with cuda support
* remove unnecessary imports
* fix docstring
* add to no_sample wlist
* backport to python2 to avoid yield from
* add **kwargs, fix typos
* update docstrings for birnn
* rename argument for SimpleRNN and SimpleRNNCell, fix sample code
* add default value for initial_states in fluid.layers.birnn
Co-authored-by: guosheng <guosheng@baidu.com>
* Enhance affine grid operator:
1. Add cuda kernel
2. Add align corners options
test=develop
* Move new affine_grid api to functional
test=develop
* Add CUDA kernel for affine_grid.
test=develop
* Add more unitest for grid sample API
test=develop
* add pool2d3d API,test=develop
* add api unitest,test=develop
* fix unittest, test=develop
* fix reviews, test=develop
* return one element when return indices is true, test=develop
* fix low converage; to_variable to to_tensor, test=develop
* sort API params, test=develop
* fix en doc, merge PR#26108 to here, test=develop
* fix en doc, test=develop
This PR enhance CPU kernel and add new CUDA kernel to make grid_sample support:
- align_corners: with bool type.
- padding mode: which can be in ['zeros', 'reflect', 'border']
- Interpolation mode: which ca be in ['bilinear', 'nearest']
The old CPU and CUDNN version only support align_corners=true, padding_mode='zeros' and interpolation_mode='bilinear'.
The behavior of the new version op in default mode is compatible with the old version.
* Add MultiHeadAttention api.
test=develop
* Add MultiHeadAttention cache type and gen_cache.
test=develop
* Add TransformerEncoderLayer and TransformerEncoder.
test=develop
* Add Transformer decoder apis.
test=develop
* Add Transformer api.
test=develop
* add unittests for transformer api
* add unittests for transformer api
* Fix some bugs in Transformer apis.
test=develop
* add unittests for encoder, decoder and transformer
* clean conflicts infor in code
* clean Chinese comments
* Add TransformerDecoderCell and TransformerBeamSearchDecoder.
test=develop
* Remove TransformerDecoderCell and TransformerBeamSearchDecoder temporarily.
test=develop
* Add import for Transformer apis.
test=develop
* Update usage of weight_attr and Tensor in Transformer api docs.
test=develop
* Update Transformer apis by renaming MultiheadAttention and cal_kv according to comments.
test=develop
* Fix MultiHeadAttention in test_transformer_api.py.
test=develop
Co-authored-by: LiuChiaChi <709153940@qq.com>
* add alpha_dropout in nn.functional and nn.layer, test=develop
* refine Interface and assertion, test=develop
* fix ci import error, test=develop
* fix alias and use layers.scale, test=develop
* fix doc and training params, test=develop
* refine details in doc, test=develop
* fix doc details, test=develop
* [API2.0] add dropout, dropout2d and dropout3d, test=develop
* refine Interface and assertion after review, test=develop
* fix alias p=1 and use scale, test=develop
* fix doc and training, test=develop
* fix doc in Dropout2D, test=develop
* add cross_entropy to nn/layer and nn/functional, test=develop
* use functional/cross_entropy in layer/CrossEntropy
* use functional/cross_entropy in layer/CrossEntropy, test=develop
* add input.py file
* write input.py
* fix init file
* add unit tests
* fix dygraph and input shape
* Revert "fix dygraph and input shape"
This reverts commit 89ad8664124c1872640b68c0a4418c377ad6aa6f.
* fixed pylint
* fix deprecated
* fix old op
* fix old op
* set check_dygraph=True
* Revert "set check_dygraph=True"
This reverts commit a8e93e33281f84e5f6fbc2b4bf05ea3e63611519.
* test commit
* fix doc and change test file name
* add pad func
* add pad
* test=develop, add pad op and apis
* restore pad2d
* test=develop, fix paddl declare
* fix pad interface
* test=develop, fix pad
* test=develop, add all pad api and cos_sim
* test=develop, remove padding default value
* test=develop, rename var to tensor
* test=develop, add more tests
* test=develop, rename tovar to totensor
* test=develop, fix init
* test=develop, add more test
* test=develop, add more tests
* expose and unify the Tensor concepts to the user
* expose tensor to user
* add copy place for Tensor
* add copy place for Tensor
* add note
* add macro PADDLE_WITH_CUDA
* remove RUN_TYPE=DIST
* fix some error
* add alias in paddle.nn and paddle.tensor test=develop
* add alias in paddle.nn and paddle.tensor dir test=develop
* fix same conflict manually test=develop
* update fc and dygraph alias test=develop
* fix initalizer.py typo test=develop
* Indent MSELoss example docs
* Point out input tensors should be of same shape
test=develop
* Document `MSELoss` input and return parameters
test=develop,test=document_fix
* add diag_embed op, test=develop
* add TestCase of diag_embed API
* Modified diag embed python API teastcase from dygraph to static graph, test=develop
* delete useless log and trigger ci, test=develop
* modified float16 of diag_embed, test=develop
* modified en doc of diag_embed
* trigger ci, test=develop
* add fp16 in dtype check of python API, test=develop
* modified __init__ and fix a big, test=develop
* modified a test bug of test_bicubic_interp_op and test_trilinear_interp_op, test=develop
* modified to use one kernel on cpu and cuda, test=develop
* Add `paddle.nn.loss.MSELoss`
test=develop
* Move to `nn/layer/loss.py`
test=develop
* Add test
test=develop
* Fix dygraph
test=develop
* Increase numel in test
test=develop
* Add test for input with more dimensions
test=develop
Zhou Wei
huangjun12
ruri
LielinJiang
zhang wenhui
Guo Sheng
Bai Yifan
tangwei12
Zhong Hui
ceci3
LutaoChu
hong19860320
littletomatodonkey
donproc
Feiyu Chan
xiaoting
zhupengyang
wanghuancoder
Qi Li
whs
yukavio
wanghuancoder
Double_V
ShenLiang
Li Fuchen
WangXi
wawltor
chajchaj
Yang Zhang
Aurelius84
Guanghua Yu
Chen Weihang
Jack Zhou
yaoxuefeng
FDInSky
XiaoguangHu
hong
swtkiwi
zhongpu
Li Fuchen