70 Commits (87e75a77c2e80bdf720d394f9b9e1ef3b0a731a9)

Author	SHA1	Message	Date
joejiong	87e75a77c2	Add tangent operator (#29207) ... As the title	5 years ago
joejiong	32b90b1c2d	add log10 (#28576) ... Add new operator log10	5 years ago
joejiong	08d2413142	add log2 operator (#28319) ... As the title	5 years ago
Jack Zhou	d37b3774fd	register log double grad kernel for cpu and cuda ... register log double grad kernel for cpu and cuda	5 years ago
Zhong Hui	fab4e6d08f	add abs support double grad ... add abs support double grad for the api 2.0	5 years ago
Qi Li	6f69fbc8ea	fix elu grad whne alpha less then zero, test=develop (#26543)	5 years ago
zhupengyang	f8863e0603	leaky_relu and LeakyReLU: alpha->negative_slope (#26216)	5 years ago
zhupengyang	4ad504e7c7	hardshrink: support threshold < 0 (#26403)	5 years ago
hong19860320	40d193ed17	Add the ReLU6, Tanhshrink, SELU, Softplus, Softshrink and Softsign for the api 2.0 (#26376)	5 years ago
cnn	70cee22fde	New features, add sinh and cosh op, test=develop (#25495) ... * New features, add sinh and cosh op, test=develop * remove duplicate test function and remove out paramters, test=develop * Add out paramters temporary, remove later. test=develop * remove out args, PR 25570, test=develop * remove TestParameter, test=developx * add test api for static dygraph, test=develop * add backword unittests for sinh and cosh, test=develop	5 years ago
Zhang Ting	b71abeee1b	use 32 bit index to improve activation ops (#24206) ... * improve activation ops performance, test=develop * use 32bit only GPU computation, test=develop	5 years ago
danleifeng	222a5137b3	Add new tensor in API2.0: max,min,t,eye,log1p (#23228) ... add new tensor: max,min,t,eye,log1p; test=develop	5 years ago
Steffy-zxf	ac4da77aa6	update error info of ops，add some test cases for raise message (#23750) ... 1. update error info of the ops (abs, acos, asin, atan, ceil, cos, exp, floor, log, pow, reciprocal, round, rsqrt, sin, sqrt, square, tanh) 2. add the unittests of the above refered ops (test error info)	5 years ago
Chen Weihang	16315d3d9e	Delete Ref & VectorRef and add GetDataSafely (#22997) ... * delete invalid check inferface Ref & VectorRef, test=develop * fix vector ref delete error, test=develop * try the new check inferface, test=develop * change all related code with new check macro, test=develop * remove static assert, test=develop * polish detail, test=develop * skip coverage problem, test=develop * add new check macro, test=develop	5 years ago
Feiyu Chan	01ab8a0619	add approximation for gelu, test=develop (#22961) ... add approximation for gelu, default value is False (only kernel with eigen is added, remove code for computing gelu with MKLDNN temporarily)	5 years ago
Double_V	fab4b0765a	support elu_op double grad (#21822) ... * support elu activation double grad,test=develop * delete the code commit in .cc,test=develop * fix relu test unpass, test=develop * add elu double grad kernel and unit test * add caculate dX in elu double grad functor, test=develop * update the commit code,test=develop	6 years ago
SunAhong1993	7f4abaf2f5	register int/int64_t/float16 in pow/square kernel,test=develop (#22023) ... * register int/int64_t/float16 in pow/square kernel,test=develop * add abs/square/exp type,test=develop	6 years ago
Leo Chen	add62acfd1	remove kDepXOut for abs_grad op, test=develop (#21407)	6 years ago
hong	ac8546701d	Add dygraph execution context (#20157) ... * add_dygraph_execution_context * add dygraph infershape context and execution context; test=develop * fix imperative bug; test=develop * remove inputs outputs interface from execution context, because it have same function with inputNames; test=develop * remove tracer_test ctest; test=develop * fix split op bug; test=develop * fix unitests bug; test=develop * fix distribute test bug; test=develop * fix ngraph compile bug; test=develop * fix grad maker bug; test=develop * fix load op bugs; test=develop * fix operator.cc construct bug; test=develop * remove useless name find in operator; test=develop * add tracer_test; test=develop * fix concat, split bug; test=develop * remove tracer_test unitest; test=develop * fix attribute check bug; test=develop * add test code to fix converage; test=develop * remove useless code, change check backward input in engin; test=develop * unlock var type infer shape;test=develop * add ShareAllLoD api; test=develop * add dygraph infershape context unitest; test=develop * remove increase and decrease lod in dygraph; test=develop * addd override; test=develop * fix increase descrease lod; test=develop * fix paddle_enforce; test=develop * disable lod op dygraph check; test=develop * fix paddle enforce error; test=develop * add comment for op_registry and OperatorBase; test=develop * optimize the comment of op_registry; test=develop * fix format of comment; test=develop * fix format of comment; test=develop * optimize the format of comment; test=develop * optimize the format of the comment; test=develop * optimize comment of op_registry; test=develop	6 years ago
Adam	d623e863c9	Fix GELU grad error (#21204) ... test=develop	6 years ago
Zeng Jinle	10505faf4e	polish codes, test=develop (#20672)	6 years ago
Leo Chen	982e61f5ff	Update elementwise double grad to save gpu memory (#19509) ... * update elementwise double grad to save gpu memory, test=develop * update elementwise_mul/div_grad_grad to save memory, test=develop * remove eval function in eigen statement to save memory, test=develop * add unittest for elementwise_div_grad_grad without dout, test=develop * add unittest for elementwise_add_grad_grad without ddx, test=develop * add float16 cuda kernel for elementwise double grad op, test=develop	6 years ago
Zeng Jinle	cabb9501bd	fix leaky_relu op when alpha is zero, test=develop (#19833)	6 years ago
liym27	677e714425	fix pow op, support tensor for agument factor. (#19313) ... improve pow op according to reviews: 1. Delete unnecessary judgement statements in PowGradOpDescMaker; 2. Improve test of test_api; overload GetKernelTypeForVar add stop_gradient=True when attr(factor) is tensor Variable, change examples in API pow. test=develop,test=document_preview	6 years ago
Zeng Jinle	0daa5c9772	Make leaky relu inplacable (#19676) ... * make leaky relu inplacable, test=develop * force add unittests to pass coverage, test=develop	6 years ago
huangjun12	20f18930ae	Add hard swish op (new op) (#19001) ... * add hard_swish activation op (new op) test=develop * remove redundancy files * modify document content of HardSwish OP * add API test in test_layers.py * add dynamic_graph for test_hard_swish	6 years ago
Zeng Jinle	88f111f885	remove unused inplace act codes, test=develop (#19079)	6 years ago
Leo Zhao	86e494eb64	use mkl to accelerate gelu_grad (#18099) ... test=develop	6 years ago
Tao Luo	bd22453f20	Revert "Add LeakyRelu MKLDNN support (#18656)" (#18723) ... test=develop	6 years ago
Adam	d6b6a337a9	Add LeakyRelu MKLDNN support (#18656) ... test=develop	6 years ago
qingqing01	80d2e66f9e	Update backward appending stragety to support double backward and fix some bug. (#18104) ... * Update backward.py: - If there is no input grad var in all outputs of previous ops, do not append this op into graph. - Only apply this stragety when double backward. * Update some double backward op. * Update sum_op to judge whether a tensor is empty by numel or IsInitialized().	6 years ago
lvmengsi	4ef631013c	Double backward sqrt (#17387) ... * double backward sqrt * refine unittest. test=develop * refine test. test=develop * remove alpha in unittest. test=develop	6 years ago
Kaipeng Deng	11d3a38f25	add double grad for square op (#17173) ... * add double grad for square. test=develop * formax code. test=develop * fix for grad sum. test=develop * refine shape. test=develop * refine extract. test=develop	6 years ago
Zeng Jinle	28d69d710a	Refine dropout gpu memory (#17095) ... * refine_dropout_mem,test=develop * # This is a combination of 14 commits. # The first commit's message is: remove ut test_dist_word2vec in mac ci, will fix it in private, test=develop (#17066) # This is the 2nd commit message: Fleet unify distributed training (#16791) * implement distributed transpiler with fleet # This is the 3rd commit message: ParallelDyGraph with GPU collective mode (#16827) implement dygraph.parallel.DataParallel to hook reduce op. # This is the 4th commit message: Init mixed precision training interface (#16856) * Init mixed precision training interface * Add fp16 test script test=develop * All initializers support float16 test=develop * Code cleanup & add more code annotations test=develop * Update API spec test=develop * Add usage example in doc test=develop # This is the 5th commit message: fix reference_count_pass,test=develop (#17060) test=develop # This is the 6th commit message: Speedup roi_perspective_transform op by caching the information of linear interpolation in forward (#17090) * Cache the information of linear interpolation in forward and use it in backward. test=develop * Fix cuda kernel. test=develop # This is the 7th commit message: remove unnecessary prepare_data (#17080) test=develop # This is the 8th commit message: fix interpolate cu. test=develop (#17101) # This is the 9th commit message: test=develop, double backward leaky_relu (#17067) backward of backward: leaky_relu # This is the 10th commit message: fix fuse optimizer ops (#17102) test=develop # This is the 11th commit message: truncated_gaussian_random supported in distributed training, test=develop (#17091) # This is the 12th commit message: Detailed coordinate description for yolov3 loss (#17007) * Detailed coordinate description for yolov3 loss test=develop * modified api.spec test=develop * modified loss name * fix api.spec test=develop * polish description test=develop * modified api.spec test=develop # This is the 13th commit message: fix test_weight_decay (#17109) test=develop # This is the 14th commit message: Path flag (#17105) * fix python/paddle/fluid/__init__.py detecting problems	6 years ago
ceci3	258e000be6	test=develop, double backward leaky_relu (#17067) ... backward of backward: leaky_relu	6 years ago
qingqing01	c1c2633a63	Support backward of backward for Relu and add a new gradient checker by comparing theoretical and numerical Jacobian. (#16862) ... * Support backward of backward and a new gradient checker * Rename decorators.py to decorator_helper.py, since Python on Windows CI has decorators package. 1. Add ReluDoubleGradMaker when register relu_grad. 2. Add a new gradient checker by comparing theoretical and numerical Jacobian. Check double gradients by double_grad_check.	6 years ago
zhoukunsheng	b1c5820b3f	fix merge conflict	6 years ago
zhoukunsheng	2b2b4ca21e	Merge branch 'develop' into rsqrt	6 years ago
Zeng Jinle	9f7b027dce	fix activation grad op desc maker (#16715) ... test=develop	6 years ago
zhoukunsheng	91ba75000c	fix type conversion problem in rsqrt functor	6 years ago
zhoukunsheng	c47f3cc7fe	test=develop ... add rsqrt op	6 years ago
tink2123	837ad7f86f	Add the inverse trigonometric function ... test=develop	6 years ago
Tao Luo	4efdebc6f6	Merge pull request #15931 from yihuaxu/develop_2c5c7b2a7_gelu_mkl_opt ... Optimize gelu operation with mkl erf	6 years ago
dzhwinter	225c11a91f	polish cudnn related code and fix bug. (#15164) ... * staged. * polish code * polish code. test=develop * polish code. test=develop * api change. test=develop * fix default value. test=develop * fix default value. test=develop	6 years ago
Yihua Xu	7396788694	Optimize gelu operation with mkl erf. ... test=develop	6 years ago
tensor-tang	ee2321debd	Revert 15770 develop a6910f900 gelu mkl opt (#15872) ... * Revert "Optimze Gelu with MKL Erf function (#15770)" This reverts commit 676995c86c. * test=develop	6 years ago
Yihua Xu	676995c86c	Optimze Gelu with MKL Erf function (#15770) ... * Optimize for gelu operator * Set up the low accuracy mode of MKL ERF function. test=develop * Only enable MKLML ERF when OS is linux * Use the speical mklml version included vmsErf function to verify gelu mkl kernel. test=develop * Add the CUDA macro to avoid NVCC's compile issue. test=develop * Add the TODO comments for mklml library modification. test=develop * Clean Code test=develop * Add the comment of marco for NVCC compiler. test=develop	6 years ago
Yibing Liu	6951ef9a55	Fix the gelu backward to avoid nan (#14857) ... * Fix the gelu backward to avoid nan test=develop * Remove unnecessary calls test=develop	7 years ago
chengduo	04539d4c5d	Fix clip.py (#14718) ... * expose square test=develop * fix activation test=develop * Add square API test=develop * add necessary op * code refine * fix API.spec test=develop * fix unit test test=develop * add unit test sparse_grad_clip test=develop * fix API.spec test=develop * remove mac test for test_gradient_clip test=develop * remove selectedrows_mul_tensor test=develop	7 years ago
minqiyang	a02ce58f2c	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into revert_vlog ... test=develop	7 years ago