692 Commits (7c55a94de51b1de42bd444c0d8ab20c9eeabcb4e)

Author	SHA1	Message	Date
songyouwei	99d30bfc36	speedup slice impl (#23340) ... test=develop	6 years ago
Leo Chen	488b2387e2	Feature/expand params in auto-generated pybind functions for dygraph operators (#23181) ... * expand parameters, test=develop * support resnet, test=develop * fix resnet, test=develop * support duplicable out, test=develop * support ptb * fix bugs, test=develop * support null input, test=develop * fix bugs, test=develop * fix batchNorm is_test, test=develop * refine code, test=develop * follow comments, test=develop * follow comments, test=develop * follow comments, test=develop * follow comments, test=develop	6 years ago
Zeng Jinle	babda94c8a	Distinguish public/private global vars (#23269) ... * distinguish public/private vars, test=develop * fix windows issues, test=develop	6 years ago
Zeng Jinle	8bfd62ffb7	Expose dygraph.grad api (#23124) ... * expose dygraph.grad api, test=develop, test=document_fix * add more parameter in dygraph.grad API, test=develop * add only_inputs=True parameter, test=develop * follow comments, test=develop, test=document_fix * fix typo, test=develop, test=document_fix	6 years ago
Zhaolong Xing	430b0099c9	[Paddle-TRT]: Ernie Dynamic shape support. (#23138) ... * add dynamic plugin support. test=develop * change emb eltwise layernorm to math function test=develop * add emb eltwise layernorm test=develop * can run dynamic shape ernie test=develop * fix ci test=develop * add ut for trt ernie dynamic test=develop * refine dynamic shape c++ interface. test=develop * fix comments test=develop * fix comments test=develop	6 years ago
xujiaqi01	68ea1ad55b	add clear one table (#23089) ... * add clear_one_table * test=develop	6 years ago
Zeng Jinle	acfc9b8a70	Reader sequential and inference partial feed (#22699) ... * sequential reader stage 1, test=develop * fix ut, test=develop * fix iterable=False reset bug, add some logs and polish code, test=develop * inference feed partial data, test=develop * Turn on keep_order=True for test, test=develop * enhance ut to test more cases, test=develop * test commit for reverting * Revert "test commit for reverting", test=develop This reverts commit 80aef42ef52ba1ee79627d6f663a624ec4f12f58. * add ut of merged and unmerged results, test=develop * add more uts for coverages and add en doc of api, test=develop * follow comments, test=develop * change note style, test=develop	6 years ago
Zeng Jinle	a31d7328b7	Add dygraph double grad implementation (#22939) ... * add double grad implementation for dygraph, test=develop * polish code, add uts, test=develop * fix place bug, test=develop * polish codes, add more uts for coverages, test=develop * add no_grad_set, test=develop * add star gan ut, test=develop * follow comments, test=develop	6 years ago
songyouwei	2e2da7124b	high-performance dygraph slice (#22879) ... * move __getitem__ to cpp * bug fix * add type check and gil release * support negative step with omitted ends test=develop * code refine test=develop * bug fix test=develop * slice always return different pyobj test=develop	6 years ago
zhaoyuchen2018	a020a25797	Fix model int8 quant fail, test=develop (#22891) ... As model fails when enable int8 quant, so disable allocate memory in cpu for small variable.	6 years ago
Zhaolong Xing	dd67d44a50	[Paddle-TRT] : (Part1) Dynamic shape support (#22868) ... * change the ci trt from version 5. to 6.0 * paddle-trt dynamic shape support init * conv+bias or conv+bn dynamic shape support test=develop * modity trt engine opconvert test=develop * fix ci error test=develop	6 years ago
Zeng Jinle	d41d802ba3	Add flags to limit gpu memory (#22793) ... * add recorded cuda memory apis, fix typo, test=develop * add more ut, test=develop * follow comments, test=develop * fix py35 incompatible issues, test=develop	6 years ago
石晓伟	1861ca88f1	serialize the PaddleTensor, test=develop (#22810) ... * encapsulate the PaddleTensorToLoDTensor, test=develop * serialize the pd_tensor, test=develop * serialize tensors to file, test=develop	6 years ago
Zhang Ting	4e8bc02461	add fluid.device_guard to specify the device type for Op (#22254) ... * add fluid.device_guard to specify the device type for Op	6 years ago
Zhen Wang	89cfa49156	Unmerged fetch list (#22635) ... * update ScopeBufferedSSAGraphExecutor&AsyncSSAGraphExecutor&ThreadedSSAGraphExecutor&FastThreadedSSAGraphExecutor&ParallelSSAGraphExecutor&ParallelExecutor for fetching unmerged results. * add the unit test for fetch_unmerged. * update ut for multi-card and multi-cpu. * add the error message and the user suggestion in FetchOpHandle. test=develop	6 years ago
Chen Weihang	7d8d573453	Speed up dygraph DataLoader based on shared memory and LoDTensor serialization (#22541) ... * add lodtensor share memory & serialization, test=develop * fix windows compile error, test=develop * deal vartype pickle & fix unittest matching error message, test=develop * update timeout variable name, test=develop * refactor memory map implement, test=develop * clear mmap file discripter when exit unexpectedly, test=develop * remove the child process fd in advance, test=develop * remove mmap fds after Queue.put in child process, test=develop * add hard unittests for register exit func, test=develop * fix python2 compatibility problem in unittest, test=develop * fix exception unittest error, test=develop * polish code based review comment, test=develop	6 years ago
hutuxian	53a2b68f4e	support customized download command in dataset (#22782) ... * user can call dataset.set_download_cmd to set its customized download cmd * add UT to cover this scenario	6 years ago
zhaoyuchen2018	72dde4abde	Refine adam op to improve performance, test=develop (#22346) ... * Refine adam op, test=develop * Fuse kernels together to reduce cpu time. * Refine paddle enforce, test=develop * Remove some comments, test=develop * Refine code,test=develop * Refine cuda kernel, test=develop * Refine code according to comments, test=develop	6 years ago
Leo Chen	b2c1be851a	support cond in clone, test=develop (#22657) ... * support cond in clone, test=develop * refine code, test=develop * refine code, test=develop * follow comments, test=develop * refine code, test=develop	6 years ago
hutuxian	175954d894	PaddleBox Framework Part2 (#22466) ... * Add two types of Metric Calculator: MultiTaskCalculator & CmatchRankCalculator. * Add a config for DynamicAdjustChannelNum function to denote whether we will discard the remaining instances when they are not be distributed evenly. * Remove CPU code in Pull/PushSparse and we will add it back when testing it fully. * Fix some known issues: such as copying persistable vars after one epoch running.	6 years ago
tianshuo78520a	d2ba91aad1	fix typo words (#22653)	6 years ago
tangwei12	66a3150135	SYNC with communicaotor (#22344) ... * add sync communicator and implement	6 years ago
wangchaochaohu	c65c6ae534	add flag to control profile level in python API (#22319) ... * add python flag to control profile level test=develop	6 years ago
tangwei12	b0675c8193	fix bug with compiledProgram (#22495) ... * add thread barrier for the compiled program	6 years ago
yaoxuefeng	2235ee1a5e	multi-loss optimization by adding a DownpourOpt worker (#22025) ... * update * update test=develop * update compile set test=develop * update compile set test=develop * update test=develop * update test=develop * update test=develop * update compile setting test=develop * update compile setting test=develop * update run demo test=develop * update test=develop * update test=develop * fix test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update format test=develop * update format test=develop * update style test=develop * update style test=develop * change style test=develop * change style test=develop * change style test=develop * add dataset unittest test=develop * update test=develop * update for record test=develop * udpate style for record test=develop * update for record test=develop * update for record test=develop * update for record test=develop * fix format test=develop * update test=develop * update test=develop * update test=develop * update test=develop * update test=develop	6 years ago
Wilber	de009152a7	Compile without nccl deps. [2/2] (#22484) ... Compile without nccl deps. [1/2] Co-authored-by: 石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>	6 years ago
Yiqun Liu	dcfb603897	Enable the detection of subgraph composed of grad ops (#21223) ... * Add the first implememtation of fusion_group op #19621 (#3) * Add the dynamic load of nvrtc, and support runtime compiling of CUDA kernel using nvrtc. test=develop * Call CUDA driver api to launch the kernel compiled by nvrtc. test=develop * Disable for mac and windows. test=develop * Refine the codes to support manually specified num_threads and workload_per_thread. test=develop * Refine the CUDA kernel to support large dims. test=develop * Add DeviceCodePool to manage all device codes. * Add the first implementation fusion_group op. * Add unit-test for fusion_group op. * Add the check of result. * Add the check of nvrtc in unit-test. test=develop * Add comment to explain the inputs, outputs and features of fusion_group op. test=develop * Disable fusion_group op for mac and windows. test=develop * Make the compiling of device code return status instead of hanging up. test=develop * Add the check of whether there is CUDA driver library, and do not core dump when failing to call the CUDA driver API. * Unify fusion_group_op's input and output names. test=develop * Add the check of CUDA driver library in unittest. test=develop * Enable generating code for a given subgraph. #21126 (#4) * Enable generating code for a given subgraph. * Support sorting the subgraph. * Remove the rearange of expressions because we use the sorted subgraph directly. * Enable generating code for a subgraph which is composed of grad ops. * Use expression information to check the accuracy in unittest. * Separate load and store from computation expressions. test=develop * Improve the loading statements in generated codes. test=develop * Remove unused arguments from formal list. test=develop * Enable the detection of subgraph of grad ops. * Generate code for detected subgraph in fusion_group_pass. * Add an option in BuildStrategy to enable fusion_group_pass and add unittest. test=develop * Fix a bug when checking whether the shape of all inputs are the same. * Add debug information. * Remove subgraph_detector from inference/analysis to the common framework/ir directory. (#5) test=develop * Call subgraph_detector in fusion_group pass. test=develop * Disable fusion_group when WITH_GPU is OFF. test=develop * Refine all PADDLE_ENFORCE message. test=develop * Fix the case that some inputs are not defined in grad ops, and set op_role for fused op. test=develop * Follow review comments. test=develop	6 years ago
Wilber	7bc4b09500	add WITH_NCCL option for cmake. (#22384) ... cmake选项中添加了WITH_NCCL，显示指定是否编译NCCL的部分代码，WITH_NCCL默认打开，但如果WITH_GPU为OFF，则关闭WITH_NCCL 添加了PADDLE_WITH_NCCL定义 单机单卡能够关闭NCCL编译，多卡的话需要默认打开NCCL，如果关闭NCCL，则只能使用单卡 Co-authored-by: 石晓伟 <39303645+Shixiaowei02@users.noreply.github.com>	6 years ago
Leo Chen	822e5b36ec	Support int16 for Tensor (#22423) ... * add int16 support, test=develop * add test, test=develop * fix typo, test=develop * fix dtype error in slice, test=develop	6 years ago
石晓伟	e1b0d7cbb1	remove anakin from code, test=develop (#22420)	6 years ago
xujiaqi01	371f377bea	add GeneralRoleMaker (#22295) ... * add GeneralRoleMaker which is for general usage * test=develop	6 years ago
Leo Chen	b96c7c9a7a	polish code, test=develop (#22380) ... remove unnecessary template.	6 years ago
Leo Chen	aaa4fe491a	use function instead of lambda, test=develop (#22348) ... * use function instead of lambda, test=develop * follow comments, test=develop	6 years ago
Yiqun Liu	b7cac50b64	Implement a common python unittest to test the ir passes. (#22209) ... * Implement a common python unittest to test the ir passes. test=develop * Save the results in np.array and support to startup on CPU. test=develop * Fix the unittest. test=develop * Add check_program to check whether the optimized program is different from the origin one. test=develop * Remove the inferface all_ops. test=develop * Add exception test in pass_test. test=develop	6 years ago
tangwei12	82bc814a57	integrated HALF_ASYNC to communicator (#21869) ... * add half_async in the communicator * fix DistributedStrategy	6 years ago
Chen Weihang	35efbe6d95	Speeding up dygraph DataLoader with multiprocessing (#21762) ... * add multiprocess for dygraph data loader, test=develop * polish code & add safe gurad, test=develop * refactor dygraph dataloader & add signal handler, test=develop * fix member initializer compile error on ci, test=develop * fix member initializer compile error one more, test=develop * remove useless config, test=develop * skip windows incompatible problem, test=develop * add unittest for coverage, test=coverage * add more exception unittest case, test=develop * deal with signal handler coverage, test=develop * polish code & add signal handler tests, test=develop * deal with coverage ci problem, test=develop * split data loader test & coverage ci fix, test=develop * remove test_imperative_data_loader_with_exception, test=develop * remove singal process except test case, test=develop * add exception tests again & remove sample list test, test=develop * split normal and exception unittests to diff class, test=develop * polish doc for use_multiprocess effect in static mode, test=develop	6 years ago
xujiaqi01	e3a457d34b	add collective communication library in fleet (#22211) ... * add collective communication library in fleet to replace mpi * test=develop	7 years ago
Zhen Wang	46189b166d	Add bn and relu fuse pass (#22048) ... * add bn and relu fuse pass * add op attr assert and dtype assert * fix some inputs&&outputs bugs for the fused op and pattern. * add the unittest for fuse_bn_act_pass. test=develop * use normative enforce statements. test=develop * add the cpu test. test=develop * add the support of batch_size=1 for the bn with relu op. test=develop * add the error type for paddle throws. test=develop * add fused_batch_norm_act and fused_batch_norm_act_grad to op_has_unsed_vars_white_list. test=develop	7 years ago
zhongpu	cf475f95df	Remove FC in dygraph, modify FC to Linear in sample code (#22082) ... * modify fc to linear in sample code, test=develop * remove FC, test=develop * remove warnings, test=develop * drop fluid/imperative/README.md , test=develop * change fc to linear, test=develop * polish code style, test=develop	7 years ago
Huihuang Zheng	dd4361568e	Add ParallelExecutor Test for Cond API and Fix PE Checks Shape Bug (#22029)	7 years ago
123malin	7fb817d447	add distributed_strategy (#21710) ... * add distributed_strategy	7 years ago
zhouwei25	2df4be5d35	Fix openblas bug to support compile on windows when WITH_MKL=OFF (#21902) ... * Fix openblas to support compile on Windows when WITH_MKL=OFF	7 years ago
flame	2bbc0d7d60	python zero copy inference, delete pass (#21897) ... * python zero copy inference * support delete inference pass	7 years ago
Zeng Jinle	aa4d6a5d6c	Add some debug flags to auto growth allocator (#21766) ... * add some debug flags to auto growth allocator, test=develop * add comments about auto growth, test=develop	7 years ago
Huihuang Zheng	557bce77da	Fix Backward Bugs in Conditional Block (#21809) ... The fixed bugs: 1. The condition sub-graph is not pruned 2. When backward graph is extremely simple, the whole backward ops are pruned.	7 years ago
xujiaqi01	0eb4d990c4	fix compiled error when with_pslib=on (#21769) ... * fix compiled error of butil when with_pslib=on and with_testing=on * test=develop	7 years ago
Leo Chen	fbe3ac217e	polish cmake, test=develop (#21681) ... * polish cmake, test=develop * add current directory to LD_LIBRARY_PATH, test=develop	7 years ago
mapingshuo	686f0ecb6a	add `no_need_buffer_slots` interface to pybind (#21575) ... * add no_need_buffer_slots interface to pybind	7 years ago
Zeng Jinle	6828f3684b	fix op_registry, add ignore op_function_impl.h, test=develop (#21654)	7 years ago
Chen Weihang	d96acc3363	Refine dygraph DataLoader implementation (#21634) ... * refine dygraph dataloader & polish related code, test=develop * refine code based review comment, test=develop	7 years ago