216 Commits (79fa8fb0df524cc5efbe5cd7a91acac7b721e5cf)

Author	SHA1	Message	Date
Zeng Jinle	cd1c404353	refine err msg of allocator, test=develop (#20804)	5 years ago
liuwei1031	569951c418	improve the efficiency of BuddyAllocator (#19888) ... * improve save and load behaviour, test=develop * code cleaning, test=develop * disable check_guards and update_guards in release version, test=develop * fix compilation issue, test=develop * add buddy_allocator speed test data, test=develop * fix compilation issue, test=develop * fix comment, test=develop * update function names according to the google C++ style guide, test=develop * tweak the test data format, test=develop * move buddy_allocator_test_data to paddle/fluid/testdata, test=develop * add accessor and mutator for Desc, test=develop	5 years ago
Zeng Jinle	b8aff5e5e9	fix buddy_allocator_test, test=develop (#19967)	5 years ago
Zeng Jinle	37f76407b0	fix cuda dev_ctx allocator cmake deps, test=develop (#19953)	5 years ago
Zeng Jinle	80e0f547bb	fix allocator ut,test=develop (#19945)	5 years ago
Zeng Jinle	747d44980a	Refine err msg of out of gpu memory (#19779) ... * refine err msg of out of gpu memory, test=develop * refine err msg again, test=develop * refine errog message again, test=develop * follow reviewer's comments, test=develop	5 years ago
Zeng Jinle	8359b415e4	add free chunks to auto growth allocator, test=develop (#19890)	5 years ago
Zeng Jinle	13ca364ceb	remove some flags and add comments to some flags, test=develop (#19813)	5 years ago
Huihuang Zheng	a0d80754c5	Add comments for CUDA Device Context Allocator related stuff (#19809)	5 years ago
Zeng Jinle	b34933d9ee	fix retry allocator bug, test=develop (#19794)	5 years ago
Huihuang Zheng	12542320c5	Replace TemporaryAllocator by CUDADeviceContextAllocator (#18989) ... TemporaryAllocator is a singleton used for allocating memory for Cudnn. Since it is a singleton, we can delete it for better performance in memory. We replace TemporaryAllocator by CUDADeviceContextAllocator and CUDADeviceContextAllocation, which uses stream callback to delete the memory allocated for the stream to avoid singleton. Also added data_feed_proto to operator to fix CI in CPU compilation	6 years ago
Zeng Jinle	a7691603a5	add gpu_allocator_try_time config, test=develop (#19675)	6 years ago
Zeng Jinle	2db40d9f60	reduce thread num of retry_allocator_test,test=develop (#19638)	6 years ago
Zeng Jinle	e045aadf9a	fix retry_allocator_test by removing glog envs, test=develop (#19596)	6 years ago
Zeng Jinle	578cccd48c	fix parallel compilation error of allocator (#19581)	6 years ago
Zeng Jinle	f4562c3468	fix typo of allocator, test=develop (#19578)	6 years ago
Zeng Jinle	0a73f7202a	Add retry_allocator for gpu (#19409) ... * add retry_allocator for gpu, test=develop * follow chengduoZH's comments, test=develop * follow huihuang's comments,test=develop * change f,l in enforce.h to be file,line, test=develop * increase code coverage by adding unittests, test=develop * fix CMakeLists.txt, test=develop	6 years ago
Tao Luo	02270b3eb1	remove unused assert.h (#19529) ... test=develop	6 years ago
chengduo	a8a9823dae	add memory profiler (#19320) ... test=develop	6 years ago
Tao Luo	6527a7df67	replace part of PADDLE_ASSERT to PADDLE_ENFORCE (#19285) ... * replace part of PADDLE_ASSERT to PADDLE_ENFORCE test=develop * remove unused fallback_alloc_size_ * add unit-test of CUDAPinnedAllocator test=develop	6 years ago
Zeng Jinle	708bd9798d	move_flags_to_unified_files_for_management, test=develop (#19224)	6 years ago
Zeng Jinle	08fa98f7cc	Fix gpu_info PADDLE_ENFORCE_GT when fraction_of_gpu_memory_to_use=1.0 (#18950) ... * fix gpu_info, test=develop * fix reserving gpu memory calculation bug, add fraction=1 unittest, test=develop * fix bug again for reserving size, test=develop	6 years ago
Huihuang Zheng	ea6ee76fa9	GPU allocation uses fraction of available memory (#18896) ... GPU allocation uses fraction of available memory, also fix the GetUsed without lock	6 years ago
Zeng Jinle	ae58afc546	Feature/auto_growth_allocator (#18561) ... * feature/auto_growth_allocator, test=develop * add unittest of AlignedAllocator, test=develop * try to turn on auto_growth to test on CI, test=develop * fix segmentation fault in mixed_vector.h, test=develop * add unittests, test=develop	6 years ago
tangwei12	db212bb932	delete AllocatorFacade destructor (#18606) ... * delete m, test=develop	6 years ago
Tao Luo	3c9755bbb9	remove unused jemalloc option (#18314) ... test=develop	6 years ago
Huihuang Zheng	3f55ab0f89	Modify format of GPU allocation failure log. (#18034) ... As title test=develop	6 years ago
Zeng Jinle	3ece61f71e	Remove attribute in Allocator::Allocate (#17878) ... * remove attribute in Allocator::Allocate, test=develop * fix travis ci error, test=develop	6 years ago
Zeng Jinle	4aa931dd85	Code clean of Allocator (#17602) ... * Revert "Revert "Fix allocator bug"" This reverts commit 174d0d0b90. * Revert "fix travis ci" This reverts commit 5656fa9f7c. test=develop * add inlined_vector.h, test=develop * add inlined_vector_test,test=develop * clean code of allocator,test=develop * delete zero_size_allocator.h,test=develop * fix failed unittest,test=develop	6 years ago
Zeng Jinle	c6189637cd	Fix allocator bug (#16712) ... * Revert "Revert "Fix allocator bug"" This reverts commit 174d0d0b90. * Revert "fix travis ci" This reverts commit 5656fa9f7c. test=develop * add inlined_vector.h, test=develop * add inlined_vector_test,test=develop	6 years ago
Zeng Jinle	6fafd37e12	fix retry_allocator (#17245) ... test=develop	6 years ago
chengduo	3c6ab799cd	Remove unnecessary set_devices (#17158) ... * remove unnecessary set_devices	6 years ago
Zeng Jinle	08773b6069	fix reader default stream,test=develop (#17106)	6 years ago
Zeng Jinle	174d0d0b90	Revert "Fix allocator bug" ... add include headers to fix travis-ci test=develop	6 years ago
sneaxiy	318072c26b	add comments of allocator design ... test=develop	6 years ago
sneaxiy	2d92b6be98	merge develop ... test=develop	6 years ago
sneaxiy	c20db6357b	split PR ... test=develop	6 years ago
sneaxiy	c75a880386	fix windows bug ... test=develop	6 years ago
sneaxiy	953214ad97	add more unittest ... modify allocator strategy remove changes of legacy buddy_allocator test=develop	6 years ago
zhhsplendid	124f1df481	Add flags for init and re-alloc gpu ... test=develop	6 years ago
zhhsplendid	22715487dc	add allocator flags ... test=develop	6 years ago
sneaxiy	fd23262e0c	merge develop, fix conflict ... test=develop	6 years ago
sneaxiy	e893cbd286	add auto increment best fit allocator ... test=develop	6 years ago
sneaxiy	682f2dbf29	merge develop ... test=develop	6 years ago
sneaxiy	2c4fcaa683	merge develop	6 years ago
chengduo	0979956619	Add memory profiler (#16137) ... test=develop	6 years ago
Qiyang Min	1f4aa7a202	Imperative remove all descs (#16045) ... * Remove Desc in Forward Pass * Refactor VarBase * Add dbg info * Only check type in imperative mode * Polish code and support optimizer test=develop * Fix stop gradient problem in PyLayer test=develop	6 years ago
chengduo	ad80bde824	Revert "Revert "Add Event for TensorCopy"" (#16035) ... * Revert "Revert "Add Event for TensorCopy" (#16022)" This reverts commit e2da3a5b22. * use default stream test=develop	6 years ago
sneaxiy	2a639d5c2a	add allocator chain to fix bug ... test=develop	6 years ago
chengduo	e2da3a5b22	Revert "Add Event for TensorCopy" (#16022) ... * Revert "Add Event for TensorCopy (#15953)" This reverts commit 7235fd662b. test=develop * fix CI test=develop	6 years ago
chengduo	7235fd662b	Add Event for TensorCopy (#15953) ... Add Event for TensorCopy	6 years ago
liuwei1031	4c7b6e2e67	fix comment, test=develop	6 years ago
liuwei1031	b20a21e299	fix comments of PR 15529, test=develop	6 years ago
chengduo	ad61e1b22c	fix potential bug (#15688) ... test=develop	6 years ago
Gabor Buella	da9c94da33	Clang build fixes (#15628) ... * Remove some superfluous std::move calls The std:move triggered a build error (with -Werror): ``` [ 9%] Building CXX object paddle/fluid/memory/allocation/CMakeFiles/allocator_facade.dir/allocator_facade.cc.o /home/tej/code/gbuella_paddle/paddle/fluid/memory/allocation/allocator_facade.cc:86:29: error: moving a temporary object prevents copy elision [-Werror,-Wpessimizing-move] [this] { return std::move(CreateAllocatorWithChunk()); }, capacity); ^ /home/tej/code/gbuella_paddle/paddle/fluid/memory/allocation/allocator_facade.cc:86:29: note: remove std::move call here [this] { return std::move(CreateAllocatorWithChunk()); }, capacity); ^~~~~~~~~~ ~ 1 error generated. ``` See: https://reviews.llvm.org/D7633 * Remove a superfluous lambda capture from framework/operator.h ``` [ 10%] Building CXX object paddle/fluid/platform/CMakeFiles/device_context.dir/init.cc.o In file included from /home/tej/code/gbuella_paddle/paddle/fluid/platform/init.cc:19: /home/tej/code/gbuella_paddle/paddle/fluid/framework/operator.h:229:21: error: lambda capture 'this' is not used [-Werror,-Wunused-lambda-capture] [this](Variable* var) { return var; }); ^~~~ 1 error generated. ``` Changing it to `return it->second;`, as is in the function below. * Rethrow an exception (instead of copying it) ``` [ 11%] Building CXX object paddle/fluid/framework/CMakeFiles/operator.dir/operator.cc.o /home/tej/code/gbuella_paddle/paddle/fluid/framework/operator.cc:191:13: error: local variable 'exception' will be copied despite being thrown by name [-Werror,-Wreturn-std-move] throw exception; ^~~~~~~~~ /home/tej/code/gbuella_paddle/paddle/fluid/framework/operator.cc:191:13: note: call 'std::move' explicitly to avoid copying throw exception; ^~~~~~~~~ std::move(exception) ``` See https://reviews.llvm.org/D43322 for an explanation of this diagnostic message. * Remove an unused variable ``` /home/tej/code/gbuella_paddle/paddle/fluid/framework/operator.cc:884:16: error: private field 'scope_' is not used [-Werror,-Wunused-private-field] const Scope& scope_; ^ ``` * struct ComputationOpHandle -> class ComputationOpHandle ``` [ 13%] Building CXX object paddle/fluid/framework/details/CMakeFiles/memory_early_delete_pass.dir/memory_early_delete_pass.cc.o In file included from /home/tej/code/gbuella_paddle/paddle/fluid/framework/details/memory_early_delete_pass.cc:21: /home/tej/code/gbuella_paddle/paddle/fluid/framework/details/reference_count_pass_helper.h:30:1: error: class 'ComputationOpHandle' was previously declared as a struct; this is valid, but may result in linker errors under the Microsoft C++ ABI [-Werror,-Wmismatched-tags] class ComputationOpHandle; ^ /home/tej/code/gbuella_paddle/paddle/fluid/framework/details/computation_op_handle.h:29:8: note: previous use is here struct ComputationOpHandle : public OpHandleBase { ^ /home/tej/code/gbuella_paddle/paddle/fluid/framework/details/reference_count_pass_helper.h:30:1: note: did you mean struct here? class ComputationOpHandle; ^~~~~ struct 1 error generated. ``` * Fix name() methods under fluid/operators ``` In file included from /home/tej/code/gbuella_paddle/paddle/fluid/operators/jit/gen/act.cc:15: In file included from /home/tej/code/gbuella_paddle/paddle/fluid/operators/jit/gen/act.h:19: /home/tej/code/gbuella_paddle/paddle/fluid/operators/jit/gen/jitcode.h:71:23: error: 'name' overrides a member function but is not marked 'override' [-Werror,-Winconsistent-missing-override] virtual const char* name() const = 0; ^ /home/tej/code/gbuella_paddle/paddle/fluid/operators/jit/gen_base.h:31:23: note: overridden virtual function is here virtual const char* name() const = 0; ^ ``` test=develop	6 years ago
dzhwinter	381f2015a5	Merge pull request #15665 from dzhwinter/experiment/refactor_memory ... refactor optimize pass.	6 years ago
dzhwinter	04e9776aef	add details. test=develop	6 years ago
Dun Liang	ceec13562c	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into my_checkpoint ... test=develop	6 years ago
Dun Liang	bc92192747	Fix Pr #15296 ... test=develop	6 years ago
dzhwinter	ce0394bcd0	merge develop branch. test=develop	6 years ago
liuwei1031	6e84eb131f	expose peak gpu memory API to python test=develop (#15529) ... * expose peak gpu memory API to python test=develop * add unittest for peak gpu memory monitoring test=develop * add pybind change test=develop * add mutex to gpu mem usage monitor test=develop * update benchmark flag definition file test=develop * tweak unittest for memory monitoring test=develop	6 years ago
Qiyang Min	6000a6e76e	Merge pull request #15312 from velconia/add_pyramid_dnn_support ... Use malloc and free in JeMalloc	6 years ago
liuwei1031	5d026a881a	Gpu memory monitoring (#15436) ... * fix github issue 15267 test=develop * fix github issue 15267 test=develop * monitor the GPU usage during runtime * revert allocator_facade.cc change * comments update test=develop	6 years ago
minqiyang	ac80273686	Change definitions to PADDLE_WITH_JEMALLOC	6 years ago
minqiyang	29ceb93126	Use malloc and free in JeMalloc ... test=develop	6 years ago
Wu Yi	29d9fb53fc	[Feature] multi process multi gpu dist training, boost v100 performance by 20% (#14661) ... * wip multi process multi gpu dist training * workable for p2p * update test=develop * change back env name test=develop * fix alloc init * fix cpu build test=devlop * fix mac tests test=develop * refine code * refine test=develop	6 years ago
gongweibao	50a698525d	Fix log level (#14692)	6 years ago
minqiyang	a02ce58f2c	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into revert_vlog ... test=develop	6 years ago
wopeizl	db9284ecde	Merge pull request #14617 from wopeizl/windows/online ... Windows/online	6 years ago
peizhilin	38715e6fd0	minor fix	6 years ago
sneaxiy	f3522a11d2	fix mac unittest bug ... test=develop	6 years ago
minqiyang	53433d7f2e	Revert the changes of VLOG ... test=develop	6 years ago
JiabinYang	47c4e65d60	test=develop	6 years ago
wopeizl	d9a1f3e58e	Windows/online (#14474) ... * add recordio support * disable the openblas multi-thread on windows since no support adjust the python script * code style * code style test=develop * add create_recordio_file_reader back * fix code style test=develop * fix the gtest.cmake on windows * fix cc_test on windows * fix the win build test=develop * remove fused compile support on windows test=develop * add the jit support test=develop * add the jit support, test=develop * add the jit support, test=develop * add the jit back fix compile error on windows * rollback test=develop * test case fix * disable DSO by default on windows * exclude warpctc_op on windows * exclude the dynload_warpctc out on windows test=develop * fix the scripts error test=develop * disable avx on windows by default test=develop * re-organize the cmake file * disable mkl on windows by default * add warp_ctc back * fix the dependency * fix the dependency * fix the build issue on windows * remove unsupported flag on windows * code style * code style test=develop * fix issue * add profiler, parallel_executor back * clean up the pre-definitions on windows * fix build issue * test=develop	6 years ago
Yu Yang	b3364d4035	fix(Macos): fix compile on macos ... test=develop	6 years ago
Yu Yang	d424115f9e	Clean code ... test=develop	6 years ago
Yu Yang	b12c77dae2	Fix unittests ... test=develop	6 years ago
Yu Yang	19e669a992	Add legacy_allocator ... test=develop	6 years ago
Yu Yang	1cb7e7dda2	fix(allocation): fix ut ... test=develop	6 years ago
Yu Yang	c8f6e70ab4	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into rewrite_allocation ... test=develop	6 years ago
Yu Yang	e5c4cf6140	Polish allocation ... Clean allocation->Deleter test=develop	6 years ago
Yu Yang	0d6718fcbd	Pass compile	6 years ago
Yu Yang	d93b2d0365	Refine code	6 years ago
Yu Yang	ea81f8eed2	Clean interface of allocator ... Clean managed/umnamaged allocator	6 years ago
Wu Yi	9f33593910	human readable memory warns (#14361) ... * human readable memory warns test=develop * update test=develop * refine test=develop * fix build test=develop	6 years ago
Yu Yang	02631965c8	Refine	6 years ago
sneaxiy	d231e55065	merge develop ... test=develop	6 years ago
sneaxiy	cf8d2e67e3	clean buffered_allocator	6 years ago
Yu Yang	1420c3b155	Add enum AllocatorStrategy ... test=develop	6 years ago
Yu Yang	b59a9bfb7c	Clean buffered_allocator ... test=develop	6 years ago
minqiyang	87450b9ad4	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_vlog ... test=develop	6 years ago
Zhaolong Xing	ba8b5619a3	Revert "cherry picked windows patches."	6 years ago
minqiyang	fcc0452c8b	Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into fix_vlog ... test=develop	6 years ago
minqiyang	0c3227a523	Change the origin VLOG level to 10 times ... Fix code to support cpplint syntax check test=develop	6 years ago
sneaxiy	c7305fbe2f	buffered_allocator: add unittest and fix bug ... test=develop	6 years ago
sneaxiy	2bef0ca346	add buffered_allocator ... remove Free() method in UnmanagedAllocator	6 years ago
dzhwinter	ebfe5a02b3	merge develop branch	6 years ago
dzhwinter	7141debe38	add cudnn back. staged.	6 years ago
Yu Yang	71c846ef8a	Revert buggy changes ... test=develop	6 years ago
Yu Yang	1d4d4e73ab	Remove place hash ... test=develop	6 years ago