188 Commits (a6beb96dd0235c236336f2db31df875b33db6635)

Author	SHA1	Message	Date
Chen Weihang	d1062d5278	Replace all errors thrown by LOG(FATAL) with PADDLE_THROW (#24759) ... * remove REPLACE_ENFORCE_GLOG compile option & add ci rule prohibit LOG(FATAL) using, test=develop * remove ci test case, test=develop * replace all LOG(FATAL) & polish message, test=develop * fix typo, test=develop * polish error info detail, test=develop	5 years ago
Huihuang Zheng	f831f61216	Make buddy_allocator_test Exclusive (#24636) ... The background is that buddy_allocator_test depends on some big GPU allocations and current machine may not have it. It can cause random failure on cloud machine. After discussion with Shuo Tian, we decided to make buddy_allocator_test exclusive.	5 years ago
Chen Weihang	aa0f254fbe	Add macro BOOST_GET to enrich the error information of boost :: get (#24175) ... * add new macro BOOST_GET_SAFELY & unittests, test=develop * add different macro type, test=develop * fix get macro type in executor, test=develop * four macro part change backup * using one macro for all case, test=develop * revert attribute change, test=develop * change to three func to solve gcc4.8 bug, test=develop * polish some details, test=develop	5 years ago
Huihuang Zheng	3047b69f94	Make Allocation Smaller on BuddyAllocatorTest to Decrease CI Failure (#24205) ... test=develop	5 years ago
石晓伟	d2584a7082	New feature: thread local allocator, test=develop (#23989) ... * add the thread_local_allocator, test=develop * refactor the thread_local_allocator, test=develop * provides option setting strategy, test=develop	5 years ago
Zhou Wei	7817003795	Optimize the error messages of paddle CUDA API (#23816) ... * Optimize the error messages of paddle CUDA API, test=develop * fix the error messages of paddle CUDA API, test=develop * Refactoring PADDLE_ENFORCE_CUDA_SUCCESS, and apply to curand/cudnn/cublas/NCCL,test=develop * remove build_ex_string,test=develop * merge conflict,test=develop	5 years ago
Zeng Jinle	d41d802ba3	Add flags to limit gpu memory (#22793) ... * add recorded cuda memory apis, fix typo, test=develop * add more ut, test=develop * follow comments, test=develop * fix py35 incompatible issues, test=develop	5 years ago
Chen Weihang	7d8d573453	Speed up dygraph DataLoader based on shared memory and LoDTensor serialization (#22541) ... * add lodtensor share memory & serialization, test=develop * fix windows compile error, test=develop * deal vartype pickle & fix unittest matching error message, test=develop * update timeout variable name, test=develop * refactor memory map implement, test=develop * clear mmap file discripter when exit unexpectedly, test=develop * remove the child process fd in advance, test=develop * remove mmap fds after Queue.put in child process, test=develop * add hard unittests for register exit func, test=develop * fix python2 compatibility problem in unittest, test=develop * fix exception unittest error, test=develop * polish code based review comment, test=develop	5 years ago
Yiqun Liu	44b45b9f07	Correct the use of DeviceContext in unittest sequence_pooling_test and sequence_padding_test (#22456) ... * Add log in memory::Copy for debug purpose. * Change to use context in DeviceContextPool directly in sequence_pooling_test, instead to new one. * Change to use context in DeviceContextPool directly in sequence_padding_test, instead to new one. test=develop * Change the type of second_dim from size_t to int64_t. test=develop	5 years ago
zhouwei25	549e6de7ac	faster build by reduce by-product, reduce linking library and fix compile warning of std=c++11 (#22164)	5 years ago
Zeng Jinle	1b76e789cf	remove cuda allocator ctor, test=develop (#22212)	5 years ago
Zeng Jinle	c3bcd3c1e2	fix dygraph non zero gpu bug, test=develop (#22165)	5 years ago
Zeng Jinle	d9f5d1eb29	ag allocator by default, test=develop (#21837)	5 years ago
Zeng Jinle	aa4d6a5d6c	Add some debug flags to auto growth allocator (#21766) ... * add some debug flags to auto growth allocator, test=develop * add comments about auto growth, test=develop	5 years ago
Tao Luo	01fa4ead61	fix -Wno-error=sign-compare warning in gcc8 (#21434) ... * fix -Wno-error=sign-compare warning in gcc8 test=develop * fix warning in distributed codes test=develop	5 years ago
Zeng Jinle	09696d5df8	Use system allocator in OpTest (#21335) ... * use system allocator in unittests, test=develop * fix op bugs, test=develop * fix tensor copy bug when src and dst are the same, test=develop	5 years ago
Chen Weihang	b3a3e6f60c	change cuda enforce & add example (#21142)	5 years ago
Chen Weihang	27fa9c100b	add examples for resource exhausted error, test=develop (#21140)	5 years ago
Zeng Jinle	a710ccc0cb	refine error message of allocator again, test=develop (#21023)	5 years ago
Zeng Jinle	f56967c483	refine error message of gpu allocator, test=develop (#21008)	5 years ago
Zeng Jinle	c51722c820	refine err msg of allocator, test=develop (#20879)	5 years ago
Zeng Jinle	bb8d778358	lazy init of allocators, test=develop (#20854)	5 years ago
Zeng Jinle	cd1c404353	refine err msg of allocator, test=develop (#20804)	5 years ago
liuwei1031	569951c418	improve the efficiency of BuddyAllocator (#19888) ... * improve save and load behaviour, test=develop * code cleaning, test=develop * disable check_guards and update_guards in release version, test=develop * fix compilation issue, test=develop * add buddy_allocator speed test data, test=develop * fix compilation issue, test=develop * fix comment, test=develop * update function names according to the google C++ style guide, test=develop * tweak the test data format, test=develop * move buddy_allocator_test_data to paddle/fluid/testdata, test=develop * add accessor and mutator for Desc, test=develop	5 years ago
Zeng Jinle	b8aff5e5e9	fix buddy_allocator_test, test=develop (#19967)	5 years ago
Zeng Jinle	37f76407b0	fix cuda dev_ctx allocator cmake deps, test=develop (#19953)	5 years ago
Zeng Jinle	80e0f547bb	fix allocator ut,test=develop (#19945)	5 years ago
Zeng Jinle	747d44980a	Refine err msg of out of gpu memory (#19779) ... * refine err msg of out of gpu memory, test=develop * refine err msg again, test=develop * refine errog message again, test=develop * follow reviewer's comments, test=develop	5 years ago
Zeng Jinle	8359b415e4	add free chunks to auto growth allocator, test=develop (#19890)	5 years ago
Zeng Jinle	13ca364ceb	remove some flags and add comments to some flags, test=develop (#19813)	5 years ago
Huihuang Zheng	a0d80754c5	Add comments for CUDA Device Context Allocator related stuff (#19809)	5 years ago
Zeng Jinle	b34933d9ee	fix retry allocator bug, test=develop (#19794)	5 years ago
Huihuang Zheng	12542320c5	Replace TemporaryAllocator by CUDADeviceContextAllocator (#18989) ... TemporaryAllocator is a singleton used for allocating memory for Cudnn. Since it is a singleton, we can delete it for better performance in memory. We replace TemporaryAllocator by CUDADeviceContextAllocator and CUDADeviceContextAllocation, which uses stream callback to delete the memory allocated for the stream to avoid singleton. Also added data_feed_proto to operator to fix CI in CPU compilation	6 years ago
Zeng Jinle	a7691603a5	add gpu_allocator_try_time config, test=develop (#19675)	6 years ago
Zeng Jinle	2db40d9f60	reduce thread num of retry_allocator_test,test=develop (#19638)	6 years ago
Zeng Jinle	e045aadf9a	fix retry_allocator_test by removing glog envs, test=develop (#19596)	6 years ago
Zeng Jinle	578cccd48c	fix parallel compilation error of allocator (#19581)	6 years ago
Zeng Jinle	f4562c3468	fix typo of allocator, test=develop (#19578)	6 years ago
Zeng Jinle	0a73f7202a	Add retry_allocator for gpu (#19409) ... * add retry_allocator for gpu, test=develop * follow chengduoZH's comments, test=develop * follow huihuang's comments,test=develop * change f,l in enforce.h to be file,line, test=develop * increase code coverage by adding unittests, test=develop * fix CMakeLists.txt, test=develop	6 years ago
Tao Luo	02270b3eb1	remove unused assert.h (#19529) ... test=develop	6 years ago
chengduo	a8a9823dae	add memory profiler (#19320) ... test=develop	6 years ago
Tao Luo	6527a7df67	replace part of PADDLE_ASSERT to PADDLE_ENFORCE (#19285) ... * replace part of PADDLE_ASSERT to PADDLE_ENFORCE test=develop * remove unused fallback_alloc_size_ * add unit-test of CUDAPinnedAllocator test=develop	6 years ago
Zeng Jinle	708bd9798d	move_flags_to_unified_files_for_management, test=develop (#19224)	6 years ago
Zeng Jinle	08fa98f7cc	Fix gpu_info PADDLE_ENFORCE_GT when fraction_of_gpu_memory_to_use=1.0 (#18950) ... * fix gpu_info, test=develop * fix reserving gpu memory calculation bug, add fraction=1 unittest, test=develop * fix bug again for reserving size, test=develop	6 years ago
Huihuang Zheng	ea6ee76fa9	GPU allocation uses fraction of available memory (#18896) ... GPU allocation uses fraction of available memory, also fix the GetUsed without lock	6 years ago
Zeng Jinle	ae58afc546	Feature/auto_growth_allocator (#18561) ... * feature/auto_growth_allocator, test=develop * add unittest of AlignedAllocator, test=develop * try to turn on auto_growth to test on CI, test=develop * fix segmentation fault in mixed_vector.h, test=develop * add unittests, test=develop	6 years ago
tangwei12	db212bb932	delete AllocatorFacade destructor (#18606) ... * delete m, test=develop	6 years ago
Tao Luo	3c9755bbb9	remove unused jemalloc option (#18314) ... test=develop	6 years ago
Huihuang Zheng	3f55ab0f89	Modify format of GPU allocation failure log. (#18034) ... As title test=develop	6 years ago
Zeng Jinle	3ece61f71e	Remove attribute in Allocator::Allocate (#17878) ... * remove attribute in Allocator::Allocate, test=develop * fix travis ci error, test=develop	6 years ago