123 Commits (269db0d1d16c0079a0f7039a5717b27e2c139af6)

Author	SHA1	Message	Date
tangwei12	82bc814a57	integrated HALF_ASYNC to communicator (#21869) ... * add half_async in the communicator * fix DistributedStrategy	5 years ago
Chen Weihang	8bed352278	Polish executor empty program hint message (#22167) ... * polish executor hint message, test=develop * fix punctuation error, test=develop	5 years ago
Huihuang Zheng	dd4361568e	Add ParallelExecutor Test for Cond API and Fix PE Checks Shape Bug (#22029)	5 years ago
hutuxian	c5aec2fe68	Paddlebox Related to Framework (#21586) ... * Add a single_process_multi_thread transpiler. * Add some UTs. * Fix some API description.	5 years ago
Dong Daxiang	691ced87c0	Refactor fetch handler (#21264) ... * fix fetch handler problem and refactor when a user define FetchHandler class, he or she should initialize a handler with variable dict. the key of a variable dict is a user defined name, the value of a variable dict is a Varaible generated from python API. For each fetching, a user should implement handler function in which fetched_result_dict will be available and the user can access the fetched value with user defined keys.	5 years ago
tangwei12	3b96e3d20a	fix FetchHandler (#20900) ... * bug fix, test=develop	5 years ago
Yiqun Liu	16e4d02675	Refine the cache of program, context and scope in executor. (#18483) ... * Refine the cache of program, context and scope in executor. test=develop * Refine the unittest test_executor_and_use_program_cache. * Add the test the PaddingRNN with use_program_cache=True. test=develop * Remove a check. test=develop * Refine the unittest to check whether it is correct when setting use_program_cache=True. test=develop	5 years ago
tangwei12	1d925440ca	fix fetch handler error with pslib (#20679) ... * fix fetch handler error with pslib * fix distributed lookup table op with 1 pserver	5 years ago
chengduo	f23eeeb460	update global scope doc (#20483) ... test=document_fix	5 years ago
xujiaqi01	408bd8b874	fix en doc and test=document_fix (#20441) ... * fix en doc train_from_dataset and infer_from_datatset	5 years ago
chengduo	4ba6d062f8	Fix fluid.data of executor (#20365) ... * fix fluid.data test=document_fix * fix doc batch dim test=document_fix	5 years ago
chengduo	d77e770353	Polish executor doc (#20244) ... * polish executor doc test=develop	5 years ago
Huihuang Zheng	e6d13ae5ae	Refine Error Message for New Data API (#20204) ... Refine error message for new data API	5 years ago
Youwei Song	340b2ba449	refine scope_guard, test=document_fix, test=develop (#20240)	5 years ago
tangwei12	c9139c3db3	trainer from dataset fetch targets (#19760) ... add executor.FetchHandler for train/infer from the dataset	5 years ago
Chen Weihang	b916335025	Paddle error message stack shaping and optimization (#19895) ... * shape and optimize paddle error message stack, test=develop * limit exception type & add unittest, test=develop * fix multi-platform problem, test=develop * fix related unnitest failed, test=develop * add doc & fix unittest errors, test=develop * fix function name error, test=develop * update tensor test exception msg compare, test=develop * remove unittest on win32, the dir format is different, test=develop * remove useless package, test=develop * add paddle enforce handler unittest, test=develop * add exception checkout, test=develop * fix coverage failed, test=develop * fix op registry test failed, test=develop * refactor whole pr, test=develop * remove test in CMakelist, test=develop * fix coverage, test=develop	5 years ago
Huihuang Zheng	88af4ab650	Add new data layer (#19916) ... The new "fluid.data" changes old "fluid.layers.data": 1. Add shape and dtype check. 2. Remove "append_batch_size" parameter. We won't offer this in the new data layer because other deep learning platforms don't have this kind of data layer pre-processing. It may confuse users. 3. Remove "stop gradient" parameter because the data layer doesn't do back-propagation TODO： Now data layer feeded by executor is checked, will we want to check the feed data of readers in the future?	5 years ago
xujiaqi01	cedc04775c	support change shuffle and train thread num (#19841) ... * support change shuffle thread num * support change train thread num * fix receive shuffle data of each channel * data norm stop gradient * add check thread_tensor type and root_tensor type when merge metric * remove sleep in shuffle, add config * add config of pslib client to client communication * fix xbox str * add data norm op testcase * add flush in trainer finalize	5 years ago
chengduo	1f68674483	refine executor bug info (#19887) ... test=develop	5 years ago
chengduo	e340df013e	Support feed single persistable variable to PE (#19417) ... * update executor feed	6 years ago
chengduo	4278518fb0	Update CompiledProgram (#18919) ... * use PE for compiler test=develop	6 years ago
Leo Chen	8f53735437	Fix memory overwriting of tensors returned by executor (#19030) ... * fix memory overlapping of fetch var (return of executor.run), test=develop * fix wrong usage of ParallelExecutor in op_test, test=develop * remove useless parameter and simplify code * avoid tensor destruct untimely, test=develop * add testcase independent of OpTest, test=develop	6 years ago
chengduo	01c7daade7	Add checking for the fetch_list of Executor.run (#18957) ... * update exe.run	6 years ago
Zeng Jinle	8008ab4e6b	Remove legacy C++ memory optimization codes (#18834) ... * remove legacy memory optimization codes, test=develop * follow huihuang's comments,test=develop * follow luotao's comments, test=develop	6 years ago
Zeng Jinle	d3003a1620	Feature/buffer_shared_inplace (#17911) ... * feature/buffer_shared_inplace, test=develop * refine code, test=develop * fix elementwise_add op cpu inplace and sum inplace bug, test=develop * add unittest and debug log, test=develop * fix parallel_executor scope bug, polish code, test=develop * fix sum op, activation op, single_in_place_inference bug, test=develop * remove kLocalExecScopeName, test=develop * fix unittest,test=develop * fix out_var first version bug, test=develop * follow comments,test=develop	6 years ago
chengduo	55baeceddb	Enhance execution error info (#18482) ... * enhance execution error info test=develop	6 years ago
hutuxian	6e0df3102e	Refactor for Pipeline Thread Check (#18459) ... move the thread-check code from train_from_dataset to a single function add UT for the thread check function	6 years ago
xsrobin	47e2ef38e9	add "import paddle.fluid as fluid" to examples lack of it	6 years ago
hutuxian	e42057cd1a	add ut for pipeline training (#18289)	6 years ago
jiaqi	3f8031e256	dataset (#17973) ... (1) use channel instead of vector/BlockingQueue in Dataset，to keep same with existing implementation, and make code more readable and flexible (dataset single output channel or multi output channel). one previous memory out of limit problem is cause by not release memory after training. (2) add Record because MultiSlotType costs too much memory (80B)，fix memory out of limit problem. (3) add Channel, Archive in paddle/fluid/framework (4) change dataset from shared_ptr to unique_ptr in pybind (5) move create/destroy readers from trainer to dataset (6) move shuffle from datafeed to dataset. dataset holds memory, datafeed is only for load data and feed data to network. (7) fix thread num bug of Dataset when filelist size < thread num (8) support set_queue_num in InMemoryDataset	6 years ago
hutuxian	cf15c3ff1e	fix errors in python3 (#18239) ... * fix relative import error in python3 * fix debug string info	6 years ago
hutuxian	969e6378b9	Pipeline Concurrency (#17402) ... Add Pipeline Concurrency Train Mode: - Cpp: pipeline_trainer & section_worker - Python: PipelineOptimizer - Add a new data_feed type: PrivateInstantDataFeed - Add a test demo of pipeline trainer and the test model is gnn - Do not support win32 now	6 years ago
guru4elephant	d52391094d	fix prepare context redundant code problem, optimize executor by cach… (#17743) ... * fix prepare context redundant code problem, optimize executor by caching create_varaiables test=develop * cache sub_scope, program, var when use_program_cache=True is set * make fetch_list runable with variables, add more unittest for use_program_cache	6 years ago
guru4elephant	326bf8291a	add Run Prepared Ctx (#17616) ... add Run Prepared Ctx, fix pybind problem	6 years ago
guru4elephant	7f8bc49d00	polish_executor_and_add_ctx_cache (#17536) ... * polish_executor_and_add_ctx_cache	6 years ago
jiaqi	66d51206b1	add save/load model, shrink table, cvm, config file & fix pull dense bug (#17118) ... * add save/load model, shrink table, cvm, config file & fix pull dense bug test=develop * fix global shuffle bug, fix pull dense bug, fix release memeory bug, fix shrink error add client flush, add get data size test=develop * fix global shuffle bug test=develop * fix global shuffle bug test=develop * fix code style test=develop * fix code style & modify pslib cmake test=develop * fix error of _role_maker test=develop * fix code style test=develop * fix code style test=develop * fix code style test=develop * fix code style test=develop * fix code style test=develop * fix windows compile error of fleet test=develop * fix global shuffle bug * add comment test=develop * update pslib.cmake test=develop * fix fill sparse bug test=develop * fix push sparse bug test=develop	6 years ago
qingqing01	e32c9888f5	Double backward of conv2d. (#17211) ... * Add conv2d_grad_grad_op * Extracte the cuDNN conv algo searching code in conv_cudnn_helper.h. - Now use it in conv2d_grad_grad. - Will simply the searching code in conv2d and conv2d_grad in next PR. * Enhance and fix bug in unit testing of gradient_checker. * Support to fetch empty variables，return None in Python.	6 years ago
guru4elephant	5d6a1fcf16	fix infer_from_dataset and train_from_dataset (#17243) ... * fix train_from_dataset and infer_from_dataset example * add inductive dim for data_reader, example: shape=[-1, 1], then -1 will be inducted through run-time reading of number of elements	6 years ago
lujun	e388a1fb66	Repair api example (#17221) ... Fix the following API examples: paddle.fluid.scope_guard paddle.fluid.backward.append_backward paddle.fluid.cpu_places paddle.fluid.cuda_pinned_places paddle.fluid.cuda_places paddle.fluid.in_dygraph_mode paddle.fluid.CUDAPlace paddle.fluid.CPUPlace paddle.fluid.CUDAPinnedPlace	6 years ago
chengduo	8f534696b7	Polish Executor and Compiler doc (#17262) ... * polish doc test=develop * updata parallel executor doc test=develop * update API.spec test=develop * polish code test=develop	6 years ago
Zeng Jinle	1202d3fc74	Refine model gpu memory (#16993) ... * speedup gc and inplace softmax_with_cross_entropy_grad test=develop * refine models gpu mem Merge skip vars and warning messages of mem opt remove relu mem opt test=develop * follow comments test=develop	6 years ago
dongdaxiang	05464e7c5c	add gpu training for Executor.train_from_dataset ... test=develop	6 years ago
xjqbest	5e5139283b	fix runtime error ... test=develop	6 years ago
xjqbest	271b7147cc	fix dataset bug ... test=develop	6 years ago
dongdaxiang	a53c8cd5a7	fix infer_from_dataset docs and abastract class problem ... test=develop	6 years ago
dongdaxiang	3829eac27b	fix API spec about infer_from_dataset ... test=develop	6 years ago
dongdaxiang	87027a2eef	fix API.spec problem and executor's docstring ... test=develop	6 years ago
dongdaxiang	ade9337486	fix API.spec ... test=develop	6 years ago
dongdaxiang	60b7bf6fa6	add infer_from_dataset for inference	6 years ago
dongdaxiang	8e14d8f900	add data_generator package into setup.py	6 years ago