Paddle

Commit Graph

Author	SHA1	Message	Date
Dong Daxiang	50a5bcfc9d	【paddle.fleet】paddle.fleet -> paddle.distributed.fleet. (#26186 ) * move paddle.fleet to paddle.distributed.fleet	5 years ago
Leo Chen	ffe52b4452	[OpDevOptimize] Add common infershape functions (#26096 ) * add unchaged infershape function * add broadcast infershape function * fix bug * rename infershape functions * add UnaryOpUnchangedInferShapeCheckAxis * add error message * add test for common infer shape functions * dont update existed ops * dont update op_desc.h * add more test * add error check, refine error message	5 years ago
Chen Weihang	838e36e9ed	Fix loaded variable suffix repeat error (#26169 ) * fix loaded var suffix repeat error * use new dygraph name for loaded param	5 years ago
JZ-LIANG	54003b873e	【paddle.fleet】add lamb to fleet meta optimizer (#26025 ) add lamb to fleet meta optimizer	5 years ago
Yiqun Liu	1be6bf45ae	Add assign to fusion_group and enhance inplace execution in fusion_group. (#26121 )	5 years ago
MRXLT	6559229b7e	fix encryption infer (#25979 ) * add encrypt for inference lib * fix code;test=develop * fix test; test=develop * bug fix; test=develop * add MakeCipher;test=develop * fix bug;test=develop * move MakeCipher to paddle space; test=develop * fix include dir ;test=develop * add include dir; test=develop * move include; test=develop * move include; test=develop * fix for windows ci * fix cmake; test=develop * fix bug bug fix	5 years ago
tangwei12	c14ec8782b	【paddle.fleet】Feature/fleet ps api 2.0 (#25857 ) * add paddle.fleet.AsyncOptimizer Co-authored-by: dongdaxiang <dongdaxiang@baidu.com>	5 years ago
joanna.wozna.intel	734cf1c3e9	Change use_quantizer attribute name and data type (#25838 ) * Change use_quantizer attribute name and data type * Fix problem with setting attribute * Add changes due to review * Small change in function * Restore use_quantizer attr for compatibility	5 years ago
tangwei12	3755564ae1	Fix/large scale fix (#25999 ) * fix large scale KV * fix single training using async ssa graph	5 years ago
Thunderbrook	fd2947babf	fix compile error with mkl (#26030 ) test=develop	5 years ago
Leo Chen	0a47387bd8	Use static local variable instead of global variable for safty (#26018 ) * remove global variable * refine code	5 years ago
123malin	2191a08317	【paddle.fleet】fleet_util move to paddle.fleet (#25805 ) * test=develop,test=document_fix, remove the out args * fleet_util move to paddle.fleet Co-authored-by: WuHaobo <wuhaobo1994@gmail.com> Co-authored-by: tangwei12 <tangwei12@baidu.com>	5 years ago
Thunderbrook	0cb60c700d	add heter ps mode (#25682 ) * add heter ps mode * code style test=develop * add with_pslib test=develop * unitest test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * code style test=develop * test monitor test=develop * prepare trainer test=develop * code style test=develop	5 years ago
WangXi	2c9d0f3cb9	【paddle.fleet】Add dgc to fleet meta optimizer (#25738 ) Add dgc to fleet meta optimizer, rm dgc from optimizer all	5 years ago
WangXi	a6c87fd091	Add amp to fleet meta optimizer, test=develop (#25770 )	5 years ago
xujiaqi01	d11c140e28	fix dump, fix cvm check (#25400 ) * fix dump, fix cvm check test=develop * fix test=develop * fix test=develop * fix test=develop	5 years ago
JZ-LIANG	8ebffc78c9	add lars to fleet meta optimizer (#25884 )	5 years ago
Dong Daxiang	8d2896f1fe	【paddle.fleet】Fleet run graph in Executor and add two more strategies (#25844 ) * split meta optimizer files * add graph execution in execution, update two properties in DistributedStrategy, unit tests for these features	5 years ago
Chen Weihang	48b9a56f1c	Polish framework error message - part 4 (#25807 ) * polish framework error message part 4 * fix type error * fix message error * polish by review comments	5 years ago
lilong12	5f30e57cdd	fix test_pipeline, test=develop (#25808 ) * fix test_pipeline, test=develop	5 years ago
Chen Weihang	d47304e6d9	Refine paddle error stack format (#25790 ) * refine error stack format * polish compile traceback format * polish detail format	5 years ago
tangwei12	caa90a6510	Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) (#22957 ) * Integrated Trainer of Parameter Server	5 years ago
Dong Daxiang	a96d54ac19	Generate final strategy (#25782 ) * refine strategy compiler and meta optimizers make async as a_sync	5 years ago
Chen Weihang	1b3081b1b4	Simplify BufferedReader to improve DataLoader performance (#25648 ) * simplify buffered reader to improve DataLoader performance * fix 22 failed unittests * fix cuda pinned context condition * fix test_reader_reset failed * fix two failed unittests * change unittest place * polish error messaage * polish cast op GetExpecctedKernelType * remove debug info in unittest	5 years ago
Zhou Wei	e0a9115e28	fix random compile failure due to missing file (#25661 )	5 years ago
Dong Daxiang	920d998f1e	add more settings for distributed strategy (#25685 ) * add more settings for distributed strategy Basically, DistributedStrategy has several parts of configurations: - BuildStrategy: the same as paddle.fluid.BuildStrategy, but the distributed arguments are moved out of BuildStrategy - ExecutionStrategy: the same as paddle.fluid.ExecutionStrategy - collective communication configs: nccl_comm_num, hierarchical allreduce and so on - distributed algorithms: async_update(mainly used in PS), lars, lamb and so on	5 years ago
Chen Weihang	c34c80d302	Polish framework error message part3 (#25701 ) * polish framework error message part3 * polish details * fix error message print error	5 years ago
arlesniak	e52df3b125	Added DNNL cache management for DyGraph (#25624 ) * Added DNNL cache management for DyGraph * move FLAGS_use_mkldnn to more general CMakeLists, getu use of the flag in ClearGradients * missing file * Fixes after review * Bringing back original idea of place for 'use_mkldnn' flag to be accessible from platform nad imperative. * Removed duplicate and added docs * Fixes for CI	5 years ago
Chen Weihang	364cc53618	Polish paddle fluid framework error message - part2 (#25667 ) * polish framework error meg part2 * polish details	5 years ago
Adam	98899b73d2	Fix FC + GRU fuse pass (#25687 )	5 years ago
wanghuancoder	1917b38099	fix some errmsg report,in framework/ir/, about 21 files (#25525 ) * fix error msg report in ir/, about 19 files, test=develop * modified some unclear descriptions, test=develop * modified some unclear descriptions, test=develop * modify unit test pass_test.cc, because the error report in pass.cc is used by pass_test.cc, test=develop	5 years ago
joanna.wozna.intel	e5bbffa84c	Add NOMINMAX define due to windows.h max/min macro conflict (#25637 ) test=develop	5 years ago
石晓伟	7206417259	supports xpu runtime, test=develop (#25554 ) * update ResetHolder, test=develop * add TensorShare for lite engine, test=develop * tensor data changed from copying to sharing, test=develop * supports xpu runtime, test=develop * fix code styles, test=develop	5 years ago
Chen Weihang	dfb3ae1b9b	Polish some error message in framework holder - Part 1 (#25509 ) * polish some error message in framework, test=develop * fix unittest error, test=develop * replace PADDLE_ENFORCE, test=develop * polish details based review comment, test=develop	5 years ago
wanghuancoder	9b46fe0440	fix some errmsg report,in framework/ir/, about 5 files (#25539 ) * fix error msg report in ir/, about 5 files, test=develop * fix error msg report in ir/, about 5 files, test=develop * fix error msg report in ir/, about 5 files, test=develop	5 years ago
Dong Daxiang	e657d7062d	fleet base initial implementation and the API (#25442 ) refactor fleet api under paddle.fleet update DistributedStrategy	5 years ago
wanghuancoder	e65c5b8e83	fix some errmsg report, in framework/ir/ (#25471 ) * fix paddle/fluid/framework/ir/ error msg reoprt, test=develop * modify error msg reoprt in ir/, about errortype, grammar, supplementary infor, test=develop * modified some unclear descriptions, test=develop * Modify the problem that report msg is less than 20 characters, test=develop	5 years ago
wanghuancoder	6c0982b942	fix some errmsg report, in framework/ir/mkldnn (#25467 ) * fix paddle/fluid/framework/ir/mkldnn/ error msg reoprt, test=develop * modify error msg reoprt, about errortype, grammar, supplementary infor, test=develop * modified some error descriptions, test=develop	5 years ago
wanghuancoder	fce6466217	fix some errmsg report, in framework/ir/ subdir(memory,optimizer,multi_device) (#25460 ) * fix paddle/fluid/framework/ir/multi_devices_graph_pass/ error msg reoprt, test=develop * fix paddle/fluid/framework/ir/memory_optimize_pass/ error msg reoprt, test=develop * fix paddle/fluid/framework/ir/fuse_optimizer_ops_pass/ error msg reoprt, test=develop * fix paddle/fluid/framework/ir/memory_optimize_pass/ error msg reoprt about PADDLE_ENFORCE, test=develop * modify error msg reoprt,about errortype，grammar. test=develop * modify error msg reoprt,about PADDLE_ENFORCE to PADDLE_ENFORCE_XXX, test=develop * modify error msg reoprt,about PADDLE_ENFORCE to PADDLE_ENFORCE_XXX, and %s to %d, test=develop * modified some error descriptions, test=develop	5 years ago
Chen Weihang	0b54d54fd8	Fix index overflow bug of the CUDA kernel loop increment (#25435 ) * fix softmax_with_cross_entropy cuda kernel overflow bug, test=develop * replace old macro & for condition, test=develop * polish details, test=develop	5 years ago
Chen Weihang	4061aa6488	Polish ParallelExecutor exception process logic (#25449 ) * polish pe exception process logic, test=develop * fix unittest, test=develop * add unittests, test=develop	5 years ago
lilong12	e39aa70ec7	add the support for pipeline (#24560 ) * add device_worker for pipeline, test=develop	5 years ago
hong	70d7d07fea	catch bad alloc exception (#25140 ) * cat bad alloc exception; test=develop * add unitest; test=develop * move bad alloc catch to the first place; test=develop * polish error message; test=develop * polish error message; test=develop * add mutex header; test=develop	5 years ago
gongweibao	80f1c50738	Fix typo in interface. (#24779 )	5 years ago
Zhaolong Xing	7b7e605189	[Fix BUGs]: fix multhead matmul pass's instable bug (#25123 ) * fix multhead matmul's instable test=develop * fix multihead matmul bug test=develop * fix converage problem test=develop	5 years ago
Dong Daxiang	d5e40d1ba9	Paddle fleet distributed strategy (#25379 ) * add paddle.fleet.DistributedStrategy for 2.0	5 years ago
Wojciech Uss	d0a921ba98	Quant2 updates and fixes (#25313 )	5 years ago
Jacek Czaja	17c751bec6	[oneDNN] Fix to #25078 (#25256 )	5 years ago
MRXLT	3b8f0a64c2	Encryption infer (#25119 ) * add encrypt api for inference lib	5 years ago
Sylwester Fraczek	36abeff44f	adding elementwiseadd quantization (#25178 )	5 years ago
Pei Yang	b2f5a149e7	[Paddle-TRT] Better Paddle-TensorRT support for PaddleSlim quant models (#25097 ) * Paddle-TensorRT support slim QAT. test=develop * add comments. test=develop * use RenameInput instead of ResetInputs. test=develop	5 years ago
Shibo Tao	19c4db1b56	don't re-generate header file if content doesn't change (#25130 ) * don't re-generate header file if content doesn't change. test=develop * add copy_if_different function. test=develop	5 years ago
Jacek Czaja	a7944904d3	[oneDNN]elementwise_add and elementwise_mul int8 support (#24984 ) * Start implementing int8 eltwise add test=develop * - Fix to Michal PR * - Fix test=develop * - Lint fixes test=develop * - Added checking if elementwise_mul can be used test=develop * - Added attribs to skip_attrs_set test=develop * - Improved broadcasting test=develop - fixes to compilation - fix - fix - Lint fixes test=develop * - removed redundant condition test=develop Co-authored-by: Michal Gallus <michal.gallus@intel.com>	5 years ago
hutuxian	5822862d8a	Monitor Framework (#24079 ) * Add a StatValue class in the backend to represent a stat. * Add a singleton StatRegistry to maintain the collection of stats. * For the sake of code neatness, we only support type of int and float, which can cover most of the scenarios.	5 years ago
Leo Chen	25a4dac4c2	Use allow list instead of white list (#25002 ) * use allow list instead of white list, test=develop * reduce include, test=develop	5 years ago
hutuxian	1c224e26af	support CMatchAuc (#24990 ) Support CMatchAucCalculator based on CMatchRankAucCalculator with a new parameter ignore_rank	5 years ago
Sylwester Fraczek	53d563a0fe	Reshape transpose matmul coverage (#24970 ) * remove gmock from ut test=develop * coverage enabled for r+t+m fuse pass test=develop	5 years ago
Sylwester Fraczek	a7ee634b45	fix WARNING: ThreadSanitizer: heap-use-after-free (#24929 ) test=develop	5 years ago
Zhou Wei	4058e736ff	temporarily disable these unittests failed on windows (#24942 )	5 years ago
lilong12	29de0d97a5	add the support to specify device index for device_guard (#24555 ) * add the support of device index for device_guard.	5 years ago
hutuxian	b8f17a049d	fix problem in dump and add log (#24891 ) * Fix the field length in LoD scenario * Fix the missed lod info when copy tensor in dump field * Add some log to make debug easy	5 years ago
Chen Weihang	6aae034f8d	add dep for fs.cc, test=develop, test=document_fix (#24881 )	5 years ago
Jacek Czaja	40a5f3fd86	[oneDNN] Clearing mkldnn cache in naiveexecutor destructor (#24756 )	5 years ago
Chen Weihang	d1062d5278	Replace all errors thrown by LOG(FATAL) with PADDLE_THROW (#24759 ) * remove REPLACE_ENFORCE_GLOG compile option & add ci rule prohibit LOG(FATAL) using, test=develop * remove ci test case, test=develop * replace all LOG(FATAL) & polish message, test=develop * fix typo, test=develop * polish error info detail, test=develop	5 years ago
123malin	9d2bd0ac38	downpour_worker增加try_catch机制，打印program所有参数 (#24700 ) * test=develop, add try_catch for debug	5 years ago
Michał Gallus	b2ba830eeb	Fix bug in ShareBufferWith causing eltwise_add inplace ut to fail (#24853 )	5 years ago
Wojciech Uss	78d4f0cc91	add option to exclude ops by id from quantization (#24689 )	5 years ago
Yanghello	62b4ff7dd2	Aes_cipher_test and cipher_utils_test failed fixed (#24816 )	5 years ago
Yanghello	5a7a517cde	Add crypto api (#24694 )	5 years ago
Chen Weihang	19e5f7879c	Append error op hint for GradOpMaker (#24750 ) * append error op hint for grad op maker, test=develop * add unittests for coverage, test=develop	5 years ago
ShenLiang	950892044f	fix conflict, test=develop (#24238 )	5 years ago
hutuxian	e6b87b3193	Support AucRunner in PaddleBox (#22884 ) * Support AucRunner in PaddleBox * update some code style	5 years ago
wangchaochaohu	dbfe5333c5	Add pe profiler Event (#24611 )	5 years ago
Wilber	ba2f8f0ce4	fix embedding_eltwise_layernorm_fuse_pass. test=develop (#24592 )	5 years ago
hutuxian	0ec3a42e97	Random Dump (#24477 ) * Refactor code for dump_field & dump_param: abstracting the common function in base class. * Support dump randomly & random with lineid * Support specify the random interval, which avoids printing too much logs.	5 years ago
Yiqun Liu	6b464f969a	Add an operator node in unittest to make the fusing result unique. (#24617 )	5 years ago
Yiqun Liu	560c815390	Add some check for CUDA Driver API and NVRTC (#22719 ) * Add the check for whether CUDA Driver and NVRTC is available for the runtime system. * Call cuInit to initialize the CUDA Driver API before all CUDA callings. test=develop * Change the behavior when libnvrtc.so can not be found, printing a warning instead of exiting. test=develop * Do not initialize CUDA Driver API for windows and macos. test=develop * Remove the call of cuInit when entering paddle and enable the test_code_generator. test=develop * Add some built-in functions for __half. test=develop * Change save_intermediate_out to false in unittest. test=develop * Fix error reference to tempropary variable when seting including path for device_code. test=develop	5 years ago
pawelpiotrowicz	db2b6b6568	Hide globals & redesign restore PR (#24279 ) test=develop	5 years ago
Jacek Czaja	8b88cd5167	[oneDNN] Fix to inplace pass (#24442 ) * - Disabling inplace pass test=develop - Disable cycles test=develop - fix test=develop - Enhancement to in-place - Lint fixes test=develop * - Lint fixes test=develop	5 years ago
hutuxian	123255cf9f	change InitializeGPU to InitializeGPUAndLoadModel (#24377 ) * Add InitializeGPUAndLoadModel to solve random hang when downloading sparse parameters. * Update SaveBase to solve test problem.	5 years ago
Chen Weihang	aa0f254fbe	Add macro BOOST_GET to enrich the error information of boost :: get (#24175 ) * add new macro BOOST_GET_SAFELY & unittests, test=develop * add different macro type, test=develop * fix get macro type in executor, test=develop * four macro part change backup * using one macro for all case, test=develop * revert attribute change, test=develop * change to three func to solve gcc4.8 bug, test=develop * polish some details, test=develop	5 years ago
Wojciech Uss	db052009c7	Enabled quantize all and skip missing in QAT (#24281 ) * Enabled quantize all and skip missing in QAT	5 years ago
Huihuang Zheng	8a1a2af82e	Add Assert Op (#24280 ) 1. To make ProgramTranslator to support `assert` grammar, this PR adds `assert` python API and C++ code. 2. Fix a bug: graph_pattern_detector.h #include <gtest/gtest_prod.h> but didn't declared dependency at CMakeLists, which can cause single build failure. 3. Refactoring `Formatter` in print_op to make it reusable and reuse the formatter to print in assert op.	5 years ago
joanna.wozna.intel	356f5ee220	[Refactoring] Unify op-dequant squashes (#24277 )	5 years ago
liym27	ac9a7eeea4	[Dy2Stat]Support list pop (#24250 ) * Replace dygraph_to_static_func with @declarative or program_translator.get_func in test_list.py * Add comments in ConditionalBlock. * Support list pop last item. * Support pop the i-th item. * Support an empty tensor array as Input in assign op and set the kernel type is float.	5 years ago
xujiaqi01	1034ca316f	add timeout and http store in communication (#23436 ) * add timeout and http store in communication, add revert and confirm in fleet * test=develop	5 years ago
wawltor	d1e1d85881	add the graph batch reader for pslib mode (#24178 ) Add the pslib graph batch reader mode, add the test case for this change	5 years ago
joanna.wozna.intel	b43b46e619	[INT8] Add requant-op squash (#24143 )	5 years ago
hutuxian	3e2bc8715f	Try to fix UT Random Fail (#24223 )	5 years ago
Sylwester Fraczek	e1a7a88057	added reshape transpose matmul fuse pass (#23754 )	5 years ago
Chen Weihang	9b851ba216	[dy2static] Add print transformer and unify print format (#24068 ) * add print transformer & unify print format, test=develop * remove using of dygraph_to_static_func, test=develop * remove python stdout capture, test=develop * fix compatibility problems for PY2, test=develop * fix detail error, test=develop * fix type analysis bug, test=develop * fix print tuple compatible error in PY2, test=develop * replace get_func to declarative, test=develop * fix detail bug, test=develop * fix some detail problems, test=develop * change visit_call in print transformer, test=develop	5 years ago
wangchaochaohu	fa43d74a3a	fix the intermediate node of graph for fusion group test=develop (#24184 )	5 years ago
Yiqun Liu	ecfddebbef	Add the implementation of inverse (#23310 )	5 years ago
liuwei1031	9a93f6aae0	improve efficiency of runtime InferVarType (#22778 ) * save InferVarType changes, test=develop * remove code comments, test=develop * tweak code, test=develop * fix compilation warning, update merge_ids_op split_ids_op to new interface, test=develop * modify fused_bn_activation_op, test=develop * fix error of fused_bn_activation_op, test=develop * fix PADDLE_ENFORCE and unittest coverage issue, test=develop * tweak PADDLE_ENFORCE messages, test=develop * improve unittest coverage, test=develop * add StaticGraphInferVarType class, test=develop * rebase develop branch, test=develop * fix unittest error, test=develop * remove comments, test=develop * improve unittest coverage, test=develop * imporve error message and imporve unittest coverage, test=develop * upgrade InferVarType API, test=develop * tweak pyfunc error message, test=develop * fix compilation conflict - save_combine_op, test=develop	5 years ago
wangchaochaohu	2270864019	Fusion group optimize for cuda codegen(#23940 )	5 years ago
ShenLiang	94dfb7d770	opt the postprocess, test=develop (#24155 )	5 years ago
Jacek Czaja	eb411613e9	[DNNL] refine activations Inplace support (#24145 )	5 years ago
Jacek Czaja	461e6a01ec	[DNNL] activations Inplace support (#24123 )	5 years ago
Zhang Ting	fb0729ee7f	avoid warnings in MAC compile (#24124 )	5 years ago
arlesniak	d31a174f51	added fusing matmul-transpose-reshape pass (#23866 )	5 years ago

1 2 3 4 5 ...

3009 Commits (aba759ba16422abf8cd39ae7e19d24f5997b9ade)