yaoxuefeng
a47d92d868
fleet add save with whitelist test=develop ( #23376 )
5 years ago
Wilber
68e0560c2f
refine paddle inference api ( #26774 )
...
* refine paddle inference api
Co-authored-by: nhzlx <nhzlx.dragon@gmail.com>
5 years ago
Leo Chen
844583c8fd
Refine paddle.manual_seed ( #26496 )
...
* refine manual seed
* fix ci problem
* fix unittests
* fix unittest
* set is_init_py=false in manual_seed
* fix unittest
* fix bernoulli_op
* fix(unittest): change random_seed to manual_seed
* 🐞 fix(unittest): fix manual_seed
* trigger ci
* fix test_sentiment
* fix test_imperative_save_load
* fix test_uniform_random_op
* fix test_uniform_random_op
* fix test_jit_save_load
* merge develop
* fix manual_seed
* fix manual_seed
* use global engine
* use shared_ptr
* fix double free
* fix bug
* fix bug
* fix bug
* fix test bug
* fix test bug
* fix test bug
* fix ci
5 years ago
joanna.wozna.intel
02083bda40
Add mkldnn bfloat16 option to C-API ( #26676 )
...
* Add mkldnn bfloat16 option to C-API
* Add test for bfloat16 gpu
* Change coverage test
5 years ago
Zhen Wang
f9066e6a6f
Update the demo code and the doc of varbase.backward. ( #26506 )
...
* update the demo code and the doc of varbase.backward.
* update the doc of the fake interface `paddle.fluid.Variable`.
* remove BackwardStrategy.
5 years ago
lilong12
1c68138327
[api 2.0] add collective op for cpu using gloo and paddle.distributed.* apis ( #26552 )
...
add collective op for cpu using gloo and paddle.distributed.* apis
5 years ago
Zhang Ting
0a895bc0df
improve unique op ( #26537 )
...
* add unique_v2 op
* remove unique_v2 op
* update doc
5 years ago
wanghuancoder
c1f5df5269
optimized transformation form tensor to numpy ( #26447 )
...
* optimized transformation form tensor to numpy, test=develop
* optimized transformation form tensor to numpy, pass pre-commit, test=develop
* modify fetchophandle zerocopy to deepcopy in PE&CUP, test=develop
* modify py:array construct, test=develop
* fix _fetch_var to use deep copy, test=develop
5 years ago
wanghuancoder
422a162019
api2.0 paddle.nn.Bilinear and paddle.nn.functional.bilinear ( #26399 )
...
* api2.0 paddle.nn.Bilinear and paddle.nn.functional.bilinear, test=develop
* api2.0 fix code examples, test=develop
* modify test_bilinear_api, about place,to_tensor , test=develop
* re pass pre-commit, test=develop
* Update common.py
* fix BilinearTensorProduct ci error, test=develop
5 years ago
wanghuancoder
6e823cfec3
add op_function_generator.exe retry in windows, test=develop ( #26591 )
...
add op_function_generator.exe retry in windows
5 years ago
wangchaochaohu
ebf9b2125e
add paddle.gather for API2.0 ( #26455 )
5 years ago
QingshuChen
138ecf24aa
support Baidu Kunlun AI Accelerator ( #25959 )
...
* support Baidu AI Accelerator
* test=kunlun
* minor
* test=kunlun
* support xpu op in separate file
* test=kunlun
* update XPU error message and remove duplicated code
* test=kunlun
* minor
* test=kunlun
* minor
* test=kunlun
5 years ago
ceci3
56890dc729
Add SyncBatchNorm ( #26032 )
...
* add SyncBatchNorm,test=develop
5 years ago
Leo Chen
049ac56c08
Print user-friendly error message in core.ops [part 2] ( #26377 )
5 years ago
yaoxuefeng
23261ff44b
add cpu random Generator ( #26013 )
5 years ago
Leo Chen
672578a797
Print user-friendly error message in core.ops ( #26261 )
...
* print user-friendly error message
* adjust error sumary
5 years ago
wangchaochaohu
0b81d76310
[API2.0] add op for cudnn version query test=develop ( #26180 )
5 years ago
wangchaochaohu
bb11cbc250
[API2.0] add Device api (set_device and get_device)( #26103 )
5 years ago
Zhou Wei
6de463d3d1
expose and unify the Tensor concepts to the user ( #25978 )
...
* expose and unify the Tensor concepts to the user
* expose tensor to user
* add copy place for Tensor
* add copy place for Tensor
* add note
* add macro PADDLE_WITH_CUDA
* remove RUN_TYPE=DIST
* fix some error
5 years ago
Zhou Wei
20147ace3f
fix_copy_if_different ( #25868 )
5 years ago
Leo Chen
2d95280e1f
Feature/Enable Auto-Mixed-Precision in dynamic graph ( #24903 )
...
* add auto_cast, test=develop
* add loss scaler, test=develop
* add comments, test=develop
* refine code, test=develop
* refine code, test=develop
* do not set flags automatically, test=develop
* fix custom op bug, test=develop
* add more test, test=develop
* refine enable logic, test=develop
* enable amp test with GPU, test=develop
* add unittest
* add test for found_inf
* follow comments
* follow comments
* remove global variable, use singleton
* add some notes
* update comments
* update comments
* update comments
* add use_dynamic_loss_scaling argument
* refine found_inf
* refine found_inf
5 years ago
Chen Weihang
838e36e9ed
Fix loaded variable suffix repeat error ( #26169 )
...
* fix loaded var suffix repeat error
* use new dygraph name for loaded param
5 years ago
Jack Zhou
dea41da715
add nll loss API for the paddlepaddle api2.0
...
* add nll loss API, update demo code of the comment
5 years ago
Chen Weihang
3c8daa9b89
Add pin memory control for BufferedReader ( #26026 )
...
* add pin memory control
* fix buffered reader init problem
* fix unittest error
* add unittest for coverage
5 years ago
Leo Chen
751305ecf0
Add flags to control call stack of error message ( #25997 )
...
* add flags_call_stack_level
* update
* refine code
5 years ago
Thunderbrook
0cb60c700d
add heter ps mode ( #25682 )
...
* add heter ps mode
* code style
test=develop
* add with_pslib
test=develop
* unitest
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* code style
test=develop
* test monitor
test=develop
* prepare trainer
test=develop
* code style
test=develop
5 years ago
tangwei12
caa90a6510
Integrated Trainer of Parameter Server (API add `fluid.contrib.layers.sparse_embedding` only) ( #22957 )
...
* Integrated Trainer of Parameter Server
5 years ago
Zhou Wei
b484a59c39
fix copy file random fail on windows ( #25731 )
5 years ago
Pei Yang
55b6205ddf
add set_mkldnn_cache_capacity python api( #25524 )
5 years ago
Zhen Wang
cea5086853
Fix the double grad bug for the star gan. ( #25655 )
...
* fix the double grad bug for the star gan. test=develop
* update the retain_graph parameter doc. test=develop
* add the unit test for the retain_graph parameter. test=develop
5 years ago
石晓伟
7206417259
supports xpu runtime, test=develop ( #25554 )
...
* update ResetHolder, test=develop
* add TensorShare for lite engine, test=develop
* tensor data changed from copying to sharing, test=develop
* supports xpu runtime, test=develop
* fix code styles, test=develop
5 years ago
Pei Yang
43f9f180e5
Add api to clear intermediate tensors in AnalysisPredictor ( #25069 )
...
* add api to clear intemediate tensors in analysis predictor. test=develop
* add python api. test=develop
5 years ago
Zhen Wang
bb45af02ac
add the c++ part of Imperative QAT. test=develop ( #25446 )
5 years ago
ceci3
52be62c5ae
fix instance norm in dy ( #24717 )
...
* fix bn & in in dy, test=develop
* update instance_norm,test=develop
* fix bugs,test=develop
* add more case in unittest,test=develop
* fix,test=develop
* fix,test=develop
5 years ago
gongweibao
80f1c50738
Fix typo in interface. ( #24779 )
5 years ago
Chen Weihang
f07b25d8e5
fix DataLoader.generrator using error, test=develop ( #25355 )
5 years ago
Aurelius84
494cb36d09
Modify tmp var name prefix in dygraph ( #25280 )
...
* Modify tmp var name prefix in dygraph test=develop
* refine comment test=develop
5 years ago
Shibo Tao
19c4db1b56
don't re-generate header file if content doesn't change ( #25130 )
...
* don't re-generate header file if content doesn't change. test=develop
* add copy_if_different function. test=develop
5 years ago
Chen Weihang
b23801a262
polish tensor set error messag, test=develop ( #25113 )
5 years ago
hutuxian
5822862d8a
Monitor Framework ( #24079 )
...
* Add a StatValue class in the backend to represent a stat.
* Add a singleton StatRegistry to maintain the collection of stats.
* For the sake of code neatness, we only support type of int and float, which can cover most of the scenarios.
5 years ago
Leo Chen
bfa46c38d5
bn supports reverse_space, test=develop ( #24988 )
5 years ago
Leo Chen
6190023ac9
Refine error message in pybind folder ( #24886 )
...
* refine err_msg of pybind.cc, test=develop
* refine err_msg in tensor_py.h, test=develop
* refine error msg, test=develop
* fix test_exception, test=develop
* follow comments, test=develop
5 years ago
Chen Weihang
4a702ef361
Support SelelctedRows allreduce in multi-cards imperative mode ( #24690 )
...
* support selectedrows allreduce in multi-cards dygraph, test=develop
* remove useless import modules in unittests, test=develop
* add nccl cmake to get nccl version, test=develop
* add if-condition to compiled correctly, test=develop
* add detail version parseing for old nccl, test=develop
* polish camke details, test=develop
* fix remove test cmake error, test=develop
* fix cmake condition, test=develop
* change unittest camke list, test=develop
* fix unittest cmake rule, test=develop, test=framep0
5 years ago
Pei Yang
14b8540551
add default ctor for AnalysisConfig python api. test=develop ( #24924 )
5 years ago
Leo Chen
1e818158f5
Feature/add amp_checkout_finite_and_scale op ( #24875 )
...
* add amp_check_finite_and_scale op, test=develop
* add cpu kernel, test=develop
* use bool, test=develop
* follow comments, test=develop
5 years ago
Chen Weihang
d1062d5278
Replace all errors thrown by LOG(FATAL) with PADDLE_THROW ( #24759 )
...
* remove REPLACE_ENFORCE_GLOG compile option & add ci rule prohibit LOG(FATAL) using, test=develop
* remove ci test case, test=develop
* replace all LOG(FATAL) & polish message, test=develop
* fix typo, test=develop
* polish error info detail, test=develop
5 years ago
Yanghello
aa47356b74
Add crypto python ( #24836 )
...
* add crypto helper for paddle, test=develop
* cryptopp.cmake bug fixed, test=develop
* remove debug build type, test=develop
* fixed CMakeLists for new target, test=develop
* fix CI bug, test=develop
* add cmake option flag DWITH_CRYPTO, test=develop
* add crypto api for python, test=develop
* Revert "add crypto api for python, test=develop"
This reverts commit 3a1cfa9d055fab357f46e653a8786f96336f6b47.
* Revert "Add crypto api (#24694 )"
This reverts commit 5a7a517cde
.
* Revert "Revert "Add crypto api (#24694 )""
This reverts commit f952b19fa7e8b7f9c57d31d78b9ffee1041c43ed.
* fixed cryptopp cmake building error, test=develop
* change WITH_CRYPTO building option to OFF, test=develop
* âfixed cipher test failed, test=develop
* "add crypto api for python, test=develop"
This reverts commit 83fb55c0668d59afad2ad1e7e04d425c7c7dd189.
* travis CI bug fixed, test=develop
* fixed test in python3
* test=develop
* fixed unittest, test=develop
5 years ago
Zhen Wang
23d253e1be
Fix out of range error for outs map. test=develop ( #24774 )
5 years ago
ShenLiang
950892044f
fix conflict, test=develop ( #24238 )
5 years ago
hutuxian
e6b87b3193
Support AucRunner in PaddleBox ( #22884 )
...
* Support AucRunner in PaddleBox
* update some code style
5 years ago
Leo Chen
9c9e635c00
support tensor to varbase, test=develop ( #24660 )
5 years ago
Leo Chen
14dd6388c5
fix bug of varbase.__getitem__, test=develop ( #24642 )
...
* fix bug of varbase.__getitem__, test=develop
* fix bug of float and other type, test=develop
5 years ago
Leo Chen
d980d251f0
specify outs, test=develop ( #24537 )
5 years ago
hutuxian
123255cf9f
change InitializeGPU to InitializeGPUAndLoadModel ( #24377 )
...
* Add InitializeGPUAndLoadModel to solve random hang when downloading sparse parameters.
* Update SaveBase to solve test problem.
6 years ago
Chen Weihang
aa0f254fbe
Add macro BOOST_GET to enrich the error information of boost :: get ( #24175 )
...
* add new macro BOOST_GET_SAFELY & unittests, test=develop
* add different macro type, test=develop
* fix get macro type in executor, test=develop
* four macro part change backup
* using one macro for all case, test=develop
* revert attribute change, test=develop
* change to three func to solve gcc4.8 bug, test=develop
* polish some details, test=develop
6 years ago
hong
67f66f0904
Fix get item out of range error ( #24339 )
...
* raise index error when slice out of range; test=develop
* add uni test; test=develop
* fix format error; test=develop
* add comment for py::index_error; test=develop
* polish error message; test=develop
* polish error message; test=develop
6 years ago
Tao Luo
9eedf05d2f
solve mklml memory leak on windows ( #24015 )
...
* solve mklml memory leak on windows
test=develop
* remove unused msvcr120.dll
test=develop
6 years ago
xujiaqi01
1034ca316f
add timeout and http store in communication ( #23436 )
...
* add timeout and http store in communication, add revert and confirm in fleet
* test=develop
6 years ago
Zhang Ting
ab8f8fa70d
fix example code, test=develop, test=document_fix ( #24139 )
6 years ago
石晓伟
46f3139c7f
supports loading model from memory, test=develop ( #24098 )
6 years ago
Leo Chen
5cccc69f1a
update name generator, test=develop ( #24048 )
...
* update name generator, test=develop
* use c++ unique name generator, test=develop
6 years ago
wawltor
5c669ad1c2
Add the support dygraph out attribute for the op of mm in api2.0 ( #23978 )
...
Fix the dygraph mode in matmul, add the support in Linear Op
6 years ago
Kaipeng Deng
80cf3c3c4d
Refine DataLoader support multi-processing ( #23107 )
...
* add DataLoader, Dataset, BatchSampler
6 years ago
guofei
2b896c1f6b
Support LoDTensorArray in fetch ( #23645 )
...
* Support LoDTEnsorArray in fetch op
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
* Support LoDTensorArray in fetch
test=develop
6 years ago
hutuxian
df64a96686
support set_test_mode and set comlog level( #23905 )
6 years ago
xujiaqi01
d98084e7ec
add save with prefix ( #23449 )
...
* add save with prefix
* test=develop
6 years ago
Leo Chen
b59426b52a
Enhance error msg of imperative code ( #23572 )
...
* fix init_gflags with 'python -c', test=develop
* enhance error msg related Tracer, test=develop
* refine err msg, test=develop
* follow comments, test=develop
6 years ago
hutuxian
94a3789fd0
Add AfsAPI in PaddleBox ( #23419 )
...
* Involves AfsAPI to resolve slow downloading.
* Mainly used in PaddleBox
6 years ago
Chen Weihang
df538439f5
api build strategy error polish, test=develop ( #23546 )
6 years ago
mozga-intel
3baaee9aab
Remove: NGraph engine from PDPD repository ( #23545 )
...
* Remove the NGraph engine from PDPD repository
1. Each operator was removed from the operator's directory
2. Each test was removed from the unittest directory
3. The parallel executor support was removed from the PDPD
4. The CMake file was removed from the PDPD
5. The NG flags were removed from the repository
test=develop
* Remove ngraph from:
1. Cmake file
2. Python file
test=develop
6 years ago
Chen Weihang
45880f604b
API(Program) error message enhancement ( #23519 )
...
* polish api program error message, test=develop
* fix condition error, test=develop
* fix test prune error, test=develop
* fix coverage problem, test=develop
6 years ago
石晓伟
9b82e4c183
change the cmake and apis of lite engine, test=develop ( #22934 )
...
* change the cmake and apis of lite engine, test=develop
* change the cmake of lite engine, test=develop
6 years ago
guofei
ca7bd2beb1
Add a function to update FLAGS ( #22851 )
...
* Add a function to update FLAGS
test=develop
* Add a function to update FLAGS
test=develop
* expr flags
* Add a function to update FLAGS
test=develop
* distinguish public/private vars, test=develop
* fix windows issues, test=develop
* expr flag
* Add functions to get and set FLAGS
test=develop
* Add functions to get and set FLAGS
test=develop
* Add functions to get and set FLAGS
test=develop
* Add functions to get and set flags
test=develop
* Add functions to get and set FLAGS
test=develop
* Add a function to update FLAGS
test=develop
* Add a function to update FLAGS
test=develop
* Add functions to get and set flags in Paddle
test=develop
Co-authored-by: sneaxiy <sneaxiy@126.com>
6 years ago
ShenLiang
5223e2bbc4
Add a new DataFeed named PaddleBoxDataFeed ( #23321 )
...
* add paddleboxdatafeed
* add ifdef linux and boxps
* add untest for datafeed
* fix untest of test_paddlebox_datafeed
* fix untest
* rename function
6 years ago
Chen Weihang
75bd350710
Implement StaticModelRunner to support dygraph fine-tune static graph pre-training model ( #23171 )
...
* static model runner basic implement, test=develop
* add run program op to execute loaded program, test=develop
* refactor static model runner & run program op, test=develop
* reset engine.cc to resolve conflict
* adapt the change of dygraph double grad, test=develop
* refactor impl to solve control flow error, test=develop
* clear debug code, test=develop
* fix ci str compatible error & checkout dygraph grad maker & add example, test=develop
* hide api & add op test, test=develop
* fix run program op test places error, test=develop
* fix program by review comment, test=develop
* delete change var desc name, test=develop
* fix other program by review comment, test=develop
* remove _static_graph_guard, test=develop
* add selectedrows test, test=develop
* remove desc parser, test=develop
* fix detail program, test=develop
* change socpe create & add test, test=develop
6 years ago
gongweibao
24a063f6ac
Add fleet checkpoint on local fs and remote fs(such as hdfs) for EDL ( #22586 )
6 years ago
Zeng Jinle
0c23e3ff4d
fix Tracer::NoGrad, test=develop ( #23443 )
6 years ago
Leo Chen
a62599a888
[feature] prune program by feed and fetch_list automatically ( #22474 )
...
* prune train program by fetch_list, test=develop
* add unittest for prune, test=develop
* fix pruned feed, test=develop
* support ParallelExecutor and feed prune, test=develop
* add comments, test=develop
* update unittest, test=develop
* update unittests, test=develop
* remove debug code, test=develop
* support cond in clone, test=develop
* support cond in prune, test=develop
* support multiple minimize, test=develop
* support cache, test=develop
* fix _copy_param_info_from, test=develop
* support python2 str, test=develop
* remove debug code, test=develop
* fix bug of caching CompiledProgram, test=develop
* fix multi_device issue, test=develop
* tmp
* support tuple in fetch_list and overriding use_prune, test=develop
* dont use nonlocal in python2, test=develop
* remove nonlocal, test=develop
* code clean, test=develop
* code clean, test=develop
* feed list, test=develop
* test adam, test=develop
* follow comments, test=develop
* reduce duplicate code, test=develop
* update comments, test=develop
6 years ago
songyouwei
99d30bfc36
speedup slice impl ( #23340 )
...
test=develop
6 years ago
Leo Chen
488b2387e2
Feature/expand params in auto-generated pybind functions for dygraph operators ( #23181 )
...
* expand parameters, test=develop
* support resnet, test=develop
* fix resnet, test=develop
* support duplicable out, test=develop
* support ptb
* fix bugs, test=develop
* support null input, test=develop
* fix bugs, test=develop
* fix batchNorm is_test, test=develop
* refine code, test=develop
* follow comments, test=develop
* follow comments, test=develop
* follow comments, test=develop
* follow comments, test=develop
6 years ago
Zeng Jinle
babda94c8a
Distinguish public/private global vars ( #23269 )
...
* distinguish public/private vars, test=develop
* fix windows issues, test=develop
6 years ago
Zeng Jinle
8bfd62ffb7
Expose dygraph.grad api ( #23124 )
...
* expose dygraph.grad api, test=develop, test=document_fix
* add more parameter in dygraph.grad API, test=develop
* add only_inputs=True parameter, test=develop
* follow comments, test=develop, test=document_fix
* fix typo, test=develop, test=document_fix
6 years ago
Zhaolong Xing
430b0099c9
[Paddle-TRT]: Ernie Dynamic shape support. ( #23138 )
...
* add dynamic plugin support.
test=develop
* change emb eltwise layernorm to math function
test=develop
* add emb eltwise layernorm
test=develop
* can run dynamic shape ernie
test=develop
* fix ci
test=develop
* add ut for trt ernie dynamic
test=develop
* refine dynamic shape c++ interface.
test=develop
* fix comments
test=develop
* fix comments
test=develop
6 years ago
xujiaqi01
68ea1ad55b
add clear one table ( #23089 )
...
* add clear_one_table
* test=develop
6 years ago
Zeng Jinle
acfc9b8a70
Reader sequential and inference partial feed ( #22699 )
...
* sequential reader stage 1, test=develop
* fix ut, test=develop
* fix iterable=False reset bug, add some logs and polish code, test=develop
* inference feed partial data, test=develop
* Turn on keep_order=True for test, test=develop
* enhance ut to test more cases, test=develop
* test commit for reverting
* Revert "test commit for reverting", test=develop
This reverts commit 80aef42ef52ba1ee79627d6f663a624ec4f12f58.
* add ut of merged and unmerged results, test=develop
* add more uts for coverages and add en doc of api, test=develop
* follow comments, test=develop
* change note style, test=develop
6 years ago
Zeng Jinle
a31d7328b7
Add dygraph double grad implementation ( #22939 )
...
* add double grad implementation for dygraph, test=develop
* polish code, add uts, test=develop
* fix place bug, test=develop
* polish codes, add more uts for coverages, test=develop
* add no_grad_set, test=develop
* add star gan ut, test=develop
* follow comments, test=develop
6 years ago
songyouwei
2e2da7124b
high-performance dygraph slice ( #22879 )
...
* move __getitem__ to cpp
* bug fix
* add type check and gil release
* support negative step with omitted ends
test=develop
* code refine
test=develop
* bug fix
test=develop
* slice always return different pyobj
test=develop
6 years ago
zhaoyuchen2018
a020a25797
Fix model int8 quant fail, test=develop ( #22891 )
...
As model fails when enable int8 quant, so disable allocate memory in cpu
for small variable.
6 years ago
Zhaolong Xing
dd67d44a50
[Paddle-TRT] : (Part1) Dynamic shape support ( #22868 )
...
* change the ci trt from version 5. to 6.0
* paddle-trt dynamic shape support init
* conv+bias or conv+bn dynamic shape support
test=develop
* modity trt engine opconvert
test=develop
* fix ci error
test=develop
6 years ago
Zeng Jinle
d41d802ba3
Add flags to limit gpu memory ( #22793 )
...
* add recorded cuda memory apis, fix typo, test=develop
* add more ut, test=develop
* follow comments, test=develop
* fix py35 incompatible issues, test=develop
6 years ago
石晓伟
1861ca88f1
serialize the PaddleTensor, test=develop ( #22810 )
...
* encapsulate the PaddleTensorToLoDTensor, test=develop
* serialize the pd_tensor, test=develop
* serialize tensors to file, test=develop
6 years ago
Zhang Ting
4e8bc02461
add fluid.device_guard to specify the device type for Op ( #22254 )
...
* add fluid.device_guard to specify the device type for Op
6 years ago
Zhen Wang
89cfa49156
Unmerged fetch list ( #22635 )
...
* update ScopeBufferedSSAGraphExecutor&AsyncSSAGraphExecutor&ThreadedSSAGraphExecutor&FastThreadedSSAGraphExecutor&ParallelSSAGraphExecutor&ParallelExecutor for fetching unmerged results.
* add the unit test for fetch_unmerged.
* update ut for multi-card and multi-cpu.
* add the error message and the user suggestion in FetchOpHandle. test=develop
6 years ago
Chen Weihang
7d8d573453
Speed up dygraph DataLoader based on shared memory and LoDTensor serialization ( #22541 )
...
* add lodtensor share memory & serialization, test=develop
* fix windows compile error, test=develop
* deal vartype pickle & fix unittest matching error message, test=develop
* update timeout variable name, test=develop
* refactor memory map implement, test=develop
* clear mmap file discripter when exit unexpectedly, test=develop
* remove the child process fd in advance, test=develop
* remove mmap fds after Queue.put in child process, test=develop
* add hard unittests for register exit func, test=develop
* fix python2 compatibility problem in unittest, test=develop
* fix exception unittest error, test=develop
* polish code based review comment, test=develop
6 years ago
hutuxian
53a2b68f4e
support customized download command in dataset ( #22782 )
...
* user can call dataset.set_download_cmd to set its customized download cmd
* add UT to cover this scenario
6 years ago
zhaoyuchen2018
72dde4abde
Refine adam op to improve performance, test=develop ( #22346 )
...
* Refine adam op, test=develop
* Fuse kernels together to reduce cpu time.
* Refine paddle enforce, test=develop
* Remove some comments, test=develop
* Refine code,test=develop
* Refine cuda kernel, test=develop
* Refine code according to comments, test=develop
6 years ago
Leo Chen
b2c1be851a
support cond in clone, test=develop ( #22657 )
...
* support cond in clone, test=develop
* refine code, test=develop
* refine code, test=develop
* follow comments, test=develop
* refine code, test=develop
6 years ago
hutuxian
175954d894
PaddleBox Framework Part2 ( #22466 )
...
* Add two types of Metric Calculator: MultiTaskCalculator & CmatchRankCalculator.
* Add a config for DynamicAdjustChannelNum function to denote whether we will discard the remaining instances when they are not be distributed evenly.
* Remove CPU code in Pull/PushSparse and we will add it back when testing it fully.
* Fix some known issues: such as copying persistable vars after one epoch running.
6 years ago
tianshuo78520a
d2ba91aad1
fix typo words ( #22653 )
6 years ago
tangwei12
66a3150135
SYNC with communicaotor ( #22344 )
...
* add sync communicator and implement
6 years ago