03bbe5f2a8
neon acceleration for subtract
4 years ago
41d925b68a
set stage id
4 years ago
f60ae8925d
!8480 Add RandomNode fix
...
From: @ezphlow
Reviewed-by: @pandoublefeng,@heleiwang
Signed-off-by:
4 years ago
510a0399fc
!8335 added cluster config and message handler unit test,change namespace from comm to core
...
From: @anancds
Reviewed-by:
Signed-off-by:
4 years ago
a21eb2d527
Added random node fix
4 years ago
0de9d3e5b7
!6989 split sort for parallel run
...
From: @kisnwang
Reviewed-by:
Signed-off-by:
4 years ago
222a0bccf4
!8431 Add more check in unsorted_segment_sum_fission pass to avoid doing wrong optimize which cause runtime error
...
From: @irmo
Reviewed-by:
Signed-off-by:
4 years ago
96d8c411e7
added message handler unit test
4 years ago
1c6c280da7
fix unsorted_segment_sum_fission pass
4 years ago
70f5775711
!8387 Add support for GetClassIndexing in C++ API
...
From: @alex-yuyue
Reviewed-by:
Signed-off-by:
4 years ago
d7c3a9ba00
Add GetClassIndexing
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
b88e722e12
add graph partition
4 years ago
bc12c647a5
!8380 [MD]remove opencv api with lite_cv in lite train
...
From: @xulei2020
Reviewed-by: @heleiwang
Signed-off-by:
4 years ago
f8d1b20873
init litemat from memory
4 years ago
f8f2d127cd
!7999 optimize cpu unique
...
From: @kisnwang
Reviewed-by:
Signed-off-by:
4 years ago
618c05d454
optimize cpu unique
4 years ago
908a494add
!8299 [MD] Skip returning IR when meet nullptr in ConcatDataset
...
From: @luoyang42
Reviewed-by: @nsyca,@pandoublefeng,@jonyguo
Signed-off-by: @jonyguo
4 years ago
36e69f6ef9
!8162 gpu support dynamic shape
...
From: @wilfchen
Reviewed-by: @limingqi107,@cristoval
Signed-off-by: @cristoval
4 years ago
027916cb5f
!8315 Cache server stability
...
From: @jkl_lee
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
f24a788eed
Rebase up to 5792d50ca7
4 years ago
7538f82da9
add callback to map's c api
...
fix test err
fix ci round 1
fix ci round 2
add col_order to batch_node
minor fix
4 years ago
a9a9c45662
!8232 C++ api add Filter
...
From: @tiancixiao
Reviewed-by:
Signed-off-by:
4 years ago
97e1f6f438
!8248 Add macro and fix album testcase
...
Merge pull request !8248 from EricZ/helper_dep_removal
4 years ago
073d991de4
!8106 add cpu adam delta
...
Merge pull request !8106 from kisnwang/add-cpu-adam-delta
4 years ago
4a5e287b92
add filter c api and ut
4 years ago
dcb758bc77
[MD] Skip returning IR when meet nullptr in ConcatDataset
4 years ago
e4e9362bd0
gpu suppor dynamic shape
4 years ago
cbece74a23
add cpu adam delta
4 years ago
394dbf50e1
Added testing macro and fix album_op test
4 years ago
523c3f07e3
!8194 Optimizer on IR #2 - Call ValidateParams in PrePass
...
Merge pull request !8194 from nsyca/opt3
4 years ago
099765bbb7
!8135 [MD] Transform api decouple
...
Merge pull request !8135 from luoyang/c-api-pyfunc
4 years ago
d7faa77b5e
support int64 shape
4 years ago
9a57cbacd9
[MD] Transform api decouple
4 years ago
8709005a57
!8200 Add two transforms API
...
Merge pull request !8200 from shenwei41/new_master
4 years ago
a2a2223373
Add optimizer to IR tree #2
4 years ago
7123a2c1d1
!7911 added key value message
...
Merge pull request !7911 from anancds/kv-patch
4 years ago
ae7384ca2d
!8208 Removed dependency on core module in util
...
Merge pull request !8208 from EricZ/helper_dep_removal
4 years ago
85f0a9bc8f
Added dependency removal for data_helper
4 years ago
87edbdf720
added protobuf message
4 years ago
183742009f
mindspore cxx api for 310 inference
...
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
4 years ago
9ffdf0b6d4
Add transform API
4 years ago
5d1ada682c
remove uncessary headers
...
staging II
clean up
further clean up
fix merge conflict with 8139
fix complie err
4 years ago
5169fb4c42
Remove api namespace
4 years ago
6e2241d64f
!8096 Add DatasetNode as a base Class for IR nodes
...
Merge pull request !8096 from h.farahat/datasetNode
4 years ago
56f1bb1b66
add dump data when task error
4 years ago
0ba0595caf
DatasetNode as a base for all IR nodes
4 years ago
5005b434e6
Fixed repeat issue with GetDatasetSize
4 years ago
cacebd1211
!7933 Cache performance updates
...
Merge pull request !7933 from Jamie/CacheOp_dev
4 years ago
7ef7bef1d8
!7796 [MD] Enable C++ cache api for non-mappable datasets
...
Merge pull request !7796 from lixiachen/cache_c_api_nonmappable
4 years ago
572c5e5f29
Rebase up to 542a52fbf8
4 years ago
18ecd65f93
C++ API: Delete ValidateParams in dataset APIs; update error input UTs
4 years ago
8f44074796
!7866 [MD] C++ API support build_sentence_piece_vocab_node & sentence_piece_tokenizer
...
Merge pull request !7866 from luoyang/c-api-pyfunc
4 years ago
52d278e858
[MD] C++ API support build_sentence_piece_vocab_node & sentence_piece_tokenizer
4 years ago
2ba20dc8e7
!7848 Add five transforms API
...
Merge pull request !7848 from shenwei41/new_master
4 years ago
814044963b
add validation check in tfrecord_node
...
update ut
4 years ago
ea97197311
fix tfrecord_op core dump
...
add test case
fix ci
fix ci round 2
address review cmts
4 years ago
c39c3ccfbe
!7734 Redesigned GetNumClasses
...
Merge pull request !7734 from Alex Yuyue/IR_dataset_input
4 years ago
779f0f387b
Add transforms API
4 years ago
823e52f1dc
add params checking of offset in distributed_sampler
...
add related comment to explain
add related UT
4 years ago
02ddddfe7e
Enable caching over non-mappable dataset c++ api
...
and caching over Album dataset
4 years ago
913a49f3af
Add support for C++ API: GetNumClasses
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
4b995fe170
fixed Destructor and RegisterRoute
4 years ago
3376e0d034
!7704 [MD] Add testcases for cache c api
...
Merge pull request !7704 from lixiachen/cache_c_api
4 years ago
d81bd7b17b
!7710 Add c++ API for GetRepeatCount and GetBatchSize
...
Merge pull request !7710 from h.farahat/getBatchRepeat
4 years ago
0124eef185
!7729 [MD] Fix log of vision and dataset in C++ api
...
Merge pull request !7729 from luoyang/pylint
4 years ago
7982f05038
!7730 [MD] Fix bugs in WeightedRandomSampler & SubsetRandomSampler
...
Merge pull request !7730 from luoyang/c-api-pyfunc
4 years ago
f0e976dbda
[MD] Fix bugs in WeightedRandomSampler & SubsetRandomSampler
4 years ago
f3880f8355
Add GetBatchSizer and GetRepeatCount to c++ API
4 years ago
f3fa5a441d
[MD] Fix log of vision and dataset in C++ api
4 years ago
3d194137da
!7702 Redesigned GetOutputType and GetOutputShape
...
Merge pull request !7702 from Alex Yuyue/IR_dataset_input
4 years ago
48edd9708c
!7690 [MD] fix num_sample in randomsampler and sequential sampler
...
Merge pull request !7690 from liyong126/fix_md_num_samples
4 years ago
2906659673
Add support for GetOutputTypes and GetOutputShapes
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
fe2852df82
!7703 C++ API: Add a parameter validation and fix incorrect format of error message for TFrecord
...
Merge pull request !7703 from TinaMengtingZhang/fix_tfrecord_issue_I1YKU6_I1YKXL
4 years ago
bc396febae
Add testcases for cache c api
4 years ago
e7346dd3a9
add a validation code to fix issue I1YKU6 and corresponded ut, fix format issue I1YKXL
4 years ago
0e03f5b0dd
Added GetDatasetSize
4 years ago
a85a256749
fix complie err in c_api_dataset_test_save
4 years ago
3355bb5f2f
!7657 Leaf node IR breakdown, port to engine/ir/datasetops/source/
...
Merge pull request !7657 from ZiruiWu/ir_breakdown_leaf_nodes
4 years ago
ee042b90f7
fix num_sample in sequentialSampler and randomSampler
4 years ago
9d35fdc4e5
!7653 [MD] C++ api SaveOp
...
Merge pull request !7653 from luoyang/c-api-pyfunc
4 years ago
cfc50e231a
Added IR breakdown for remaining ops after PR7596
...
fix android build failure
fix include in datasets.cc
attempting fix android build
fix complie err x86
4 years ago
8e60cfe800
[MD] C++ api save
4 years ago
19b10d474f
!7530 [MD] Add divide image proccessing
...
Merge pull request !7530 from jiangzhiwen/lite/image_divide
4 years ago
98bbb4ef7a
added tcp base on libevent
4 years ago
8bfe141680
!7571 fix bug in reshape strategy search when reshape as the first operator
...
Merge pull request !7571 from yao_yf/reshape_strategy_search_fix_when_reshape_is_first_op
4 years ago
f7189adb91
fix bug in reshape strategy search when reshape is first operator
4 years ago
d471552fc5
shuffle take repeat bucketbatch buildvocab repeat shuffle take project concat rename node IR added
...
concat, bucketbatch project rename
fix ci round 1
fix ci round 2
fix up
fix ci
4 years ago
de7ea8e68c
!7540 Extract ImageFolderNode and BatchNode into its own files from datasets.cc/.h
...
Merge pull request !7540 from ZiruiWu/refactor_ir_demo
4 years ago
566656ea72
!7558 fix the repeated calculation accuracy error
...
Merge pull request !7558 from yangzhenzhang/update-repeated-calculation
4 years ago
a8dc0f5c1b
!7557 [MD] Add merge image proccessing
...
Merge pull request !7557 from jiangzhiwen/lite/merge
4 years ago
eb6f4e3ce8
update repeated calculation
4 years ago
8e785648da
add merge image processing
4 years ago
52eec881ec
Refactor ImageFolderNode and BatchNode into its separate files
...
fix ci
fix ci
address review cmmts, fix ci
remove dup code in datasets.cc
4 years ago
643366ea70
!7538 Add empty string tensor support for Album
...
Merge pull request !7538 from EricZ/album_empty_string
4 years ago
7e21648e16
Added Album empty string tensor support
4 years ago
aa8442e0a3
add skeleton code for tree_adapter
...
stage II tree_adapter
add test case for tree_adapter
use dfs to build tree
add more test case
add test case
fix ci
fix ci round 2
fix ci round 3
fix ci round 4
fix complie error
fix ci round 6
fix ci round 7
fix ci round 8
fix ci round 9
4 years ago
fadc97a18f
add divide op
4 years ago
48601f51b0
!7295 [MD] C++ api add MindDataset
...
Merge pull request !7295 from luoyang/c-api-pyfunc
4 years ago
8ff82843ea
!7486 [MD] Add subtract image proccessing
...
Merge pull request !7486 from jiangzhiwen/lite/image_subtract
4 years ago
947f6d96d1
!7414 C++ api add config_manager
...
Merge pull request !7414 from xiaotianci/c_api_config
4 years ago
7707bb8540
!7439 [MD] Add YUV to BGR , Split, extractChannel ops
...
Merge pull request !7439 from xulei/lite_test0905
4 years ago
fb98fbcc9f
add c api config
4 years ago
2dc8e5f421
[MD] C++ api add MindDataset
4 years ago
442cee15ad
add yuv420sp to bgr, split and extractchannel
4 years ago
44f7978f7c
add image subtract
4 years ago
fc4ed975c4
handle repeated calculation
4 years ago
70bd405338
!7375 Change normalize input check
...
Merge pull request !7375 from EricZ/change_normalize_check
4 years ago
28c9e9d9a5
Added http server based on libevent
4 years ago
d3e89086e5
Removed check for normalize mean
4 years ago
0357088a73
!7319 C++ API: vision ops - reorder and add gap UTs; correct parm desc style
...
Merge pull request !7319 from cathwong/ckw_c_api_transforms_tests2
4 years ago
15b1725198
!7321 Fix ordering for album dataset
...
Merge pull request !7321 from EricZ/album_float_array
4 years ago
359ad19884
Added float_array support
...
Added fix, tests to come
4 years ago
b7519b7418
unify save_graphs_path
4 years ago
9f7c1a32e7
C++ API: vision ops - reorder and add gap UTs; correct parm desc style
4 years ago
7e7d47db50
!7266 RandomResizedCrop for C API
...
Merge pull request !7266 from MahdiRahmaniHanzaki/c-api
4 years ago
87b108f4e0
C++ api add Rescale
4 years ago
c8333accfc
RandomResizedCrop C API
4 years ago
4a077f6341
!7035 Add validation for input image size of affine transformation
...
Merge pull request !7035 from jiangzhiwen/fix/check_affine_size
4 years ago
2d645fdc7e
!7184 [MD] C++ api add TypeCaseOp & RandomCropDecodeResizeOp
...
Merge pull request !7184 from luoyang/pylint
4 years ago
197f0cabe0
check affine input size
4 years ago
9e033bbe19
C++ api add TypeCaseOp & RandomCropDecodeResizeOp
4 years ago
c951d42c2c
!6728 [Ascend][DynamicShape] Dynamic shape feature
...
Merge pull request !6728 from caifubi/dynamic_shape_share_2
4 years ago
d3b978147f
Ascend Dynamic Shape
4 years ago
755863ebae
insert memcpy when hccl node
4 years ago
d3bd1cb5b8
!6668 [Data Dump] [master] Fix asynchronous data dump failure
...
Merge pull request !6668 from caifubi/dump
4 years ago
ccb2e8851c
!6782 enable parallel optimizer in auto parallel
...
Merge pull request !6782 from gziyan/enable_optimizer_shard_in_auto_parallel
4 years ago
2aa26d245c
C++ API: Move vision ops to new vision files; create transforms namespace
4 years ago
ddc0113058
enable parallel optimizer in auto parallel
4 years ago
03f0e64af9
!7049 Fixes to TensorRow conversion and Tensor
...
Merge pull request !7049 from MahdiRahmaniHanzaki/c_func
4 years ago
b17b4abf7d
Fix async data dump failed
4 years ago
e92d4edceb
Updated TensorRow conversion
4 years ago
7dda95d247
set soc version
4 years ago
9bd34a1b29
!6673 Add stage information for ops and strategy
...
Merge pull request !6673 from huangxinjing/stage_strategy
4 years ago
0d8015b043
!5300 [MD] Add nD Slice Support
...
Merge pull request !5300 from nhussain/slice_op
4 years ago
4ef439e27b
Add stage information for ops and strategy
4 years ago
70221f5261
!6307 Conversion to and from TensorRow in C++
...
Merge pull request !6307 from MahdiRahmaniHanzaki/c_func
4 years ago
77d507279c
first working implementation
...
add string implementation, can handle partial string slices
finish core implementation, added Index object
fix up the logic
add in new SliceOption object, cleaning up tests
4 years ago
983827ec5c
Rebase up to 88ded11f59
4 years ago
890598d112
Added TensorRow conversion
4 years ago
f847414117
!6471 Fix AdjustAllReduceMulAdd pass
...
Merge pull request !6471 from thlinh/dev_Sep18_fix_AdjustAllReduceMulAdd_pass
4 years ago
4ff4c17632
fix get_dataset_size in CelebADataset when usage is not all
4 years ago
46f07efc31
Fix AdjustAllReduceMulAdd pass
...
Revive tests in lib_test
Code cleaning
4 years ago
c8e9d46391
!6450 Change PS directory.
...
Merge pull request !6450 from ZPaC/master-change-ps-dir
4 years ago
0b49f0fb57
change PS dir
4 years ago
5d0b91cb22
!6436 [Ascend Profiling] FIx start profiling failed
...
Merge pull request !6436 from caifubi/profiling
4 years ago
39039974b2
fix profiling start up fail
4 years ago
9064a5f731
add num_row check & fix api distributed sampler, lookup, default value
...
of usage
4 years ago
af1c5aba5b
!6354 [Data][BUG]add SubStractMeanNormalize input param check
...
Merge pull request !6354 from xulei/lite_test0905
4 years ago
85962adffd
add code
4 years ago
e24f534002
sync-from-trunk-to-blue-zone-0912-c75b220
4 years ago
jiangzhiwen
yangzhenzhang
mindspore-ci-bot
Eric
anancds
huanghui
alex-yuyue
kswang
xulei2020
Lixia Chen
Zirui Wu
Xiao Tianci
luoyang
wilfChen
Yi Huaijie
Nat Sutyanyong
zhoufeng
shenwei41
hesham
jjfeing
Mahdi
Cathy Wong
tinazhang
liyong
yao_yf
caifubi
Ziyan
huangxinjing
nhussain
yanghaitao1
Hoai Linh Tran
ZPaC
wuweikang