a5f57ce8a0
add ps cache
6 years ago
0659473535
add TruncateSequencePair, ToNumber C++ API and enable three test cases
6 years ago
49fd5308a4
!9564 Tidy up code in dataset compilation phase
...
From: @nsyca
Reviewed-by:
Signed-off-by:
6 years ago
6b5626634c
!9530 add BasicTokenizer and BertTokenizer C++ API
...
From: @tiancixiao
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
6 years ago
41ea1621c5
Tidy up TreeAdapter::Compile
6 years ago
206ae1a7c3
Add Three text C++ API
6 years ago
4cb78f2e03
Remove Repeat(1),Take(-1), and Skip(0) in NodeRemovalPass
6 years ago
0c8dfc68ec
Fix hang on RequestFreeTag
6 years ago
290cc72887
add BasicTokenizer and BertTokenizer C++ API
6 years ago
d69a29a44e
Migrate 3 pre passes to IR optimizer, namely, cache_error_pass, epoch_injection, and removal_pass
6 years ago
73c91e05b1
!9398 Change Build to return status
...
From: @alex-yuyue
Reviewed-by: @mikef
Signed-off-by:
6 years ago
ccff3a5316
Change build to return status
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
6 years ago
a2ec7ad5bd
Fix concat issue & fix schema doc
6 years ago
efc7e9f89e
!9358 PyNative Bugfix
...
From: @jojobugfree
Reviewed-by: @chujinjin,@jjfeing
Signed-off-by: @jjfeing
6 years ago
c8e7c3edb0
PyNative Hccl Bugfix
6 years ago
6c18c09121
!9266 PyNative Support Hccl(Data Parallel)
...
From: @jojobugfree
Reviewed-by: @chujinjin,@jjfeing
Signed-off-by: @chujinjin
6 years ago
df44e1339e
!9249 Optimizing GetDatasetSize
...
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
6 years ago
9ed31ea2cb
!9339 Disable getter optimization pass
...
From: @ezphlow
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @nsyca
6 years ago
db2a8b5e1d
Disable getter pass
6 years ago
f80553bc6e
Optimization for GetDatasetSize
6 years ago
04d8cd5d8b
Support PyNative Data Parallel
6 years ago
da8d7d661a
!9283 Modify the dataset ut log message
...
From: @liucunwei
Reviewed-by: @pandoublefeng,@heleiwang,@jonyguo
Signed-off-by: @heleiwang,@jonyguo
6 years ago
c41a21d2c2
!9208 Add four new c++ api of text
...
From: @shenwei41
Reviewed-by: @heleiwang
Signed-off-by:
6 years ago
8ef4b2796e
modify the dataset ut log message
6 years ago
0e6d06c463
!9230 Set trace info of Primitive CNode only for equiv out node, not the whole fprop function.
...
From: @zh_qh
Reviewed-by: @ginfung
Signed-off-by: @ginfung
6 years ago
3bea84d0f7
add four new text API
6 years ago
8310236ff1
Set trace info of Primitive CNode only for equiv out node, not the whole fprop function.
6 years ago
ea191ed5da
!8463 Run ops one by one in pynative bp graph
...
From: @HulkTang
Reviewed-by:
Signed-off-by:
6 years ago
7748ae823a
!9141 Fix DatasetCache C++ API cache sharing behavior
...
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
6 years ago
a37e9710b5
!9038 port name functions from TensorOp to TensorOperation
...
From: @mhmotallebi
Reviewed-by:
Signed-off-by:
6 years ago
c36b477568
Run ops one by one in pynative bp graph
6 years ago
a6845395e6
!9181 Add some ut pipeline test case for C++ dataset
...
From: @liucunwei
Reviewed-by: @pandoublefeng,@jonyguo
Signed-off-by: @jonyguo
6 years ago
e612e23a05
Add some ut pipeline test case for C++ dataset
6 years ago
7f13f2ad0e
add some pipeline ut test cases for c++ dataset
6 years ago
cf383af36e
!8624 updated cluster config and proto
...
From: @anancds
Reviewed-by:
Signed-off-by:
6 years ago
9cfeb08c4d
port name() to TensorOperation and its derived classes
6 years ago
e8247eadef
Same runtime CacheClient if c++ cache is shared
6 years ago
36bfd0d8ad
address left over cmts from 8802
6 years ago
3e57236fe3
add some new ut test for minddataset
6 years ago
fc380b8071
updated cluster config and proto
6 years ago
4e56618d18
Add text C++ API
6 years ago
3fa7233f68
!9072 fix topk fussion help tensor size = 4096*2
...
From: @jjfeing
Reviewed-by: @chujinjin,@kisnwang
Signed-off-by:
6 years ago
5e1bb0b697
boilerplate code for future IR optimizer
...
add 2 test cases to IRNode Deepcopy()
address review cmts
fix ut
samplerObj copy
ci
fix ci
fix ci round III
address further review cmts
add a missing macro
fix merge conflict
fix complie err
fix lite compile err
fix compile err
fix lite compile round III
address an issue
fix minor comments
6 years ago
8fb7d11ecb
fix topk help 4096
6 years ago
809e1d5086
added python api based on cpp api
...
1st draft of python iterator
Added Cifar10 and Cifar100 pybind port
Change pybind to use IR for Skip and Manifest
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
DatasetNode as a base for all IR nodes
namespace change
Fix the namespace issue and make ut tests work
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
Add VOCDataset
!63 Added RandomDataset
* Added RandomDataset
add imagefolder ir
Pybind switch: CelebA and UT
!61 CLUE example with class definition
* Merge branch 'python-api' of gitee.com:ezphlow/mindspore into clue_class_pybind
* Passing testcases
* Added CLUE, not working
add ManifestDataset IR
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
Update Coco & VOC & TFReader, Update clang-format, Reorder
datasets_binding
!69 Add Generator and move c_dataset.Iterator to dataset.Iterator
* Add GeneratorDataset to c_dataset
* Add GeneratorDataset to c_dataset
!67 Moving c_datasets and adding sampler wrapper
* Need to add create() method in datasets.py
* migration from c_dataset to dataset part 1
!71 Fix indent error
* Fix indentation error
!72 Fix c_api tests cases
* Fix c_api tests cases
!73 Added CSV Dataset
* Added CSVDataset
pybind switch: Take and CelebA fixes
!75 move c_dataset functionality to datasets
* Fixed existing testcases
* Added working clue and imagefolder
* Added sampler conversion from pybind
* Added sampler creation
!77 Add Python API tree
* Python API tree
add minddataset
TextFileDataset pybind
Rename to skip test_concat.py and test_minddataset_exception.py
!80 Add batch IR to python-api branch, most test cases work
* staging III
* staging, add pybind
Enable more c_api take and CelebA tests; delete util_c_api
!84 Schema changes in datasets.py
* Schema changes
!85 Remove input_indexes from sub-classes
* remove input_index from each subclass
!83 Remove C datasets
* Removed c_dataset package
* Remove c_datasets
!82 pybind switch: shuffle
* pybind switch: shuffle
!86 Add build_vocab
* Add build_vocab
Rebase with upstream/master
_shuffle conflict
BatchNode error
!88 Fix rebase problem
* fix rebase problem
Enable more unit tests; code typo/nit fixes
!91 Fix python vocag hang
* Fix python vocab hang
!89 Added BucketBatchByLength Pybind switch
* Added BucketBatchByLength
Update and enable more tet_c_api_*.py tests
!95 Add BuildSentencePeiceVocab
* - Add BuildSentencePeiceVocab
!96 Fix more tests
* - Fix some tests
- Enable more test_c_api_*
- Add syncwait
!99 pybind switch for device op
* pybind switch for device op
!93 Add getters to python API
* Add getters to python API
!101 Validate tree, error if graph
* - Add sync wait
!103 TFrecord/Random Datasets schema problem
* - TfRecord/Random schem aproblem
!102 Added filter pybind switch
* Added Filter pybind switch
!104 Fix num_samples
* - TfRecord/Random schem aproblem
!105 Fix to_device hang
* Fix to_device hang
!94 Adds Cache support for CLUE dataset
* Added cache for all dataset ops
* format change
* Added CLUE cache support
* Added Cache conversion
Add save pybind
fix compile err
init modify concat_node
!107 Fix some tests cases
* Fix tests cases
Enable and fix more tests
!109 pybind switch for get dataset size
* pybind_get_dataset_size
some check-code fixes for pylint, cpplint and clang-format
!113 Add callback
* revert
* dataset_sz 1 line
* fix typo
* get callback to work
!114 Make Android compile clean
* Make Android Compile Clean
Fix build issues due to rebase
!115 Fix more tests
* Fix tests cases
* !93 Add getters to python API
fix test_profiling.py
!116 fix get dataset size
* fix get dataset size
!117 GetColumnNames pybind switch
* Added GetColumnNames pybind switch
code-check fixes: clangformat, cppcheck, cpplint, pylint
Delete duplicate test_c_api_*.py files; more lint fixes
!121 Fix cpp tests
* Remove extra call to getNext in cpp tests
!122 Fix Schema with Generator
* Fix Schema with Generator
fix some cases of csv & mindrecord
!124 fix tfrecord get_dataset_size and add some UTs
* fix tfrecord get dataset size and add some ut for get_dataset_size
!125 getter separation
* Getter separation
!126 Fix sampler.GetNumSamples
* Fix sampler.GetNumSampler
!127 Assign runtime getter to each get function
* Assign runtime getter to each get function
Fix compile issues
!128 Match master code
* Match master code
!129 Cleanup DeviceOp/save code
* Cleanup ToDevice/Save code
!130 Add cache fix
* Added cache fix for map and image folder
!132 Fix testing team issues
* Pass queue_name from python to C++
* Add Schema.from_json
!131 Fix Cache op issues and delete de_pipeline
* Roll back C++ change
* Removed de_pipeline and passing all cache tests.
* fixed cache tests
!134 Cleanup datasets.py part1
* Cleanup dataset.py part1
!133 Updated validation for SentencePieceVocab.from_dataset
* Added type_check for column names in SentencePieceVocab.from_dataset
Rebase on master 181120 10:20
fix profiling
temporary solution of catching stauts from Node.Build()
!141 ToDevice Termination
* ToDevice termination
pylint fixes
!137 Fix test team issues and add some corresponding tests
* Fix test team issues and add some corresponding tests
!138 TreeGetter changes to use OptPass
* Getter changes to use OptPass (Zirui)
Rebase fix
!143 Fix cpplint issue
* Fix cpplint issue
pylint fixes in updated testcases
!145 Reset exceptions testcase
* reset exception test to master
!146 Fix Check_Pylint Error
* Fix Check_Pylint Error
!147 fix android
* fix android
!148 ToDevice changes
* Add ToDevice to the iterator List for cleanup at exit
!149 Pylint issue
* Add ToDevice to the iterator List for cleanup at exit
!150 Pylint 2
* Add ToDevice to the iterator List for cleanup at exit
!152 ExecutionTree error
* ET destructor error
!153 in getter_pass, only remove callback, without deleting map op
* getter pass no longer removes map
!156 early __del__ of iterator/to_device
* early __del__ of iterator
!155 Address review comments Eric 1
* Added one liner fix to validators.py
* roll back signature fix
* lint fix
* Eric Address comments 2
* C++ lint fix
* Address comments Eric 1
!158 Review rework for dataset bindings - part 1
* Reorder nodes repeat and rename
* Review rework for dataset bindings - part 1
!154 Fixing minor problems in the comments (datasets.py, python_tree_consumer.cc, iterators_bindings.cc, and iterators.py)
* Fixing minor problems in the comments (datasets.py, python_tree_consum…
!157 add replace none
* Add replace_none to datasets.py, address comments in tests
Trying to resolve copy
Override the deepcopy method of deviceop
Create_ir_tree method
Create_ir_tree method 2
Create_ir_tree method 2
del to_device if already exists
del to_device if already exists
cache getters shapes and types
Added yolov3 relaxation, to be rolled back
Get shapes and types together
bypass yolo
NumWorkers for MapOp
revert Yolo
revert Thor
Print more info
Debug code: Update LOG INFO to LOG ERROR
do not remove epochctrl for getter pass
Remove repeat(1)
pritn batch size
add log to tree_consumer and device_queue op
Revert PR 8744
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
__del__ toDEvice
__del__ toDevice2
!165 add ifndef ENABLE_ANDROID to device queue print
* Add ifndef ENABLE_ANDROID to device queue print
revert some changes
!166 getter: get_data_info
* getter: get_data_info
!168 add back tree print
* revert info to warnning in one log
* add back the missed print tree log
Release GIL in GetDataInfo
6 years ago
7c73bc50f4
fixed codex
6 years ago
d532af3a9a
new hccl interface
...
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
6 years ago
0d49650bd5
!8888 Add PyNative Device Profiling
...
From: @jojobugfree
Reviewed-by: @kisnwang,@jjfeing
Signed-off-by: @jjfeing
6 years ago
ab26dd71dc
!8789 Enable value inference in Concat; Support const input in graph_ir convertor.
...
From: @c_34
Reviewed-by: @liangchenghui,@guoqi1024
Signed-off-by: @liangchenghui
6 years ago
12643a33dd
Add profiling reporter
6 years ago
4132228c10
Add c++ api of randomresizecropwithbbox
6 years ago
69338af0f5
fixed get post message return type
6 years ago
812095de8f
!8753 Adds execute testcase and fix get_dataset_size
...
From: @ezphlow
Reviewed-by:
Signed-off-by:
6 years ago
b3add83bf0
support const input in graph_ir convertor, add value inference in Concat
6 years ago
45292abdfd
Added execute test case
...
Added execute tests for server
6 years ago
c8047a35ab
!8632 [MD] Add Multiply op for Lite Dataset
...
From: @jiangzhiwen8
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
6 years ago
215fce192e
!8737 [MD] Fix the Pad function return false if bottom value is 0
...
From: @jiangzhiwen8
Reviewed-by: @xulei2020,@liucunwei,@heleiwang
Signed-off-by: @liucunwei
6 years ago
f352f9a54a
!8511 [MD] Decouple more Transform Ops
...
From: @luoyang42
Reviewed-by:
Signed-off-by:
6 years ago
bc91f7b3ac
fix pad zero
6 years ago
d43155b5b0
[MD] Decouple more Transform Ops
6 years ago
e3b1814401
!8713 Fix for GetDatasetSize issue in TextFile
...
From: @mahdirahmanihanzaki
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @nsyca
6 years ago
449e1526dc
Fixed GetDatasetSize for TextFile
6 years ago
ff5999fc2f
add removal pass for getters
...
fix CI round I
fix ci round II
address review cmts
fix ci round II
6 years ago
ecde0f03a2
Updated GetNumSamples logic
6 years ago
b30c1045e1
add lite_mat multiply
6 years ago
9c957072e2
!8097 Remove redundant phi nodes
...
From: @ginfung
Reviewed-by:
Signed-off-by:
6 years ago
3176d377e6
Remove redundant phi nodes
6 years ago
0c2c76d037
update get rank in parallel ops
6 years ago
edcb0cd86b
!8370 [MD] Use neon instruction set to accelerate the Substract and Divide ops
...
From: @jiangzhiwen8
Reviewed-by: @xulei2020
Signed-off-by:
6 years ago
c54a4a4494
!8540 Added GetColumnNames to C++
...
From: @mahdirahmanihanzaki
Reviewed-by: @nsyca,@jonyguo
Signed-off-by: @nsyca
6 years ago
5a7515e48f
Added GetColumnNames to C++
6 years ago
3555d19b07
fix get num_class in imagefolder
...
address cmt
review cmts
6 years ago
7aa7ece5ce
!8497 add stage id for pipeline parallel
...
From: @yangzhenzhang
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
6 years ago
03bbe5f2a8
neon acceleration for subtract
6 years ago
41d925b68a
set stage id
6 years ago
f60ae8925d
!8480 Add RandomNode fix
...
From: @ezphlow
Reviewed-by: @pandoublefeng,@heleiwang
Signed-off-by:
6 years ago
510a0399fc
!8335 added cluster config and message handler unit test,change namespace from comm to core
...
From: @anancds
Reviewed-by:
Signed-off-by:
6 years ago
a21eb2d527
Added random node fix
6 years ago
0de9d3e5b7
!6989 split sort for parallel run
...
From: @kisnwang
Reviewed-by:
Signed-off-by:
6 years ago
222a0bccf4
!8431 Add more check in unsorted_segment_sum_fission pass to avoid doing wrong optimize which cause runtime error
...
From: @irmo
Reviewed-by:
Signed-off-by:
6 years ago
96d8c411e7
added message handler unit test
6 years ago
1c6c280da7
fix unsorted_segment_sum_fission pass
6 years ago
70f5775711
!8387 Add support for GetClassIndexing in C++ API
...
From: @alex-yuyue
Reviewed-by:
Signed-off-by:
6 years ago
d7c3a9ba00
Add GetClassIndexing
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
6 years ago
b88e722e12
add graph partition
6 years ago
bc12c647a5
!8380 [MD]remove opencv api with lite_cv in lite train
...
From: @xulei2020
Reviewed-by: @heleiwang
Signed-off-by:
6 years ago
f8d1b20873
init litemat from memory
6 years ago
f8f2d127cd
!7999 optimize cpu unique
...
From: @kisnwang
Reviewed-by:
Signed-off-by:
6 years ago
618c05d454
optimize cpu unique
6 years ago
908a494add
!8299 [MD] Skip returning IR when meet nullptr in ConcatDataset
...
From: @luoyang42
Reviewed-by: @nsyca,@pandoublefeng,@jonyguo
Signed-off-by: @jonyguo
6 years ago
36e69f6ef9
!8162 gpu support dynamic shape
...
From: @wilfchen
Reviewed-by: @limingqi107,@cristoval
Signed-off-by: @cristoval
6 years ago
027916cb5f
!8315 Cache server stability
...
From: @jkl_lee
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
6 years ago
f24a788eed
Rebase up to 5792d50ca7
6 years ago
7538f82da9
add callback to map's c api
...
fix test err
fix ci round 1
fix ci round 2
add col_order to batch_node
minor fix
6 years ago
a9a9c45662
!8232 C++ api add Filter
...
From: @tiancixiao
Reviewed-by:
Signed-off-by:
6 years ago
97e1f6f438
!8248 Add macro and fix album testcase
...
Merge pull request !8248 from EricZ/helper_dep_removal
6 years ago
073d991de4
!8106 add cpu adam delta
...
Merge pull request !8106 from kisnwang/add-cpu-adam-delta
6 years ago
4a5e287b92
add filter c api and ut
6 years ago
dcb758bc77
[MD] Skip returning IR when meet nullptr in ConcatDataset
6 years ago
e4e9362bd0
gpu suppor dynamic shape
6 years ago
cbece74a23
add cpu adam delta
6 years ago
394dbf50e1
Added testing macro and fix album_op test
6 years ago
523c3f07e3
!8194 Optimizer on IR #2 - Call ValidateParams in PrePass
...
Merge pull request !8194 from nsyca/opt3
6 years ago
099765bbb7
!8135 [MD] Transform api decouple
...
Merge pull request !8135 from luoyang/c-api-pyfunc
6 years ago
d7faa77b5e
support int64 shape
6 years ago
9a57cbacd9
[MD] Transform api decouple
6 years ago
8709005a57
!8200 Add two transforms API
...
Merge pull request !8200 from shenwei41/new_master
6 years ago
a2a2223373
Add optimizer to IR tree #2
6 years ago
7123a2c1d1
!7911 added key value message
...
Merge pull request !7911 from anancds/kv-patch
6 years ago
ae7384ca2d
!8208 Removed dependency on core module in util
...
Merge pull request !8208 from EricZ/helper_dep_removal
6 years ago
85f0a9bc8f
Added dependency removal for data_helper
6 years ago
87edbdf720
added protobuf message
6 years ago
183742009f
mindspore cxx api for 310 inference
...
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
6 years ago
9ffdf0b6d4
Add transform API
6 years ago
5d1ada682c
remove uncessary headers
...
staging II
clean up
further clean up
fix merge conflict with 8139
fix complie err
6 years ago
5169fb4c42
Remove api namespace
6 years ago
6e2241d64f
!8096 Add DatasetNode as a base Class for IR nodes
...
Merge pull request !8096 from h.farahat/datasetNode
6 years ago
56f1bb1b66
add dump data when task error
6 years ago
0ba0595caf
DatasetNode as a base for all IR nodes
6 years ago
5005b434e6
Fixed repeat issue with GetDatasetSize
6 years ago
cacebd1211
!7933 Cache performance updates
...
Merge pull request !7933 from Jamie/CacheOp_dev
6 years ago
7ef7bef1d8
!7796 [MD] Enable C++ cache api for non-mappable datasets
...
Merge pull request !7796 from lixiachen/cache_c_api_nonmappable
6 years ago
572c5e5f29
Rebase up to 542a52fbf8
6 years ago
18ecd65f93
C++ API: Delete ValidateParams in dataset APIs; update error input UTs
6 years ago
8f44074796
!7866 [MD] C++ API support build_sentence_piece_vocab_node & sentence_piece_tokenizer
...
Merge pull request !7866 from luoyang/c-api-pyfunc
6 years ago
52d278e858
[MD] C++ API support build_sentence_piece_vocab_node & sentence_piece_tokenizer
6 years ago
2ba20dc8e7
!7848 Add five transforms API
...
Merge pull request !7848 from shenwei41/new_master
6 years ago
814044963b
add validation check in tfrecord_node
...
update ut
6 years ago
ea97197311
fix tfrecord_op core dump
...
add test case
fix ci
fix ci round 2
address review cmts
6 years ago
c39c3ccfbe
!7734 Redesigned GetNumClasses
...
Merge pull request !7734 from Alex Yuyue/IR_dataset_input
6 years ago
779f0f387b
Add transforms API
6 years ago
823e52f1dc
add params checking of offset in distributed_sampler
...
add related comment to explain
add related UT
6 years ago
02ddddfe7e
Enable caching over non-mappable dataset c++ api
...
and caching over Album dataset
6 years ago
913a49f3af
Add support for C++ API: GetNumClasses
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
6 years ago
4b995fe170
fixed Destructor and RegisterRoute
6 years ago
3376e0d034
!7704 [MD] Add testcases for cache c api
...
Merge pull request !7704 from lixiachen/cache_c_api
6 years ago
d81bd7b17b
!7710 Add c++ API for GetRepeatCount and GetBatchSize
...
Merge pull request !7710 from h.farahat/getBatchRepeat
6 years ago
0124eef185
!7729 [MD] Fix log of vision and dataset in C++ api
...
Merge pull request !7729 from luoyang/pylint
6 years ago
7982f05038
!7730 [MD] Fix bugs in WeightedRandomSampler & SubsetRandomSampler
...
Merge pull request !7730 from luoyang/c-api-pyfunc
6 years ago
f0e976dbda
[MD] Fix bugs in WeightedRandomSampler & SubsetRandomSampler
6 years ago
f3880f8355
Add GetBatchSizer and GetRepeatCount to c++ API
6 years ago
f3fa5a441d
[MD] Fix log of vision and dataset in C++ api
6 years ago
3d194137da
!7702 Redesigned GetOutputType and GetOutputShape
...
Merge pull request !7702 from Alex Yuyue/IR_dataset_input
6 years ago
48edd9708c
!7690 [MD] fix num_sample in randomsampler and sequential sampler
...
Merge pull request !7690 from liyong126/fix_md_num_samples
6 years ago
2906659673
Add support for GetOutputTypes and GetOutputShapes
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
6 years ago
fe2852df82
!7703 C++ API: Add a parameter validation and fix incorrect format of error message for TFrecord
...
Merge pull request !7703 from TinaMengtingZhang/fix_tfrecord_issue_I1YKU6_I1YKXL
6 years ago
bc396febae
Add testcases for cache c api
6 years ago
e7346dd3a9
add a validation code to fix issue I1YKU6 and corresponded ut, fix format issue I1YKXL
6 years ago
0e03f5b0dd
Added GetDatasetSize
6 years ago
a85a256749
fix complie err in c_api_dataset_test_save
6 years ago
3355bb5f2f
!7657 Leaf node IR breakdown, port to engine/ir/datasetops/source/
...
Merge pull request !7657 from ZiruiWu/ir_breakdown_leaf_nodes
6 years ago
ee042b90f7
fix num_sample in sequentialSampler and randomSampler
6 years ago
9d35fdc4e5
!7653 [MD] C++ api SaveOp
...
Merge pull request !7653 from luoyang/c-api-pyfunc
6 years ago
cfc50e231a
Added IR breakdown for remaining ops after PR7596
...
fix android build failure
fix include in datasets.cc
attempting fix android build
fix complie err x86
6 years ago
8e60cfe800
[MD] C++ api save
6 years ago
19b10d474f
!7530 [MD] Add divide image proccessing
...
Merge pull request !7530 from jiangzhiwen/lite/image_divide
6 years ago
98bbb4ef7a
added tcp base on libevent
6 years ago
8bfe141680
!7571 fix bug in reshape strategy search when reshape as the first operator
...
Merge pull request !7571 from yao_yf/reshape_strategy_search_fix_when_reshape_is_first_op
6 years ago
f7189adb91
fix bug in reshape strategy search when reshape is first operator
6 years ago
d471552fc5
shuffle take repeat bucketbatch buildvocab repeat shuffle take project concat rename node IR added
...
concat, bucketbatch project rename
fix ci round 1
fix ci round 2
fix up
fix ci
6 years ago
de7ea8e68c
!7540 Extract ImageFolderNode and BatchNode into its own files from datasets.cc/.h
...
Merge pull request !7540 from ZiruiWu/refactor_ir_demo
6 years ago
566656ea72
!7558 fix the repeated calculation accuracy error
...
Merge pull request !7558 from yangzhenzhang/update-repeated-calculation
6 years ago
a8dc0f5c1b
!7557 [MD] Add merge image proccessing
...
Merge pull request !7557 from jiangzhiwen/lite/merge
6 years ago
eb6f4e3ce8
update repeated calculation
6 years ago
8e785648da
add merge image processing
6 years ago
52eec881ec
Refactor ImageFolderNode and BatchNode into its separate files
...
fix ci
fix ci
address review cmmts, fix ci
remove dup code in datasets.cc
6 years ago
643366ea70
!7538 Add empty string tensor support for Album
...
Merge pull request !7538 from EricZ/album_empty_string
6 years ago
7e21648e16
Added Album empty string tensor support
6 years ago
aa8442e0a3
add skeleton code for tree_adapter
...
stage II tree_adapter
add test case for tree_adapter
use dfs to build tree
add more test case
add test case
fix ci
fix ci round 2
fix ci round 3
fix ci round 4
fix complie error
fix ci round 6
fix ci round 7
fix ci round 8
fix ci round 9
6 years ago
fadc97a18f
add divide op
6 years ago
48601f51b0
!7295 [MD] C++ api add MindDataset
...
Merge pull request !7295 from luoyang/c-api-pyfunc
6 years ago
8ff82843ea
!7486 [MD] Add subtract image proccessing
...
Merge pull request !7486 from jiangzhiwen/lite/image_subtract
6 years ago
947f6d96d1
!7414 C++ api add config_manager
...
Merge pull request !7414 from xiaotianci/c_api_config
6 years ago
7707bb8540
!7439 [MD] Add YUV to BGR , Split, extractChannel ops
...
Merge pull request !7439 from xulei/lite_test0905
6 years ago
fb98fbcc9f
add c api config
6 years ago
2dc8e5f421
[MD] C++ api add MindDataset
6 years ago
442cee15ad
add yuv420sp to bgr, split and extractchannel
6 years ago
44f7978f7c
add image subtract
6 years ago
fc4ed975c4
handle repeated calculation
6 years ago
70bd405338
!7375 Change normalize input check
...
Merge pull request !7375 from EricZ/change_normalize_check
6 years ago
28c9e9d9a5
Added http server based on libevent
6 years ago
d3e89086e5
Removed check for normalize mean
6 years ago
0357088a73
!7319 C++ API: vision ops - reorder and add gap UTs; correct parm desc style
...
Merge pull request !7319 from cathwong/ckw_c_api_transforms_tests2
6 years ago
15b1725198
!7321 Fix ordering for album dataset
...
Merge pull request !7321 from EricZ/album_float_array
6 years ago
359ad19884
Added float_array support
...
Added fix, tests to come
6 years ago
b7519b7418
unify save_graphs_path
6 years ago
9f7c1a32e7
C++ API: vision ops - reorder and add gap UTs; correct parm desc style
6 years ago
7e7d47db50
!7266 RandomResizedCrop for C API
...
Merge pull request !7266 from MahdiRahmaniHanzaki/c-api
6 years ago
87b108f4e0
C++ api add Rescale
6 years ago
c8333accfc
RandomResizedCrop C API
6 years ago
4a077f6341
!7035 Add validation for input image size of affine transformation
...
Merge pull request !7035 from jiangzhiwen/fix/check_affine_size
6 years ago
2d645fdc7e
!7184 [MD] C++ api add TypeCaseOp & RandomCropDecodeResizeOp
...
Merge pull request !7184 from luoyang/pylint
6 years ago
197f0cabe0
check affine input size
6 years ago
9e033bbe19
C++ api add TypeCaseOp & RandomCropDecodeResizeOp
6 years ago
c951d42c2c
!6728 [Ascend][DynamicShape] Dynamic shape feature
...
Merge pull request !6728 from caifubi/dynamic_shape_share_2
6 years ago
d3b978147f
Ascend Dynamic Shape
6 years ago
755863ebae
insert memcpy when hccl node
6 years ago
d3bd1cb5b8
!6668 [Data Dump] [master] Fix asynchronous data dump failure
...
Merge pull request !6668 from caifubi/dump
6 years ago
ccb2e8851c
!6782 enable parallel optimizer in auto parallel
...
Merge pull request !6782 from gziyan/enable_optimizer_shard_in_auto_parallel
6 years ago
2aa26d245c
C++ API: Move vision ops to new vision files; create transforms namespace
6 years ago
ddc0113058
enable parallel optimizer in auto parallel
6 years ago
03f0e64af9
!7049 Fixes to TensorRow conversion and Tensor
...
Merge pull request !7049 from MahdiRahmaniHanzaki/c_func
6 years ago
b17b4abf7d
Fix async data dump failed
6 years ago
e92d4edceb
Updated TensorRow conversion
6 years ago
7dda95d247
set soc version
6 years ago
9bd34a1b29
!6673 Add stage information for ops and strategy
...
Merge pull request !6673 from huangxinjing/stage_strategy
6 years ago
0d8015b043
!5300 [MD] Add nD Slice Support
...
Merge pull request !5300 from nhussain/slice_op
6 years ago
4ef439e27b
Add stage information for ops and strategy
6 years ago
70221f5261
!6307 Conversion to and from TensorRow in C++
...
Merge pull request !6307 from MahdiRahmaniHanzaki/c_func
6 years ago
77d507279c
first working implementation
...
add string implementation, can handle partial string slices
finish core implementation, added Index object
fix up the logic
add in new SliceOption object, cleaning up tests
6 years ago
983827ec5c
Rebase up to 88ded11f59
6 years ago
890598d112
Added TensorRow conversion
6 years ago
f847414117
!6471 Fix AdjustAllReduceMulAdd pass
...
Merge pull request !6471 from thlinh/dev_Sep18_fix_AdjustAllReduceMulAdd_pass
6 years ago
4ff4c17632
fix get_dataset_size in CelebADataset when usage is not all
6 years ago
46f07efc31
Fix AdjustAllReduceMulAdd pass
...
Revive tests in lib_test
Code cleaning
6 years ago
c8e9d46391
!6450 Change PS directory.
...
Merge pull request !6450 from ZPaC/master-change-ps-dir
6 years ago
0b49f0fb57
change PS dir
6 years ago
5d0b91cb22
!6436 [Ascend Profiling] FIx start profiling failed
...
Merge pull request !6436 from caifubi/profiling
6 years ago
39039974b2
fix profiling start up fail
6 years ago
9064a5f731
add num_row check & fix api distributed sampler, lookup, default value
...
of usage
6 years ago
af1c5aba5b
!6354 [Data][BUG]add SubStractMeanNormalize input param check
...
Merge pull request !6354 from xulei/lite_test0905
6 years ago
85962adffd
add code
6 years ago
e24f534002
sync-from-trunk-to-blue-zone-0912-c75b220
6 years ago
bb4dbf4989
!5803 Combine Async Dump with E2e Dump
...
Merge pull request !5803 from caifubi/dump
6 years ago
372c2e7951
Combine Async Dump and E2E Dump
6 years ago
581335453e
Change return val of GetNextRow
6 years ago
a084196300
!6094 Adding input checks to C API
...
Merge pull request !6094 from EricZ/add_input_check_capi
6 years ago
cd5af9472e
Added input check
6 years ago
72861a68f3
add code
6 years ago
d4ce668b9b
add Affine ut
6 years ago
c882e4863c
!5961 [Data]Add lite_cv lib for mindspore lite data preprocessing
...
Merge pull request !5961 from xulei/lite_test0905
6 years ago
ea94756839
!5605 Introduce usage flag to MNIST and CIFAR dataset
...
Merge pull request !5605 from ZiruiWu/add_usage_to_cifar_mnist_coco
6 years ago
b356211413
add init code
6 years ago
7152fe04be
!5783 GraphKernel supports GPU
...
Merge pull request !5783 from DeshiChen/graph_kernel_1.0
6 years ago
1bb93580dd
Add usage flag to MNIST/CIFAR
...
ci fix 1
fix ci 2
fix ci 3
fix ci 4
fix ci 5
fix ci 6
fix ci 7
change var name in CelebA from dataset_type to usage
address review cmts
fix cpp ut fail
change mode to usage in VOCDataset
fix cmts
fix ci test case fail
6 years ago
37a48f6aac
GraphKernel supports GPU
...
1. Update akg submodule
2. Refactor akg_kernel_build, akg_ascend_kernel_build, akg_gpu_kernel_build
3. Add akg_kernel_json_decoder to support converting kernel_json to AnfNode.
4. Add GraphKernel Cost Model. (mindspore/_extends/graph_kernel)
5. Add some GraphKernel passes to GpuSession, move these passes to backend/optimizer/graph_kernel.
6. Add global id for ir files.
7. Fix bug in ConstInputToAttr.
6 years ago
bde9f18f5a
update lookup api to take in a type
...
ci
add test case
address some of the review cmts
address review cmts
6 years ago
bd527a331d
update aicpu proto and update module: graphengine
...
Support Dynamic Shape Aicpu Run Package
adapt tensorengin modify, fix ub fusion
6 years ago
5c7fa52468
!5673 [performance]cell init opt performance
...
Merge pull request !5673 from kingxian/master
6 years ago
92bebe65a9
cell init performance opt
6 years ago
d0c7b1ba24
!5731 Manifest Dataset check invalid filename string
...
Merge pull request !5731 from jiangzhiwen/fix/invalid_filename_string
6 years ago
bc4c5afc1a
!5667 add kernel select after optimize pass
...
Merge pull request !5667 from zyli2020/code_refactor
6 years ago
2f3684d4fa
!4872 Add C++ API support for TFRecordDataset
...
Merge pull request !4872 from TinaMengtingZhang/cpp-api-tfrecord-dataset
6 years ago
c3d6918649
add kernel select after optimize pass
6 years ago
294f7b620a
check invalid filename string
6 years ago
527d7f0afb
!5580 [MD] remove finish in FileReader
...
Merge pull request !5580 from liyong126/rmv_filereader_finish
6 years ago
b961d47d40
!5642 UTest compiling performance optimization
...
Merge pull request !5642 from zhoufeng/ut-compile-performance
6 years ago
ac39c20f41
del finish in FileReader
6 years ago
01da7d2c1a
!5713 Align num_samples of CSV with other dataset
...
Merge pull request !5713 from jiangzhiwen/fix/csv_num_samples
6 years ago
1a1a8893a4
Align num_samples of CSV with other dataset
6 years ago
limingqi107
Xiao Tianci
mindspore-ci-bot
Nat Sutyanyong
shenwei41
Jesse Lee
alex-yuyue
YangLuo
caifubi
Eric
Mahdi
liucunwei
Zhang Qinghua
HulkTang
mohammad
Lixia Chen
Zirui Wu
anancds
jjfeing
zhoufeng
chenhaozhe
jiangzhiwen
yujianfeng
yangzhenzhang
huanghui
kswang
xulei2020
wilfChen
Yi Huaijie
hesham
Cathy Wong
tinazhang
liyong
yao_yf
Ziyan
huangxinjing
nhussain
yanghaitao1
Hoai Linh Tran
ZPaC
wuweikang
dayschan
wuxuejian
kingxian
lizhenyu