19b10d474f
!7530 [MD] Add divide image proccessing
...
Merge pull request !7530 from jiangzhiwen/lite/image_divide
6 years ago
d471552fc5
shuffle take repeat bucketbatch buildvocab repeat shuffle take project concat rename node IR added
...
concat, bucketbatch project rename
fix ci round 1
fix ci round 2
fix up
fix ci
6 years ago
de7ea8e68c
!7540 Extract ImageFolderNode and BatchNode into its own files from datasets.cc/.h
...
Merge pull request !7540 from ZiruiWu/refactor_ir_demo
6 years ago
a8dc0f5c1b
!7557 [MD] Add merge image proccessing
...
Merge pull request !7557 from jiangzhiwen/lite/merge
6 years ago
8e785648da
add merge image processing
6 years ago
52eec881ec
Refactor ImageFolderNode and BatchNode into its separate files
...
fix ci
fix ci
address review cmmts, fix ci
remove dup code in datasets.cc
6 years ago
643366ea70
!7538 Add empty string tensor support for Album
...
Merge pull request !7538 from EricZ/album_empty_string
6 years ago
7e21648e16
Added Album empty string tensor support
6 years ago
aa8442e0a3
add skeleton code for tree_adapter
...
stage II tree_adapter
add test case for tree_adapter
use dfs to build tree
add more test case
add test case
fix ci
fix ci round 2
fix ci round 3
fix ci round 4
fix complie error
fix ci round 6
fix ci round 7
fix ci round 8
fix ci round 9
6 years ago
fadc97a18f
add divide op
6 years ago
48601f51b0
!7295 [MD] C++ api add MindDataset
...
Merge pull request !7295 from luoyang/c-api-pyfunc
6 years ago
8ff82843ea
!7486 [MD] Add subtract image proccessing
...
Merge pull request !7486 from jiangzhiwen/lite/image_subtract
6 years ago
947f6d96d1
!7414 C++ api add config_manager
...
Merge pull request !7414 from xiaotianci/c_api_config
6 years ago
7707bb8540
!7439 [MD] Add YUV to BGR , Split, extractChannel ops
...
Merge pull request !7439 from xulei/lite_test0905
6 years ago
fb98fbcc9f
add c api config
6 years ago
2dc8e5f421
[MD] C++ api add MindDataset
6 years ago
442cee15ad
add yuv420sp to bgr, split and extractchannel
6 years ago
44f7978f7c
add image subtract
6 years ago
d3e89086e5
Removed check for normalize mean
6 years ago
0357088a73
!7319 C++ API: vision ops - reorder and add gap UTs; correct parm desc style
...
Merge pull request !7319 from cathwong/ckw_c_api_transforms_tests2
6 years ago
359ad19884
Added float_array support
...
Added fix, tests to come
6 years ago
9f7c1a32e7
C++ API: vision ops - reorder and add gap UTs; correct parm desc style
6 years ago
7e7d47db50
!7266 RandomResizedCrop for C API
...
Merge pull request !7266 from MahdiRahmaniHanzaki/c-api
6 years ago
87b108f4e0
C++ api add Rescale
6 years ago
c8333accfc
RandomResizedCrop C API
6 years ago
4a077f6341
!7035 Add validation for input image size of affine transformation
...
Merge pull request !7035 from jiangzhiwen/fix/check_affine_size
6 years ago
197f0cabe0
check affine input size
6 years ago
9e033bbe19
C++ api add TypeCaseOp & RandomCropDecodeResizeOp
6 years ago
2aa26d245c
C++ API: Move vision ops to new vision files; create transforms namespace
6 years ago
e92d4edceb
Updated TensorRow conversion
6 years ago
0d8015b043
!5300 [MD] Add nD Slice Support
...
Merge pull request !5300 from nhussain/slice_op
6 years ago
70221f5261
!6307 Conversion to and from TensorRow in C++
...
Merge pull request !6307 from MahdiRahmaniHanzaki/c_func
6 years ago
77d507279c
first working implementation
...
add string implementation, can handle partial string slices
finish core implementation, added Index object
fix up the logic
add in new SliceOption object, cleaning up tests
6 years ago
983827ec5c
Rebase up to 88ded11f59
6 years ago
890598d112
Added TensorRow conversion
6 years ago
4ff4c17632
fix get_dataset_size in CelebADataset when usage is not all
6 years ago
9064a5f731
add num_row check & fix api distributed sampler, lookup, default value
...
of usage
6 years ago
85962adffd
add code
6 years ago
581335453e
Change return val of GetNextRow
6 years ago
a084196300
!6094 Adding input checks to C API
...
Merge pull request !6094 from EricZ/add_input_check_capi
6 years ago
cd5af9472e
Added input check
6 years ago
72861a68f3
add code
6 years ago
d4ce668b9b
add Affine ut
6 years ago
c882e4863c
!5961 [Data]Add lite_cv lib for mindspore lite data preprocessing
...
Merge pull request !5961 from xulei/lite_test0905
6 years ago
b356211413
add init code
6 years ago
1bb93580dd
Add usage flag to MNIST/CIFAR
...
ci fix 1
fix ci 2
fix ci 3
fix ci 4
fix ci 5
fix ci 6
fix ci 7
change var name in CelebA from dataset_type to usage
address review cmts
fix cpp ut fail
change mode to usage in VOCDataset
fix cmts
fix ci test case fail
6 years ago
bde9f18f5a
update lookup api to take in a type
...
ci
add test case
address some of the review cmts
address review cmts
6 years ago
d0c7b1ba24
!5731 Manifest Dataset check invalid filename string
...
Merge pull request !5731 from jiangzhiwen/fix/invalid_filename_string
6 years ago
2f3684d4fa
!4872 Add C++ API support for TFRecordDataset
...
Merge pull request !4872 from TinaMengtingZhang/cpp-api-tfrecord-dataset
6 years ago
294f7b620a
check invalid filename string
6 years ago
1a1a8893a4
Align num_samples of CSV with other dataset
6 years ago
e430b4056a
add tfrecord dataset to cpp api
...
fix to support schema=nullptr
6 years ago
8aba39a71b
Modify VOCDataset doc & Fix BuildVocab bug
6 years ago
ce419404ce
Add check for duplicate column for a-cpi
6 years ago
0cb6d29f0c
!4998 Shared memory pool clean up
...
Merge pull request !4998 from JesseKLee/mem_pool
6 years ago
dff02cc282
!5188 rename image files in imagefolder
...
Merge pull request !5188 from tony_liu2/alt
6 years ago
b99149dc37
!4901 Adding data_helper for minddata
...
Merge pull request !4901 from EricZ/md_helper
6 years ago
3be136f6f0
!5354 Fix randomdata issue
...
Merge pull request !5354 from xiefangqi/fix_randomdata_columnlist
6 years ago
84efa0b96b
Added BucketBatchByLength for C API
6 years ago
65bf3ecc3e
Adding data_helper class
6 years ago
e89b4648f6
Memory pool clean up
6 years ago
e2085a9505
fix randomdata issue
6 years ago
5e4c314130
rename dataset dir and image files
...
change references to use path original
revert folder name
revert graphengine
6 years ago
716329df6c
!5278 Change default value of sampler in c-api
...
Merge pull request !5278 from luoyang/c-api
6 years ago
419478b410
Change default value of sampler to seperate behaviour of default sampler
...
& null sampler, add check for duplicate column name
6 years ago
94a4a3f20b
changing affine and posterize apis
6 years ago
46e9d79a50
C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets
6 years ago
b26f6b3d5e
fix bug in c-api: rename, concat, take
6 years ago
0bbce9367e
!4772 Adding AlbumDataset for device training
...
Merge pull request !4772 from EricZ/ms-album
6 years ago
c79db93c48
Initial commit for album
...
Added linter fix for album dataset
Added testDataset
Adding signature
Added JsonDataset example API
Example dataset
Resolving format
More fixing
Refactor
Small fix
Added compiling album dataset
Running tests
Added linter fix #1
Passing UT
Added dataset API
Addressing clang
Clang part 2
Fixing pass
Fixed tree check
lint fix
Added lint fix part 2
6 years ago
9b503e4f38
!4955 Fixes for Dynamic Augmentation Ops
...
Merge pull request !4955 from MahdiRahmaniHanzaki/dynamic-ops-fix
6 years ago
a5f9b8f92e
Added fix for MixUpBatch and CutMixBatch and for RandomAffine
...
updated c color op descriptions
6 years ago
74c1e6da60
introducing pause and quit flags to DataBuffer
...
fix review cmts
fix ci
fix Ci
fixci
address ci
ci
- add timeout
- add more test cases
fix CI
address review cmts
6 years ago
9a3baf4f6c
!4314 [MD] remove defaults used in binding code, and remove bilinear resize op
...
Merge pull request !4314 from nhussain/clean_up_bindings
6 years ago
7dc7990d75
add NumWorkers validate
6 years ago
7b0a4e5929
!4796 Fix randomdata ut core dump problem
...
Merge pull request !4796 from xiefangqi/fix_randomdata_ut
6 years ago
c0d18d2517
fix randomdata ut problem
6 years ago
8a08d0c37b
Phase 2 of CacheOp
6 years ago
78c1aa1d96
Implemented Callback for Dataset
...
implment pause in MapOp, added more to callback
add ds_callback
- Initial drop of Python DSCallback
- Pybind DSCallback
- Pybind DSCallback
added callback to mapOp
- de_pipeline DSCallback
- de_pipeline DSCallback
add test case, segfault for now
fix seg fault
- de_pipeline DSCallback
remove 1 line
update callback test case, now works
use builder class for mapOp callback
- de_pipeline DSCallback
- de_pipeline DSCallback
- de_pipeline DSCallback
better test case
minor fix
add comments and minor clean ups
get rid of nullptr in MapOp, use other flag instead
fix a bug ParseMapOp only takes 1 callback
- Added WaitedDSCalabck
refactor callback param
fix text case incorrect number
- added testing
fix cpp test case
- added testing
- revert back lenet changes
- cleanup test_callbacks.py
- cleanup test_callbacks.py
fix CI stage I
fix CI stage II
fix CI and update epoch counter
- add validation
- add more testing test_callbacks.py
use random data op to do tests
adjust when to call EpochBegin/End
- add repeat with callback
- addressing reviewers' comments
- docstring and CI fixes
- docstring and CI fixes
- docstring and CI fixes
- rebase with upstream/master
fix cpp test case
fix review comments
addr review cmts, add test case
6 years ago
b50ae27c72
!4597 [Dataset] C++ API Support for build_vocab
6 years ago
eb9a611041
remove old defaults
6 years ago
d541e261a0
!4696 C++ API Support for CSV Dataset
...
Merge pull request !4696 from jiangzhiwen/jzw/c_api_csv
6 years ago
256dccc651
!4498 Gnn data processing supports distributed scenarios
...
Merge pull request !4498 from heleiwang/gnn_distributed
6 years ago
39df25f803
c++ api for CSV Dataset
6 years ago
8ee4d8e92d
Gnn data processing supports distributed scenarios
6 years ago
6868b9b6fa
!4422 Minddata new dataset api ==> RandomData
...
Merge pull request !4422 from xiefangqi/xfq_c++api_randomdata
6 years ago
b91e56375e
add randomdataset and schema
6 years ago
738ae2c78d
change api to use std_vector
...
try to display image
6 years ago
979111d0ef
Added Posterize Op
6 years ago
a88273bd3f
c++ api support for Manifest Dataset
6 years ago
113ff6ca24
!4367 CutMixBatch Augmentation Op
...
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
6 years ago
3ecc53fb4e
Added CutMix
6 years ago
9c8af0d1cf
C++ API: Provide validate param functions
6 years ago
7d70fb4dc4
!3769 add RandomColorOp
...
Merge pull request !3769 from Alexey_Shevlyakov/ColorOp
6 years ago
ebdea65f70
!4402 [Dataset] Fix c_api bugs
...
Merge pull request !4402 from luoyang/c-api-pyfunc
6 years ago
8526d5414d
RandomColor
6 years ago
2953720169
!4322 Adding RGBA color conversion
...
Merge pull request !4322 from EricZ/bitmap_support
6 years ago
7a10e07fc6
!4383 Add distributedSampler to concatOP
...
Merge pull request !4383 from genglishuai/genglshOK
6 years ago
6a41b44724
Added wrapper around color change function
6 years ago
4d4df68d1e
add DistributedSampler for Concat op
6 years ago
373adaa553
!4402 [Dataset] Fix c_api bugs
6 years ago
0868720eb7
fix parameter type for repeat op in c++ api and added c++/python ut.
6 years ago
deb1146474
reorganize headers and tests
...
remove headers
fix iterator file
fix pr comments
fix new file
6 years ago
5adba834d0
!3819 C++ API Support for CLUE Dataset
...
Merge pull request !3819 from jiangzhiwen/jzw/c_api_clue
6 years ago
5842a0212f
c++ api support for CLUE Dataset
6 years ago
9276a9d2fb
!3771 C++ API Support for TextFile Dataset
...
Merge pull request !3771 from cathwong/ckw_c_api_textfile_nosampler
6 years ago
477528de7f
random sharpness cpp op support
6 years ago
7766efd58e
add files
6 years ago
7f39b5cfd7
C++ API Support for TextFile Dataset and Unit Tests
6 years ago
f21ee64fd0
!4247 Add ChannelSwap operation
...
Merge pull request !4247 from 章一智/channel_swap_op
6 years ago
2cab58fdbc
!3850 Implementing RandomAffine C Op and a CPP UT for AutoContrast & Equalize
...
Merge pull request !3850 from islam_amin/randomaffine_op
6 years ago
0bb39830ae
!4250 fix cpp api iterator build function
...
Merge pull request !4250 from anthonyaje/fix_cpp_api_iterator
6 years ago
9774505ecd
Fixed dataset cpp api iterator build function
6 years ago
e52d85ba9d
Added RandomAffine Op
6 years ago
612f533d15
!3917 Add c++ ops CreateTupleIterator & Code changes in VOC DatasetOp
...
Merge pull request !3917 from luoyang/c-api
6 years ago
3a1d8b5f39
added channel swap operation in transforms.h
6 years ago
e6a12946c8
Updata voc build() & add C++ Op CreateTupleIterator
6 years ago
1896950ae5
Added Mixup
6 years ago
3a020fe877
split c_api_test
...
split into datasets
review fix
fix merge issues
fixed minddata lite build issues
6 years ago
6276c0f22f
new c++ api ==> CelebA
6 years ago
7ec0b5857a
!3977 [MD] Refactor Concatenate Op
...
Merge pull request !3977 from nhussain/multi_dim_concat_2
6 years ago
c65670b1a7
changed sampler parameter to support std::move
6 years ago
6aa65da5d2
!3860 Minddata new dataset api ==> Coco
...
Merge pull request !3860 from xiefangqi/md_new_api_cocodataset
6 years ago
61769b2dd9
fix concat
6 years ago
bb7bda1d6b
new dataset api -- Coco
6 years ago
d81862a916
decoupling core and context
6 years ago
e57d849618
add concat op and extend zip support to cpp api
6 years ago
8c018da468
Fixing issues in distributed sampler
...
Added Distributed sampler option
Fix style
6 years ago
634d797ca3
!3549 MapOp refactor for device augmentation (part 1)
...
Merge pull request !3549 from anthonyaje/device_augment_mapop_refactor1
6 years ago
388e43f7cb
delete parameter block_reader for MindDataset
6 years ago
a7eaf2736a
First drop of MapOp refactor to support device augment.
...
Refactored MapOp to in preparation to support device augment
Minor fix
6 years ago
ae99a3a3e4
C++ API support for TakeDatasetOp and VOCDatasetOp
6 years ago
b6c7273bb6
!3551 [MD] Fix Broken C++ Only Build
...
Merge pull request !3551 from nhussain/fix_cpp_only_build
6 years ago
b65125b0a1
add more ifdef and include statments for pybind
6 years ago
ee67f70b73
!3449 Cifar100 for C API
...
Merge pull request !3449 from MahdiRahmaniHanzaki/cifar100-c-api
6 years ago
92568248c9
Added Cifar100 for C API
6 years ago
84c8b85ddc
!3452 [MD] Gets rid of uncessary print calls
...
Merge pull request !3452 from nhussain/refactor_name_function
6 years ago
9c06a564d1
!2983 Dataset Tensor class cleanup
...
Merge pull request !2983 from h.farahat/tensor_class
6 years ago
465a69a70a
Added crop signature, wip
...
Added input check
Added SwapRedBlue
6 years ago
adfbc891d3
- Add checks and testing for empty tensors
...
- cleanup work on createTensor and Tensor's constructors
6 years ago
a306264030
remove print calls
6 years ago
2b71cbf1bd
Added RenameOp
6 years ago
8921a6099c
C++ API Support for Skip Dataset Op and UTs
6 years ago
568e75fdd3
!3256 Zip C API
...
Merge pull request !3256 from MahdiRahmaniHanzaki/zip-c-api
6 years ago
91b4d90716
Added ZipOp
6 years ago
bfc18704d5
!3254 [MD]Add more strict upper bounds to CenterCropOp and RandomCropWithBboxOp
...
Merge pull request !3254 from nhussain/padding_upperbound
6 years ago
b064cbab5d
fix upper bound
6 years ago
2f506b7985
CSV dataset loader
6 years ago
18b519ae0f
add sentence piece
6 years ago
008b91b2a1
inject epoch ctrl op in the execution tree and send eos at the end of epoch
6 years ago
4136892a3e
add SlidingWindow Op
6 years ago
ba0143402c
!3067 Cleanup dataset UT: Remove unneeded tf data files and tests
...
Merge pull request !3067 from cathwong/ckw_dataset_ut_cleanup6
6 years ago
ae1ed327ba
Cleanup dataset UT: Remove unneeded data files and tests
6 years ago
43c79eb853
mindspore path adjust
6 years ago
b930162e79
Decode + RandomCropAndResize = RandomCropDecodeResize
6 years ago
7c1bc5192b
Initial Drop of CacheOp Phase I
6 years ago
65c6e54e2e
!2773 Adding cpp_api
...
Merge pull request !2773 from 章一智/cpp_api
6 years ago
6284c42a76
!2941 MD tokenizer support output offsets
...
Merge pull request !2941 from xiefangqi/md_add_offsets_feature
6 years ago
47060631e5
add offsets feature to tokenizer
6 years ago
bd5a777f81
introducing new C++ API
6 years ago
7a046a1d70
support get_edge_feature
6 years ago
2c3c204b14
!2982 supporting cpp unit tests for randomresizewithbbox and resizewithbbox
...
Merge pull request !2982 from ava/CPP_test3
6 years ago
02e797d130
!2947 CPP UTs for 3 BBoxAugOps + Fix to image_util.cc
...
Merge pull request !2947 from danishnxt/AugOps-testing
6 years ago
b2bfb0342b
supporting cpp unit tests for random_resize_with_bbox_op and resize_with_bbox_op.
6 years ago
506f8f134e
fix, cpp ut's
...
fix cmakefile
fixed log statments in cpp UT tests
6 years ago
5355deca04
!2946 Added empty tensor support
...
Merge pull request !2946 from EricZ/emtpy-tensor
6 years ago
3cc9217f06
!2926 [Dataset C++ UT] Implement C++ UTs for RandomHorizontalFlipWithBBox and BoundingBoxAugment
...
Merge pull request !2926 from islam_amin/object_ops_cc_ut_floats
6 years ago
79445012bd
Tensor ut works
...
new test case
Name change for empty check
6 years ago
915ddd25dd
!2892 gnn random walk pr 1977 comment follow up
...
Merge pull request !2892 from tony_liu2/master
6 years ago
284cc910d5
C++ UTs for RandomHorizontalFlipWithBBox and Bounding Box Augment
6 years ago
14899a1410
fix gnn random walk pr 1977 comments
...
add fix to random resize decode crop test case
fix pylint issues
6 years ago
9ba937b1af
!2920 Updating 3 BBox AugOps for Float + Common Files for BBox Float Support - (VertFlip/RandomCrop/RandomResizeCrop)
...
Merge pull request !2920 from danishnxt/AugOps-M1-Python
6 years ago
6d946b6a19
!2890 Fix for Alexey's testcase
...
Merge pull request !2890 from JesseKLee/queue_perf
6 years ago
78c370f72a
First Commit - New Infrastructure - Python UT tests + Common Aug Files
...
fix accidental change overwrite
fix 2
updated inits from 0 to 0.0 for float
improvd python ut comments
updated macro
6 years ago
e0ef91a676
Fix Queue::Reset
6 years ago
383564c417
fix perf_data test
6 years ago
709dfd7e81
!2738 [Dataset C++ UT] Implement C++ UT common class for object detection tests.
...
Merge pull request !2738 from islam_amin/object_ops_ut_cc
6 years ago
593ee1eb34
C++ UT common files for object detection tests
6 years ago
88bb65768e
Clean up part 1
...
Removed extra fields in schema
Fixed test cases
Fixing CI
6 years ago
71cede8173
remove de_error.h
6 years ago
9b4399480a
!2321 Connector throughput performance metric
...
Merge pull request !2321 from Alexey_Shevlyakov/connector_throughput_dev
6 years ago
41d16a3c77
enhance: 1. fix api comment, 2. del dead code
6 years ago
698abf75fc
Connector throughput + PerfData + CyclicArray
6 years ago
81bf4bde1d
AutoIndexObj primary should start with 0
6 years ago
c22eac743d
subtree creation in python apis
...
updates
fix
fix cpplint
fix
6 years ago
d9b1825552
!2374 C++ UT for CutOut and Pad
...
Merge pull request !2374 from MahdiRahmaniHanzaki/I1L892-pad-cutout-ut
6 years ago
e829535a86
change GetTensor into GetRow to avoid NullPtr
6 years ago
0d52888fc5
fix misspell and check parameters
6 years ago
bca037e1be
added cpp test cases for pad and cut out
6 years ago
cf82aa9035
init remove storage op in c++
...
init remove storage op test case c++
remove source c++ files
6 years ago
11826fb256
DuplicateOp
6 years ago
5515016dba
remove graphengine changes
...
remove graphengine changes
concat op
Truncate Pair
concat_op
remove graph engine changes
6 years ago
ffc8a3c362
!2274 add PadEndOp
...
Merge pull request !2274 from xunxue/padend
6 years ago
e4322baece
!2316 [Dataset] Move python tree transformation into cpp pass
...
Merge pull request !2316 from JunhanHu/alter_node_cpp
6 years ago
87aa9c8f7a
PadEndOp
6 years ago
57f3732ac3
Move python tree transformation into cpp pass.
6 years ago
5850b99161
!2211 Add TruncatePair Op to dataset
...
Merge pull request !2211 from h.farahat/pair_truncate
6 years ago
b9495a9ccc
Truncate Pair
6 years ago
a4048e192c
!2256 Rename Sampler::Reset() to Sampler::ResetSampler()
...
Merge pull request !2256 from JesseKLee/sampler
6 years ago
ea829e89c3
!2198 Add MaskOp to dataset
...
Merge pull request !2198 from h.farahat/mask_op
6 years ago
dcfdff6021
Rename Sampler Reset
6 years ago
4f16f036be
Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp
...
add CaseFold, NormalizeUTF8
add RegexReplace
add RegexTokenizer
add BasicTokenizer
add WordpieceTokenizer
add BertTokenizer
6 years ago
f2462bb00d
Mask Op
6 years ago
625f2421b5
!1977 random walk in gnn node2vec
...
Merge pull request !1977 from JonathanY/randomwalk
6 years ago
a1f194c971
!2188 Remove B+ tree deadcode and add an additional output to Search function
...
Merge pull request !2188 from JesseKLee/deadcode
6 years ago
287ca71260
Remove dead code
6 years ago
e2012a1de9
Slice Op
6 years ago
dceb3c2be4
!2026 Change C++ behavior in RandomCropAndResize
...
Merge pull request !2026 from MahdiRahmaniHanzaki/I1K3FL-random-resized-crop
6 years ago
add29f95f5
resolved issues in the comments
6 years ago
2cab44a637
!2028 FillOp for BERT
...
Merge pull request !2028 from nhussain/fillOp_learning
6 years ago
dd9bf09f0a
added FillOp for #119 - special Ops
6 years ago
87d2c27c7f
random walk v1
6 years ago
a8cf83acf2
!1932 Add CLUE dataset
...
Merge pull request !1932 from jiangzhiwen/dataset/clue
6 years ago
e0e167a000
add CLUE dataset
6 years ago
c661087b99
!2029 Create TensorRow class that supports a row id
...
Merge pull request !2029 from lixiachen/lixia/tensorrow
6 years ago
6ae88c3987
Create TensorRow class that supports a row id.
6 years ago
0c5e47111b
- Move MutableBuffer to be protected
...
- Add new CreateTensors
6 years ago
beefb20c01
!1983 Remove inheritance of Sampler from DatasetOp
...
Merge pull request !1983 from JesseKLee/sampler
6 years ago
b3da41bd7a
!1913 CocoDataset implementation
...
Merge pull request !1913 from xiefangqi/xfq_support_coco
6 years ago
097cbcc0cb
CocoDataset implementation
6 years ago
255adf7c6e
Remove inheritance of Sampler from DatasetOp
6 years ago
3ece8dd090
1. support get_all_edges, get_nodes_from_edge, get_sampled_neighbors, get_neg_sampled_neighbors and graph_info API
...
2. mod cora and citeseer conversion script
6 years ago
5eb95599f6
!1874 Updates to string tensor
...
Merge pull request !1874 from h.farahat/string_tensor_updates
6 years ago
f837ddc956
- Bug when empty strings sent to Python
...
- Support accepting Numpy of str as input
- Support batching strings
- Core logic of batch&pad is static
- Make Pad a utility function
6 years ago
51bc0c0460
consistent design for num_samples
...
updates
more update
more work
more fixin
post rebase updates
clang formatting
code review recovery
ci fixes
updates
update
update
update
6 years ago
3b80c10b1e
Fix some timing hole in these two testcases
6 years ago
e311473401
!1453 Raise mse threshold in RandomCropDecodeResizeOp
...
Merge pull request !1453 from Alexey_Shevlyakov/fix_random_crop_decode_resize_ut
6 years ago
a8fa847556
Allow join_all to be blocking
6 years ago
7a807cbff9
fix ut
6 years ago
641112a40c
Initial Drop
6 years ago
964a757db2
!1378 Just want to debug this case in Jenkin environment
...
Merge pull request !1378 from JesseKLee/cond_var_debug
6 years ago
06ae724261
Again
6 years ago
458436186c
!1365 Clean up work for text python sub-package
...
Merge pull request !1365 from h.farahat/text_namespace
6 years ago
6f733ec113
!1308 Stage 2 of adding support for string Tensor
...
Merge pull request !1308 from h.farahat/string_tensor2
6 years ago
6c21e556c4
Clean up work for text python package
6 years ago
599a449e0b
Support processing GNN data
6 years ago
df361d1d26
Change mem layout of string tensor
...
add support for MindRecord and TFRecord
----
optimize tensorshape
optimize tensorshape and FlatIndex
TFRecord and MindRecord support for string tensor
Modify mem layout
Add new constructor
Add method Allocate
Change some GetMutableBuffer usages to AllocateBuffer
6 years ago
2e3d55ed87
!1281 Implementation of SplitOp
...
Merge pull request !1281 from Peilin/splitOp
6 years ago
71e8bb1960
general split case done, chaining sampler (basic case) is working
...
implementation 99% complete
everything and tested except for repeatable shuffling
tested most basic/typical split usecases
cleanup
some more cleanup
fix CI
more ci fix
more ci fixes
more ci fix
more ci fix
more ci fix
added more tests, fixed some bugs
some more clean up and test cases
added shard/shuffle before split warning/error
addressed code review comments and ci
fixed ci
6 years ago
451c20a6f5
Add UnicodeCharTokenizer for nlp
6 years ago
163b6b7ea7
add jieba c++ code
6 years ago
e8ca243364
-Add DE_STRING
...
-replace switch'case by indexing
- Add test case
- Add constructors
- Add getItem string
- Fix bugs
- Add more tests
- Tensor iterator
- asNumpy
- TextFileDataset
- Tensor(Numpy)
- Super > 2D
- Add more test cases for GeneratorDataset
- Change StartAddr to GetBuffer and GetMutableNuffer
- Raise an error if batch is used with strings
Clean-up work
6 years ago
c680cfbf27
!1157 dataset: add concat operation for dataset
...
Merge pull request !1157 from ms_yan/concat_dataset
6 years ago
ab031ee9ea
!1126 VOCDataset support object detection function
...
Merge pull request !1126 from xiefangqi/voc_support_detection
6 years ago
c937bad53f
minddata support voc
6 years ago
c0fa7b4b19
init commit of concat dataset
...
change to use __add__ operation instead ds.concat
6 years ago
9e116e15fb
!1139 Change Thread::Join to async call with time out
...
Merge pull request !1139 from JesseKLee/timing_hole
6 years ago
1a052f7155
!1131 [Data]fix cmake build format
...
Merge pull request !1131 from xulei/filter_op
6 years ago
f2be49d85e
Fix a racing condition
6 years ago
903b64daa2
fix cmake build format
6 years ago
mindspore-ci-bot
Zirui Wu
jiangzhiwen
Eric
Xiao Tianci
luoyang
xulei2020
Cathy Wong
shenwei41
Mahdi
nhussain
Lixia Chen
yanghaitao1
tinazhang
Jesse Lee
xiefangqi
tony_liu2
islam_amin
heleiwang
Alexey Shevlyakov
genglishuai
avakh
anthonyaje
ervinzhang
liubuyu
dengyutao
hesham
anzhengqi
ervinzhang
Danish Farid
ale
jonyguo
Jamie Nisbet
ms_yan
xunxue
Junhan Hu
qianlong
Jonathan Yan
mindspore-ci-bot
Peilin Wang
mindspore-ci-bot