46e9d79a50
C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets
5 years ago
b26f6b3d5e
fix bug in c-api: rename, concat, take
5 years ago
0bbce9367e
!4772 Adding AlbumDataset for device training
...
Merge pull request !4772 from EricZ/ms-album
5 years ago
c79db93c48
Initial commit for album
...
Added linter fix for album dataset
Added testDataset
Adding signature
Added JsonDataset example API
Example dataset
Resolving format
More fixing
Refactor
Small fix
Added compiling album dataset
Running tests
Added linter fix #1
Passing UT
Added dataset API
Addressing clang
Clang part 2
Fixing pass
Fixed tree check
lint fix
Added lint fix part 2
5 years ago
9b503e4f38
!4955 Fixes for Dynamic Augmentation Ops
...
Merge pull request !4955 from MahdiRahmaniHanzaki/dynamic-ops-fix
5 years ago
a5f9b8f92e
Added fix for MixUpBatch and CutMixBatch and for RandomAffine
...
updated c color op descriptions
5 years ago
74c1e6da60
introducing pause and quit flags to DataBuffer
...
fix review cmts
fix ci
fix Ci
fixci
address ci
ci
- add timeout
- add more test cases
fix CI
address review cmts
5 years ago
9a3baf4f6c
!4314 [MD] remove defaults used in binding code, and remove bilinear resize op
...
Merge pull request !4314 from nhussain/clean_up_bindings
5 years ago
7dc7990d75
add NumWorkers validate
5 years ago
7b0a4e5929
!4796 Fix randomdata ut core dump problem
...
Merge pull request !4796 from xiefangqi/fix_randomdata_ut
5 years ago
c0d18d2517
fix randomdata ut problem
5 years ago
8a08d0c37b
Phase 2 of CacheOp
5 years ago
78c1aa1d96
Implemented Callback for Dataset
...
implment pause in MapOp, added more to callback
add ds_callback
- Initial drop of Python DSCallback
- Pybind DSCallback
- Pybind DSCallback
added callback to mapOp
- de_pipeline DSCallback
- de_pipeline DSCallback
add test case, segfault for now
fix seg fault
- de_pipeline DSCallback
remove 1 line
update callback test case, now works
use builder class for mapOp callback
- de_pipeline DSCallback
- de_pipeline DSCallback
- de_pipeline DSCallback
better test case
minor fix
add comments and minor clean ups
get rid of nullptr in MapOp, use other flag instead
fix a bug ParseMapOp only takes 1 callback
- Added WaitedDSCalabck
refactor callback param
fix text case incorrect number
- added testing
fix cpp test case
- added testing
- revert back lenet changes
- cleanup test_callbacks.py
- cleanup test_callbacks.py
fix CI stage I
fix CI stage II
fix CI and update epoch counter
- add validation
- add more testing test_callbacks.py
use random data op to do tests
adjust when to call EpochBegin/End
- add repeat with callback
- addressing reviewers' comments
- docstring and CI fixes
- docstring and CI fixes
- docstring and CI fixes
- rebase with upstream/master
fix cpp test case
fix review comments
addr review cmts, add test case
5 years ago
b50ae27c72
!4597 [Dataset] C++ API Support for build_vocab
5 years ago
eb9a611041
remove old defaults
5 years ago
d541e261a0
!4696 C++ API Support for CSV Dataset
...
Merge pull request !4696 from jiangzhiwen/jzw/c_api_csv
5 years ago
256dccc651
!4498 Gnn data processing supports distributed scenarios
...
Merge pull request !4498 from heleiwang/gnn_distributed
5 years ago
39df25f803
c++ api for CSV Dataset
5 years ago
8ee4d8e92d
Gnn data processing supports distributed scenarios
5 years ago
6868b9b6fa
!4422 Minddata new dataset api ==> RandomData
...
Merge pull request !4422 from xiefangqi/xfq_c++api_randomdata
5 years ago
b91e56375e
add randomdataset and schema
5 years ago
738ae2c78d
change api to use std_vector
...
try to display image
5 years ago
979111d0ef
Added Posterize Op
5 years ago
a88273bd3f
c++ api support for Manifest Dataset
5 years ago
113ff6ca24
!4367 CutMixBatch Augmentation Op
...
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
5 years ago
3ecc53fb4e
Added CutMix
5 years ago
9c8af0d1cf
C++ API: Provide validate param functions
5 years ago
7d70fb4dc4
!3769 add RandomColorOp
...
Merge pull request !3769 from Alexey_Shevlyakov/ColorOp
5 years ago
ebdea65f70
!4402 [Dataset] Fix c_api bugs
...
Merge pull request !4402 from luoyang/c-api-pyfunc
5 years ago
8526d5414d
RandomColor
5 years ago
2953720169
!4322 Adding RGBA color conversion
...
Merge pull request !4322 from EricZ/bitmap_support
5 years ago
7a10e07fc6
!4383 Add distributedSampler to concatOP
...
Merge pull request !4383 from genglishuai/genglshOK
5 years ago
6a41b44724
Added wrapper around color change function
5 years ago
4d4df68d1e
add DistributedSampler for Concat op
5 years ago
373adaa553
!4402 [Dataset] Fix c_api bugs
5 years ago
0868720eb7
fix parameter type for repeat op in c++ api and added c++/python ut.
5 years ago
deb1146474
reorganize headers and tests
...
remove headers
fix iterator file
fix pr comments
fix new file
5 years ago
5adba834d0
!3819 C++ API Support for CLUE Dataset
...
Merge pull request !3819 from jiangzhiwen/jzw/c_api_clue
5 years ago
5842a0212f
c++ api support for CLUE Dataset
5 years ago
9276a9d2fb
!3771 C++ API Support for TextFile Dataset
...
Merge pull request !3771 from cathwong/ckw_c_api_textfile_nosampler
5 years ago
477528de7f
random sharpness cpp op support
5 years ago
7766efd58e
add files
5 years ago
7f39b5cfd7
C++ API Support for TextFile Dataset and Unit Tests
5 years ago
f21ee64fd0
!4247 Add ChannelSwap operation
...
Merge pull request !4247 from 章一智/channel_swap_op
5 years ago
2cab58fdbc
!3850 Implementing RandomAffine C Op and a CPP UT for AutoContrast & Equalize
...
Merge pull request !3850 from islam_amin/randomaffine_op
5 years ago
0bb39830ae
!4250 fix cpp api iterator build function
...
Merge pull request !4250 from anthonyaje/fix_cpp_api_iterator
5 years ago
9774505ecd
Fixed dataset cpp api iterator build function
5 years ago
e52d85ba9d
Added RandomAffine Op
5 years ago
612f533d15
!3917 Add c++ ops CreateTupleIterator & Code changes in VOC DatasetOp
...
Merge pull request !3917 from luoyang/c-api
5 years ago
3a1d8b5f39
added channel swap operation in transforms.h
5 years ago
e6a12946c8
Updata voc build() & add C++ Op CreateTupleIterator
5 years ago
1896950ae5
Added Mixup
5 years ago
3a020fe877
split c_api_test
...
split into datasets
review fix
fix merge issues
fixed minddata lite build issues
5 years ago
6276c0f22f
new c++ api ==> CelebA
5 years ago
7ec0b5857a
!3977 [MD] Refactor Concatenate Op
...
Merge pull request !3977 from nhussain/multi_dim_concat_2
5 years ago
c65670b1a7
changed sampler parameter to support std::move
5 years ago
6aa65da5d2
!3860 Minddata new dataset api ==> Coco
...
Merge pull request !3860 from xiefangqi/md_new_api_cocodataset
5 years ago
61769b2dd9
fix concat
5 years ago
bb7bda1d6b
new dataset api -- Coco
5 years ago
d81862a916
decoupling core and context
5 years ago
e57d849618
add concat op and extend zip support to cpp api
5 years ago
8c018da468
Fixing issues in distributed sampler
...
Added Distributed sampler option
Fix style
5 years ago
634d797ca3
!3549 MapOp refactor for device augmentation (part 1)
...
Merge pull request !3549 from anthonyaje/device_augment_mapop_refactor1
5 years ago
388e43f7cb
delete parameter block_reader for MindDataset
5 years ago
a7eaf2736a
First drop of MapOp refactor to support device augment.
...
Refactored MapOp to in preparation to support device augment
Minor fix
5 years ago
ae99a3a3e4
C++ API support for TakeDatasetOp and VOCDatasetOp
5 years ago
b6c7273bb6
!3551 [MD] Fix Broken C++ Only Build
...
Merge pull request !3551 from nhussain/fix_cpp_only_build
5 years ago
b65125b0a1
add more ifdef and include statments for pybind
5 years ago
ee67f70b73
!3449 Cifar100 for C API
...
Merge pull request !3449 from MahdiRahmaniHanzaki/cifar100-c-api
5 years ago
92568248c9
Added Cifar100 for C API
5 years ago
84c8b85ddc
!3452 [MD] Gets rid of uncessary print calls
...
Merge pull request !3452 from nhussain/refactor_name_function
5 years ago
9c06a564d1
!2983 Dataset Tensor class cleanup
...
Merge pull request !2983 from h.farahat/tensor_class
5 years ago
465a69a70a
Added crop signature, wip
...
Added input check
Added SwapRedBlue
5 years ago
adfbc891d3
- Add checks and testing for empty tensors
...
- cleanup work on createTensor and Tensor's constructors
5 years ago
a306264030
remove print calls
5 years ago
2b71cbf1bd
Added RenameOp
5 years ago
8921a6099c
C++ API Support for Skip Dataset Op and UTs
5 years ago
568e75fdd3
!3256 Zip C API
...
Merge pull request !3256 from MahdiRahmaniHanzaki/zip-c-api
5 years ago
91b4d90716
Added ZipOp
5 years ago
bfc18704d5
!3254 [MD]Add more strict upper bounds to CenterCropOp and RandomCropWithBboxOp
...
Merge pull request !3254 from nhussain/padding_upperbound
5 years ago
b064cbab5d
fix upper bound
5 years ago
2f506b7985
CSV dataset loader
5 years ago
18b519ae0f
add sentence piece
5 years ago
008b91b2a1
inject epoch ctrl op in the execution tree and send eos at the end of epoch
5 years ago
4136892a3e
add SlidingWindow Op
5 years ago
ba0143402c
!3067 Cleanup dataset UT: Remove unneeded tf data files and tests
...
Merge pull request !3067 from cathwong/ckw_dataset_ut_cleanup6
5 years ago
ae1ed327ba
Cleanup dataset UT: Remove unneeded data files and tests
5 years ago
43c79eb853
mindspore path adjust
5 years ago
b930162e79
Decode + RandomCropAndResize = RandomCropDecodeResize
5 years ago
7c1bc5192b
Initial Drop of CacheOp Phase I
5 years ago
65c6e54e2e
!2773 Adding cpp_api
...
Merge pull request !2773 from 章一智/cpp_api
5 years ago
6284c42a76
!2941 MD tokenizer support output offsets
...
Merge pull request !2941 from xiefangqi/md_add_offsets_feature
5 years ago
47060631e5
add offsets feature to tokenizer
5 years ago
bd5a777f81
introducing new C++ API
5 years ago
7a046a1d70
support get_edge_feature
5 years ago
2c3c204b14
!2982 supporting cpp unit tests for randomresizewithbbox and resizewithbbox
...
Merge pull request !2982 from ava/CPP_test3
5 years ago
02e797d130
!2947 CPP UTs for 3 BBoxAugOps + Fix to image_util.cc
...
Merge pull request !2947 from danishnxt/AugOps-testing
5 years ago
b2bfb0342b
supporting cpp unit tests for random_resize_with_bbox_op and resize_with_bbox_op.
5 years ago
506f8f134e
fix, cpp ut's
...
fix cmakefile
fixed log statments in cpp UT tests
5 years ago
5355deca04
!2946 Added empty tensor support
...
Merge pull request !2946 from EricZ/emtpy-tensor
5 years ago
Cathy Wong
luoyang
mindspore-ci-bot
Eric
Mahdi
Zirui Wu
xiefangqi
Jesse Lee
nhussain
jiangzhiwen
heleiwang
islam_amin
Alexey Shevlyakov
genglishuai
tinazhang
tony_liu2
avakh
anthonyaje
ervinzhang
liubuyu
dengyutao
hesham
xulei2020
anzhengqi
ervinzhang
Danish Farid