f42f9ef9d7
move random apply order and choice ops
5 years ago
92e99ff224
change map calls
5 years ago
2d08d83247
Fixed connector_size and monitor.
5 years ago
1bb93580dd
Add usage flag to MNIST/CIFAR
...
ci fix 1
fix ci 2
fix ci 3
fix ci 4
fix ci 5
fix ci 6
fix ci 7
change var name in CelebA from dataset_type to usage
address review cmts
fix cpp ut fail
change mode to usage in VOCDataset
fix cmts
fix ci test case fail
5 years ago
d0410d6191
md delete set_dataset_size interface
5 years ago
c45f79d36b
!5384 [MD]-Api changes
...
Merge pull request !5384 from nhussain/api_changes
5 years ago
a152a65227
Fixed the column problem in BucketBatchByLength
5 years ago
bde9f18f5a
update lookup api to take in a type
...
ci
add test case
address some of the review cmts
address review cmts
5 years ago
3bac9d3713
switch input columns and operation
...
change ImagefolderDV2 name
change ds.transforms.vision to ds.vision
change batch api to match map api more closely
compose op changes
test_pylint
remove compose op from vision, move to transform module, refactor map and batch to use column_order
5 years ago
d76ac7c6e8
!5648 GetColumnNames for Python
...
Merge pull request !5648 from MahdiRahmaniHanzaki/get-col-name
5 years ago
6e7aab8c4f
Added GetColumnNames for Datasets
5 years ago
4d4c11b133
dataset API docstring cleanup: Standard product terms NumPy, Python
5 years ago
bb84f50407
!5473 optim pylint
...
Merge pull request !5473 from jinyaohui/master
5 years ago
27d5281641
Change epoch count to 1 for python testcases
5 years ago
8f3ebfd469
!5624 Optimize the performance of GraphData.get_neg_sampled_neighbors
...
Merge pull request !5624 from heleiwang/gnn_perf
5 years ago
857cf2f77f
Optimize the negative sampling process
5 years ago
5453b40311
!4477 add dataset compare function to utils
...
Merge pull request !4477 from tony_liu2/staging
5 years ago
7f6782be2a
dataset fixes: Update OneHot API docs; fixup Python UTs
5 years ago
a9972a7def
optim pylint
5 years ago
70bfd506a1
add function
...
pr comment fix
revert graphengine
5 years ago
7aaf4118bf
!5297 CutMixBatch and MixUpBatch fix for 2D one-hot labels
...
Merge pull request !5297 from MahdiRahmaniHanzaki/cutmix-fix
5 years ago
7ad7024c45
Fixed 2D one-hot label problems in CutMix and MixUp
5 years ago
94a4a3f20b
changing affine and posterize apis
5 years ago
e4d2f2fd3b
!5030 Adding a BBox class and fixing Posterize C Op testing.
...
Merge pull request !5030 from islam_amin/bbox_class
5 years ago
20b3134785
!5184 fix: padded dataset when no div and with repeat op
...
Merge pull request !5184 from guozhijian/fix_padded_with_no_div_repeat
5 years ago
f3fd7a5578
!5073 Add checks and exception handling DS callback
...
Merge pull request !5073 from h.farahat/map_callback_end
5 years ago
6df1a43ec2
fix: padded dataset with non div & repeat
5 years ago
346b97acb8
!5156 fix softdvpp coredump
...
Merge pull request !5156 from qianlong21st/master_fix_softdvpp_core
5 years ago
12dfca71f1
fix softdvpp coredump
5 years ago
67f5c89cd6
Check input image type for random posterize
5 years ago
641e751d5e
adding bbox class
5 years ago
a2c38d89f9
Added float32 support for CutMixBatch
5 years ago
8eeceb267b
- release the wait if training is ended
5 years ago
ac81886328
!4916 fix generator_dataset hangs and test_graphdata_distributed.py failing randomly
...
Merge pull request !4916 from heleiwang/gnn_fix_bug
5 years ago
9b503e4f38
!4955 Fixes for Dynamic Augmentation Ops
...
Merge pull request !4955 from MahdiRahmaniHanzaki/dynamic-ops-fix
5 years ago
a5f9b8f92e
Added fix for MixUpBatch and CutMixBatch and for RandomAffine
...
updated c color op descriptions
5 years ago
9d7250c483
!4776 Introduce 2 extra ctrl flags to DataBuffer in dataset, address remaining cmts to PR4632
...
Merge pull request !4776 from ZiruiWu/map_callback_follow_up
5 years ago
74c1e6da60
introducing pause and quit flags to DataBuffer
...
fix review cmts
fix ci
fix Ci
fixci
address ci
ci
- add timeout
- add more test cases
fix CI
address review cmts
5 years ago
82c888f065
!4930 Fix CI cifar hang issue
...
Merge pull request !4930 from xiefangqi/fix_cifar_nofile_issue
5 years ago
e3e7820413
fix cifar stuck problem
5 years ago
4870abc848
1. fix generator_dataset hangs
...
2. fix test_graphdata_distributed.py failing randomly
5 years ago
5b4b539751
fix: concat with none sample dataset
5 years ago
ed954dc407
!4782 Python UT fails on RandomPosterize
...
Merge pull request !4782 from islam_amin/bbox_class
5 years ago
85357238fe
Fixing posterize python ut
5 years ago
8a08d0c37b
Phase 2 of CacheOp
5 years ago
78c1aa1d96
Implemented Callback for Dataset
...
implment pause in MapOp, added more to callback
add ds_callback
- Initial drop of Python DSCallback
- Pybind DSCallback
- Pybind DSCallback
added callback to mapOp
- de_pipeline DSCallback
- de_pipeline DSCallback
add test case, segfault for now
fix seg fault
- de_pipeline DSCallback
remove 1 line
update callback test case, now works
use builder class for mapOp callback
- de_pipeline DSCallback
- de_pipeline DSCallback
- de_pipeline DSCallback
better test case
minor fix
add comments and minor clean ups
get rid of nullptr in MapOp, use other flag instead
fix a bug ParseMapOp only takes 1 callback
- Added WaitedDSCalabck
refactor callback param
fix text case incorrect number
- added testing
fix cpp test case
- added testing
- revert back lenet changes
- cleanup test_callbacks.py
- cleanup test_callbacks.py
fix CI stage I
fix CI stage II
fix CI and update epoch counter
- add validation
- add more testing test_callbacks.py
use random data op to do tests
adjust when to call EpochBegin/End
- add repeat with callback
- addressing reviewers' comments
- docstring and CI fixes
- docstring and CI fixes
- docstring and CI fixes
- rebase with upstream/master
fix cpp test case
fix review comments
addr review cmts, add test case
5 years ago
256dccc651
!4498 Gnn data processing supports distributed scenarios
...
Merge pull request !4498 from heleiwang/gnn_distributed
5 years ago
8ee4d8e92d
Gnn data processing supports distributed scenarios
5 years ago
50b5c8035b
!4701 fix concat get_dataset_size error
...
Merge pull request !4701 from guozhijian/fix_concat_get_dataset_size_err
5 years ago
738ae2c78d
change api to use std_vector
...
try to display image
5 years ago
979111d0ef
Added Posterize Op
5 years ago
b0b370336f
fix: concat get_dataset_size error
5 years ago
5f294fb90d
fix: random affine parameter check
5 years ago
113ff6ca24
!4367 CutMixBatch Augmentation Op
...
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
5 years ago
3ecc53fb4e
Added CutMix
5 years ago
8bb4449fa8
add testcase for padded dataset with decode op
5 years ago
c410c6a6e2
soft_dvpp_decode_resize_jpeg_op issue resolved, input size can be an int, break the constraints of input size being sequence (height, width)
5 years ago
8526d5414d
RandomColor
5 years ago
7a10e07fc6
!4383 Add distributedSampler to concatOP
...
Merge pull request !4383 from genglishuai/genglshOK
5 years ago
4d4df68d1e
add DistributedSampler for Concat op
5 years ago
ed1244558c
!4366 Fixing param type in c++ api and fixing python validator for Repeat Op
...
Merge pull request !4366 from TinaMengtingZhang/cpp-api-repeat-count
5 years ago
0868720eb7
fix parameter type for repeat op in c++ api and added c++/python ut.
5 years ago
3e31ac6d62
all Dataset support get_dataset_size
5 years ago
9276a9d2fb
!3771 C++ API Support for TextFile Dataset
...
Merge pull request !3771 from cathwong/ckw_c_api_textfile_nosampler
5 years ago
477528de7f
random sharpness cpp op support
5 years ago
7766efd58e
add files
5 years ago
7f39b5cfd7
C++ API Support for TextFile Dataset and Unit Tests
5 years ago
c2997845c2
!4289 Fix pad op validate issue
...
Merge pull request !4289 from xiefangqi/fix_pad_validate
5 years ago
7ee1e46455
fix pad op validate issue
5 years ago
e9c4378ed8
add support of soft dvpp op
5 years ago
266df56570
!4220 [MD] add num_samples support in minddataset pk sampler
...
Merge pull request !4220 from liyong126/minddataset_pk_num_samples
5 years ago
e52d85ba9d
Added RandomAffine Op
5 years ago
9ad82f79fd
!3979 Adding MixUp operation
...
Merge pull request !3979 from MahdiRahmaniHanzaki/mixup
5 years ago
7341421d3b
fix num samples in pk sampler
5 years ago
3d7826b6df
test five crop problem
5 years ago
1896950ae5
Added Mixup
5 years ago
e19d382473
!3346 Maintain epoch/repeat count for ops
...
Merge pull request !3346 from lixiachen/repeat_rework
5 years ago
ac85b77b76
Maintain epoch/repeat count for ops
5 years ago
7ec0b5857a
!3977 [MD] Refactor Concatenate Op
...
Merge pull request !3977 from nhussain/multi_dim_concat_2
5 years ago
61769b2dd9
fix concat
5 years ago
27e51c5a63
!3553 Unify np array comparisons
...
Merge pull request !3553 from tony_liu2/staging
5 years ago
388e43f7cb
delete parameter block_reader for MindDataset
5 years ago
6017b050ac
add generatordataset support split
5 years ago
269b477684
use np.testing.assert instead of asserting
...
fix line lengths
fix spacing
reverse a few changes
5 years ago
d06da1d270
!3603 Check that the number columns of names and default matches
...
Merge pull request !3603 from jiangzhiwen/fix_column_names_exceeded
5 years ago
2cc6b5cb52
fix number of columns not match
5 years ago
1906ed1be8
fix cache description again
5 years ago
b6529b9096
fix cache description
5 years ago
620d951e5e
Merge branch 'ql/fix_cache_core' of https://gitee.com/qianlong21st/mindspore into ql/fix_cache_core
5 years ago
9c06a564d1
!2983 Dataset Tensor class cleanup
...
Merge pull request !2983 from h.farahat/tensor_class
5 years ago
bf87b1d1fb
fix cache op core dump
5 years ago
0a2980ca74
!3440 [MD]Fix Segementation Falut when SentencepieceTokenizer Op before zipOp and ConcatOp
...
Merge pull request !3440 from xulei/sentence_piece0715
5 years ago
adfbc891d3
- Add checks and testing for empty tensors
...
- cleanup work on createTensor and Tensor's constructors
5 years ago
06ed9ffd6a
!3183 Remove files on test fail for test_minddataset*.py
...
Merge pull request !3183 from tony_liu2/master
5 years ago
0af6d75761
add code
5 years ago
d28c63b6c0
fix diff workers disallow cache
5 years ago
21a5f06e93
!3328 Add testcases
...
Merge pull request !3328 from shenwei41/sw_master
5 years ago
1f4251a440
add try to minddataset python tests to remove files on fail
...
delete unrelated file
change finally to except else
fix spacing alignment
fix indentation
fix indentation
fix indentation
add fix to new test case
add if main for pytest
fix spacing
5 years ago
859fe6bc41
!3342 C++ API Support for Skip Dataset Op plus UTs
...
Merge pull request !3342 from cathwong/ckw_c_api_skip
5 years ago
df1300d9cb
!3294 Refactor opt/pre passes
...
Merge pull request !3294 from nsyca/removal_pass
5 years ago
nhussain
anthonyaje
Zirui Wu
xiefangqi
mindspore-ci-bot
mahdi
Cathy Wong
Lixia Chen
heleiwang
jinyaohui
tony_liu2
islam_amin
jonyguo
qianlong
YangLuo
hesham
Jesse Lee
mayang
Alexey Shevlyakov
genglishuai
tinazhang
anzhengqi
avakh
liyong
dengyutao
jiangzhiwen
guansongsong
xulei2020