8f392204be
minddata build with mindspore-lite train
4 years ago
fb2bd156c9
add unique op
4 years ago
c42a1b4a2f
fix batch core dump when col name doesn't exist
...
fix ci
4 years ago
6f77ec45f1
!6905 [MD] Enable cache for more leaf datasets
...
Merge pull request !6905 from lixiachen/CacheOp_dev
4 years ago
2a799fe90e
!6018 Set the number of epochs in mode.train() non-sink Mode
...
Merge pull request !6018 from h.farahat/ms_nonsink_epochs
4 years ago
82bc278e26
minddata use new ps api
4 years ago
19ca9762db
skip graphdata distributed test case when asan mode
4 years ago
477808e622
Enable cache for other leaf ops
4 years ago
0d8015b043
!5300 [MD] Add nD Slice Support
...
Merge pull request !5300 from nhussain/slice_op
4 years ago
b785b7d0ff
!6813 dataset UT: check PIL version, delete test_callback_2maps
...
Merge pull request !6813 from cathwong/ckw_dataset_cleanup8
4 years ago
9cee0d2143
Add num_epochs to non-sink training
4 years ago
f2b07d907a
dataset UT: check PIL version, delete test_callback_2maps
4 years ago
4c0b3c1bd3
!6017 per_batch_map needs to support x input columns and y output columns
...
Merge pull request !6017 from ZiruiWu/per_batch_map_multi_col
4 years ago
e88e114a50
!5930 Cache server phase 2 single node
...
Merge pull request !5930 from Jamie/CacheOp_dev
4 years ago
77d507279c
first working implementation
...
add string implementation, can handle partial string slices
finish core implementation, added Index object
fix up the logic
add in new SliceOption object, cleaning up tests
4 years ago
983827ec5c
Rebase up to 88ded11f59
4 years ago
0cab373223
per_batch_map supports x num_columns to y num_columns
...
decided to use project after batch as well
per_batch_map 1->x colunm works
add more test case
add test cases, project after map
col order hahaah
fix ci
add test cases
addr review cmts
ci
fix build err
fix test case failure
ci
4 years ago
2f3add4acd
!6301 [MD] Combine c++ and python ops in map
...
Merge pull request !6301 from nhussain/c_py_compose
4 years ago
1c6c54ae0f
fix: testcase test_cutmix_batch_op.py slowly
4 years ago
fda9462682
embed python compose op
...
Leaf ops do self-reset.
embed python compose op
add implicit compose op
more tests
4 years ago
f2e34b2eaf
Clean up the view code
4 years ago
53a82fa6e0
!6472 fix get_dataset_size error in CelebaDataset when usage is not 'all'
...
Merge pull request !6472 from yanghaitao/yht_celeba_get_dataset_size
4 years ago
92aecf128f
!6549 [MD] minddata add iterator parameter validation
...
Merge pull request !6549 from xiefangqi/add_output_numpy_valid
4 years ago
4ff4c17632
fix get_dataset_size in CelebADataset when usage is not all
4 years ago
a6360cb2e4
add output_numpy validation to iterator
4 years ago
dd0d9fe9ab
fix ci error
4 years ago
da15495d7b
fix bucket_batch ci error
4 years ago
bef2118253
!6300 [MD] fix get_dataset_size bug when set num_samples in DistributedSampler
...
Merge pull request !6300 from liyong126/fix_md_num_samples
4 years ago
0d486adef1
!3974 Eliminate the pause for each cycle of the Repeat
...
Merge pull request !3974 from lixiachen/repeat_task2
4 years ago
930e85ed5c
fix get_dataset_size in distributedSampler & num_samples
4 years ago
f7adf648e9
dataset API docstring: Update datasets, samplers, graphdata and text
4 years ago
b5b333726f
Leaf ops do self-reset.
4 years ago
653c79b4af
md fix per_batch_map issue
4 years ago
16147669a6
fix num_samples in concatDataset
4 years ago
eb049b0e93
!5842 [Dataset] dataset op log changes
...
Merge pull request !5842 from luoyang/pylint
4 years ago
28e2b0253e
!6086 Order dict by column_id in create_dict_iterator()
...
Merge pull request !6086 from ZiruiWu/order_dict_in_create_dict_iterator
4 years ago
d54ba374b9
order dict by column_id in create_dict_iterator()
...
fix CI
4 years ago
f5a85510f2
[MD] dataset op log changes
4 years ago
96de2ffdb6
fix errors from old compose call in Python
4 years ago
d8c09067ce
!5801 [MD][Feature] minddata iterator output ms_tensor
...
Merge pull request !5801 from xiefangqi/md_modify_output_tensor
4 years ago
5b4642d10a
!4950 Fixing Minddata profiling monitor
...
Merge pull request !4950 from anthonyaje/monitor_fix
4 years ago
9b3c33e157
minddata iterator output ms_tensor
4 years ago
cf7d6eddc4
!6019 [MD] Move Random(Choice/Apply/Order) from vision to transforms module
...
Merge pull request !6019 from nhussain/move_random_choice_apply
4 years ago
a778868a5a
!5929 BucketBatchByLength column issue
...
Merge pull request !5929 from MahdiRahmaniHanzaki/bucket_batch_by_length_fix
4 years ago
f42f9ef9d7
move random apply order and choice ops
4 years ago
92e99ff224
change map calls
4 years ago
2d08d83247
Fixed connector_size and monitor.
4 years ago
1bb93580dd
Add usage flag to MNIST/CIFAR
...
ci fix 1
fix ci 2
fix ci 3
fix ci 4
fix ci 5
fix ci 6
fix ci 7
change var name in CelebA from dataset_type to usage
address review cmts
fix cpp ut fail
change mode to usage in VOCDataset
fix cmts
fix ci test case fail
4 years ago
d0410d6191
md delete set_dataset_size interface
4 years ago
c45f79d36b
!5384 [MD]-Api changes
...
Merge pull request !5384 from nhussain/api_changes
4 years ago
xulei2020
liyong
Zirui Wu
mindspore-ci-bot
xiefangqi
jonyguo
Lixia Chen
hesham
Cathy Wong
nhussain
shenwei41
yanghaitao1
YangLuo
anthonyaje