f1ef84e1a6
!8714 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size
...
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
0cb5c47856
add err modify
4 years ago
e5f62013f4
dataset Python UT: Add Sampler Chain Tests, with get_dataset_size
4 years ago
d2427b6e89
!8538 fix get_num_class in imagefolder
...
From: @ziruiwu
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @nsyca
4 years ago
3555d19b07
fix get num_class in imagefolder
...
address cmt
review cmts
4 years ago
c795879313
CacheOp delivery for HQ tester
4 years ago
4a5e287b92
add filter c api and ut
4 years ago
1b78e34310
add ANTIALIAS support for python progress
4 years ago
82cc7c3f63
[MD] Revert changes to weighted_random_sampler in PR7866
4 years ago
cacebd1211
!7933 Cache performance updates
...
Merge pull request !7933 from Jamie/CacheOp_dev
4 years ago
0d40abf5dd
fix md padding bug
4 years ago
572c5e5f29
Rebase up to 542a52fbf8
4 years ago
ea97197311
fix tfrecord_op core dump
...
add test case
fix ci
fix ci round 2
address review cmts
4 years ago
823e52f1dc
add params checking of offset in distributed_sampler
...
add related comment to explain
add related UT
4 years ago
c5867d2d7e
!7676 [MD] fix arm compile error
...
Merge pull request !7676 from liyong126/fix_arm_env
4 years ago
1e7f46c998
fix unorder_map hash
4 years ago
ee042b90f7
fix num_sample in sequentialSampler and randomSampler
4 years ago
8f392204be
minddata build with mindspore-lite train
4 years ago
fb2bd156c9
add unique op
4 years ago
c42a1b4a2f
fix batch core dump when col name doesn't exist
...
fix ci
4 years ago
6f77ec45f1
!6905 [MD] Enable cache for more leaf datasets
...
Merge pull request !6905 from lixiachen/CacheOp_dev
4 years ago
2a799fe90e
!6018 Set the number of epochs in mode.train() non-sink Mode
...
Merge pull request !6018 from h.farahat/ms_nonsink_epochs
4 years ago
82bc278e26
minddata use new ps api
4 years ago
19ca9762db
skip graphdata distributed test case when asan mode
4 years ago
477808e622
Enable cache for other leaf ops
4 years ago
0d8015b043
!5300 [MD] Add nD Slice Support
...
Merge pull request !5300 from nhussain/slice_op
4 years ago
b785b7d0ff
!6813 dataset UT: check PIL version, delete test_callback_2maps
...
Merge pull request !6813 from cathwong/ckw_dataset_cleanup8
4 years ago
9cee0d2143
Add num_epochs to non-sink training
4 years ago
f2b07d907a
dataset UT: check PIL version, delete test_callback_2maps
4 years ago
4c0b3c1bd3
!6017 per_batch_map needs to support x input columns and y output columns
...
Merge pull request !6017 from ZiruiWu/per_batch_map_multi_col
4 years ago
e88e114a50
!5930 Cache server phase 2 single node
...
Merge pull request !5930 from Jamie/CacheOp_dev
4 years ago
77d507279c
first working implementation
...
add string implementation, can handle partial string slices
finish core implementation, added Index object
fix up the logic
add in new SliceOption object, cleaning up tests
4 years ago
983827ec5c
Rebase up to 88ded11f59
4 years ago
0cab373223
per_batch_map supports x num_columns to y num_columns
...
decided to use project after batch as well
per_batch_map 1->x colunm works
add more test case
add test cases, project after map
col order hahaah
fix ci
add test cases
addr review cmts
ci
fix build err
fix test case failure
ci
4 years ago
2f3add4acd
!6301 [MD] Combine c++ and python ops in map
...
Merge pull request !6301 from nhussain/c_py_compose
4 years ago
1c6c54ae0f
fix: testcase test_cutmix_batch_op.py slowly
4 years ago
fda9462682
embed python compose op
...
Leaf ops do self-reset.
embed python compose op
add implicit compose op
more tests
4 years ago
f2e34b2eaf
Clean up the view code
4 years ago
53a82fa6e0
!6472 fix get_dataset_size error in CelebaDataset when usage is not 'all'
...
Merge pull request !6472 from yanghaitao/yht_celeba_get_dataset_size
4 years ago
92aecf128f
!6549 [MD] minddata add iterator parameter validation
...
Merge pull request !6549 from xiefangqi/add_output_numpy_valid
4 years ago
4ff4c17632
fix get_dataset_size in CelebADataset when usage is not all
4 years ago
a6360cb2e4
add output_numpy validation to iterator
4 years ago
dd0d9fe9ab
fix ci error
4 years ago
da15495d7b
fix bucket_batch ci error
4 years ago
bef2118253
!6300 [MD] fix get_dataset_size bug when set num_samples in DistributedSampler
...
Merge pull request !6300 from liyong126/fix_md_num_samples
4 years ago
0d486adef1
!3974 Eliminate the pause for each cycle of the Repeat
...
Merge pull request !3974 from lixiachen/repeat_task2
4 years ago
930e85ed5c
fix get_dataset_size in distributedSampler & num_samples
4 years ago
f7adf648e9
dataset API docstring: Update datasets, samplers, graphdata and text
4 years ago
b5b333726f
Leaf ops do self-reset.
4 years ago
653c79b4af
md fix per_batch_map issue
4 years ago
mindspore-ci-bot
ms_yan
Cathy Wong
Zirui Wu
Jesse Lee
Xiao Tianci
jonyguo
YangLuo
liyong
Lixia Chen
xulei2020
xiefangqi
hesham
nhussain
shenwei41
yanghaitao1