liyong
f1542a90a3
add pk sampler
5 years ago
jiangzhiwen
e1b109e8b8
optimize skip dataset op
5 years ago
Cathy Wong
60df369100
Fixup py Normalize doc: takes input CHW
5 years ago
mindspore-ci-bot
6369cf27bd
!406 added first row crc check for when reading tfrecord files
...
Merge pull request !406 from Peilin/first-row-crc-check
5 years ago
mindspore-ci-bot
98fbd30a5b
!460 [Data]Add filter operation
...
Merge pull request !460 from xulei/filter_master
5 years ago
mindspore-ci-bot
822a3160e4
!404 [Dataset] Add Python Sampler support for CPP dataset
...
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
5 years ago
xulei2020
c705ea5e5b
add filterOp code
5 years ago
Peilin Wang
9bc2134cb7
added checking of first row crc to find invalid tfrecord files
...
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file
fixed clang format
fixed cppcheck
fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before
fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments
more clang whitespace fixes...
changed print to logger.info
5 years ago
yanghaitao
2795e492ff
TextFileDataset
5 years ago
Junhan Hu
43a2e99833
Add python sampler support for CPP dataset
5 years ago
ms_yan
f0c07c3fa6
Realize take op and add ut
5 years ago
mindspore-ci-bot
80333e9f55
!435 Fix dataset serialize and deserialize for MindDataset
...
Merge pull request !435 from anthonyaje/fix_serdes_dataset
5 years ago
mindspore-ci-bot
40f0a4a4f4
!333 Add skip op to Dataset
...
Merge pull request !333 from jiangzhiwen/dataset/skip
5 years ago
mindspore-ci-bot
9e1b5efd1d
!434 Bug in cleaning dataset iterators
...
Merge pull request !434 from h.farahat/multi_itr_bug
5 years ago
anthonyaje
ea297c0889
Fix dataset serdes for MindDataset
5 years ago
hesham
3c02c82771
Bug in weak reference.
...
Add new test cases
5 years ago
jzw
3f7054dccb
add skip dataset op
5 years ago
mindspore-ci-bot
cf026096a6
!183 Mindspore.dataset CPP sampler for GeneratorDataset
...
Merge pull request !183 from JunhanHu/cpp_sampler
5 years ago
Junhan Hu
9739d3b048
Add CPP sampler support for GeneratorDataset
5 years ago
mindspore-ci-bot
30de261c3c
!243 Support nested repeat
...
Merge pull request !243 from h.farahat/nested_repeat
5 years ago
hesham
0fc23eee0f
Support nested repeat
5 years ago
xiefangqi
1a1cbc6814
implemention of new api: apply
5 years ago
liyong
0ce83e39e1
fix TestShardSampleWrongNumber
...
adjust internal api
5 years ago
liyong
11403492ae
add mindrecord subset random sampler
5 years ago
Cathy Wong
59a714c654
Correct shuffle UT buffer_size > #dataset-row as valid
5 years ago
jonyguo
c688265671
fix: when use MindDataset block_reade=True hung
5 years ago
xiefangqi
bc4602b58e
fix and remove useless import of example, st, ut
5 years ago
mindspore-ci-bot
5c22c088bb
!69 Enable skipped dataset zip operator python unit tests
...
Merge pull request !69 from cathwong/ckw_dataset_py_ut1
5 years ago
anzhengqi
6a1b865c91
check num_samples
5 years ago
Cathy Wong
2e881276ab
Enable skipped dataset zip python unit tests
...
Signed-off-by: Cathy Wong <cathy.wong@huawei.com>
5 years ago
qianlong
8c88b39da1
Optimize the execution time of test case test_rgb_hsv.py
5 years ago
jonyguo
34e42bd6f9
1. add more log info for dataset & mindrecord, 2. add two new testcase for MindDataset
5 years ago
zhunaipan
930a1fb0a8
initial version
...
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
5 years ago