28ebd73096
fix bug when int or float is numpy type
6 years ago
e2ea1fa0df
activate num_samples in distributed samplers
6 years ago
2412ee09ce
fix distributedSampler reshuffle and fix random_device failed
6 years ago
1de7271afc
add floatxx test case
6 years ago
96859f44b6
fix: MindDataset distribute shuffle bug
6 years ago
feff8899ac
support padding samples
6 years ago
9b2a778d94
!1478 [Dataset] clean pylint.
6 years ago
abca62f407
10:00 26/5 clean pylint
6 years ago
df361d1d26
Change mem layout of string tensor
...
add support for MindRecord and TFRecord
----
optimize tensorshape
optimize tensorshape and FlatIndex
TFRecord and MindRecord support for string tensor
Modify mem layout
Add new constructor
Add method Allocate
Change some GetMutableBuffer usages to AllocateBuffer
6 years ago
bb51bb88d7
add compress in mindrecord
6 years ago
5a914994ba
clean pylint
6 years ago
bcfaff97f9
clean pylint
6 years ago
aa3f89e74f
mindrecord support read file list
6 years ago
d4d236bcce
fix: use MindDataset by column_names get data error in some situation
6 years ago
c688265671
fix: when use MindDataset block_reade=True hung
6 years ago
bc4602b58e
fix and remove useless import of example, st, ut
6 years ago
34e42bd6f9
1. add more log info for dataset & mindrecord, 2. add two new testcase for MindDataset
6 years ago
930a1fb0a8
initial version
...
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
6 years ago
liyong
jonyguo
Yang
hesham
jonwe
jinyaohui
xiefangqi
zhunaipan