mindspore-ci-bot
20c1727b2c
!11631 Add SubsetSampler
...
From: @hfarahat
Reviewed-by:
Signed-off-by:
4 years ago
mindspore-ci-bot
8e4a6842ff
!11681 gnn support edge weight sampling
...
From: @heleiwang
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
4 years ago
heleiwang
2dc9ba761c
gnn support weight sampling neighbors.
4 years ago
hesham
7120c66998
Add SubsetSampler
4 years ago
mindspore-ci-bot
4cd6588af0
!11393 Migrating cache transform pass from execution tree to IR tree
...
From: @lixiachen
Reviewed-by:
Signed-off-by:
4 years ago
mindspore-ci-bot
f2fd357ffc
!11623 fix issues of MD
...
From: @luoyang42
Reviewed-by:
Signed-off-by:
4 years ago
luoyang
415c8b08a5
fix issues of MD:
...
1. description of num_shard in datasets.py
2. add param validation for sampler
3. add description for add_child in sampler.py
4 years ago
Lixia Chen
922e1f4f36
Migrate CacheTransformPass
4 years ago
mindspore-ci-bot
3708624a25
!11559 [MD] Change the default spill location of cache server
...
From: @lixiachen
Reviewed-by:
Signed-off-by:
4 years ago
Lixia Chen
be6d310946
Default to memory-only cache server
4 years ago
xiefangqi
3f76abcdee
minddata err msg add file path
4 years ago
mindspore-ci-bot
2beb916bf5
!11427 TextOp decoupling
...
From: @alexyuyue
Reviewed-by:
Signed-off-by:
4 years ago
mohammad
b5e91139e2
add GetDatasetSize to concat node
4 years ago
alex-yuyue
a8675f8227
TextOp decoupling
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
Lixia Chen
273865a72b
Rename SamplerObj::Build() to SamplerBuild()
4 years ago
TinaMengtingZhang
d3fdbceb61
[Part II] Push down json save logic to IR and add getter to each IR node
4 years ago
alex-yuyue
b54e01bfb4
Tensor op decoupling stage 2
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
TinaMengtingZhang
4812fece80
[Part I] Push down json save logic to IR and add getter to each IR node
5 years ago
Nat Sutyanyong
686772cce7
Migrate GeneratorOp resetting logic to IR optimizer (incl. debug code)
...
with comments from the peer view addressed
5 years ago
mindspore-ci-bot
7957a3b6f5
!10988 Tensor op decoupling stage 1
...
From: @ezphlow
Reviewed-by:
Signed-off-by:
5 years ago
Eric
be46ccf721
Started vision decoupling
...
map validate params
Changing bindings
Change behavior of vision.cc
Added signature and changed Cmake
Compiling
Need to fix compile
Added compiling random transforms
python changes for decoupling
two failed test case remaining
Compiling random choice
passes all ut
Changed assert
review comments
Added validate params
add back return value
Fix lint
py lint fix
pylint 2
Addressing comments
5 years ago
Zirui Wu
0e68575e77
port over getter pass
...
port over tensor_op_fusion pass
add fusion support for prebuildOpeartion (TensorOpeartion)
5 years ago
mindspore-ci-bot
03e655f14a
!10070 Fixing GetDatasetSize issue with chained samplers
...
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
5 years ago
Xiao Tianci
31fed1a2f6
change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine
5 years ago
mindspore-ci-bot
20df37e428
!10287 Add ut for dataset to_number
...
From: @luoyang42
Reviewed-by: @heleiwang
Signed-off-by:
5 years ago
Zirui Wu
a1355a827c
introduce a master switch to turn on and off profiler
5 years ago
YangLuo
da6de519ae
Add ut for dataset to_number
5 years ago
mindspore-ci-bot
d99189f681
!10207 Fix some minor doc, typo related to AutoNumWorker
...
From: @ziruiwu
Reviewed-by: @mikef
Signed-off-by:
5 years ago
Zirui Wu
4ae7102fd3
address 2 tickets
5 years ago
Mahdi
98ea8fa6ea
Added tests for chain samplers, fixed GetDatasetSize issue with chained samplers
5 years ago
mindspore-ci-bot
fc11b7dd68
!10074 Fix a testcase error when shuffle is above cache
...
From: @lixiachen
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei,@liucunwei
5 years ago
mindspore-ci-bot
691e3baab6
!10109 [MD] Fix Decode doc & RandomNode log
...
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
5 years ago
mindspore-ci-bot
6035823c4b
!10044 fix get num classes of concat
...
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang,@liucunwei
Signed-off-by: @liucunwei,@liucunwei
5 years ago
luoyang
595b7a782f
[MD] Fix Decode doc & RandomNode log
5 years ago
Lixia Chen
a7f0e13234
Remove special treatment for cache above repeat
5 years ago
YangLuo
df9f4f41e8
fix get num classes of concat
5 years ago
Xiao Tianci
633f97bb48
fix get dataset size in distributed scenario
5 years ago
mindspore-ci-bot
c4f284b928
!9910 [MD][Perf] MindData add NormalizePad for GPU performance
...
From: @xiefangqi
Reviewed-by:
Signed-off-by:
5 years ago
xiefangqi
3c6cc3c58c
Add NormalizePadOp
5 years ago
YangLuo
18e61a627a
python eager add decode
5 years ago
mindspore-ci-bot
ad6507d88a
!9825 [MD] fix pad, normalize in c_trasnform
...
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
5 years ago
luoyang
1cc147df1d
fix pad, normalize in c_trasnform
5 years ago
Zirui Wu
77521e78d2
staging
5 years ago
Zirui Wu
91a6b2b0ca
Add checks to RandomData and LookUp
5 years ago
mindspore-ci-bot
317a97e6b9
!9336 auto num_parallel_workers setup
...
From: @ziruiwu
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
a2c80435ce
!9685 Fix a core dump in TreeConsumer::Terminate() plus minor cache fixes
...
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
5 years ago
Zirui Wu
d6df1b0832
Implemented AutoNumWorker Pass which sets num_workers of selected parallel ops automatically if enabled
5 years ago
Lixia Chen
32b82c2737
Fix a core dump in TreeConsumer::Terminate()
...
and other minor cache changes
5 years ago
hesham
ff65f6feb8
Remove batch_map multiprocess test case
5 years ago
mindspore-ci-bot
aa5d4e08a9
!9544 Fix a possible seg fault in GenerateCRC caused by std::regex
...
From: @lixiachen
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @heleiwang
5 years ago