6ae8345cad
refactor vm module for multigraph sink
5 years ago
b37db1edf5
!603 [MD] update pk sampler in minddataset
...
Merge pull request !603 from liyong126/update_pk_sampler
5 years ago
f82e63fecc
!671 Added testcase for sync_wait
...
Merge pull request !671 from EricZ/master
5 years ago
0e3054d527
!466 Deepcopy problem when pyfunc cannot be pickled
...
Merge pull request !466 from h.farahat/deepcopy
5 years ago
bfba630aa2
update pK_sampler
5 years ago
c47ef8ee4e
!711 Address first epoch always shuffle with same seed init of random sampler
...
Merge pull request !711 from ZiruiWu/mindspore_master_only
5 years ago
afbd24cb78
!718 Fix dtype judge sentence in infer_dtype function of hcom operations
...
Merge pull request !718 from zhouyuanshen/master
5 years ago
c046874b03
fix bug in infer_dtype function of hcom operations
5 years ago
ab04b3dc4b
fix np.histograms(bins='auto') sometimes calc very small width and very large bucket number, which lead to error/long compute time.
5 years ago
9e633b6c12
validate bprop rules
5 years ago
ef71ae941f
!698 [Auto parallel] Support multi-subgraphs in auto-parallel
...
Merge pull request !698 from Xiaoda/support-wide-deep-in-auto-parallel
5 years ago
e213f2a435
!687 Fix bug: Summary tage type checking and exception throwing
...
Merge pull request !687 from candanzg/summary_tag_check
5 years ago
e227415673
support-the-multiple-subgraphs-in-the-ANF
5 years ago
8c3931cf1d
fix first epoch always shuffle with default seed in random sampler
...
fix ut
5 years ago
efdcd4c258
!682 fix api comments of some ops
...
Merge pull request !682 from liuxiao/fix-bug
5 years ago
da5b10b699
!681 add psnr inputs shape and dtype check
...
Merge pull request !681 from zhaozhenlong/psnr-check-same-shape
5 years ago
c88edfb31d
psnr check two input same shape and type
5 years ago
4750861054
fix layernorm bug
5 years ago
348b0ef53c
!344 add prim name to error message for operators in array_ops.py
...
Merge pull request !344 from fary86/add_prim_name_to_error_message_for_array_ops
5 years ago
b84deeeb5c
fix summary tage check error
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
2078229436
Add prim name to error message for array_ops
5 years ago
36a62576e8
support forward graph
5 years ago
5e877a7715
modify api and add example
5 years ago
ad2a5dcad2
!676 [Auto parallel] Add the resnet50 testcase
...
Merge pull request !676 from Xiaoda/add-the-resnet50-testcase
5 years ago
aff6777ecc
fix reviewboot and example of TruncatedNormal and add type mapping
5 years ago
3ff9e54734
add the resnet50 32k-8p testcase
5 years ago
2d115cd04e
Added example for multiple iterator
...
Added new testcase for multi iterator
Addressing review
Fixed typo
5 years ago
56f785f7e6
add context configration
5 years ago
6844ea633d
!56 Synchronization code423 to ms-incubator
...
Merge pull request !56 from changzherui/syn-code423
5 years ago
a02eb240e9
!595 Tensor assign with int or tuple(int) index
...
Merge pull request !595 from candanzg/tensor_assign_with_integer
5 years ago
ce71c17933
!645 auto parallel prelu operator support broadcast
...
Merge pull request !645 from yao_yf/auto_parallel_prelu_support_broadcast
5 years ago
84d5e4f923
!643 [AutoParallel]Support reshape parameter
...
Merge pull request !643 from lichen/support_reshape_parameter
5 years ago
31aae36106
Tensor assign with integer
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
43a8f829a2
!628 fix the infer of TruncatedNormal and a bug of structure output
...
Merge pull request !628 from zhangbuxue/fix_example_for_TruncatedNormal
5 years ago
00859ae119
!586 enable/disable allreduce_fusion
...
Merge pull request !586 from lirongzhen1/allreduce_fusion
5 years ago
2ab211ae04
support reshape parameter
5 years ago
c8a1a24ce3
fix the infer of TruncatedNormal and a bug of structure output and a bug of tensorslice ellipsis
5 years ago
425276d43d
auto parallel prelu support prelu
5 years ago
dfde76af88
delete the 'simplify_cal' attribute in 'set_algo_parameters' and 'get_algo_parameters' interface
5 years ago
4ff418084c
enable/disable allreduce_fusion
5 years ago
d1add07b5a
change error type
5 years ago
1af894e25f
change error type
5 years ago
57bc30505c
change error type
5 years ago
ad75618ca6
!611 change error message type
...
Merge pull request !611 from JichenZhao/errormsg
5 years ago
bd13f9ba33
modify ResizeNearestNeighborV2D
5 years ago
8963e39516
change error type
5 years ago
5ac07bb695
!504 Support Tensor assign A[slice] = u
...
Merge pull request !504 from candanzg/tensor_assign_with_slice
5 years ago
663d597330
tensor assign with slice index
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
0bf6717e9a
!454 Fix the check of bool type in auto cast
...
Merge pull request !454 from candanzg/bug_cast_op
5 years ago
5cf09405e2
!532 [AutoParallel]support multiple subgraphs
...
Merge pull request !532 from lichen/support_multiple_subgraphs_in_auto_parallel
5 years ago
a9e9266149
Deepcopy problem when pyfunc cannot be pickled
5 years ago
b6e77e5178
Add ReluV2/ReluGradV2/ConfusionMulGrad for VM
5 years ago
1a0d2666b7
!559 Add Fill/Erf op for VM.
...
Merge pull request !559 from liuxiao/fill-op
5 years ago
818acd46d4
!569 fix bug in checkpoint when save scaler
...
Merge pull request !569 from wangnan39/master
5 years ago
c78630d737
support multiple subgraphs
5 years ago
f38d18c665
fix bug in checkpoint when save scaler
5 years ago
24a9f4974c
!536 support ellipsis and bool for tensor slice
...
Merge pull request !536 from zhangbuxue/support_elipis_for_tensor_slice
5 years ago
5b6c8fade8
Add Erf\FillD operator for VM
5 years ago
437bb8c27c
support ellipsis and bool for tensor slice
5 years ago
67057d1309
!541 add average pooling 1D
...
Merge pull request !541 from JichenZhao/avgpooling
5 years ago
4516b8feff
!437 Add L2Loss op for VM.
...
Merge pull request !437 from liuxiao/add-l2-loss
5 years ago
3b083d07bb
!550 support one node communication group
...
Merge pull request !550 from yao_yf/support_one_node_communication_group
5 years ago
c874e2d484
Add L2Loss op for VM
5 years ago
aad5771a62
!524 Added support for UA augmentation ops with tests
...
Merge pull request !524 from alashkari/ua-ops
5 years ago
56e7a7deb5
Added UniformAugment + Python Augmentation Ops
5 years ago
dc0491caf9
!508 [Dataset] Adding sync_wait operator for dataset
...
Merge pull request !508 from EricZ/master
5 years ago
cd94518769
X# This is a combination of 2 commits.
...
Initial commit for dataset op python
Added signature to barrier
Adde compiling barrier code
Rebasing, fixed new compile errors
Final fix for make_unique
Added pybind API for barrier
Fixed pyfunc invocation
python interface - sync_wait
!1 sync_wait python interface
* python interface - sync_wait
fix test
update test
update test
Added new test case
add test case
test for shuffle + batch
Added two-sync test case
Restrited that no shuffle after sync
Added sync to pipeline info
block first databuffer as well
Intelligently get batch size
Fix default case
Lock Pair shares among all iterators
Added fix for empty character
Fixed up test case formatting
Fix end of epoch in sync_wait
Fixing CI
5 years ago
78001ac9e6
Add multiprocessing support for Mindspore.Dataset.GeneratorDataset
5 years ago
fb18671b28
!506 [Dataset] Multiprocessing support for Pyfunc
...
Merge pull request !506 from JunhanHu/multiprocess_pyfunc
5 years ago
b13e7bc31a
Add python multiprocessing support for Mindspore.dataset
5 years ago
371b3338b6
support one node communication group
5 years ago
72f42fc37c
!170 Add prim name to error message for operators in nn_ops.py
...
Merge pull request !170 from fary86/add_prim_name_to_error_message_for_nn_ops
5 years ago
b812b18c02
support update parameter for vm
5 years ago
6dd72f654a
Add prim name to error message for nn_ops.py
5 years ago
db80f4ff92
The num_samples and numRows in schema for TFRecordDataset are conflict
5 years ago
94c99998ae
add AvgPooling layer
5 years ago
d9e4dcc33b
!483 Optimize skip dataset op
...
Merge pull request !483 from jiangzhiwen/dataset/skip_opt
5 years ago
862d23fe90
!481 Move args_type_check function to _checkparam.py
...
Merge pull request !481 from leonwanghui/rm-code
5 years ago
7aac50804a
!514 [MD] add Pk Sampler in minddataset
...
Merge pull request !514 from liyong126/mindrecord_pk_sampler_lee
5 years ago
24b26ee1a8
Move args_type_check function to _checkparam.py
5 years ago
f1542a90a3
add pk sampler
5 years ago
0de05b3949
[bug] fixed bool check for cast op
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
27a88a6bc3
!456 Auto cast case for NotEqual op
...
Merge pull request !456 from candanzg/not_equal_auto_cast
5 years ago
e1b109e8b8
optimize skip dataset op
5 years ago
60df369100
Fixup py Normalize doc: takes input CHW
5 years ago
6369cf27bd
!406 added first row crc check for when reading tfrecord files
...
Merge pull request !406 from Peilin/first-row-crc-check
5 years ago
98fbd30a5b
!460 [Data]Add filter operation
...
Merge pull request !460 from xulei/filter_master
5 years ago
822a3160e4
!404 [Dataset] Add Python Sampler support for CPP dataset
...
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
5 years ago
c705ea5e5b
add filterOp code
5 years ago
9bc2134cb7
added checking of first row crc to find invalid tfrecord files
...
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file
fixed clang format
fixed cppcheck
fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before
fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments
more clang whitespace fixes...
changed print to logger.info
5 years ago
d8176a77f4
!425 New api "TextFileDataset"
...
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
5 years ago
5434a96d85
!493 support python func print and != for list with none
...
Merge pull request !493 from zhangbuxue/support_python_func_print
5 years ago
0cdb1171d5
!87 Take AllToAll as a virtual operator in cost model
...
Merge pull request !87 from gziyan/dev_alltoall
5 years ago
c3ec9712e0
!403 add cell class name to error message
...
Merge pull request !403 from fary86/add_cell_name_to_error_message_for_nn_layer
5 years ago
7c233a57fa
support python func print and != for list with none
5 years ago
679dbd27b3
!478 fix save_graphs_path and log file mode related issues
...
Merge pull request !478 from fary86/fix_log_and_ir_issues
5 years ago
7e23a1a475
Fix issues of save_graphs_path, Type/Value error message and log file mode
5 years ago
3ba31ec15a
!419 Tensor assign with bool Tensor
...
Merge pull request !419 from candanzg/tensor_assign_bool_index
5 years ago
2795e492ff
TextFileDataset
5 years ago
18580a7867
!261 Add summary module python code to extract histogram info from tensor
...
Merge pull request !261 from wenkai/histogram_dev3cp
5 years ago
3822b4837f
!340 Add a HistogramSummary ops to record tensor value
...
Merge pull request !340 from ougongchang/master
5 years ago
0d208e00bd
Model ALLTOALL as a single operator in cost model; scale the ALLTOALL,
...
ALLGATHER, and REDUCESCATTER with different factors; change the BETA and
GAMMA value in cost model.
5 years ago
3f087dba1a
Tensor assign syntax:
...
1) A[B]=U
2) A[A>n]=U
A.shape == B.shape
U is a scalar or Tensor(size==1)
B is Tensor(dtype=bool)
n is a Number
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
43a2e99833
Add python sampler support for CPP dataset
5 years ago
79c4312e89
NotEqual op auto cast
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
f0c07c3fa6
Realize take op and add ut
5 years ago
cc08fdfd9a
!420 Fix mixed precision usage when const value passed as argument
...
Merge pull request !420 from amongo/FixMixedPrecisionForConstParam
5 years ago
0ed6d9178e
add Histogram summary operator
...
clean clang format errors and cpplint errors
add some test cases for histogram summary operator
5 years ago
80333e9f55
!435 Fix dataset serialize and deserialize for MindDataset
...
Merge pull request !435 from anthonyaje/fix_serdes_dataset
5 years ago
d34afbd61b
!400 Support math operation between float and int for scalar
...
Merge pull request !400 from amongo/FixMathOps
5 years ago
40f0a4a4f4
!333 Add skip op to Dataset
...
Merge pull request !333 from jiangzhiwen/dataset/skip
5 years ago
9e1b5efd1d
!434 Bug in cleaning dataset iterators
...
Merge pull request !434 from h.farahat/multi_itr_bug
5 years ago
ea297c0889
Fix dataset serdes for MindDataset
5 years ago
3c02c82771
Bug in weak reference.
...
Add new test cases
5 years ago
3f7054dccb
add skip dataset op
5 years ago
7fae76d10d
add support for calculation between float and int
...
format code
remove test case for fp64
add back scalar manipulation
remove save graph
5 years ago
9cb665e634
add suport for parameter of const value pass as mixed precision args
...
fix pylint
5 years ago
7214c04114
!402 Add parallel op for Square
...
Merge pull request !402 from yangzhenzhang/square
5 years ago
8cbbbd950e
Add cell name to error message
5 years ago
36ffb66782
add parallel op for square
5 years ago
2d31ae97e8
!383 add cell psnr
...
Merge pull request !383 from zhaozhenlong/cell/psnr
5 years ago
08985a1e56
!286 resolve pynative operator unsupport issue
...
Merge pull request !286 from wangqiuliang/resolve-pynative-operator-issue
5 years ago
cce61d462c
histogram python dev
5 years ago
aa8fbcc06e
add cell psnr
5 years ago
cf026096a6
!183 Mindspore.dataset CPP sampler for GeneratorDataset
...
Merge pull request !183 from JunhanHu/cpp_sampler
5 years ago
75fec82b52
resolve pynative operator issue
5 years ago
d3e4dd06b0
!386 modify test_cell_bprop.py ut test_with_param
...
Merge pull request !386 from changzherui/modify-ut
5 years ago
549bfb97ad
!343 Fix usage of variable arguments in test framework
...
Merge pull request !343 from amongo/FixGradUsingInterfaceExtend
5 years ago
31621467a4
!217 support operator ** // % for scalar and tensor, and "in" "not in" key word, and string concat
...
Merge pull request !217 from zhangbuxue/support_pow_operator
5 years ago
0d0517c22d
!379 Add Group normalization
...
Merge pull request !379 from JichenZhao/groupnorm
5 years ago
80978cf3cc
support operator ** // % for scalar and tensor, and in not in for dict, ang str concat
5 years ago
efedcfb530
add test case of Bprop and tester
...
add test case for grad concat
fix usage in test framework
fix testcase
format code
5 years ago
8bdcd8c267
modify test_cell_bprop.py ut
5 years ago
57cd9f8188
add parallel op for sigmoidloss
5 years ago
04c522d0c6
Add Group Normalization
5 years ago
0b7de6968f
Add Group Normalization
5 years ago
ebe6efff71
Add Group Normalization
5 years ago
6d522f0a4f
add parallel op for layernorm
5 years ago
ba55a8ed0b
!304 [Auto parallel] Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel
...
Merge pull request !304 from Xiaoda/modify-not-fully-use-devices-and-strategy-checking
5 years ago
62807da0c4
Develop operator Unfold，take the ge backend，dock with tbe's ExtractImagePatches operator
5 years ago
ffb2cb03a4
Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel
5 years ago
9739d3b048
Add CPP sampler support for GeneratorDataset
5 years ago
30de261c3c
!243 Support nested repeat
...
Merge pull request !243 from h.farahat/nested_repeat
5 years ago
fe4cde6b1e
!294 Add cell ssim
...
Merge pull request !294 from zhaozhenlong/cell/ssim
5 years ago
150024f089
!312 Implemention of new dataset ops: apply
...
Merge pull request !312 from xiefangqi/xfq_apply_branch
5 years ago
0fc23eee0f
Support nested repeat
5 years ago
6a2cf4b6e6
ssim impl code
5 years ago
1a1cbc6814
implemention of new api: apply
5 years ago
e1c8f248e0
Fix the output is not tuple, when eval
5 years ago
f1fa2a9941
!273 [MD] update subset random sampler in minddataset
...
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
5 years ago
rick_sanchez
mindspore-ci-bot
liyong
zhouyuanshen
wenkai
panyifeng
Xiaoda Zhang
Zirui Wu
zhaozhenlong
yangzhenzhang
candanzg
fary86
liuxiao
buxue
eric
lirongzhen1
lichenever
yao_yf
zhaojichen
chang zherui
hesham
wangnan39@huawei.com
Amir Lashkari
Junhan Hu
qianlong
leonwanghui
jiangzhiwen
Cathy Wong
xulei2020
Peilin Wang
yanghaitao
Ziyan
ms_yan
ougongchang
anthonyaje
jzw
huangdongrun
kingfo
xiefangqi
Wei Luning