391a060f21
remove two context param
5 years ago
48e54dcfda
!1056 [Auto parallel] Memory calculation in the inference phase
...
Merge pull request !1056 from Xiaoda/memory-estimation-in-inference-phase
5 years ago
79725af4cd
为L2Normalize/L2NormalizeGrad增加VM支持
5 years ago
10abb68498
add ops CTCLoss
5 years ago
fdad91355f
!1093 reset parallel context before running each parallel test case
...
Merge pull request !1093 from yihuaijie/master
5 years ago
da7d605e85
!683 WIP: specialize hyper map parameter
...
Merge pull request !683 from xychow/bypass-renorm-and-specialize-hypermap-parameter
5 years ago
6ab046e4dd
!1062 Adapt Softplus\SoftplusGrad for VM, and ApplyFtrlD for both GE and VM.
...
Merge pull request !1062 from liuxiao/softplus-softplusgrad
5 years ago
a05aa21cc2
calculating PEAK memory cost in the inference phase
5 years ago
06a9eeb3bf
!1050 [bug][auto_mixed_precision]fix sens shape error of `TrainOneStepWithLossScaleCell`
...
Merge pull request !1050 from vlne-v1/I1GEPN-check-bprop-error-loss-scale-wrap
5 years ago
462f30e077
reset auto parallel context before each test
5 years ago
98112d1a64
!997 support vm for log1p
...
Merge pull request !997 from jiangjinsheng/log1p
5 years ago
3e89f7baaa
fix sens shape error in loss_scale one_step_wrap
5 years ago
28a6daaed5
!1017 add profiling_mode and profiling_options to context
...
Merge pull request !1017 from jinyaohui/context_opt
5 years ago
c36e7f1564
support vm for log1p
5 years ago
8003a89a7b
!766 bugfix(SA): Add the support of nested loop.
...
Merge pull request !766 from gongchen/nest_loop
5 years ago
fd72534a1c
!1065 Seperate lr groups and weight_decay groups
...
Merge pull request !1065 from ghzl/improve-parameter-groups
5 years ago
4fe6ddebd1
!1075 Cleanup dataset UT: util.py internals
...
Merge pull request !1075 from cathwong/ckw_dataset_ut_cleanup3
5 years ago
5a9de3716d
add profiling mode and profiling options to context
5 years ago
047ac018da
specialize hypermap paramater
5 years ago
4a8fcf5d76
!1055 support vm for floor
...
Merge pull request !1055 from jiangjinsheng/vm_floor
5 years ago
05e8b8028b
!1060 Fix bug of assigning value to non-Parameter class member
...
Merge pull request !1060 from fary86/fix_assign_target_not_parameter
5 years ago
66667d727e
!1034 Gpu Support Dropout operator
...
Merge pull request !1034 from SanjayChan/dropout
5 years ago
49ef53f164
Cleanup dataset UT: util.py internals
5 years ago
2af6ee2482
!1054 Add slice shape for param info
...
Merge pull request !1054 from yangzhenzhang/add-slice-shape-for-param-info
5 years ago
c95215bca0
seperate lr groups and weight_decay groups
5 years ago
4335e9bc83
adapt Softplus\SoftplusGrad\ApplyFtrlD for VM
5 years ago
16b9004d53
Fix bug of assign value to non Parameter class member
5 years ago
5ff79d0204
!1048 Support index to switch_layer
...
Merge pull request !1048 from panyifeng/index_to_switch_case
5 years ago
661f9dfaf8
add dropout primtive
5 years ago
57085bb18d
!996 [Auto parallel] Supporting VirtualDataset having three inputs
...
Merge pull request !996 from Xiaoda/supporting-virtualdataset-has-three-inputs
5 years ago
2fa654e65c
support vm for floor
5 years ago
05fde3d23d
add slice shape for param info
5 years ago
065e25e1bb
Support index to switch_layer
5 years ago
716def7c0a
move InferStraByTensorInfo to tensor_info.h
5 years ago
dd2062bf8d
!1023 add_gatherv2_distributed_op
...
Merge pull request !1023 from lichen/add_gatherv2_distributed_op
5 years ago
8a45ab1125
!906 fix a bug that support dilation greater than 1 in conv2dTranspose ops
...
Merge pull request !906 from yangyongjie/master
5 years ago
22632f2f09
!977 reshape operator support auto strategy search
...
Merge pull request !977 from yao_yf/reshape_auto_parallel_strategy_search
5 years ago
19a24b86ac
add gatherv2 distributed op
5 years ago
68372231bb
!1031 Support transform valuetuple of nested graph to make tuple
...
Merge pull request !1031 from amongo/ValueTupleOfNestedGraph
5 years ago
f0bf438a55
reshape strategy search
5 years ago
425a207663
bug(SA): Add the support of nested loop.
5 years ago
0e89813759
add resolve
...
transform valuetuple to maketuple of graphs
add testcase
5 years ago
affdd22de3
!967 Add switch_case primitive
...
Merge pull request !967 from panyifeng/switch_case_primitive
5 years ago
5e041966f1
add a new vritualdataset cell for three inputs
5 years ago
0eb32593a6
!958 Add parallel mode configuration for cell
...
Merge pull request !958 from yangzhenzhang/add_parallel_mode_for_cell
5 years ago
b7596e1f33
Add switch_case primitive
5 years ago
2860fd9338
!984 Add unit test case for HWC2CHW.
...
Merge pull request !984 from Tinazhang/hwc2chw
5 years ago
c8b5586c7f
add unit test for HWC2CHWC
5 years ago
58226addd6
Cleanup dataset UT: use md5 npz in test_zip for images
5 years ago
47f5abceb4
!960 Adding example for grayscale
...
Merge pull request !960 from EricZ/grayscale_fix
5 years ago
078dd86cfe
!507 Implemented padded_batch
...
Merge pull request !507 from ZiruiWu/batch_with_padding
5 years ago
de7625777f
!951 fix: MindDataset with columns_name parameter cause errors in some scenes
...
Merge pull request !951 from guozhijian/fix_read_by_columns
5 years ago
0f0548f21b
Added test case for grayscale support
5 years ago
c2d364a573
batch with padding implemented
...
support for 1 specific dimension to be None, added validator
fix various CI complains
another round of CI fixes
ci
refactor parts of the code
code refactor
ci fix
comments added, fix bugs
address review comments
address review comments
review cmts
added simple perf test script
update pad code
perf imprv
5 years ago
16930c562d
!969 [MD] fix bug in pk sampler of minddataset
...
Merge pull request !969 from liyong126/fix_mindrecord_pk_sampler
5 years ago
8c9730b3c5
add parallel mode for cell
5 years ago
7c64048d76
!935 develop op ScatterMax and dock ge process
...
Merge pull request !935 from zhangbuxue/develop_scatter_max_op_and_dock_ge
5 years ago
becaf39262
!957 complete vm ops for BatchToSpace and SpaceToBatch
...
Merge pull request !957 from jiangjinsheng/space_to_batch
5 years ago
ac86996746
develop op ScatterMax and dock ge process
5 years ago
d4d236bcce
fix: use MindDataset by column_names get data error in some situation
5 years ago
6351f9c837
!859 [Auto parallel] Support searching strategy for inference phase
...
Merge pull request !859 from Xiaoda/support-inferring-phase-parallel-strategy-searching
5 years ago
e75d75854d
!959 Add Elu\EluGrad ops for VM.
...
Merge pull request !959 from liuxiao/ops-for-VM
5 years ago
deae380969
!637 Learning rate and weight decay making group params
...
Merge pull request !637 from ghzl/learning-rate-make-group-mode
5 years ago
a945299e42
update test for batch_to_space
5 years ago
b520ca9087
fix pk sampler in mindrecord
5 years ago
def8573275
implementing-searching-strategy-for-inference
5 years ago
79a3f0821a
add vm for batch_to_space and space_to_batch
5 years ago
eba74ca8f7
add ops for VM
5 years ago
824bc30a94
learning rate and weight decay support group mode
5 years ago
3d3b9d5474
!840 [BUG] fix conv2dtranspose bug
...
Merge pull request !840 from jinyaohui/conv2dtranspose
5 years ago
88e763a98f
modify conv2dtranspose
5 years ago
108ef72aaf
!904 fix avgpool and add dimension check for groupnorm
...
Merge pull request !904 from JichenZhao/groupn
5 years ago
cae8a921e3
!929 Cleanup dataset UT: test_batch, save_and_check support
...
Merge pull request !929 from cathwong/ckw_dataset_ut_cleanup
5 years ago
772e6c1461
Cleanup dataset UT: test_batch, save_and_check support
5 years ago
ffcbcc8dcb
syn code 505
5 years ago
446828f221
modify momentum test
5 years ago
039c75af8e
fix avgpool and add check
5 years ago
36fffb7706
Added example md5 generation
...
Comparison example
Added md5 and comparison example for py_transforms
Added md5 check for images
5 years ago
3f1c6b7b47
solve the problem when dialtion greater than 1 in Conv2dTranspose ops
5 years ago
83c68ca2ef
Skip pyfunc test case
5 years ago
79f087c2af
!909 Adding fix for set seed
...
Merge pull request !909 from EricZ/test_random
5 years ago
200b3f0789
!837 add onnx op converter: ReLU6 and DepthwiseConv2dNative
...
Merge pull request !837 from chenzupeng/master
5 years ago
26cb3e8a5f
Added test function to show that seed doesn't work.
...
Added testcase to show that c image aug don't use seed properly
Added passing test cases
Added working testcases for using seed
Added additional test cases to show seed use
Added test case for seed
5 years ago
b323199dc1
syn code 430
5 years ago
a5b530c427
!857 use parameter name as the key of strategy checkpoint
...
Merge pull request !857 from yao_yf/strategy_ckpt_key_to_use_param_name
5 years ago
4694c979a5
delete pack description about num and add raise error
...
SparseApplyAdagrad example format
PReLU and grad state 1-d not supported
atan2 bprop dx dy revert to original shapes
5 years ago
0611c1a579
!849 [CT][MS] Wrong format of broadcast output, when multi-output
...
Merge pull request !849 from vlne-v1/I1FQ76-wrong-format-of-boardcast-output-when-multi-output
5 years ago
67f3d0eb5d
!871 dataset: repair take op problem when there exist muti-thread in next node
...
Merge pull request !871 from ms_yan/take_operator
5 years ago
a109bc3d96
add onnx op converter: ReLU6, DepthwiseConv2dNative
5 years ago
157710ca0f
bugfix* fix bug in output tuple of tuple.* check kRWWrite input no-variable* input x of ScatterNdUpdate should be a parameter node
5 years ago
ff1a05d6c8
!882 fix bug of bprop of FloorMod
...
Merge pull request !882 from zhangbuxue/fix_bprop_for_floor_mod
5 years ago
0c6cf98db0
fix bug of brpop of FloorMod
5 years ago
5a6540450e
use param name as the key of strategy checkpoint
5 years ago
c56fe3aa2d
modify take op with an operator
5 years ago
8af10eb51e
!875 Reject python OP in operations argument for C++ uniform augmentation OP
...
Merge pull request !875 from AdelShafiei/ua_py
5 years ago
d15bd04bfe
added input validation to reject python op in C++ uniform augmentation operations list
5 years ago
a606c2e4da
!872 [Dataset] Add schema support for GeneratorDataset
...
Merge pull request !872 from JunhanHu/generator_schema
5 years ago
2303453753
!869 Random data op
...
Merge pull request !869 from JesseKLee/random_data_op
5 years ago
c5a8ffe4f4
Add schema support for GeneratorDataset
5 years ago
5236d0c3c0
Replace print with logger.info
5 years ago
8d3695f666
!672 Added UT for uniform augmentation C++ OP
...
Merge pull request !672 from AdelShafiei/ua_ut
5 years ago
732c7f8266
!794 fix issues image gradients 4d check
...
Merge pull request !794 from zhaozhenlong/fix-issues-image-gradients-complement-check
5 years ago
270bf831a9
Random Data Op
5 years ago
98939d839c
!856 Fix skip op bug
...
Merge pull request !856 from jiangzhiwen/dataset/skip_thread
5 years ago
66e7a36846
ImageGradients check 4d
...
fix DiagPart constant folding issue
fix argmin output type check
fix atan2 doc error
fix remove FusedBatchNorm and its grad
5 years ago
34bfa2f7c9
fix skip
5 years ago
8ab5e0118f
!829 Add parser of case which parameter in tuple in run_op function
...
Merge pull request !829 from ghzl/parser-parameter-in-tuple-in-run_op
5 years ago
b96df362f8
add parser of case which parameter in tuple in run_op function
5 years ago
883fde0494
!839 add parameter verification for RMSprop
...
Merge pull request !839 from wangnan39/add_parameter_verification_for_rmsprop
5 years ago
728345fdd0
!841 fix bugs of Acosh bprop and Elu bprop
...
Merge pull request !841 from zhangbuxue/adapt_ExtractImagePatches_and_fix_EluGrad
5 years ago
064d370a61
fix bug of Acosh bprop and Elu bprop
5 years ago
33e427e1c5
!721 Tensor assign by ellipsis
...
Merge pull request !721 from candanzg/tensor_assgin_ellipsis
5 years ago
7f602016f4
add parameter verification for rmsprop, and modify default value in annotation
5 years ago
6241814320
!749 fix np.histogram sometimes calc very large bucket number
...
Merge pull request !749 from wenkai/wkmaster
5 years ago
e886a3182c
tensor assign with ellpsis
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
3322e65da9
added ut for uniform augment C++ op
5 years ago
243cd33203
adapt SparseApplyAdagradD adding output accum
5 years ago
9ffb3993e8
!732 dock AcoshGrad for GE and AvgPool AvgPoolGrad for VM
...
Merge pull request !732 from zhangbuxue/dock_AcoshGrad_AvgPool_AvgPoolGrad_for_vm
5 years ago
21d936e656
!728 auto parallel strategy checkpoint full
...
Merge pull request !728 from yao_yf/strategy_checkpoint_extend
5 years ago
4fff5f442c
!791 onnx adapter for MaxPoolWithArgmax
...
Merge pull request !791 from 梅晓蔚/master
5 years ago
0f89cc1da4
dock AcoshGrad for GE and AvgPool AvgPoolGrad for Vm
5 years ago
cd899fba0a
ONNX adapter for the MaxPoolWithArgmax
5 years ago
6cde5f6d91
auto parallel strategy checkpoint
5 years ago
9399dffe0e
!751 Remove enable hccl
...
Merge pull request !751 from zjun/remove_enable_hccl
5 years ago
5b3327d103
!746 reducescatter backforward operator
...
Merge pull request !746 from lirongzhen1/bp_reducescatter
5 years ago
c1813671db
!694 Refactor vm module for multigraph sink.
...
Merge pull request !694 from rick_sanchez/master
5 years ago
8bf35b2b0c
!700 validate bprop rules
...
Merge pull request !700 from penn/validate_bprop_rules
5 years ago
c538b83712
remove enbale hccl
5 years ago
0b4648881b
add reducescatter bprop
5 years ago
6ae8345cad
refactor vm module for multigraph sink
5 years ago
b37db1edf5
!603 [MD] update pk sampler in minddataset
...
Merge pull request !603 from liyong126/update_pk_sampler
5 years ago
f82e63fecc
!671 Added testcase for sync_wait
...
Merge pull request !671 from EricZ/master
5 years ago
0e3054d527
!466 Deepcopy problem when pyfunc cannot be pickled
...
Merge pull request !466 from h.farahat/deepcopy
5 years ago
bfba630aa2
update pK_sampler
5 years ago
c47ef8ee4e
!711 Address first epoch always shuffle with same seed init of random sampler
...
Merge pull request !711 from ZiruiWu/mindspore_master_only
5 years ago
afbd24cb78
!718 Fix dtype judge sentence in infer_dtype function of hcom operations
...
Merge pull request !718 from zhouyuanshen/master
5 years ago
c046874b03
fix bug in infer_dtype function of hcom operations
5 years ago
ab04b3dc4b
fix np.histograms(bins='auto') sometimes calc very small width and very large bucket number, which lead to error/long compute time.
5 years ago
9e633b6c12
validate bprop rules
5 years ago
ef71ae941f
!698 [Auto parallel] Support multi-subgraphs in auto-parallel
...
Merge pull request !698 from Xiaoda/support-wide-deep-in-auto-parallel
5 years ago
e213f2a435
!687 Fix bug: Summary tage type checking and exception throwing
...
Merge pull request !687 from candanzg/summary_tag_check
5 years ago
e227415673
support-the-multiple-subgraphs-in-the-ANF
5 years ago
8c3931cf1d
fix first epoch always shuffle with default seed in random sampler
...
fix ut
5 years ago
efdcd4c258
!682 fix api comments of some ops
...
Merge pull request !682 from liuxiao/fix-bug
5 years ago
da5b10b699
!681 add psnr inputs shape and dtype check
...
Merge pull request !681 from zhaozhenlong/psnr-check-same-shape
5 years ago
c88edfb31d
psnr check two input same shape and type
5 years ago
4750861054
fix layernorm bug
5 years ago
348b0ef53c
!344 add prim name to error message for operators in array_ops.py
...
Merge pull request !344 from fary86/add_prim_name_to_error_message_for_array_ops
5 years ago
b84deeeb5c
fix summary tage check error
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
2078229436
Add prim name to error message for array_ops
5 years ago
36a62576e8
support forward graph
5 years ago
5e877a7715
modify api and add example
5 years ago
ad2a5dcad2
!676 [Auto parallel] Add the resnet50 testcase
...
Merge pull request !676 from Xiaoda/add-the-resnet50-testcase
5 years ago
aff6777ecc
fix reviewboot and example of TruncatedNormal and add type mapping
5 years ago
3ff9e54734
add the resnet50 32k-8p testcase
5 years ago
2d115cd04e
Added example for multiple iterator
...
Added new testcase for multi iterator
Addressing review
Fixed typo
5 years ago
56f785f7e6
add context configration
5 years ago
6844ea633d
!56 Synchronization code423 to ms-incubator
...
Merge pull request !56 from changzherui/syn-code423
5 years ago
a02eb240e9
!595 Tensor assign with int or tuple(int) index
...
Merge pull request !595 from candanzg/tensor_assign_with_integer
5 years ago
ce71c17933
!645 auto parallel prelu operator support broadcast
...
Merge pull request !645 from yao_yf/auto_parallel_prelu_support_broadcast
5 years ago
84d5e4f923
!643 [AutoParallel]Support reshape parameter
...
Merge pull request !643 from lichen/support_reshape_parameter
5 years ago
31aae36106
Tensor assign with integer
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
43a8f829a2
!628 fix the infer of TruncatedNormal and a bug of structure output
...
Merge pull request !628 from zhangbuxue/fix_example_for_TruncatedNormal
5 years ago
00859ae119
!586 enable/disable allreduce_fusion
...
Merge pull request !586 from lirongzhen1/allreduce_fusion
5 years ago
2ab211ae04
support reshape parameter
5 years ago
c8a1a24ce3
fix the infer of TruncatedNormal and a bug of structure output and a bug of tensorslice ellipsis
5 years ago
425276d43d
auto parallel prelu support prelu
5 years ago
dfde76af88
delete the 'simplify_cal' attribute in 'set_algo_parameters' and 'get_algo_parameters' interface
5 years ago
4ff418084c
enable/disable allreduce_fusion
5 years ago
d1add07b5a
change error type
5 years ago
1af894e25f
change error type
5 years ago
57bc30505c
change error type
5 years ago
ad75618ca6
!611 change error message type
...
Merge pull request !611 from JichenZhao/errormsg
5 years ago
bd13f9ba33
modify ResizeNearestNeighborV2D
5 years ago
8963e39516
change error type
5 years ago
5ac07bb695
!504 Support Tensor assign A[slice] = u
...
Merge pull request !504 from candanzg/tensor_assign_with_slice
5 years ago
663d597330
tensor assign with slice index
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
0bf6717e9a
!454 Fix the check of bool type in auto cast
...
Merge pull request !454 from candanzg/bug_cast_op
5 years ago
5cf09405e2
!532 [AutoParallel]support multiple subgraphs
...
Merge pull request !532 from lichen/support_multiple_subgraphs_in_auto_parallel
5 years ago
a9e9266149
Deepcopy problem when pyfunc cannot be pickled
5 years ago
b6e77e5178
Add ReluV2/ReluGradV2/ConfusionMulGrad for VM
5 years ago
1a0d2666b7
!559 Add Fill/Erf op for VM.
...
Merge pull request !559 from liuxiao/fill-op
5 years ago
818acd46d4
!569 fix bug in checkpoint when save scaler
...
Merge pull request !569 from wangnan39/master
5 years ago
c78630d737
support multiple subgraphs
5 years ago
f38d18c665
fix bug in checkpoint when save scaler
5 years ago
24a9f4974c
!536 support ellipsis and bool for tensor slice
...
Merge pull request !536 from zhangbuxue/support_elipis_for_tensor_slice
5 years ago
5b6c8fade8
Add Erf\FillD operator for VM
5 years ago
437bb8c27c
support ellipsis and bool for tensor slice
5 years ago
67057d1309
!541 add average pooling 1D
...
Merge pull request !541 from JichenZhao/avgpooling
5 years ago
4516b8feff
!437 Add L2Loss op for VM.
...
Merge pull request !437 from liuxiao/add-l2-loss
5 years ago
3b083d07bb
!550 support one node communication group
...
Merge pull request !550 from yao_yf/support_one_node_communication_group
5 years ago
c874e2d484
Add L2Loss op for VM
5 years ago
aad5771a62
!524 Added support for UA augmentation ops with tests
...
Merge pull request !524 from alashkari/ua-ops
5 years ago
56e7a7deb5
Added UniformAugment + Python Augmentation Ops
5 years ago
dc0491caf9
!508 [Dataset] Adding sync_wait operator for dataset
...
Merge pull request !508 from EricZ/master
5 years ago
cd94518769
X# This is a combination of 2 commits.
...
Initial commit for dataset op python
Added signature to barrier
Adde compiling barrier code
Rebasing, fixed new compile errors
Final fix for make_unique
Added pybind API for barrier
Fixed pyfunc invocation
python interface - sync_wait
!1 sync_wait python interface
* python interface - sync_wait
fix test
update test
update test
Added new test case
add test case
test for shuffle + batch
Added two-sync test case
Restrited that no shuffle after sync
Added sync to pipeline info
block first databuffer as well
Intelligently get batch size
Fix default case
Lock Pair shares among all iterators
Added fix for empty character
Fixed up test case formatting
Fix end of epoch in sync_wait
Fixing CI
5 years ago
78001ac9e6
Add multiprocessing support for Mindspore.Dataset.GeneratorDataset
5 years ago
fb18671b28
!506 [Dataset] Multiprocessing support for Pyfunc
...
Merge pull request !506 from JunhanHu/multiprocess_pyfunc
5 years ago
b13e7bc31a
Add python multiprocessing support for Mindspore.dataset
5 years ago
371b3338b6
support one node communication group
5 years ago
jinyaohui
mindspore-ci-bot
zhouneng
liuxiao
Xiaoda Zhang
Yi Huaijie
Wei Luning
jiangjinsheng
zhousiyi
Cathy Wong
guohongzilong
fary86
chenzomi
yangzhenzhang
panyifeng
yao_yf
lichenever
gongchen
huangdongrun
Tinazhang
eric
Zirui Wu
buxue
jonyguo
liyong
changzherui
zhaojichen
yangyongjie
Junhan Hu
zhaozhenlong
chenzupeng
ms_yan
Adel Shafiei
Jesse Lee
jiangzhiwen
wangnan39@huawei.com
candanzg
meixiaowei
zjun
lirongzhen1
rick_sanchez
zhouyuanshen
wenkai
chang zherui
hesham
Amir Lashkari