3f23aa1d79
!1348 fix pylint warnings of parallel test cases
...
Merge pull request !1348 from yihuaijie/master
5 years ago
6c21e556c4
Clean up work for text python package
5 years ago
368007240c
!1320 add applyrmsprop cumprod and reduceprod for vm
...
Merge pull request !1320 from JichenZhao/applyrms_squaresumall_cumprod_reduceprod
5 years ago
4bdfddedb2
!1358 Link child graphs
...
Merge pull request !1358 from zhoufeng/link-child-graph-2
5 years ago
62c716b68e
!1349 Fix some functions in group parameters and optimizer
...
Merge pull request !1349 from ghzl/add-group-check-for-lars
5 years ago
850171a34b
Restrict tensor getitem or setitem not support mixed tensor.
5 years ago
af5019b94f
link child graphs
...
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
5 years ago
14fe72f383
fix pylint warnings
5 years ago
bd845dd0b7
!1352 [MD] fix bug when append data in mindrecord using absolute path
...
Merge pull request !1352 from liyong126/mindrecord_fix_bug_I1HQUI
5 years ago
599a449e0b
Support processing GNN data
5 years ago
fbdba6e4da
clean pylint
5 years ago
df361d1d26
Change mem layout of string tensor
...
add support for MindRecord and TFRecord
----
optimize tensorshape
optimize tensorshape and FlatIndex
TFRecord and MindRecord support for string tensor
Modify mem layout
Add new constructor
Add method Allocate
Change some GetMutableBuffer usages to AllocateBuffer
5 years ago
447420eb9a
fix bug when append data by absolute path
5 years ago
2d2f9ba8fd
fix group parameter code for check
5 years ago
a42ec8f69f
add applyrmsprop op for vm
5 years ago
9f4b8a3cd1
changing the succive edges order in GetAliveSuccEdges() so that Triangle and Star Elimination can be merged into particular node; adding some check information
5 years ago
d9c74e0acd
!1328 Add 3 patterns support for LambNextMVWithDecay fusion pass
...
Merge pull request !1328 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
5 years ago
58e6d7d950
!1341 Added lookup and vocab to mindspore.dataset.text
...
Merge pull request !1341 from ZiruiWu/vocab_and_lookup
5 years ago
decf12cd0b
!1317 [MD]add compress for nlp data in mindrecord
...
Merge pull request !1317 from liyong126/mindrecord_compress
5 years ago
274f6f014f
!1133 support tensor get value by tensor index
...
Merge pull request !1133 from zhangbuxue/support_tensor_get_value_by_tensor_index
5 years ago
0a795c24aa
!1245 add model init api to compile df graph before train
...
Merge pull request !1245 from wangnan39/add_model_init_api_to_compile_df_graph_before_train_and_eval
5 years ago
bb51bb88d7
add compress in mindrecord
5 years ago
2e3d55ed87
!1281 Implementation of SplitOp
...
Merge pull request !1281 from Peilin/splitOp
5 years ago
39b9aedf68
!1342 Bug fix on issue Core dump on GPU when train with lenet with AU
...
Merge pull request !1342 from Tinazhang/cc
5 years ago
0ca626ef6c
!1229 Init the slices of a Initializer on different devices
...
Merge pull request !1229 from yihuaijie/master
5 years ago
71e8bb1960
general split case done, chaining sampler (basic case) is working
...
implementation 99% complete
everything and tested except for repeatable shuffling
tested most basic/typical split usecases
cleanup
some more cleanup
fix CI
more ci fix
more ci fixes
more ci fix
more ci fix
more ci fix
added more tests, fixed some bugs
some more clean up and test cases
added shard/shuffle before split warning/error
addressed code review comments and ci
fixed ci
5 years ago
e9e40b688b
Bug fix
5 years ago
25ab2ef303
Implemented lookup and vocab
5 years ago
46949fc327
!1307 Cleanup dataset UT: unskip and enhance TFRecord sharding tests
...
Merge pull request !1307 from cathwong/ckw_dataset_ut_unskip2
5 years ago
1ebf98b795
add model init api to compile df graph before exec
5 years ago
e490618db8
support tensor get value by tensor index
...
support tensor set value by tensor index
5 years ago
07b14f32b9
!1296 move signature to primitivepy and bprop_func to utils
...
Merge pull request !1296 from leopz/fix_primitive
5 years ago
7a5004cc49
init the slices of a Initialzer on different devices
5 years ago
218ade30b2
add vm support sin and cumsum
5 years ago
eaff850f11
add 3 patterns for lamb_next_mv_with_decay_rule pass
5 years ago
2224fa093b
!1302 Complete vm ops for BinaryCrossEntropy and BinaryCrossEntropyGrad
...
Merge pull request !1302 from lihongkang/master
5 years ago
b96a2ed816
!1312 support vm for erfc
...
Merge pull request !1312 from jiangjinsheng/vm_erfc
5 years ago
bddd743ca9
!1304 Add check for controldepend
...
Merge pull request !1304 from amongo/AddCheckForControlDepend
5 years ago
e4795974be
!1266 Refactor LambNextMVWithDecayRule fusion pass
...
Merge pull request !1266 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
5 years ago
5a68eba585
Refactor LambNextMVWithDecayRule fusion pass
5 years ago
2d3cd8276e
vm for erfc
5 years ago
451c20a6f5
Add UnicodeCharTokenizer for nlp
5 years ago
93e7c97a96
!1272 [Dataset] MindData Tree Optimizer Infrastructure
...
Merge pull request !1272 from JunhanHu/minddata_opt
5 years ago
b78894e02b
Cleanup dataset UT: unskip and enhance TFRecord sharding tests
5 years ago
f44d213503
MindData optimizer infrastructure.
5 years ago
3e2074b113
add check for ControlDepend
5 years ago
233508b70e
!1250 Dict_setitem transofrm to tuple_setitem
...
Merge pull request !1250 from amongo/SupportDictSetItemTransform
5 years ago
cf543382aa
add vms for binarycrossentropy and binarycrossentropygrad
5 years ago
04763b8b76
move signature to primitivepy and bprop_func to utils
5 years ago
183144e135
!1282 support vm for PReLU and PReLUGrad
...
Merge pull request !1282 from jiangjinsheng/vm_prelu
5 years ago
163b6b7ea7
add jieba c++ code
5 years ago
89470cf29d
!1263 Modified clip_gradients to clip_grad
...
Merge pull request !1263 from Kang/master
5 years ago
1ba8e052f8
!1125 support vm for space_to_depth
...
Merge pull request !1125 from jiangjinsheng/space_to_depth
5 years ago
bfff7c0a2f
Modified clip_gradients to clip_grad
5 years ago
97ba539e7b
!1269 fix issue of loadding control input tensors failed in control sink mode
...
Merge pull request !1269 from wenchunjiang/fix_task_sink_bug
5 years ago
ce09f5e15a
vm for prelu and prelugrad
5 years ago
729ea8cc55
fix bug of loadding ctrl input tensors failed in control sink mode
5 years ago
04ac611fe8
!1189 Decoupling py default param from Parameter
...
Merge pull request !1189 from leopz/master
5 years ago
3cf94daefc
add support for dict setitem operation
...
format code
remove save_graph
raise exception when dictionary setitem if the key not exists
resolve error
remove unnessary op_
5 years ago
ba99cb7bcb
support vm for space_to_depth
5 years ago
17cecf2cf5
Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling
5 years ago
fe8b59f26b
!1111 support vm for pack and unpack
...
Merge pull request !1111 from jiangjinsheng/vm_pack
5 years ago
40e15996b0
move default_param out of parameter and remove pybind11 in anf define
5 years ago
3db8cfa54f
add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try
5 years ago
f9bd460c96
support vm for pack
5 years ago
c793540cc9
!1231 Assign label resource for new control sink
...
Merge pull request !1231 from zhoufeng/label-assign
5 years ago
18c9495000
!1228 Adapt tbe op UnsortedSegmentMin for GE.
...
Merge pull request !1228 from liuxiao/UnsortedSegmentMin
5 years ago
9f9af3c59a
!1224 add squaresumall op
...
Merge pull request !1224 from JichenZhao/squaresumall
5 years ago
c99f904276
assign label resource for new control sink
...
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
5 years ago
828d0b124e
!1209 add format trans function
...
Merge pull request !1209 from liubuyu/master
5 years ago
cc024bb3a1
UnsortedSegmentMin for GE
5 years ago
d1d1766bed
add squaresumall op
5 years ago
1b7cdc4c61
!1218 clean pylint warning in test about import
...
Merge pull request !1218 from jinyaohui/pylint1
5 years ago
f70429d671
add format transfer
5 years ago
3b6de89368
!1187 Checkpoint and restore parameter's shape
...
Merge pull request !1187 from yangzhenzhang/ckpt-and-restore-parameter-shape
5 years ago
c8d33568f2
Add an new output to FusedMulApplyMomentum
5 years ago
5a914994ba
clean pylint
5 years ago
6b54a6417d
ckpt and restore parameter shape
5 years ago
c4af71e236
add LarsV2 fission pass
5 years ago
bcfaff97f9
clean pylint
5 years ago
051567ba20
!1192 Support string type Stage !
...
Merge pull request !1192 from h.farahat/string_Tensor
5 years ago
4efa9717bb
!1129 Add op bounding box encoder
...
Merge pull request !1129 from zhaozhenlong/op/bounding-box-encoder
5 years ago
6de7eb2633
!1203 delete ApplyAdamD for master
...
Merge pull request !1203 from changzherui/code516
5 years ago
1e93927772
code 516 for test
5 years ago
c3d9f18087
!1176 fix validator for transpose
...
Merge pull request !1176 from jiangjinsheng/issue_transpose
5 years ago
c169ac6a18
!1195 add validate for geswitch and merge
...
Merge pull request !1195 from jiangjinsheng/issue_geswitch
5 years ago
e45532b78c
fixed transpose
5 years ago
c05203ef06
add validate for geswitch and merge
5 years ago
0040764dec
!1100 delete some context param(enable_loop_sink,enable_mem_reuse,enable_auto_mixed_precision)
...
Merge pull request !1100 from jinyaohui/context_opt_2
5 years ago
2907cf4488
remove some context param
5 years ago
b54ffdc086
add op BoundingBoxDecode
...
iou
NMSWithMask
larsupdate testcase
sgd testcase
5 years ago
92d196f054
!1178 Complete vm ops for ROIAlign and ROIAlignGrad
...
Merge pull request !1178 from zhouneng/add_vm_support_roialign
5 years ago
e8ca243364
-Add DE_STRING
...
-replace switch'case by indexing
- Add test case
- Add constructors
- Add getItem string
- Fix bugs
- Add more tests
- Tensor iterator
- asNumpy
- TextFileDataset
- Tensor(Numpy)
- Super > 2D
- Add more test cases for GeneratorDataset
- Change StartAddr to GetBuffer and GetMutableNuffer
- Raise an error if batch is used with strings
Clean-up work
5 years ago
7240c6feff
!1061 Add flat_map op to Dataset
...
Merge pull request !1061 from jiangzhiwen/dataset/flat_map
5 years ago
cb2814b498
flat_map first commit
5 years ago
ca64bfdbab
!1120 Code refactoring ：modify Infer to Eval
...
Merge pull request !1120 from Kang/master
5 years ago
889d7b6eea
!1180 [pre_activate]Fix pylint warning
...
Merge pull request !1180 from YuJianfeng/master
5 years ago
efb9672849
!1118 Add BatchNormGrad2BNInferGrad pass
...
Merge pull request !1118 from huanghui/batchnormgrad-to-bninfergrad-pass
5 years ago
c680cfbf27
!1157 dataset: add concat operation for dataset
...
Merge pull request !1157 from ms_yan/concat_dataset
5 years ago
ab031ee9ea
!1126 VOCDataset support object detection function
...
Merge pull request !1126 from xiefangqi/voc_support_detection
5 years ago
0f42fdbb80
Fix pylint warning
5 years ago
c2a1b5f8c1
add register info for ROIAlign and ROIAlignGrad
5 years ago
709828a98b
add BatchNormGrad2BNInferGrad pass
5 years ago
42ba885e58
!1098 Add BatchNorm2BNInfer pass
...
Merge pull request !1098 from huanghui/add-batchnorm-bninfer-pass
5 years ago
c937bad53f
minddata support voc
5 years ago
c0fa7b4b19
init commit of concat dataset
...
change to use __add__ operation instead ds.concat
5 years ago
6f68dd7d12
!1130 support vm for flatten
...
Merge pull request !1130 from jiangjinsheng/flatten
5 years ago
c786596641
!1156 Add batch_norm grad infer fission pass
...
Merge pull request !1156 from YuJianfeng/master
5 years ago
766906dd6d
support vm for flatten
5 years ago
be60bd3d79
Code refactoring for the static_analysis : modified Infer to Eval.
5 years ago
6db71e6576
add batchnorm2bninfer pass
5 years ago
8a853cec2d
!1171 adjust onnx related testcases
...
Merge pull request !1171 from fary86/adjust_onnx_related_uts
5 years ago
2b061c84c7
Add batch_norm_grad infer fisson
5 years ago
597933b04b
!1113 rename kernel/mng to kernel/rts
...
Merge pull request !1113 from dengwentao/rts
5 years ago
d2efa20cab
!1163 Add BatchNorm fusion pattern with mix precision
...
Merge pull request !1163 from YuJianfeng/bn_fusion_with_cast
5 years ago
bb374ebc28
!1015 Support weights to be compiled according to shape
...
Merge pull request !1015 from candanzg/me_with_shape
5 years ago
fe2ee14340
Adjust onnx exporting related testcases
5 years ago
a9816fa779
!1026 Add Logsigmoid and Reduce_logsumexp
...
Merge pull request !1026 from peixu_ren/custom_pp_ops
5 years ago
6e89ebe6f0
Add BatchNorm fusion pattern with mix precision
5 years ago
be2e7531ca
fix: MindDataset parameter shard_id & num_shards check
5 years ago
4bb46606db
!1149 fix pylint in tests
...
Merge pull request !1149 from panyifeng/fix_pylint
5 years ago
5075f0a27e
!1146 add matmul eltwise buffer fusion
...
Merge pull request !1146 from Etone.Chan/master
5 years ago
755ba75deb
fix pylint
5 years ago
4bb5c7b39a
!1084 add new interface quant combined
...
Merge pull request !1084 from SanjayChan/04quant
5 years ago
99fda6f431
Add logsigmoid and reduce_logsumexp
5 years ago
c4a5bfb787
add matmul eltwise buffer fusion pass
5 years ago
a2a3b1c6c5
!1089 Add Optimizer method get_lr_parameter
...
Merge pull request !1089 from ghzl/add-get-lr-base-on-parameter
5 years ago
9e116e15fb
!1139 Change Thread::Join to async call with time out
...
Merge pull request !1139 from JesseKLee/timing_hole
5 years ago
1a052f7155
!1131 [Data]fix cmake build format
...
Merge pull request !1131 from xulei/filter_op
5 years ago
f2be49d85e
Fix a racing condition
5 years ago
913074e656
Cleanup dataset UT: resolve skipped test units
5 years ago
6b68671805
!1069 Use a resident process to write summary files and SummaryRecord as context manager
...
Merge pull request !1069 from 李鸿章/context_manager
5 years ago
32c1d558f4
SummaryRecord as context manager
5 years ago
7e3ec651dc
!1094 Complete vm ops for L2Normalize and L2NormalizeGrad
...
Merge pull request !1094 from zhouneng/add_vm_support_l2normalize
5 years ago
2cc85bdc93
Support weight compile according to shape
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
21bcdcd8ad
!1121 Complete vm ops for ResizeBilinear and ResizeBilinearGrad
...
Merge pull request !1121 from lihongkang/master
5 years ago
1239cd6135
Merge branch 'master' into 04quant
5 years ago
e70b2f5430
add optimizer.get_lr_parameter() method
5 years ago
bf6246e617
add quant combined
5 years ago
903b64daa2
fix cmake build format
5 years ago
8b98f921cc
!1124 Add broadcast fusion pass
...
Merge pull request !1124 from YuJianfeng/master
5 years ago
fa83fc3e02
rename kernel/mng to kernel/rts
5 years ago
1a98c6b459
!999 [MD] mindrecord support reading file list
...
Merge pull request !999 from liyong126/mindrecord_file_list
5 years ago
31d8db9fc6
Add broadcast fusion pass
5 years ago
86d4797399
!1079 Convert AiCpu kernel when aicore not supported
...
Merge pull request !1079 from lianliguang/convert-to-AICPU-when-AiCore-not-supported-kernel
5 years ago
25b2424f9b
!1042 clean pylint warning in test_framwork dir
...
Merge pull request !1042 from jinyaohui/clean_pylint
5 years ago
ca8a914736
接入算子resizebilinear and resizebilineargrad
5 years ago
6f386c5782
!1082 Support 'break', 'continue' and 'pass' statements
...
Merge pull request !1082 from hewei/support_cont_break
5 years ago
aa3f89e74f
mindrecord support read file list
5 years ago
33fa90efc9
Support 'break', 'continue' and 'pass'
...
To handle 'break' and 'continue' statement, a loop context is pushed
to a stack before we parse the loop body, and pop it after body parsed.
When a 'break', 'continue' statement is encountered, we retrieve current
loop contex from the stack, and let the current block jump to the end
block or header block;
For 'break' statement, we added an extra 'end_block' follow the 'after_block',
because 'after_block' is called from a ContionalJump in 'header_block', it can
not be set as jump target from other place. to support 'break', we let loop
body jump to the 'end_block' at the 'break' point. and 'after_block'
maybe a good place to handle loop 'else' clause in the future.
Handle 'pass' is simple, just bypass it when doing parse.
5 years ago
691b0648e3
convert unsupported kernel in aicore to aicpu
5 years ago
0345995000
!1110 [AutoParallel]fix gatherv2 and dataset bug
...
Merge pull request !1110 from lichen/fix_gatherv2_and_dataset_bug
5 years ago
26fd75895d
pylint waring clean
5 years ago
168dfb2555
!1108 Add input shape condition for transpose_reshape fusion pass
...
Merge pull request !1108 from YuJianfeng/master
5 years ago
18019ad6a5
!1038 clean some context param
...
Merge pull request !1038 from jinyaohui/clean_context
5 years ago
debfd38b75
fix gatherv2 and dataset bug
5 years ago
ba3d48817e
!1070 Adapt aicpu op CTCLoss and TBE op L2Loss for GE.
...
Merge pull request !1070 from liuxiao/ops-for-VM
5 years ago
85ff90c237
Add input shape condition for transpose_reshape fusion pass
5 years ago
391a060f21
remove two context param
5 years ago
48e54dcfda
!1056 [Auto parallel] Memory calculation in the inference phase
...
Merge pull request !1056 from Xiaoda/memory-estimation-in-inference-phase
5 years ago
79725af4cd
为L2Normalize/L2NormalizeGrad增加VM支持
5 years ago
10abb68498
add ops CTCLoss
5 years ago
fdad91355f
!1093 reset parallel context before running each parallel test case
...
Merge pull request !1093 from yihuaijie/master
5 years ago
da7d605e85
!683 WIP: specialize hyper map parameter
...
Merge pull request !683 from xychow/bypass-renorm-and-specialize-hypermap-parameter
5 years ago
6ab046e4dd
!1062 Adapt Softplus\SoftplusGrad for VM, and ApplyFtrlD for both GE and VM.
...
Merge pull request !1062 from liuxiao/softplus-softplusgrad
5 years ago
a05aa21cc2
calculating PEAK memory cost in the inference phase
5 years ago
06a9eeb3bf
!1050 [bug][auto_mixed_precision]fix sens shape error of `TrainOneStepWithLossScaleCell`
...
Merge pull request !1050 from vlne-v1/I1GEPN-check-bprop-error-loss-scale-wrap
5 years ago
462f30e077
reset auto parallel context before each test
5 years ago
98112d1a64
!997 support vm for log1p
...
Merge pull request !997 from jiangjinsheng/log1p
5 years ago
3e89f7baaa
fix sens shape error in loss_scale one_step_wrap
5 years ago
28a6daaed5
!1017 add profiling_mode and profiling_options to context
...
Merge pull request !1017 from jinyaohui/context_opt
5 years ago
c36e7f1564
support vm for log1p
5 years ago
8003a89a7b
!766 bugfix(SA): Add the support of nested loop.
...
Merge pull request !766 from gongchen/nest_loop
5 years ago
fd72534a1c
!1065 Seperate lr groups and weight_decay groups
...
Merge pull request !1065 from ghzl/improve-parameter-groups
5 years ago
4fe6ddebd1
!1075 Cleanup dataset UT: util.py internals
...
Merge pull request !1075 from cathwong/ckw_dataset_ut_cleanup3
5 years ago
5a9de3716d
add profiling mode and profiling options to context
5 years ago
047ac018da
specialize hypermap paramater
5 years ago
4a8fcf5d76
!1055 support vm for floor
...
Merge pull request !1055 from jiangjinsheng/vm_floor
5 years ago
05e8b8028b
!1060 Fix bug of assigning value to non-Parameter class member
...
Merge pull request !1060 from fary86/fix_assign_target_not_parameter
5 years ago
66667d727e
!1034 Gpu Support Dropout operator
...
Merge pull request !1034 from SanjayChan/dropout
5 years ago
3c643e7298
Move from dataset_dev branch to here
5 years ago
49ef53f164
Cleanup dataset UT: util.py internals
5 years ago
2af6ee2482
!1054 Add slice shape for param info
...
Merge pull request !1054 from yangzhenzhang/add-slice-shape-for-param-info
5 years ago
c95215bca0
seperate lr groups and weight_decay groups
5 years ago
c72589aad6
!953 add submodule id for log interface
...
Merge pull request !953 from fary86/add_submodule_id_for_log_interface
5 years ago
4335e9bc83
adapt Softplus\SoftplusGrad\ApplyFtrlD for VM
5 years ago
16b9004d53
Fix bug of assign value to non Parameter class member
5 years ago
5ff79d0204
!1048 Support index to switch_layer
...
Merge pull request !1048 from panyifeng/index_to_switch_case
5 years ago
661f9dfaf8
add dropout primtive
5 years ago
3f323e48e2
Add submodule id for log interface
5 years ago
57085bb18d
!996 [Auto parallel] Supporting VirtualDataset having three inputs
...
Merge pull request !996 from Xiaoda/supporting-virtualdataset-has-three-inputs
5 years ago
2fa654e65c
support vm for floor
5 years ago
05fde3d23d
add slice shape for param info
5 years ago
065e25e1bb
Support index to switch_layer
5 years ago
716def7c0a
move InferStraByTensorInfo to tensor_info.h
5 years ago
dd2062bf8d
!1023 add_gatherv2_distributed_op
...
Merge pull request !1023 from lichen/add_gatherv2_distributed_op
5 years ago
8a45ab1125
!906 fix a bug that support dilation greater than 1 in conv2dTranspose ops
...
Merge pull request !906 from yangyongjie/master
5 years ago
22632f2f09
!977 reshape operator support auto strategy search
...
Merge pull request !977 from yao_yf/reshape_auto_parallel_strategy_search
5 years ago
19a24b86ac
add gatherv2 distributed op
5 years ago
68372231bb
!1031 Support transform valuetuple of nested graph to make tuple
...
Merge pull request !1031 from amongo/ValueTupleOfNestedGraph
5 years ago
f0bf438a55
reshape strategy search
5 years ago
425a207663
bug(SA): Add the support of nested loop.
5 years ago
0e89813759
add resolve
...
transform valuetuple to maketuple of graphs
add testcase
5 years ago
affdd22de3
!967 Add switch_case primitive
...
Merge pull request !967 from panyifeng/switch_case_primitive
5 years ago
5e041966f1
add a new vritualdataset cell for three inputs
5 years ago
0eb32593a6
!958 Add parallel mode configuration for cell
...
Merge pull request !958 from yangzhenzhang/add_parallel_mode_for_cell
5 years ago
b7596e1f33
Add switch_case primitive
5 years ago
2860fd9338
!984 Add unit test case for HWC2CHW.
...
Merge pull request !984 from Tinazhang/hwc2chw
5 years ago
37f787b657
!1019 Cleanup dataset UT: use md5 npz in test_zip for images
...
Merge pull request !1019 from cathwong/ckw_dataset_ut_cleanup2
5 years ago
c8b5586c7f
add unit test for HWC2CHWC
5 years ago
58226addd6
Cleanup dataset UT: use md5 npz in test_zip for images
5 years ago
9433ca6468
!998 format the func name
...
Merge pull request !998 from guozhijian/enhance_format_func_name
5 years ago
cf352d190f
format func name for mindrecord
5 years ago
12eaaf710b
mul_add_fusion pass supports when add's 2nd is mul
5 years ago
47f5abceb4
!960 Adding example for grayscale
...
Merge pull request !960 from EricZ/grayscale_fix
5 years ago
078dd86cfe
!507 Implemented padded_batch
...
Merge pull request !507 from ZiruiWu/batch_with_padding
5 years ago
de7625777f
!951 fix: MindDataset with columns_name parameter cause errors in some scenes
...
Merge pull request !951 from guozhijian/fix_read_by_columns
5 years ago
0f0548f21b
Added test case for grayscale support
5 years ago
c2d364a573
batch with padding implemented
...
support for 1 specific dimension to be None, added validator
fix various CI complains
another round of CI fixes
ci
refactor parts of the code
code refactor
ci fix
comments added, fix bugs
address review comments
address review comments
review cmts
added simple perf test script
update pad code
perf imprv
5 years ago
16930c562d
!969 [MD] fix bug in pk sampler of minddataset
...
Merge pull request !969 from liyong126/fix_mindrecord_pk_sampler
5 years ago
8c9730b3c5
add parallel mode for cell
5 years ago
7c64048d76
!935 develop op ScatterMax and dock ge process
...
Merge pull request !935 from zhangbuxue/develop_scatter_max_op_and_dock_ge
5 years ago
becaf39262
!957 complete vm ops for BatchToSpace and SpaceToBatch
...
Merge pull request !957 from jiangjinsheng/space_to_batch
5 years ago
ac86996746
develop op ScatterMax and dock ge process
5 years ago
d4d236bcce
fix: use MindDataset by column_names get data error in some situation
5 years ago
6351f9c837
!859 [Auto parallel] Support searching strategy for inference phase
...
Merge pull request !859 from Xiaoda/support-inferring-phase-parallel-strategy-searching
5 years ago
e75d75854d
!959 Add Elu\EluGrad ops for VM.
...
Merge pull request !959 from liuxiao/ops-for-VM
5 years ago
deae380969
!637 Learning rate and weight decay making group params
...
Merge pull request !637 from ghzl/learning-rate-make-group-mode
5 years ago
a945299e42
update test for batch_to_space
5 years ago
b520ca9087
fix pk sampler in mindrecord
5 years ago
def8573275
implementing-searching-strategy-for-inference
5 years ago
79a3f0821a
add vm for batch_to_space and space_to_batch
5 years ago
eba74ca8f7
add ops for VM
5 years ago
824bc30a94
learning rate and weight decay support group mode
5 years ago
d78b85c8d4
!898 Add batch norm bert fission pass
...
Merge pull request !898 from YuJianfeng/master
5 years ago
3d3b9d5474
!840 [BUG] fix conv2dtranspose bug
...
Merge pull request !840 from jinyaohui/conv2dtranspose
5 years ago
aa6f808616
Add batch norm bert fission pass
5 years ago
9a2daae84c
del unused change_mode_op
5 years ago
88e763a98f
modify conv2dtranspose
5 years ago
108ef72aaf
!904 fix avgpool and add dimension check for groupnorm
...
Merge pull request !904 from JichenZhao/groupn
5 years ago
cae8a921e3
!929 Cleanup dataset UT: test_batch, save_and_check support
...
Merge pull request !929 from cathwong/ckw_dataset_ut_cleanup
5 years ago
772e6c1461
Cleanup dataset UT: test_batch, save_and_check support
5 years ago
ffcbcc8dcb
syn code 505
5 years ago
446828f221
modify momentum test
5 years ago
039c75af8e
fix avgpool and add check
5 years ago
36fffb7706
Added example md5 generation
...
Comparison example
Added md5 and comparison example for py_transforms
Added md5 check for images
5 years ago
99c9b48a4d
delete TestHWBatchNormGradSplit
5 years ago
3f1c6b7b47
solve the problem when dialtion greater than 1 in Conv2dTranspose ops
5 years ago
83c68ca2ef
Skip pyfunc test case
5 years ago
79f087c2af
!909 Adding fix for set seed
...
Merge pull request !909 from EricZ/test_random
5 years ago
200b3f0789
!837 add onnx op converter: ReLU6 and DepthwiseConv2dNative
...
Merge pull request !837 from chenzupeng/master
5 years ago
26cb3e8a5f
Added test function to show that seed doesn't work.
...
Added testcase to show that c image aug don't use seed properly
Added passing test cases
Added working testcases for using seed
Added additional test cases to show seed use
Added test case for seed
5 years ago
b323199dc1
syn code 430
5 years ago
a5b530c427
!857 use parameter name as the key of strategy checkpoint
...
Merge pull request !857 from yao_yf/strategy_ckpt_key_to_use_param_name
5 years ago
aaf8ade7ab
!886 fix issues pack raise error when input list length is 1
...
Merge pull request !886 from zhaozhenlong/fix-issues-pack-one-input-error
5 years ago
4694c979a5
delete pack description about num and add raise error
...
SparseApplyAdagrad example format
PReLU and grad state 1-d not supported
atan2 bprop dx dy revert to original shapes
5 years ago
7185961e89
Enable BatchNorm fusion pass
5 years ago
0611c1a579
!849 [CT][MS] Wrong format of broadcast output, when multi-output
...
Merge pull request !849 from vlne-v1/I1FQ76-wrong-format-of-boardcast-output-when-multi-output
5 years ago
67f3d0eb5d
!871 dataset: repair take op problem when there exist muti-thread in next node
...
Merge pull request !871 from ms_yan/take_operator
5 years ago
a109bc3d96
add onnx op converter: ReLU6, DepthwiseConv2dNative
5 years ago
157710ca0f
bugfix* fix bug in output tuple of tuple.* check kRWWrite input no-variable* input x of ScatterNdUpdate should be a parameter node
5 years ago
ff1a05d6c8
!882 fix bug of bprop of FloorMod
...
Merge pull request !882 from zhangbuxue/fix_bprop_for_floor_mod
5 years ago
db3dd02838
!847 Optimize the collectors in manager which listen to the graphs and nodes changes.
...
Merge pull request !847 from ZhangQinghua/opt
5 years ago
0c6cf98db0
fix bug of brpop of FloorMod
5 years ago
5a6540450e
use param name as the key of strategy checkpoint
5 years ago
c56fe3aa2d
modify take op with an operator
5 years ago
8af10eb51e
!875 Reject python OP in operations argument for C++ uniform augmentation OP
...
Merge pull request !875 from AdelShafiei/ua_py
5 years ago
d15bd04bfe
added input validation to reject python op in C++ uniform augmentation operations list
5 years ago
a606c2e4da
!872 [Dataset] Add schema support for GeneratorDataset
...
Merge pull request !872 from JunhanHu/generator_schema
5 years ago
2303453753
!869 Random data op
...
Merge pull request !869 from JesseKLee/random_data_op
5 years ago
c5a8ffe4f4
Add schema support for GeneratorDataset
5 years ago
5236d0c3c0
Replace print with logger.info
5 years ago
8d3695f666
!672 Added UT for uniform augmentation C++ OP
...
Merge pull request !672 from AdelShafiei/ua_ut
5 years ago
732c7f8266
!794 fix issues image gradients 4d check
...
Merge pull request !794 from zhaozhenlong/fix-issues-image-gradients-complement-check
5 years ago
270bf831a9
Random Data Op
5 years ago
98939d839c
!856 Fix skip op bug
...
Merge pull request !856 from jiangzhiwen/dataset/skip_thread
5 years ago
66e7a36846
ImageGradients check 4d
...
fix DiagPart constant folding issue
fix argmin output type check
fix atan2 doc error
fix remove FusedBatchNorm and its grad
5 years ago
34bfa2f7c9
fix skip
5 years ago
8ab5e0118f
!829 Add parser of case which parameter in tuple in run_op function
...
Merge pull request !829 from ghzl/parser-parameter-in-tuple-in-run_op
5 years ago
b96df362f8
add parser of case which parameter in tuple in run_op function
5 years ago
883fde0494
!839 add parameter verification for RMSprop
...
Merge pull request !839 from wangnan39/add_parameter_verification_for_rmsprop
5 years ago
728345fdd0
!841 fix bugs of Acosh bprop and Elu bprop
...
Merge pull request !841 from zhangbuxue/adapt_ExtractImagePatches_and_fix_EluGrad
5 years ago
f31c659944
!823 Add BatchNormGrad split pass
...
Merge pull request !823 from huanghui/BatchNormGrad-split-pass
5 years ago
064d370a61
fix bug of Acosh bprop and Elu bprop
5 years ago
33e427e1c5
!721 Tensor assign by ellipsis
...
Merge pull request !721 from candanzg/tensor_assgin_ellipsis
5 years ago
7f602016f4
add parameter verification for rmsprop, and modify default value in annotation
5 years ago
a22a4a57c2
Modify UT case after adjust the collectors of manager.
5 years ago
0de0aee54e
Add BatchNormGrad split pass
5 years ago
6241814320
!749 fix np.histogram sometimes calc very large bucket number
...
Merge pull request !749 from wenkai/wkmaster
5 years ago
e886a3182c
tensor assign with ellpsis
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
3322e65da9
added ut for uniform augment C++ op
5 years ago
332398d20a
Check return code from WaitPost::Register
5 years ago
243cd33203
adapt SparseApplyAdagradD adding output accum
5 years ago
9ffb3993e8
!732 dock AcoshGrad for GE and AvgPool AvgPoolGrad for VM
...
Merge pull request !732 from zhangbuxue/dock_AcoshGrad_AvgPool_AvgPoolGrad_for_vm
5 years ago
21d936e656
!728 auto parallel strategy checkpoint full
...
Merge pull request !728 from yao_yf/strategy_checkpoint_extend
5 years ago
4fff5f442c
!791 onnx adapter for MaxPoolWithArgmax
...
Merge pull request !791 from 梅晓蔚/master
5 years ago
0f89cc1da4
dock AcoshGrad for GE and AvgPool AvgPoolGrad for Vm
5 years ago
cd899fba0a
ONNX adapter for the MaxPoolWithArgmax
5 years ago
6cde5f6d91
auto parallel strategy checkpoint
5 years ago
9399dffe0e
!751 Remove enable hccl
...
Merge pull request !751 from zjun/remove_enable_hccl
5 years ago
5b3327d103
!746 reducescatter backforward operator
...
Merge pull request !746 from lirongzhen1/bp_reducescatter
5 years ago
c1813671db
!694 Refactor vm module for multigraph sink.
...
Merge pull request !694 from rick_sanchez/master
5 years ago
8bf35b2b0c
!700 validate bprop rules
...
Merge pull request !700 from penn/validate_bprop_rules
5 years ago
c538b83712
remove enbale hccl
5 years ago
0b4648881b
add reducescatter bprop
5 years ago
6ae8345cad
refactor vm module for multigraph sink
5 years ago
b37db1edf5
!603 [MD] update pk sampler in minddataset
...
Merge pull request !603 from liyong126/update_pk_sampler
5 years ago
1df8ea2915
!747 change cpu kernel dir
...
Merge pull request !747 from kisnwang/change-cpu-kernel-dir
5 years ago
f82e63fecc
!671 Added testcase for sync_wait
...
Merge pull request !671 from EricZ/master
5 years ago
0e3054d527
!466 Deepcopy problem when pyfunc cannot be pickled
...
Merge pull request !466 from h.farahat/deepcopy
5 years ago
bfba630aa2
update pK_sampler
5 years ago
c47ef8ee4e
!711 Address first epoch always shuffle with same seed init of random sampler
...
Merge pull request !711 from ZiruiWu/mindspore_master_only
5 years ago
afbd24cb78
!718 Fix dtype judge sentence in infer_dtype function of hcom operations
...
Merge pull request !718 from zhouyuanshen/master
5 years ago
e6f36e050f
change cpu kernel dir
5 years ago
e6473f0765
!736 Skip blank line for TextFileDataset
...
Merge pull request !736 from yanghaitao/yht_tftextfile_black_line
5 years ago
c046874b03
fix bug in infer_dtype function of hcom operations
5 years ago
ab04b3dc4b
fix np.histograms(bins='auto') sometimes calc very small width and very large bucket number, which lead to error/long compute time.
5 years ago
1cb3bead32
skip black line for TextFileDataset
5 years ago
9e633b6c12
validate bprop rules
5 years ago
ef71ae941f
!698 [Auto parallel] Support multi-subgraphs in auto-parallel
...
Merge pull request !698 from Xiaoda/support-wide-deep-in-auto-parallel
5 years ago
e537a70808
!657 Fix confusionmulgrad fusion pass cannot work
...
Merge pull request !657 from huanghui/fix-confusionmulgrad-fusion-pass
5 years ago
e213f2a435
!687 Fix bug: Summary tage type checking and exception throwing
...
Merge pull request !687 from candanzg/summary_tag_check
5 years ago
e227415673
support-the-multiple-subgraphs-in-the-ANF
5 years ago
8c3931cf1d
fix first epoch always shuffle with default seed in random sampler
...
fix ut
5 years ago
3d9f1087c6
!695 Check topk supported before converting input to attr
...
Merge pull request !695 from YuJianfeng/master
5 years ago
efdcd4c258
!682 fix api comments of some ops
...
Merge pull request !682 from liuxiao/fix-bug
5 years ago
ce2a13fcda
Check topk supported before converting input to attr
5 years ago
da5b10b699
!681 add psnr inputs shape and dtype check
...
Merge pull request !681 from zhaozhenlong/psnr-check-same-shape
5 years ago
fb5cfe31d5
!430 add buffer fusion bnupdate eltwise pass
...
Merge pull request !430 from Etone.Chan/bufferfusion
5 years ago
d2727d0504
add buffer fusion bnupdate eltwise pass
5 years ago
c88edfb31d
psnr check two input same shape and type
5 years ago
4750861054
fix layernorm bug
5 years ago
348b0ef53c
!344 add prim name to error message for operators in array_ops.py
...
Merge pull request !344 from fary86/add_prim_name_to_error_message_for_array_ops
5 years ago
713c48acaa
!679 Move add_memcpy_async pass and transdata_split pass
...
Merge pull request !679 from huanghui/move-pass-to-right-directory
5 years ago
b84deeeb5c
fix summary tage check error
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
230e77f923
fix confusionmulgrad fusion pass cannot work
5 years ago
2078229436
Add prim name to error message for array_ops
5 years ago
36a62576e8
support forward graph
5 years ago
5e877a7715
modify api and add example
5 years ago
ad2a5dcad2
!676 [Auto parallel] Add the resnet50 testcase
...
Merge pull request !676 from Xiaoda/add-the-resnet50-testcase
5 years ago
875ebc296d
!662 fix reviewboot and example of TruncatedNormal
...
Merge pull request !662 from zhangbuxue/fix-reviewboot
5 years ago
9e29224af9
move add_memcpy_async pass and transdata_split pass
5 years ago
aff6777ecc
fix reviewboot and example of TruncatedNormal and add type mapping
5 years ago
3ff9e54734
add the resnet50 32k-8p testcase
5 years ago
f305d6f8a7
Revert "add pattern AdjustAllReduceMulAdd"
...
This reverts commit ea6958c50a
5 years ago
2d115cd04e
Added example for multiple iterator
...
Added new testcase for multi iterator
Addressing review
Fixed typo
5 years ago
56f785f7e6
add context configration
5 years ago
6844ea633d
!56 Synchronization code423 to ms-incubator
...
Merge pull request !56 from changzherui/syn-code423
5 years ago
89f82e1a37
fix cpp ut test TestConvertConvBackpropFilter
5 years ago
a02eb240e9
!595 Tensor assign with int or tuple(int) index
...
Merge pull request !595 from candanzg/tensor_assign_with_integer
5 years ago
ce71c17933
!645 auto parallel prelu operator support broadcast
...
Merge pull request !645 from yao_yf/auto_parallel_prelu_support_broadcast
5 years ago
84d5e4f923
!643 [AutoParallel]Support reshape parameter
...
Merge pull request !643 from lichen/support_reshape_parameter
5 years ago
31aae36106
Tensor assign with integer
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
43a8f829a2
!628 fix the infer of TruncatedNormal and a bug of structure output
...
Merge pull request !628 from zhangbuxue/fix_example_for_TruncatedNormal
5 years ago
00859ae119
!586 enable/disable allreduce_fusion
...
Merge pull request !586 from lirongzhen1/allreduce_fusion
5 years ago
2ab211ae04
support reshape parameter
5 years ago
c8a1a24ce3
fix the infer of TruncatedNormal and a bug of structure output and a bug of tensorslice ellipsis
5 years ago
425276d43d
auto parallel prelu support prelu
5 years ago
dfde76af88
delete the 'simplify_cal' attribute in 'set_algo_parameters' and 'get_algo_parameters' interface
5 years ago
4ff418084c
enable/disable allreduce_fusion
5 years ago
53d2da5fe4
!264 static_analysis: remove useless cache in TrivialPrimEvaluator and add cache for PythonPrimEvaluator
...
Merge pull request !264 from xychow/remove-unnecessary-cache-and-add-cache
5 years ago
2440cea732
!621 [MD] adjust mindrecord ut
...
Merge pull request !621 from liyong126/mindrecord_ut
5 years ago
928dcf4ec4
!554 Fix derelu fusion pass
...
Merge pull request !554 from huanghui/fix_derelu_fusion_pass
5 years ago
d1add07b5a
change error type
5 years ago
1f222ddb9e
fix mindrecord c ut
5 years ago
cd6e8d6542
fix ReluV2's mask shape in derelu fusion pass
5 years ago
1af894e25f
change error type
5 years ago
4a3e5cb944
!492 Add AllGather fusion pass
...
Merge pull request !492 from YuJianfeng/allgather
5 years ago
54e0fa5c09
!556 [Auto Parallel] use DeviceMemory instead of fixed-size memory check
...
Merge pull request !556 from Chong/partition
5 years ago
57bc30505c
change error type
5 years ago
ad75618ca6
!611 change error message type
...
Merge pull request !611 from JichenZhao/errormsg
5 years ago
39945d0f79
Add AllGather fusion pass
5 years ago
bd13f9ba33
modify ResizeNearestNeighborV2D
5 years ago
f806b72447
use DeviceMemory for memory control
5 years ago
8963e39516
change error type
5 years ago
f6a4f3d155
[static_analysis]: remove the TrivialPrimEvaluator cache.
...
add cache for PythonPrimEvaluator. Be careful that
the infer function of PythonPrimitive in python code should
be idempotent.
5 years ago
14df771175
fix confusion_softmax_grad_rule pass
5 years ago
5ac07bb695
!504 Support Tensor assign A[slice] = u
...
Merge pull request !504 from candanzg/tensor_assign_with_slice
5 years ago
3c1785a121
syn code
5 years ago
663d597330
tensor assign with slice index
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
672244e0ac
add keep_bn_fp32 parameter
5 years ago
0bf6717e9a
!454 Fix the check of bool type in auto cast
...
Merge pull request !454 from candanzg/bug_cast_op
5 years ago
2dabcb9e59
!41 Synchronization code to ms-incubator
...
Merge pull request !41 from changzherui/syn-code
5 years ago
ac25cbae0e
Revert "add pattern AdjustAllReduceMulAdd"
...
This reverts commit d447364417
5 years ago
5cf09405e2
!532 [AutoParallel]support multiple subgraphs
...
Merge pull request !532 from lichen/support_multiple_subgraphs_in_auto_parallel
5 years ago
a9e9266149
Deepcopy problem when pyfunc cannot be pickled
5 years ago
b6e77e5178
Add ReluV2/ReluGradV2/ConfusionMulGrad for VM
5 years ago
1a0d2666b7
!559 Add Fill/Erf op for VM.
...
Merge pull request !559 from liuxiao/fill-op
5 years ago
818acd46d4
!569 fix bug in checkpoint when save scaler
...
Merge pull request !569 from wangnan39/master
5 years ago
c78630d737
support multiple subgraphs
5 years ago
f38d18c665
fix bug in checkpoint when save scaler
5 years ago
24a9f4974c
!536 support ellipsis and bool for tensor slice
...
Merge pull request !536 from zhangbuxue/support_elipis_for_tensor_slice
5 years ago
5b6c8fade8
Add Erf\FillD operator for VM
5 years ago
437bb8c27c
support ellipsis and bool for tensor slice
5 years ago
67057d1309
!541 add average pooling 1D
...
Merge pull request !541 from JichenZhao/avgpooling
5 years ago
4516b8feff
!437 Add L2Loss op for VM.
...
Merge pull request !437 from liuxiao/add-l2-loss
5 years ago
3b083d07bb
!550 support one node communication group
...
Merge pull request !550 from yao_yf/support_one_node_communication_group
5 years ago
c874e2d484
Add L2Loss op for VM
5 years ago
aad5771a62
!524 Added support for UA augmentation ops with tests
...
Merge pull request !524 from alashkari/ua-ops
5 years ago
56e7a7deb5
Added UniformAugment + Python Augmentation Ops
5 years ago
mindspore-ci-bot
hesham
buxue
zhoufeng
Yi Huaijie
heleiwang
jinyaohui
liyong
guohongzilong
zhaojichen
Xiaoda Zhang
jonwe
Peilin Wang
Tinazhang
Zirui Wu
wangnan39@huawei.com
zhouneng
huanghui
jiangjinsheng
qianlong
Cathy Wong
Junhan Hu
huangdongrun
lihongkang
leopz
xulei2020
Kang
wenchunjiang
Wei Luning
liuxiao
liubuyu
yujianfeng
yangzhenzhang
mindspore-ci-bot
changzherui
zhaozhenlong
jiangzhiwen
xiefangqi
ms_yan
fary86
jonyguo
panyifeng
peixu_ren
etone-chan
Jesse Lee
李鸿章
candanzg
chenzomi
dengwentao
He Wei
WilliamLian
lichenever
zhousiyi
yao_yf
gongchen
eric
yangyongjie
chenzupeng
Adel Shafiei
Zhang Qinghua
meixiaowei
zjun
lirongzhen1
rick_sanchez
kswang
zhouyuanshen
wenkai
yanghaitao
chang zherui
ch-l
Amir Lashkari