976b4793d1
!1544 Python Unit Test for TenCrop
...
Merge pull request !1544 from MahdiRahmaniHanzaki/I1IHNG-ten-crop
6 years ago
15a196eba9
!1636 Add TCs to 3 vision transformation ops and cleanup config settings
...
Merge pull request !1636 from Tinazhang/randomGray
6 years ago
3ef3d1433d
fixed num_samples bug for RandomSampler
6 years ago
f4a61fdbb2
Adding new UT cases and missing TCs in PY Ops.
6 years ago
5469be2a97
fixed bug for split, RandomSampler and some other cleanup
...
add another test case
typo
merge conflict
another PR changed testing behavior, updated test cases in this commit
added input check for use_sampler
addressed code review comments
fixed pylint, not related to my changes
fixed edge case of rounding in getting split sizes
fix pylint
6 years ago
86d197dfeb
clean pylint
6 years ago
65b0f8d1b3
为算子进行VM流程对接
6 years ago
c3f681f0cf
vm for BesselI0e and BesselI1e
6 years ago
d3dbb10b6d
!1563 Fixing some tiny faults about Pylint in my code(ops)
...
Merge pull request !1563 from liuwenhao/master
6 years ago
8316f736ea
!1650 Support forward reduce scatter for Matmul
...
Merge pull request !1650 from yangzhenzhang/forward-reduce-scatter
6 years ago
f87c70a9ab
Fixing some tiny faults about Pylint in my code(ops)
6 years ago
57874cd61f
!1372 [Auto parallel] Add a new primitive EmbeddingLookup
...
Merge pull request !1372 from Xiaoda/add-embedinglookup-primitive
6 years ago
19bd830539
support forward reduce scatter for matmul
6 years ago
f523a0f83c
!1600 [AutoParallel]Fix GatherV2 bug
...
Merge pull request !1600 from lichen/fix_auto_parallel_gatherv2_bug
6 years ago
4154adf196
add embedinglookup primitive
6 years ago
dfc097019b
Added TenCrop test
...
Added unit tests for both testing the functinality of the TenCrop and
its error messages. Due to the similarity of this method to FiveCrop the
test cases are similar to FiveCrop test cases.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>
added error_msg function call in the main method
refactored the test and added visual representation of the results
Separated the two error cases into two different functions and used the
visualize function in util.py to plot the result of TenCrop.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>
Added new test cases
Added new test cases including test case for checking the error message
when the size variable is not a positive integer, test case for
rectangle crop, test case for vertical flip setting, and testing for
similarity of the result of TenCrop for the same input data in different runs.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>
changed visualize in test_five_crop
Changed the visualize function in test_five_crop to use the already
existing function in util.py
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>
made generate_golden variable global
6 years ago
37904cea01
fix reviewBot of mem_reuse
6 years ago
21da86b393
!1591 add get_dataset_size for CelebADataset
...
Merge pull request !1591 from yanghaitao/yht_celeba_get_dataset_size
6 years ago
c223fde566
fix auto parallel gatherv2 bug
6 years ago
8556eee3fc
!1578 recitify pretrained path and revert AdjustAllReduceMulAdduse
...
Merge pull request !1578 from gengdongjie/master
6 years ago
ec5363ad9d
!1593 Fix the bug that there is only return node in the forward graph
...
Merge pull request !1593 from yangzhenzhang/reshape-optimized
6 years ago
4bf1c5099a
!1551 add onnx ops for deepfm
...
Merge pull request !1551 from wandongdong/master
6 years ago
39c1966593
!1488 add vm ops: Asin, AsinGrad, Asinh, AsinhGrad
...
Merge pull request !1488 from fangzehua/fzh_edit
6 years ago
19ce0c372a
!1257 Implicit type conversion
...
Merge pull request !1257 from candanzg/implicit_type_conversion2
6 years ago
cc6c7a3f60
add get_dataset_size to celebadataset
6 years ago
9c858444b0
!1568 Fix pylint warning for test cases of optimizer, infer, parse and pynative.
...
Merge pull request !1568 from seatea/fix-pylint-warning
6 years ago
1a4abefa9a
!1385 support for multi nest switch
...
Merge pull request !1385 from amongo/SupportMultiSwitch
6 years ago
2a6a3e012c
!1555 fix bug in lamb warmup step check
...
Merge pull request !1555 from wangnan39/fix_bug_in_check_lamb_warmup_step
6 years ago
1413f520d7
support reshape optimized
6 years ago
0f4dc13e8e
!1478 [Dataset] Fix CI warnings, clean pylint.
...
Merge pull request !1478 from luoyang/pylint
6 years ago
705c71a257
Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try"
...
This reverts commit 3db8cfa54f
6 years ago
9c5f6b9198
add onnx ops for deepfm
6 years ago
c0b8a90105
add vm ops: asin asinh asingrad asinhgrad
6 years ago
dd54ffdbdb
!1491 Complete vm ops for ReduceAllD, SparseApplyAdagradD and UnsortedSegmentMinD
...
Merge pull request !1491 from lihongkang/master
6 years ago
3dc061165b
!1559 Voc dataset support split ops
...
Merge pull request !1559 from xiefangqi/xfq_voc_support_split
6 years ago
9b2a778d94
!1478 [Dataset] clean pylint.
6 years ago
810ccf80d8
fix_bug_in_check_lamb_warmup_step
6 years ago
7398526abc
Fix pylint warning for test cases of optimizer, infer, parse and
...
pynative.
6 years ago
5e4728c50f
add voc support split
6 years ago
a36880f0ef
add vms for reducealld etc.
6 years ago
a7ad0d0a49
Fixing some tiny faults about Pylint in my code(ops)
6 years ago
fb7e4eac76
!1535 change hook function grad input to tuple
...
Merge pull request !1535 from wangqiuliang/change-hook-grad-input-to-tuple
6 years ago
ff4e4c2ee2
!1533 Fix pylint warning for pynative test cases
...
Merge pull request !1533 from seatea/fix-pylint-warning-for-pynative-mode
6 years ago
0fe3ff2761
!1506 Setting auto parallel flag for dataset wrap cell
...
Merge pull request !1506 from yangzhenzhang/set-auto-parallel-for-dataset-wrap
6 years ago
77547cdfc0
!1530 support tensor set item the number value type is similar as tensor dtype
...
Merge pull request !1530 from zhangbuxue/support_tensor_getitem_number_value_type_similar_as_tensor_dtype
6 years ago
906389b3a7
!1382 support create new item when dictionary set item key not exist
...
Merge pull request !1382 from amongo/DictionarySupportSetNewItem
6 years ago
8f7e571a0b
change hook grad input to tuple
6 years ago
df347785c3
!1508 add op BitwiseAnd BitwiseOr BitwiseXor vm
...
Merge pull request !1508 from zhaozhenlong/op/bitwise-and-or-xor
6 years ago
2429da19fb
implicit type conversion
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
6 years ago
21ab029227
Fix pylint warning for files under `pynative_mode` directory.
6 years ago
c8b30f9290
!1504 add custom tbe ops for quant aware training
...
Merge pull request !1504 from wandongdong/master
6 years ago
d226a23b65
support tensor set item the number value type is similar as tensor dtype not same
6 years ago
d35c41e737
add custom tbe ops for quant aware training
6 years ago
9c20b1d6f7
!1512 fix reshape reshape case
...
Merge pull request !1512 from yao_yf/fix_reshape_reshape_graph
6 years ago
6fa2813945
add op BitwiseAnd BitwiseOr BitwiseXor
6 years ago
b46ad9a1bb
!1398 Update the bert scripts according to rules of modelzoo
...
Merge pull request !1398 from chenhaozhe/update_bert_script
6 years ago
2f8516e5d7
set auto parallel for dataset warp cell
6 years ago
ad279e90fd
!1407 support mixed tensor index for tensor get item and set item and support in operator.
...
Merge pull request !1407 from zhangbuxue/support_mixed_tensor_for_tensor_get_item_and_tensor_set_item
6 years ago
b6aceddeab
update bert scripts according to rules of modelzoo
6 years ago
96c9569dca
fix reshape reshape case
6 years ago
2e684e89e7
!1446 pylint clean
...
Merge pull request !1446 from liuxiao78/master
6 years ago
5b9c145ff8
!1383 keep different attributes for cnode evaluation
...
Merge pull request !1383 from amongo/KeepPrimAttrInCNode
6 years ago
2eedd32120
!1472 add operator HostAllGather and HostReduceScatter
...
Merge pull request !1472 from yihuaijie/master
6 years ago
7ae289a197
Support mixed tensor for tensor getitem or setitem.
6 years ago
e9aa280f86
add support for dictionary set item which does not exist
6 years ago
b94949ea99
!1477 support vm for SpaceToBatchND and BatchToSpaceND
...
Merge pull request !1477 from jiangjinsheng/BatchToSpaceND
6 years ago
4e8e82f24a
!1457 fix 3 bug reports for split
...
Merge pull request !1457 from Peilin/splitOp-after-testing
6 years ago
a45dfca142
support BatchToSpaceND and SpaceToBatchND
6 years ago
d4c93575e7
fixed bug for split, RandomSampler and some other cleanup
...
add another test case
typo
merge conflict
another PR changed testing behavior, updated test cases in this commit
added input check for use_sampler
addressed code review comments
fixed pylint, not related to my changes
6 years ago
7c237620ba
add sigmoid op
6 years ago
334d038008
add support for multi switch
...
resolve review
6 years ago
73a287e5e0
pylint clean
6 years ago
ebbccca78b
pylint clean
6 years ago
f4542f810b
pylint clean
6 years ago
2f8e7ff693
add operator HostAllGather and HostReduceScatter
6 years ago
1159f2b11e
add prim infer attr cache
...
modify infer to get abstract value and attr value map together
support get attr in specialize
clone primitive when specialize if attribute is not the same with
infered attribute
6 years ago
55d1927534
add op scatter add vm
6 years ago
831ceba6eb
!1277 Fixing some tiny faults about Pylint in ME code
...
Merge pull request !1277 from liuwenhao/master
6 years ago
abca62f407
10:00 26/5 clean pylint
6 years ago
93fc82b8f7
!1447 remove unused variable
...
Merge pull request !1447 from yihuaijie/master
6 years ago
0b191615a9
!1427 fix check bprop attr error
...
Merge pull request !1427 from panyifeng/fix_check_bprop_attr_error
6 years ago
0a8ef2fe72
!1455 Cleanup dataset UT: restore config support
...
Merge pull request !1455 from cathwong/ckw_dataset_config_util
6 years ago
f891e1755c
Cleanup dataset UT: restore config support
6 years ago
aeb4c52f2d
!1379 Creating new UTs to three vision transformation ops
...
Merge pull request !1379 from Tinazhang/linearTrans
6 years ago
f3f0cbaeee
Fixing some tiny faults about Pylint in my code(ops)
6 years ago
382a0124c3
pylint clean
6 years ago
44bf7c9330
!1414 fix issue use reshape as flatten grad impl
...
Merge pull request !1414 from zhaozhenlong/fix-issues-reshape-replace-flattern-grad
6 years ago
ac484ebbc0
remove unused variable
6 years ago
18f0af0529
pylint clean
6 years ago
1c8548adb8
!1300 Add TBE op RangeD for GE.
...
Merge pull request !1300 from liuxiao/RangeD
6 years ago
30b93ecbf8
use reshape as flatten grad
6 years ago
6a57eeb922
fix check_bprop attr error
6 years ago
0b137e5312
delete unused arguments in test cases
6 years ago
627724a205
Add RangeD for GE
6 years ago
8cfc05e4cf
clean pylint warnings of parallel test cases
6 years ago
0e665616f0
!1160 add backward hook and custom bprop in pynative mode
...
Merge pull request !1160 from wangqiuliang/add-backward-hook-in-pynative-mode
6 years ago
840922e501
add backward hook function in pynative mode
6 years ago
718a96430f
!1389 Security issues in recent string tensor PR
...
Merge pull request !1389 from h.farahat/fix_security_issues
6 years ago
a6b8451a33
!1380 make ShuffleOp have deterministic behavior for subsequent epochs
...
Merge pull request !1380 from Peilin/shuffle-subsequent-epoch-deterministic
6 years ago
ad9db524bb
!1394 Fix comment error and mod parameter check in graphdata
...
Merge pull request !1394 from heleiwang/fix_comments_error
6 years ago
f28f883cac
fix comments error and modify parameter check
6 years ago
e87e6b38b0
!1355 [AutoParallel]Fix GatherV2 distributed op
...
Merge pull request !1355 from lichen/fix_gatherv2
6 years ago
390a86effb
fix gatherv2
6 years ago
c0f0e154f5
Clean up work for text python package
6 years ago
45368a86e9
!1329 Put the parameter validation of the Summary operator into the python layer
...
Merge pull request !1329 from ougongchang/master
6 years ago
41456ac824
!1369 dataset: delete StorageDataset
...
Merge pull request !1369 from ms_yan/del_storage
6 years ago
7322839b04
add UTs for LinearTransformation, ToPIL, ToType
6 years ago
0cbcc7200b
made shuffle determinisitc for subsequent epochs
6 years ago
61639be1e0
!1375 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception
...
Merge pull request !1375 from cathwong/ckw_dataset_ut_cleanup5
6 years ago
a528797253
!1377 Code Fix for Uniform Augmentation
...
Merge pull request !1377 from Tinazhang/cc
6 years ago
458436186c
!1365 Clean up work for text python sub-package
...
Merge pull request !1365 from h.farahat/text_namespace
6 years ago
b390883c6a
Bug fix
6 years ago
702005d403
Cleanup dataset UT: remove num_parallel_workers=1 in test_exception
6 years ago
7d78b5d89e
Put the parameter validation of the Summary operator into the python layer
...
add some unittest for summary operator
support ScalarSummary to record number type
6 years ago
d5e896b51c
delete storageDataset Op API and its test case
6 years ago
6f733ec113
!1308 Stage 2 of adding support for string Tensor
...
Merge pull request !1308 from h.farahat/string_tensor2
6 years ago
34236ce1f1
fix pylint
6 years ago
d402b94476
!1370 delete parallel end-to-end test cases
...
Merge pull request !1370 from yihuaijie/master
6 years ago
3363d4e834
!1249 Add GNN dataset processing API
...
Merge pull request !1249 from heleiwang/hlw_gnn_data
6 years ago
f3d14fa14b
!1363 Restrict tensor get item or set item not support mixed tensor.
...
Merge pull request !1363 from zhangbuxue/Not_support_mixed_tensor_as_index_for_tensor_getitem_and_setitem
6 years ago
1e6ee83874
delete parallel end-to-end test cases
6 years ago
3f23aa1d79
!1348 fix pylint warnings of parallel test cases
...
Merge pull request !1348 from yihuaijie/master
6 years ago
6c21e556c4
Clean up work for text python package
6 years ago
368007240c
!1320 add applyrmsprop cumprod and reduceprod for vm
...
Merge pull request !1320 from JichenZhao/applyrms_squaresumall_cumprod_reduceprod
6 years ago
62c716b68e
!1349 Fix some functions in group parameters and optimizer
...
Merge pull request !1349 from ghzl/add-group-check-for-lars
6 years ago
850171a34b
Restrict tensor getitem or setitem not support mixed tensor.
6 years ago
14fe72f383
fix pylint warnings
6 years ago
bd845dd0b7
!1352 [MD] fix bug when append data in mindrecord using absolute path
...
Merge pull request !1352 from liyong126/mindrecord_fix_bug_I1HQUI
6 years ago
599a449e0b
Support processing GNN data
6 years ago
fbdba6e4da
clean pylint
6 years ago
df361d1d26
Change mem layout of string tensor
...
add support for MindRecord and TFRecord
----
optimize tensorshape
optimize tensorshape and FlatIndex
TFRecord and MindRecord support for string tensor
Modify mem layout
Add new constructor
Add method Allocate
Change some GetMutableBuffer usages to AllocateBuffer
6 years ago
447420eb9a
fix bug when append data by absolute path
6 years ago
2d2f9ba8fd
fix group parameter code for check
6 years ago
a42ec8f69f
add applyrmsprop op for vm
6 years ago
58e6d7d950
!1341 Added lookup and vocab to mindspore.dataset.text
...
Merge pull request !1341 from ZiruiWu/vocab_and_lookup
6 years ago
decf12cd0b
!1317 [MD]add compress for nlp data in mindrecord
...
Merge pull request !1317 from liyong126/mindrecord_compress
6 years ago
274f6f014f
!1133 support tensor get value by tensor index
...
Merge pull request !1133 from zhangbuxue/support_tensor_get_value_by_tensor_index
6 years ago
0a795c24aa
!1245 add model init api to compile df graph before train
...
Merge pull request !1245 from wangnan39/add_model_init_api_to_compile_df_graph_before_train_and_eval
6 years ago
bb51bb88d7
add compress in mindrecord
6 years ago
2e3d55ed87
!1281 Implementation of SplitOp
...
Merge pull request !1281 from Peilin/splitOp
6 years ago
39b9aedf68
!1342 Bug fix on issue Core dump on GPU when train with lenet with AU
...
Merge pull request !1342 from Tinazhang/cc
6 years ago
0ca626ef6c
!1229 Init the slices of a Initializer on different devices
...
Merge pull request !1229 from yihuaijie/master
6 years ago
71e8bb1960
general split case done, chaining sampler (basic case) is working
...
implementation 99% complete
everything and tested except for repeatable shuffling
tested most basic/typical split usecases
cleanup
some more cleanup
fix CI
more ci fix
more ci fixes
more ci fix
more ci fix
more ci fix
added more tests, fixed some bugs
some more clean up and test cases
added shard/shuffle before split warning/error
addressed code review comments and ci
fixed ci
6 years ago
e9e40b688b
Bug fix
6 years ago
25ab2ef303
Implemented lookup and vocab
6 years ago
46949fc327
!1307 Cleanup dataset UT: unskip and enhance TFRecord sharding tests
...
Merge pull request !1307 from cathwong/ckw_dataset_ut_unskip2
6 years ago
1ebf98b795
add model init api to compile df graph before exec
6 years ago
e490618db8
support tensor get value by tensor index
...
support tensor set value by tensor index
6 years ago
7a5004cc49
init the slices of a Initialzer on different devices
6 years ago
218ade30b2
add vm support sin and cumsum
6 years ago
2224fa093b
!1302 Complete vm ops for BinaryCrossEntropy and BinaryCrossEntropyGrad
...
Merge pull request !1302 from lihongkang/master
6 years ago
b96a2ed816
!1312 support vm for erfc
...
Merge pull request !1312 from jiangjinsheng/vm_erfc
6 years ago
bddd743ca9
!1304 Add check for controldepend
...
Merge pull request !1304 from amongo/AddCheckForControlDepend
6 years ago
2d3cd8276e
vm for erfc
6 years ago
451c20a6f5
Add UnicodeCharTokenizer for nlp
6 years ago
93e7c97a96
!1272 [Dataset] MindData Tree Optimizer Infrastructure
...
Merge pull request !1272 from JunhanHu/minddata_opt
6 years ago
b78894e02b
Cleanup dataset UT: unskip and enhance TFRecord sharding tests
6 years ago
f44d213503
MindData optimizer infrastructure.
6 years ago
3e2074b113
add check for ControlDepend
6 years ago
233508b70e
!1250 Dict_setitem transofrm to tuple_setitem
...
Merge pull request !1250 from amongo/SupportDictSetItemTransform
6 years ago
cf543382aa
add vms for binarycrossentropy and binarycrossentropygrad
6 years ago
183144e135
!1282 support vm for PReLU and PReLUGrad
...
Merge pull request !1282 from jiangjinsheng/vm_prelu
6 years ago
163b6b7ea7
add jieba c++ code
6 years ago
89470cf29d
!1263 Modified clip_gradients to clip_grad
...
Merge pull request !1263 from Kang/master
6 years ago
bfff7c0a2f
Modified clip_gradients to clip_grad
6 years ago
ce09f5e15a
vm for prelu and prelugrad
6 years ago
3cf94daefc
add support for dict setitem operation
...
format code
remove save_graph
raise exception when dictionary setitem if the key not exists
resolve error
remove unnessary op_
6 years ago
ba99cb7bcb
support vm for space_to_depth
6 years ago
17cecf2cf5
Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling
6 years ago
fe8b59f26b
!1111 support vm for pack and unpack
...
Merge pull request !1111 from jiangjinsheng/vm_pack
6 years ago
3db8cfa54f
add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try
6 years ago
f9bd460c96
support vm for pack
6 years ago
18c9495000
!1228 Adapt tbe op UnsortedSegmentMin for GE.
...
Merge pull request !1228 from liuxiao/UnsortedSegmentMin
6 years ago
cc024bb3a1
UnsortedSegmentMin for GE
6 years ago
d1d1766bed
add squaresumall op
6 years ago
1b7cdc4c61
!1218 clean pylint warning in test about import
...
Merge pull request !1218 from jinyaohui/pylint1
6 years ago
5a914994ba
clean pylint
6 years ago
6b54a6417d
ckpt and restore parameter shape
6 years ago
bcfaff97f9
clean pylint
6 years ago
051567ba20
!1192 Support string type Stage !
...
Merge pull request !1192 from h.farahat/string_Tensor
6 years ago
4efa9717bb
!1129 Add op bounding box encoder
...
Merge pull request !1129 from zhaozhenlong/op/bounding-box-encoder
6 years ago
6de7eb2633
!1203 delete ApplyAdamD for master
...
Merge pull request !1203 from changzherui/code516
6 years ago
1e93927772
code 516 for test
6 years ago
c3d9f18087
!1176 fix validator for transpose
...
Merge pull request !1176 from jiangjinsheng/issue_transpose
6 years ago
c169ac6a18
!1195 add validate for geswitch and merge
...
Merge pull request !1195 from jiangjinsheng/issue_geswitch
6 years ago
e45532b78c
fixed transpose
6 years ago
c05203ef06
add validate for geswitch and merge
6 years ago
0040764dec
!1100 delete some context param(enable_loop_sink,enable_mem_reuse,enable_auto_mixed_precision)
...
Merge pull request !1100 from jinyaohui/context_opt_2
6 years ago
2907cf4488
remove some context param
6 years ago
b54ffdc086
add op BoundingBoxDecode
...
iou
NMSWithMask
larsupdate testcase
sgd testcase
6 years ago
92d196f054
!1178 Complete vm ops for ROIAlign and ROIAlignGrad
...
Merge pull request !1178 from zhouneng/add_vm_support_roialign
6 years ago
e8ca243364
-Add DE_STRING
...
-replace switch'case by indexing
- Add test case
- Add constructors
- Add getItem string
- Fix bugs
- Add more tests
- Tensor iterator
- asNumpy
- TextFileDataset
- Tensor(Numpy)
- Super > 2D
- Add more test cases for GeneratorDataset
- Change StartAddr to GetBuffer and GetMutableNuffer
- Raise an error if batch is used with strings
Clean-up work
6 years ago
cb2814b498
flat_map first commit
6 years ago
c680cfbf27
!1157 dataset: add concat operation for dataset
...
Merge pull request !1157 from ms_yan/concat_dataset
6 years ago
ab031ee9ea
!1126 VOCDataset support object detection function
...
Merge pull request !1126 from xiefangqi/voc_support_detection
6 years ago
c2a1b5f8c1
add register info for ROIAlign and ROIAlignGrad
6 years ago
c937bad53f
minddata support voc
6 years ago
c0fa7b4b19
init commit of concat dataset
...
change to use __add__ operation instead ds.concat
6 years ago
766906dd6d
support vm for flatten
6 years ago
8a853cec2d
!1171 adjust onnx related testcases
...
Merge pull request !1171 from fary86/adjust_onnx_related_uts
6 years ago
bb374ebc28
!1015 Support weights to be compiled according to shape
...
Merge pull request !1015 from candanzg/me_with_shape
6 years ago
fe2ee14340
Adjust onnx exporting related testcases
6 years ago
a9816fa779
!1026 Add Logsigmoid and Reduce_logsumexp
...
Merge pull request !1026 from peixu_ren/custom_pp_ops
6 years ago
be2e7531ca
fix: MindDataset parameter shard_id & num_shards check
6 years ago
755ba75deb
fix pylint
6 years ago
4bb5c7b39a
!1084 add new interface quant combined
...
Merge pull request !1084 from SanjayChan/04quant
6 years ago
99fda6f431
Add logsigmoid and reduce_logsumexp
6 years ago
a2a3b1c6c5
!1089 Add Optimizer method get_lr_parameter
...
Merge pull request !1089 from ghzl/add-get-lr-base-on-parameter
6 years ago
913074e656
Cleanup dataset UT: resolve skipped test units
6 years ago
6b68671805
!1069 Use a resident process to write summary files and SummaryRecord as context manager
...
Merge pull request !1069 from 李鸿章/context_manager
6 years ago
32c1d558f4
SummaryRecord as context manager
6 years ago
7e3ec651dc
!1094 Complete vm ops for L2Normalize and L2NormalizeGrad
...
Merge pull request !1094 from zhouneng/add_vm_support_l2normalize
6 years ago
2cc85bdc93
Support weight compile according to shape
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
6 years ago
21bcdcd8ad
!1121 Complete vm ops for ResizeBilinear and ResizeBilinearGrad
...
Merge pull request !1121 from lihongkang/master
6 years ago
1239cd6135
Merge branch 'master' into 04quant
6 years ago
e70b2f5430
add optimizer.get_lr_parameter() method
6 years ago
bf6246e617
add quant combined
6 years ago
1a98c6b459
!999 [MD] mindrecord support reading file list
...
Merge pull request !999 from liyong126/mindrecord_file_list
6 years ago
25b2424f9b
!1042 clean pylint warning in test_framwork dir
...
Merge pull request !1042 from jinyaohui/clean_pylint
6 years ago
ca8a914736
接入算子resizebilinear and resizebilineargrad
6 years ago
6f386c5782
!1082 Support 'break', 'continue' and 'pass' statements
...
Merge pull request !1082 from hewei/support_cont_break
6 years ago
aa3f89e74f
mindrecord support read file list
6 years ago
33fa90efc9
Support 'break', 'continue' and 'pass'
...
To handle 'break' and 'continue' statement, a loop context is pushed
to a stack before we parse the loop body, and pop it after body parsed.
When a 'break', 'continue' statement is encountered, we retrieve current
loop contex from the stack, and let the current block jump to the end
block or header block;
For 'break' statement, we added an extra 'end_block' follow the 'after_block',
because 'after_block' is called from a ContionalJump in 'header_block', it can
not be set as jump target from other place. to support 'break', we let loop
body jump to the 'end_block' at the 'break' point. and 'after_block'
maybe a good place to handle loop 'else' clause in the future.
Handle 'pass' is simple, just bypass it when doing parse.
6 years ago
0345995000
!1110 [AutoParallel]fix gatherv2 and dataset bug
...
Merge pull request !1110 from lichen/fix_gatherv2_and_dataset_bug
6 years ago
26fd75895d
pylint waring clean
6 years ago
18019ad6a5
!1038 clean some context param
...
Merge pull request !1038 from jinyaohui/clean_context
6 years ago
debfd38b75
fix gatherv2 and dataset bug
6 years ago
ba3d48817e
!1070 Adapt aicpu op CTCLoss and TBE op L2Loss for GE.
...
Merge pull request !1070 from liuxiao/ops-for-VM
6 years ago
391a060f21
remove two context param
6 years ago
48e54dcfda
!1056 [Auto parallel] Memory calculation in the inference phase
...
Merge pull request !1056 from Xiaoda/memory-estimation-in-inference-phase
6 years ago
79725af4cd
为L2Normalize/L2NormalizeGrad增加VM支持
6 years ago
10abb68498
add ops CTCLoss
6 years ago
fdad91355f
!1093 reset parallel context before running each parallel test case
...
Merge pull request !1093 from yihuaijie/master
6 years ago
da7d605e85
!683 WIP: specialize hyper map parameter
...
Merge pull request !683 from xychow/bypass-renorm-and-specialize-hypermap-parameter
6 years ago
6ab046e4dd
!1062 Adapt Softplus\SoftplusGrad for VM, and ApplyFtrlD for both GE and VM.
...
Merge pull request !1062 from liuxiao/softplus-softplusgrad
6 years ago
a05aa21cc2
calculating PEAK memory cost in the inference phase
6 years ago
06a9eeb3bf
!1050 [bug][auto_mixed_precision]fix sens shape error of `TrainOneStepWithLossScaleCell`
...
Merge pull request !1050 from vlne-v1/I1GEPN-check-bprop-error-loss-scale-wrap
6 years ago
462f30e077
reset auto parallel context before each test
6 years ago
98112d1a64
!997 support vm for log1p
...
Merge pull request !997 from jiangjinsheng/log1p
6 years ago
3e89f7baaa
fix sens shape error in loss_scale one_step_wrap
6 years ago
28a6daaed5
!1017 add profiling_mode and profiling_options to context
...
Merge pull request !1017 from jinyaohui/context_opt
6 years ago
c36e7f1564
support vm for log1p
6 years ago
8003a89a7b
!766 bugfix(SA): Add the support of nested loop.
...
Merge pull request !766 from gongchen/nest_loop
6 years ago
fd72534a1c
!1065 Seperate lr groups and weight_decay groups
...
Merge pull request !1065 from ghzl/improve-parameter-groups
6 years ago
4fe6ddebd1
!1075 Cleanup dataset UT: util.py internals
...
Merge pull request !1075 from cathwong/ckw_dataset_ut_cleanup3
6 years ago
5a9de3716d
add profiling mode and profiling options to context
6 years ago
047ac018da
specialize hypermap paramater
6 years ago
4a8fcf5d76
!1055 support vm for floor
...
Merge pull request !1055 from jiangjinsheng/vm_floor
6 years ago
05e8b8028b
!1060 Fix bug of assigning value to non-Parameter class member
...
Merge pull request !1060 from fary86/fix_assign_target_not_parameter
6 years ago
66667d727e
!1034 Gpu Support Dropout operator
...
Merge pull request !1034 from SanjayChan/dropout
6 years ago
49ef53f164
Cleanup dataset UT: util.py internals
6 years ago
2af6ee2482
!1054 Add slice shape for param info
...
Merge pull request !1054 from yangzhenzhang/add-slice-shape-for-param-info
6 years ago
c95215bca0
seperate lr groups and weight_decay groups
6 years ago
4335e9bc83
adapt Softplus\SoftplusGrad\ApplyFtrlD for VM
6 years ago
16b9004d53
Fix bug of assign value to non Parameter class member
6 years ago
5ff79d0204
!1048 Support index to switch_layer
...
Merge pull request !1048 from panyifeng/index_to_switch_case
6 years ago
661f9dfaf8
add dropout primtive
6 years ago
57085bb18d
!996 [Auto parallel] Supporting VirtualDataset having three inputs
...
Merge pull request !996 from Xiaoda/supporting-virtualdataset-has-three-inputs
6 years ago
2fa654e65c
support vm for floor
6 years ago
05fde3d23d
add slice shape for param info
6 years ago
065e25e1bb
Support index to switch_layer
6 years ago
716def7c0a
move InferStraByTensorInfo to tensor_info.h
6 years ago
dd2062bf8d
!1023 add_gatherv2_distributed_op
...
Merge pull request !1023 from lichen/add_gatherv2_distributed_op
6 years ago
8a45ab1125
!906 fix a bug that support dilation greater than 1 in conv2dTranspose ops
...
Merge pull request !906 from yangyongjie/master
6 years ago
22632f2f09
!977 reshape operator support auto strategy search
...
Merge pull request !977 from yao_yf/reshape_auto_parallel_strategy_search
6 years ago
19a24b86ac
add gatherv2 distributed op
6 years ago
68372231bb
!1031 Support transform valuetuple of nested graph to make tuple
...
Merge pull request !1031 from amongo/ValueTupleOfNestedGraph
6 years ago
f0bf438a55
reshape strategy search
6 years ago
425a207663
bug(SA): Add the support of nested loop.
6 years ago
0e89813759
add resolve
...
transform valuetuple to maketuple of graphs
add testcase
6 years ago
affdd22de3
!967 Add switch_case primitive
...
Merge pull request !967 from panyifeng/switch_case_primitive
6 years ago
5e041966f1
add a new vritualdataset cell for three inputs
6 years ago
0eb32593a6
!958 Add parallel mode configuration for cell
...
Merge pull request !958 from yangzhenzhang/add_parallel_mode_for_cell
6 years ago
b7596e1f33
Add switch_case primitive
6 years ago
2860fd9338
!984 Add unit test case for HWC2CHW.
...
Merge pull request !984 from Tinazhang/hwc2chw
6 years ago
c8b5586c7f
add unit test for HWC2CHWC
6 years ago
58226addd6
Cleanup dataset UT: use md5 npz in test_zip for images
6 years ago
47f5abceb4
!960 Adding example for grayscale
...
Merge pull request !960 from EricZ/grayscale_fix
6 years ago
078dd86cfe
!507 Implemented padded_batch
...
Merge pull request !507 from ZiruiWu/batch_with_padding
6 years ago
de7625777f
!951 fix: MindDataset with columns_name parameter cause errors in some scenes
...
Merge pull request !951 from guozhijian/fix_read_by_columns
6 years ago
0f0548f21b
Added test case for grayscale support
6 years ago
c2d364a573
batch with padding implemented
...
support for 1 specific dimension to be None, added validator
fix various CI complains
another round of CI fixes
ci
refactor parts of the code
code refactor
ci fix
comments added, fix bugs
address review comments
address review comments
review cmts
added simple perf test script
update pad code
perf imprv
6 years ago
16930c562d
!969 [MD] fix bug in pk sampler of minddataset
...
Merge pull request !969 from liyong126/fix_mindrecord_pk_sampler
6 years ago
8c9730b3c5
add parallel mode for cell
6 years ago
7c64048d76
!935 develop op ScatterMax and dock ge process
...
Merge pull request !935 from zhangbuxue/develop_scatter_max_op_and_dock_ge
6 years ago
becaf39262
!957 complete vm ops for BatchToSpace and SpaceToBatch
...
Merge pull request !957 from jiangjinsheng/space_to_batch
6 years ago
ac86996746
develop op ScatterMax and dock ge process
6 years ago
d4d236bcce
fix: use MindDataset by column_names get data error in some situation
6 years ago
6351f9c837
!859 [Auto parallel] Support searching strategy for inference phase
...
Merge pull request !859 from Xiaoda/support-inferring-phase-parallel-strategy-searching
6 years ago
e75d75854d
!959 Add Elu\EluGrad ops for VM.
...
Merge pull request !959 from liuxiao/ops-for-VM
6 years ago
deae380969
!637 Learning rate and weight decay making group params
...
Merge pull request !637 from ghzl/learning-rate-make-group-mode
6 years ago
a945299e42
update test for batch_to_space
6 years ago
b520ca9087
fix pk sampler in mindrecord
6 years ago
def8573275
implementing-searching-strategy-for-inference
6 years ago
79a3f0821a
add vm for batch_to_space and space_to_batch
6 years ago
eba74ca8f7
add ops for VM
6 years ago
824bc30a94
learning rate and weight decay support group mode
6 years ago
3d3b9d5474
!840 [BUG] fix conv2dtranspose bug
...
Merge pull request !840 from jinyaohui/conv2dtranspose
6 years ago
88e763a98f
modify conv2dtranspose
6 years ago
108ef72aaf
!904 fix avgpool and add dimension check for groupnorm
...
Merge pull request !904 from JichenZhao/groupn
6 years ago
cae8a921e3
!929 Cleanup dataset UT: test_batch, save_and_check support
...
Merge pull request !929 from cathwong/ckw_dataset_ut_cleanup
6 years ago
772e6c1461
Cleanup dataset UT: test_batch, save_and_check support
6 years ago
ffcbcc8dcb
syn code 505
6 years ago
446828f221
modify momentum test
6 years ago
039c75af8e
fix avgpool and add check
6 years ago
36fffb7706
Added example md5 generation
...
Comparison example
Added md5 and comparison example for py_transforms
Added md5 check for images
6 years ago
3f1c6b7b47
solve the problem when dialtion greater than 1 in Conv2dTranspose ops
6 years ago
83c68ca2ef
Skip pyfunc test case
6 years ago
79f087c2af
!909 Adding fix for set seed
...
Merge pull request !909 from EricZ/test_random
6 years ago
200b3f0789
!837 add onnx op converter: ReLU6 and DepthwiseConv2dNative
...
Merge pull request !837 from chenzupeng/master
6 years ago
26cb3e8a5f
Added test function to show that seed doesn't work.
...
Added testcase to show that c image aug don't use seed properly
Added passing test cases
Added working testcases for using seed
Added additional test cases to show seed use
Added test case for seed
6 years ago
b323199dc1
syn code 430
6 years ago
a5b530c427
!857 use parameter name as the key of strategy checkpoint
...
Merge pull request !857 from yao_yf/strategy_ckpt_key_to_use_param_name
6 years ago
4694c979a5
delete pack description about num and add raise error
...
SparseApplyAdagrad example format
PReLU and grad state 1-d not supported
atan2 bprop dx dy revert to original shapes
6 years ago
0611c1a579
!849 [CT][MS] Wrong format of broadcast output, when multi-output
...
Merge pull request !849 from vlne-v1/I1FQ76-wrong-format-of-boardcast-output-when-multi-output
6 years ago
67f3d0eb5d
!871 dataset: repair take op problem when there exist muti-thread in next node
...
Merge pull request !871 from ms_yan/take_operator
6 years ago
a109bc3d96
add onnx op converter: ReLU6, DepthwiseConv2dNative
6 years ago
157710ca0f
bugfix* fix bug in output tuple of tuple.* check kRWWrite input no-variable* input x of ScatterNdUpdate should be a parameter node
6 years ago
ff1a05d6c8
!882 fix bug of bprop of FloorMod
...
Merge pull request !882 from zhangbuxue/fix_bprop_for_floor_mod
6 years ago
0c6cf98db0
fix bug of brpop of FloorMod
6 years ago
5a6540450e
use param name as the key of strategy checkpoint
6 years ago
c56fe3aa2d
modify take op with an operator
6 years ago
8af10eb51e
!875 Reject python OP in operations argument for C++ uniform augmentation OP
...
Merge pull request !875 from AdelShafiei/ua_py
6 years ago
d15bd04bfe
added input validation to reject python op in C++ uniform augmentation operations list
6 years ago
a606c2e4da
!872 [Dataset] Add schema support for GeneratorDataset
...
Merge pull request !872 from JunhanHu/generator_schema
6 years ago
2303453753
!869 Random data op
...
Merge pull request !869 from JesseKLee/random_data_op
6 years ago
c5a8ffe4f4
Add schema support for GeneratorDataset
6 years ago
5236d0c3c0
Replace print with logger.info
6 years ago
8d3695f666
!672 Added UT for uniform augmentation C++ OP
...
Merge pull request !672 from AdelShafiei/ua_ut
6 years ago
732c7f8266
!794 fix issues image gradients 4d check
...
Merge pull request !794 from zhaozhenlong/fix-issues-image-gradients-complement-check
6 years ago
270bf831a9
Random Data Op
6 years ago
98939d839c
!856 Fix skip op bug
...
Merge pull request !856 from jiangzhiwen/dataset/skip_thread
6 years ago
66e7a36846
ImageGradients check 4d
...
fix DiagPart constant folding issue
fix argmin output type check
fix atan2 doc error
fix remove FusedBatchNorm and its grad
6 years ago
34bfa2f7c9
fix skip
6 years ago
8ab5e0118f
!829 Add parser of case which parameter in tuple in run_op function
...
Merge pull request !829 from ghzl/parser-parameter-in-tuple-in-run_op
6 years ago
b96df362f8
add parser of case which parameter in tuple in run_op function
6 years ago
883fde0494
!839 add parameter verification for RMSprop
...
Merge pull request !839 from wangnan39/add_parameter_verification_for_rmsprop
6 years ago
728345fdd0
!841 fix bugs of Acosh bprop and Elu bprop
...
Merge pull request !841 from zhangbuxue/adapt_ExtractImagePatches_and_fix_EluGrad
6 years ago
064d370a61
fix bug of Acosh bprop and Elu bprop
6 years ago
33e427e1c5
!721 Tensor assign by ellipsis
...
Merge pull request !721 from candanzg/tensor_assgin_ellipsis
6 years ago
7f602016f4
add parameter verification for rmsprop, and modify default value in annotation
6 years ago
6241814320
!749 fix np.histogram sometimes calc very large bucket number
...
Merge pull request !749 from wenkai/wkmaster
6 years ago
e886a3182c
tensor assign with ellpsis
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
6 years ago
3322e65da9
added ut for uniform augment C++ op
6 years ago
243cd33203
adapt SparseApplyAdagradD adding output accum
6 years ago
9ffb3993e8
!732 dock AcoshGrad for GE and AvgPool AvgPoolGrad for VM
...
Merge pull request !732 from zhangbuxue/dock_AcoshGrad_AvgPool_AvgPoolGrad_for_vm
6 years ago
21d936e656
!728 auto parallel strategy checkpoint full
...
Merge pull request !728 from yao_yf/strategy_checkpoint_extend
6 years ago
4fff5f442c
!791 onnx adapter for MaxPoolWithArgmax
...
Merge pull request !791 from 梅晓蔚/master
6 years ago
0f89cc1da4
dock AcoshGrad for GE and AvgPool AvgPoolGrad for Vm
6 years ago
cd899fba0a
ONNX adapter for the MaxPoolWithArgmax
6 years ago
6cde5f6d91
auto parallel strategy checkpoint
6 years ago
9399dffe0e
!751 Remove enable hccl
...
Merge pull request !751 from zjun/remove_enable_hccl
6 years ago
5b3327d103
!746 reducescatter backforward operator
...
Merge pull request !746 from lirongzhen1/bp_reducescatter
6 years ago
c1813671db
!694 Refactor vm module for multigraph sink.
...
Merge pull request !694 from rick_sanchez/master
6 years ago
8bf35b2b0c
!700 validate bprop rules
...
Merge pull request !700 from penn/validate_bprop_rules
6 years ago
c538b83712
remove enbale hccl
6 years ago
0b4648881b
add reducescatter bprop
6 years ago
6ae8345cad
refactor vm module for multigraph sink
6 years ago
b37db1edf5
!603 [MD] update pk sampler in minddataset
...
Merge pull request !603 from liyong126/update_pk_sampler
6 years ago
f82e63fecc
!671 Added testcase for sync_wait
...
Merge pull request !671 from EricZ/master
6 years ago
0e3054d527
!466 Deepcopy problem when pyfunc cannot be pickled
...
Merge pull request !466 from h.farahat/deepcopy
6 years ago
bfba630aa2
update pK_sampler
6 years ago
c47ef8ee4e
!711 Address first epoch always shuffle with same seed init of random sampler
...
Merge pull request !711 from ZiruiWu/mindspore_master_only
6 years ago
afbd24cb78
!718 Fix dtype judge sentence in infer_dtype function of hcom operations
...
Merge pull request !718 from zhouyuanshen/master
6 years ago
c046874b03
fix bug in infer_dtype function of hcom operations
6 years ago
ab04b3dc4b
fix np.histograms(bins='auto') sometimes calc very small width and very large bucket number, which lead to error/long compute time.
6 years ago
9e633b6c12
validate bprop rules
6 years ago
ef71ae941f
!698 [Auto parallel] Support multi-subgraphs in auto-parallel
...
Merge pull request !698 from Xiaoda/support-wide-deep-in-auto-parallel
6 years ago
e213f2a435
!687 Fix bug: Summary tage type checking and exception throwing
...
Merge pull request !687 from candanzg/summary_tag_check
6 years ago
e227415673
support-the-multiple-subgraphs-in-the-ANF
6 years ago
8c3931cf1d
fix first epoch always shuffle with default seed in random sampler
...
fix ut
6 years ago
efdcd4c258
!682 fix api comments of some ops
...
Merge pull request !682 from liuxiao/fix-bug
6 years ago
da5b10b699
!681 add psnr inputs shape and dtype check
...
Merge pull request !681 from zhaozhenlong/psnr-check-same-shape
6 years ago
c88edfb31d
psnr check two input same shape and type
6 years ago
4750861054
fix layernorm bug
6 years ago
348b0ef53c
!344 add prim name to error message for operators in array_ops.py
...
Merge pull request !344 from fary86/add_prim_name_to_error_message_for_array_ops
6 years ago
b84deeeb5c
fix summary tage check error
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
6 years ago
2078229436
Add prim name to error message for array_ops
6 years ago
36a62576e8
support forward graph
6 years ago
5e877a7715
modify api and add example
6 years ago
ad2a5dcad2
!676 [Auto parallel] Add the resnet50 testcase
...
Merge pull request !676 from Xiaoda/add-the-resnet50-testcase
6 years ago
aff6777ecc
fix reviewboot and example of TruncatedNormal and add type mapping
6 years ago
3ff9e54734
add the resnet50 32k-8p testcase
6 years ago
2d115cd04e
Added example for multiple iterator
...
Added new testcase for multi iterator
Addressing review
Fixed typo
6 years ago
56f785f7e6
add context configration
6 years ago
6844ea633d
!56 Synchronization code423 to ms-incubator
...
Merge pull request !56 from changzherui/syn-code423
6 years ago
a02eb240e9
!595 Tensor assign with int or tuple(int) index
...
Merge pull request !595 from candanzg/tensor_assign_with_integer
6 years ago
ce71c17933
!645 auto parallel prelu operator support broadcast
...
Merge pull request !645 from yao_yf/auto_parallel_prelu_support_broadcast
6 years ago
84d5e4f923
!643 [AutoParallel]Support reshape parameter
...
Merge pull request !643 from lichen/support_reshape_parameter
6 years ago
31aae36106
Tensor assign with integer
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
6 years ago
43a8f829a2
!628 fix the infer of TruncatedNormal and a bug of structure output
...
Merge pull request !628 from zhangbuxue/fix_example_for_TruncatedNormal
6 years ago
00859ae119
!586 enable/disable allreduce_fusion
...
Merge pull request !586 from lirongzhen1/allreduce_fusion
6 years ago
2ab211ae04
support reshape parameter
6 years ago
c8a1a24ce3
fix the infer of TruncatedNormal and a bug of structure output and a bug of tensorslice ellipsis
6 years ago
425276d43d
auto parallel prelu support prelu
6 years ago
dfde76af88
delete the 'simplify_cal' attribute in 'set_algo_parameters' and 'get_algo_parameters' interface
6 years ago
4ff418084c
enable/disable allreduce_fusion
6 years ago
d1add07b5a
change error type
6 years ago
1af894e25f
change error type
6 years ago
57bc30505c
change error type
6 years ago
mindspore-ci-bot
Peilin Wang
Tinazhang
jinyaohui
zhouneng
jiangjinsheng
liuwenhao4
yangzhenzhang
Xiaoda Zhang
Mahdi
yangjie159
lichenever
yanghaitao
gengdongjie
wandongdong
fangzehua
Yang
wangnan39@huawei.com
seatea
xiefangqi
lihongkang
kingfo
candanzg
buxue
zhaozhenlong
chenhaozhe
yao_yf
huangdongrun
“liuxiao”
Yi Huaijie
Cathy Wong
panyifeng
liuxiao
heleiwang
hesham
ougongchang
ms_yan
liyong
guohongzilong
zhaojichen
jonwe
Zirui Wu
qianlong
Junhan Hu
xulei2020
Kang
Wei Luning
mindspore-ci-bot
changzherui
jiangzhiwen
fary86
jonyguo
peixu_ren
李鸿章
chenzomi
He Wei
zhousiyi
gongchen
eric
yangyongjie
chenzupeng
Adel Shafiei
Jesse Lee
meixiaowei
zjun
lirongzhen1
rick_sanchez
zhouyuanshen
wenkai