bcfaff97f9
clean pylint
5 years ago
e8ca243364
-Add DE_STRING
...
-replace switch'case by indexing
- Add test case
- Add constructors
- Add getItem string
- Fix bugs
- Add more tests
- Tensor iterator
- asNumpy
- TextFileDataset
- Tensor(Numpy)
- Super > 2D
- Add more test cases for GeneratorDataset
- Change StartAddr to GetBuffer and GetMutableNuffer
- Raise an error if batch is used with strings
Clean-up work
5 years ago
ca64bfdbab
!1120 Code refactoring ：modify Infer to Eval
...
Merge pull request !1120 from Kang/master
5 years ago
889d7b6eea
!1180 [pre_activate]Fix pylint warning
...
Merge pull request !1180 from YuJianfeng/master
5 years ago
efb9672849
!1118 Add BatchNormGrad2BNInferGrad pass
...
Merge pull request !1118 from huanghui/batchnormgrad-to-bninfergrad-pass
5 years ago
c680cfbf27
!1157 dataset: add concat operation for dataset
...
Merge pull request !1157 from ms_yan/concat_dataset
5 years ago
ab031ee9ea
!1126 VOCDataset support object detection function
...
Merge pull request !1126 from xiefangqi/voc_support_detection
5 years ago
0f42fdbb80
Fix pylint warning
5 years ago
709828a98b
add BatchNormGrad2BNInferGrad pass
5 years ago
42ba885e58
!1098 Add BatchNorm2BNInfer pass
...
Merge pull request !1098 from huanghui/add-batchnorm-bninfer-pass
5 years ago
c937bad53f
minddata support voc
5 years ago
c0fa7b4b19
init commit of concat dataset
...
change to use __add__ operation instead ds.concat
5 years ago
be60bd3d79
Code refactoring for the static_analysis : modified Infer to Eval.
5 years ago
6db71e6576
add batchnorm2bninfer pass
5 years ago
2b061c84c7
Add batch_norm_grad infer fisson
5 years ago
597933b04b
!1113 rename kernel/mng to kernel/rts
...
Merge pull request !1113 from dengwentao/rts
5 years ago
6e89ebe6f0
Add BatchNorm fusion pattern with mix precision
5 years ago
4bb46606db
!1149 fix pylint in tests
...
Merge pull request !1149 from panyifeng/fix_pylint
5 years ago
755ba75deb
fix pylint
5 years ago
c4a5bfb787
add matmul eltwise buffer fusion pass
5 years ago
9e116e15fb
!1139 Change Thread::Join to async call with time out
...
Merge pull request !1139 from JesseKLee/timing_hole
5 years ago
1a052f7155
!1131 [Data]fix cmake build format
...
Merge pull request !1131 from xulei/filter_op
5 years ago
f2be49d85e
Fix a racing condition
5 years ago
903b64daa2
fix cmake build format
5 years ago
8b98f921cc
!1124 Add broadcast fusion pass
...
Merge pull request !1124 from YuJianfeng/master
5 years ago
fa83fc3e02
rename kernel/mng to kernel/rts
5 years ago
1a98c6b459
!999 [MD] mindrecord support reading file list
...
Merge pull request !999 from liyong126/mindrecord_file_list
5 years ago
31d8db9fc6
Add broadcast fusion pass
5 years ago
86d4797399
!1079 Convert AiCpu kernel when aicore not supported
...
Merge pull request !1079 from lianliguang/convert-to-AICPU-when-AiCore-not-supported-kernel
5 years ago
aa3f89e74f
mindrecord support read file list
5 years ago
691b0648e3
convert unsupported kernel in aicore to aicpu
5 years ago
85ff90c237
Add input shape condition for transpose_reshape fusion pass
5 years ago
3c643e7298
Move from dataset_dev branch to here
5 years ago
3f323e48e2
Add submodule id for log interface
5 years ago
f0bf438a55
reshape strategy search
5 years ago
9433ca6468
!998 format the func name
...
Merge pull request !998 from guozhijian/enhance_format_func_name
5 years ago
cf352d190f
format func name for mindrecord
5 years ago
12eaaf710b
mul_add_fusion pass supports when add's 2nd is mul
5 years ago
c2d364a573
batch with padding implemented
...
support for 1 specific dimension to be None, added validator
fix various CI complains
another round of CI fixes
ci
refactor parts of the code
code refactor
ci fix
comments added, fix bugs
address review comments
address review comments
review cmts
added simple perf test script
update pad code
perf imprv
5 years ago
def8573275
implementing-searching-strategy-for-inference
5 years ago
aa6f808616
Add batch norm bert fission pass
5 years ago
9a2daae84c
del unused change_mode_op
5 years ago
99c9b48a4d
delete TestHWBatchNormGradSplit
5 years ago
b323199dc1
syn code 430
5 years ago
7185961e89
Enable BatchNorm fusion pass
5 years ago
db3dd02838
!847 Optimize the collectors in manager which listen to the graphs and nodes changes.
...
Merge pull request !847 from ZhangQinghua/opt
5 years ago
2303453753
!869 Random data op
...
Merge pull request !869 from JesseKLee/random_data_op
5 years ago
732c7f8266
!794 fix issues image gradients 4d check
...
Merge pull request !794 from zhaozhenlong/fix-issues-image-gradients-complement-check
5 years ago
270bf831a9
Random Data Op
5 years ago
98939d839c
!856 Fix skip op bug
...
Merge pull request !856 from jiangzhiwen/dataset/skip_thread
5 years ago
66e7a36846
ImageGradients check 4d
...
fix DiagPart constant folding issue
fix argmin output type check
fix atan2 doc error
fix remove FusedBatchNorm and its grad
5 years ago
34bfa2f7c9
fix skip
5 years ago
a22a4a57c2
Modify UT case after adjust the collectors of manager.
5 years ago
0de0aee54e
Add BatchNormGrad split pass
5 years ago
332398d20a
Check return code from WaitPost::Register
5 years ago
6cde5f6d91
auto parallel strategy checkpoint
5 years ago
e6f36e050f
change cpu kernel dir
5 years ago
e537a70808
!657 Fix confusionmulgrad fusion pass cannot work
...
Merge pull request !657 from huanghui/fix-confusionmulgrad-fusion-pass
5 years ago
3d9f1087c6
!695 Check topk supported before converting input to attr
...
Merge pull request !695 from YuJianfeng/master
5 years ago
ce2a13fcda
Check topk supported before converting input to attr
5 years ago
fb5cfe31d5
!430 add buffer fusion bnupdate eltwise pass
...
Merge pull request !430 from Etone.Chan/bufferfusion
5 years ago
d2727d0504
add buffer fusion bnupdate eltwise pass
5 years ago
230e77f923
fix confusionmulgrad fusion pass cannot work
5 years ago
9e29224af9
move add_memcpy_async pass and transdata_split pass
5 years ago
f305d6f8a7
Revert "add pattern AdjustAllReduceMulAdd"
...
This reverts commit ea6958c50a
5 years ago
89f82e1a37
fix cpp ut test TestConvertConvBackpropFilter
5 years ago
53d2da5fe4
!264 static_analysis: remove useless cache in TrivialPrimEvaluator and add cache for PythonPrimEvaluator
...
Merge pull request !264 from xychow/remove-unnecessary-cache-and-add-cache
5 years ago
2440cea732
!621 [MD] adjust mindrecord ut
...
Merge pull request !621 from liyong126/mindrecord_ut
5 years ago
928dcf4ec4
!554 Fix derelu fusion pass
...
Merge pull request !554 from huanghui/fix_derelu_fusion_pass
5 years ago
1f222ddb9e
fix mindrecord c ut
5 years ago
cd6e8d6542
fix ReluV2's mask shape in derelu fusion pass
5 years ago
4a3e5cb944
!492 Add AllGather fusion pass
...
Merge pull request !492 from YuJianfeng/allgather
5 years ago
54e0fa5c09
!556 [Auto Parallel] use DeviceMemory instead of fixed-size memory check
...
Merge pull request !556 from Chong/partition
5 years ago
39945d0f79
Add AllGather fusion pass
5 years ago
f806b72447
use DeviceMemory for memory control
5 years ago
f6a4f3d155
[static_analysis]: remove the TrivialPrimEvaluator cache.
...
add cache for PythonPrimEvaluator. Be careful that
the infer function of PythonPrimitive in python code should
be idempotent.
5 years ago
14df771175
fix confusion_softmax_grad_rule pass
5 years ago
3c1785a121
syn code
5 years ago
672244e0ac
add keep_bn_fp32 parameter
5 years ago
2dabcb9e59
!41 Synchronization code to ms-incubator
...
Merge pull request !41 from changzherui/syn-code
5 years ago
ac25cbae0e
Revert "add pattern AdjustAllReduceMulAdd"
...
This reverts commit d447364417
5 years ago
d99dfbd83d
!390 getnext parallel optimization part III & IV: Loop Control & Stream Dispatch adaptation
...
Merge pull request !390 from gukecai/master
5 years ago
f8208c7c52
Support GetNext Parallel
5 years ago
f1542a90a3
add pk sampler
5 years ago
6369cf27bd
!406 added first row crc check for when reading tfrecord files
...
Merge pull request !406 from Peilin/first-row-crc-check
5 years ago
c705ea5e5b
add filterOp code
5 years ago
9bc2134cb7
added checking of first row crc to find invalid tfrecord files
...
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file
fixed clang format
fixed cppcheck
fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before
fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments
more clang whitespace fixes...
changed print to logger.info
5 years ago
d8176a77f4
!425 New api "TextFileDataset"
...
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
5 years ago
11a4b35caa
!472 Fix inputs size and attr for AddN fission pass
...
Merge pull request !472 from YuJianfeng/master
5 years ago
c5cfb09e66
Repair some MS_LOG problem
5 years ago
679dbd27b3
!478 fix save_graphs_path and log file mode related issues
...
Merge pull request !478 from fary86/fix_log_and_ir_issues
5 years ago
7e23a1a475
Fix issues of save_graphs_path, Type/Value error message and log file mode
5 years ago
bc2df2c913
Fix inputs size and attr for AddN fission pass
5 years ago
2795e492ff
TextFileDataset
5 years ago
3822b4837f
!340 Add a HistogramSummary ops to record tensor value
...
Merge pull request !340 from ougongchang/master
5 years ago
d447364417
add pattern AdjustAllReduceMulAdd
5 years ago
f0c07c3fa6
Realize take op and add ut
5 years ago
71b63c3fcf
!246 [opt pass] AdjustAllReduceMulAdd
...
Merge pull request !246 from vlne-v1/I1E3PI-opt-pass-adjust-allreduce-apply-weight-decy-seq
5 years ago
ea6958c50a
add pattern AdjustAllReduceMulAdd
5 years ago
5eb5379889
Add AdamApplyOne fusion pass
5 years ago
0ed6d9178e
add Histogram summary operator
...
clean clang format errors and cpplint errors
add some test cases for histogram summary operator
5 years ago
3f7054dccb
add skip dataset op
5 years ago
f69a668d98
!350 change tuple output to make tuple
...
Merge pull request !350 from lianliguang/chang-tuple-output-to-make-tuple
5 years ago
00e4306518
convert all tuple output to maketuple
5 years ago
f98efafa16
!317 [IRFusion] add derelu_fusion pass
...
Merge pull request !317 from huanghui/derelu_fusion_pass
5 years ago
cf026096a6
!183 Mindspore.dataset CPP sampler for GeneratorDataset
...
Merge pull request !183 from JunhanHu/cpp_sampler
5 years ago
ee5f3fa240
add pass to insert memcpy_async for get_next outputs
5 years ago
58a70b5f82
!346 getnext parallel optimization part II: Eliminate Memcpy in specify scenario
...
Merge pull request !346 from laiyongqiang/develop
5 years ago
3e05f50f5f
getnext_memcpy_elimination
5 years ago
6d522f0a4f
add parallel op for layernorm
5 years ago
b02e871c1a
[IRFusion] add derelu_fusion pass
5 years ago
9739d3b048
Add CPP sampler support for GeneratorDataset
5 years ago
30de261c3c
!243 Support nested repeat
...
Merge pull request !243 from h.farahat/nested_repeat
5 years ago
0fc23eee0f
Support nested repeat
5 years ago
b571fabd77
!289 Add cnode mapping after graph match
...
Merge pull request !289 from YuJianfeng/find_op
5 years ago
e5c67b9088
Add cnode to equal map when opt matching
5 years ago
9bda080bb5
!260 refactor padding strategy
...
Merge pull request !260 from lianliguang/refactor-padding-strategy
5 years ago
1ab430072e
!232 [Auto parallel] Model the memory_cost in cost model
...
Merge pull request !232 from Xiaoda/model-memory-cost-in-auto-parallel
5 years ago
94589ce611
!226 expend conv stride and dilation to 2d
...
Merge pull request !226 from wangnan39/expend_conv_stride_to_2d
5 years ago
2604acedcb
extend conv stride and dilation to 2d
5 years ago
5d225f934f
change the padding strategy & refactor insert transdata
5 years ago
0ac50a19f5
Model the memory cost in auto-parallel. It is calculated by the output of operators, plus the parameters. Additionally, modify the graph-operations in auto_parallel to include memory_cost.
5 years ago
f1fa2a9941
!273 [MD] update subset random sampler in minddataset
...
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
5 years ago
298a32f1e2
!132 Add confusion_mul_grad_fusion pass
...
Merge pull request !132 from huanghui/master
5 years ago
0ce83e39e1
fix TestShardSampleWrongNumber
...
adjust internal api
5 years ago
57f953ca38
!216 Implement addn fusion pass
...
Merge pull request !216 from YuJianfeng/master
5 years ago
19ee376cd3
add confusion_mul_grad fusion pass
5 years ago
d62f560b50
add_bool_type_check_in_comm_op
5 years ago
7307c81f31
implement AddN fission pass
5 years ago
6a79fc1735
skip mindrecord ut test case
5 years ago
5841fe010e
Support pow's second input could be tensor and fix bug in bprop of pow
5 years ago
b34c0e7a17
add parallel op for dropoutdomask
5 years ago
a9443635b7
fix: mindpage enhance parameter check and search by filename failed
5 years ago
53a98210af
skip ut test cases temporarily
5 years ago
406475160f
refactor OperatorCostPtr in OperatorInfo
5 years ago
cc1416bfc2
constant duplicate mul for momentum
5 years ago
a6747c522f
add ascend mem pool
5 years ago
513f384c43
fix auto parallel prelu
5 years ago
d84cfb0108
add mem manager
5 years ago
6d1ea7af8e
remove make_unique.h
5 years ago
6690a7fd7a
fix: error info is not exactly when column list invalid
5 years ago
89f0b3b1bb
profiling feature enhancement
5 years ago
7798c85e70
This commit is to separate the computation cost and memory cost in auto_parallel. Some related memory correction is removed.
5 years ago
f01098bc12
remove ENABLE_MINDRECORD flag
5 years ago
b9701db887
fix RandomCropDecodeResize test
5 years ago
268d358a1d
!187 refactor OperatorCostPtr in OperatorInfo
...
Merge pull request !187 from chentingting/refactor_OperatorCostPtr_in_OperatorInfo
5 years ago
1b3b3b1a1c
!198 [opt] momentum duplicate mul constant
...
Merge pull request !198 from biffex/momentum-duplicate-mul-constant
5 years ago
62bbf560c6
constant duplicate mul for momentum
5 years ago
b413638f23
refactor OperatorCostPtr in OperatorInfo
5 years ago
bef62db128
add ascend mem pool
5 years ago
2e6e94b2b6
!177 prelu operator support parallel on the channel
...
Merge pull request !177 from yao_yf/fix_auto_parallel_prelu
5 years ago
31efc8b088
!172 add mem manager
...
Merge pull request !172 from kisnwang/add-resource-manager
5 years ago
fb343bd607
add mem manager
5 years ago
1d3bb0b731
Develop op MaxPoolWithArgMax
5 years ago
cc75cb357c
!168 remove mindspore::make_unique and make_unique.h
...
Merge pull request !168 from Alexey_Shevlyakov/remove_mindspore_make_unique
5 years ago
3e36982314
!99 Develop op MaxPoolWithArgMax
...
Merge pull request !99 from zhangbuxue/Dock_MaxPoolWithArgMax
5 years ago
68f804255f
!174 enhance: the error info is not detail when the column list is invalid by MindDataset
...
Merge pull request !174 from guozhijian/fix_false_error_info
5 years ago
7541d3b067
Develop op MaxPoolWithArgMax
5 years ago
b5e3fa9593
fix auto parallel prelu
5 years ago
cdbef85e5e
refactor callback for ge backend
5 years ago
d12a720fc5
add comparison ops
...
fix pylint
use scalar_lt primitive directly
fix review
5 years ago
024706f951
Optimize depend edge with make tuple input
5 years ago
b18f634912
remove ge depend in cpu
5 years ago
73e0bdcd43
Dump graph with type info when static analysis failed
5 years ago
c4b03e854c
use std::vector instead of std::list to promote performance for parallel module
5 years ago
2fd7f67108
Add matmul biasadd fusion pass
5 years ago
295c00ac39
Replace std::cout with MS_LOG in dataset unit test
...
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
5 years ago
2eb71103f9
!82 profiling feature enhancement
...
Merge pull request !82 from caifubi/dev-profiling
5 years ago
20d1b64443
fix: error info is not exactly when column list invalid
5 years ago
effdb483d6
profiling feature enhancement
5 years ago
a153fad874
This commit is to separate the computation cost and memory cost in auto_parallel. Some related memory correction is removed.
5 years ago
9d0fde29f4
remove ENABLE_MINDRECORD flag
5 years ago
84d780c1a4
remove make_unique.h
5 years ago
a4b9f8a728
!120 Fix test for RandomCropDecodeResizeOp.
...
Merge pull request !120 from Alexey_Shevlyakov/master
5 years ago
3202fc0df9
refactor callback for ge backend
5 years ago
d37b8c4f2d
fix RandomCropDecodeResize test
5 years ago
a5d95e472e
!106 support comparison ops for python
...
Merge pull request !106 from amongo/SupportPythonOperators
5 years ago
461d8e3a08
add comparison ops
...
fix pylint
use scalar_lt primitive directly
fix review
5 years ago
9be1a01db6
!85 Optimize depend edge with make tuple input
...
Merge pull request !85 from YuJianfeng/master
5 years ago
73ba399364
remove ge depend in cpu
5 years ago
7f53bb062d
Optimize depend edge with make tuple input
5 years ago
52166a85cf
!43 dump graph with type info when analysis failed
...
Merge pull request !43 from fary86/dump-typed-graph-when-analyze-fail
5 years ago
816b60491d
Dump graph with type info when static analysis failed
5 years ago
da447b8d4d
!45 use std::vector instead of std::list to promote performance for parallel module
...
Merge pull request !45 from chentingting/permote_auto_prallel_performance
5 years ago
3bb48ffee1
use std::vector instead of std::list to promote performance for parallel module
5 years ago
976226f9ac
!10 Add matmul biasadd fusion pass
...
Merge pull request !10 from YuJianfeng/master
5 years ago
080bcda021
Replace std::cout with MS_LOG in dataset unit test
...
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
5 years ago
468dbc3557
Add matmul biasadd fusion pass
5 years ago
930a1fb0a8
initial version
...
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
5 years ago
jinyaohui
hesham
mindspore-ci-bot
yujianfeng
huanghui
xiefangqi
ms_yan
Kang
panyifeng
etone-chan
Jesse Lee
xulei2020
dengwentao
liyong
WilliamLian
fary86
yao_yf
jonyguo
Zirui Wu
Xiaoda Zhang
changzherui
zhaozhenlong
jiangzhiwen
Zhang Qinghua
kswang
Wei Luning
ch-l
zhousiyi
chang zherui
liubuyu
gukecai
Peilin Wang
yanghaitao
ougongchang
jzw
wenchunjiang
laiyongqiang
yangzhenzhang
Junhan Hu
wangnan39@huawei.com
c00425699
panfengfeng
buxue
biffex
Alexey Shevlyakov
jojobugfree
Jonathan Yan
kingfo
huangdongrun
Wei Luning
zhunaipan