c5ac2cc38c
add memory copy module
5 years ago
f16ff539ba
refactor multiple patterns pass
5 years ago
964a757db2
!1378 Just want to debug this case in Jenkin environment
...
Merge pull request !1378 from JesseKLee/cond_var_debug
5 years ago
06ae724261
Again
5 years ago
458436186c
!1365 Clean up work for text python sub-package
...
Merge pull request !1365 from h.farahat/text_namespace
5 years ago
6f733ec113
!1308 Stage 2 of adding support for string Tensor
...
Merge pull request !1308 from h.farahat/string_tensor2
5 years ago
f967700ef4
!1215 [Auto parallel] Changing succive edges orders and add some strategy checkings
...
Merge pull request !1215 from Xiaoda/change-succive-edges-order-and-add-checking
5 years ago
3363d4e834
!1249 Add GNN dataset processing API
...
Merge pull request !1249 from heleiwang/hlw_gnn_data
5 years ago
6c21e556c4
Clean up work for text python package
5 years ago
4bdfddedb2
!1358 Link child graphs
...
Merge pull request !1358 from zhoufeng/link-child-graph-2
5 years ago
af5019b94f
link child graphs
...
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
5 years ago
599a449e0b
Support processing GNN data
5 years ago
fbdba6e4da
clean pylint
5 years ago
df361d1d26
Change mem layout of string tensor
...
add support for MindRecord and TFRecord
----
optimize tensorshape
optimize tensorshape and FlatIndex
TFRecord and MindRecord support for string tensor
Modify mem layout
Add new constructor
Add method Allocate
Change some GetMutableBuffer usages to AllocateBuffer
5 years ago
9f4b8a3cd1
changing the succive edges order in GetAliveSuccEdges() so that Triangle and Star Elimination can be merged into particular node; adding some check information
5 years ago
d9c74e0acd
!1328 Add 3 patterns support for LambNextMVWithDecay fusion pass
...
Merge pull request !1328 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
5 years ago
2e3d55ed87
!1281 Implementation of SplitOp
...
Merge pull request !1281 from Peilin/splitOp
5 years ago
71e8bb1960
general split case done, chaining sampler (basic case) is working
...
implementation 99% complete
everything and tested except for repeatable shuffling
tested most basic/typical split usecases
cleanup
some more cleanup
fix CI
more ci fix
more ci fixes
more ci fix
more ci fix
more ci fix
added more tests, fixed some bugs
some more clean up and test cases
added shard/shuffle before split warning/error
addressed code review comments and ci
fixed ci
5 years ago
07b14f32b9
!1296 move signature to primitivepy and bprop_func to utils
...
Merge pull request !1296 from leopz/fix_primitive
5 years ago
eaff850f11
add 3 patterns for lamb_next_mv_with_decay_rule pass
5 years ago
e4795974be
!1266 Refactor LambNextMVWithDecayRule fusion pass
...
Merge pull request !1266 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
5 years ago
5a68eba585
Refactor LambNextMVWithDecayRule fusion pass
5 years ago
451c20a6f5
Add UnicodeCharTokenizer for nlp
5 years ago
04763b8b76
move signature to primitivepy and bprop_func to utils
5 years ago
163b6b7ea7
add jieba c++ code
5 years ago
97ba539e7b
!1269 fix issue of loadding control input tensors failed in control sink mode
...
Merge pull request !1269 from wenchunjiang/fix_task_sink_bug
5 years ago
729ea8cc55
fix bug of loadding ctrl input tensors failed in control sink mode
5 years ago
04ac611fe8
!1189 Decoupling py default param from Parameter
...
Merge pull request !1189 from leopz/master
5 years ago
40e15996b0
move default_param out of parameter and remove pybind11 in anf define
5 years ago
3db8cfa54f
add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try
5 years ago
c793540cc9
!1231 Assign label resource for new control sink
...
Merge pull request !1231 from zhoufeng/label-assign
5 years ago
c99f904276
assign label resource for new control sink
...
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
5 years ago
828d0b124e
!1209 add format trans function
...
Merge pull request !1209 from liubuyu/master
5 years ago
1b7cdc4c61
!1218 clean pylint warning in test about import
...
Merge pull request !1218 from jinyaohui/pylint1
5 years ago
f70429d671
add format transfer
5 years ago
c8d33568f2
Add an new output to FusedMulApplyMomentum
5 years ago
5a914994ba
clean pylint
5 years ago
c4af71e236
add LarsV2 fission pass
5 years ago
bcfaff97f9
clean pylint
5 years ago
e8ca243364
-Add DE_STRING
...
-replace switch'case by indexing
- Add test case
- Add constructors
- Add getItem string
- Fix bugs
- Add more tests
- Tensor iterator
- asNumpy
- TextFileDataset
- Tensor(Numpy)
- Super > 2D
- Add more test cases for GeneratorDataset
- Change StartAddr to GetBuffer and GetMutableNuffer
- Raise an error if batch is used with strings
Clean-up work
5 years ago
ca64bfdbab
!1120 Code refactoring ：modify Infer to Eval
...
Merge pull request !1120 from Kang/master
5 years ago
889d7b6eea
!1180 [pre_activate]Fix pylint warning
...
Merge pull request !1180 from YuJianfeng/master
5 years ago
efb9672849
!1118 Add BatchNormGrad2BNInferGrad pass
...
Merge pull request !1118 from huanghui/batchnormgrad-to-bninfergrad-pass
5 years ago
c680cfbf27
!1157 dataset: add concat operation for dataset
...
Merge pull request !1157 from ms_yan/concat_dataset
5 years ago
ab031ee9ea
!1126 VOCDataset support object detection function
...
Merge pull request !1126 from xiefangqi/voc_support_detection
5 years ago
0f42fdbb80
Fix pylint warning
5 years ago
709828a98b
add BatchNormGrad2BNInferGrad pass
5 years ago
42ba885e58
!1098 Add BatchNorm2BNInfer pass
...
Merge pull request !1098 from huanghui/add-batchnorm-bninfer-pass
5 years ago
c937bad53f
minddata support voc
5 years ago
c0fa7b4b19
init commit of concat dataset
...
change to use __add__ operation instead ds.concat
5 years ago
be60bd3d79
Code refactoring for the static_analysis : modified Infer to Eval.
5 years ago
6db71e6576
add batchnorm2bninfer pass
5 years ago
2b061c84c7
Add batch_norm_grad infer fisson
5 years ago
597933b04b
!1113 rename kernel/mng to kernel/rts
...
Merge pull request !1113 from dengwentao/rts
5 years ago
6e89ebe6f0
Add BatchNorm fusion pattern with mix precision
5 years ago
4bb46606db
!1149 fix pylint in tests
...
Merge pull request !1149 from panyifeng/fix_pylint
5 years ago
755ba75deb
fix pylint
5 years ago
c4a5bfb787
add matmul eltwise buffer fusion pass
5 years ago
9e116e15fb
!1139 Change Thread::Join to async call with time out
...
Merge pull request !1139 from JesseKLee/timing_hole
5 years ago
1a052f7155
!1131 [Data]fix cmake build format
...
Merge pull request !1131 from xulei/filter_op
5 years ago
f2be49d85e
Fix a racing condition
5 years ago
903b64daa2
fix cmake build format
5 years ago
8b98f921cc
!1124 Add broadcast fusion pass
...
Merge pull request !1124 from YuJianfeng/master
5 years ago
fa83fc3e02
rename kernel/mng to kernel/rts
5 years ago
1a98c6b459
!999 [MD] mindrecord support reading file list
...
Merge pull request !999 from liyong126/mindrecord_file_list
5 years ago
31d8db9fc6
Add broadcast fusion pass
5 years ago
86d4797399
!1079 Convert AiCpu kernel when aicore not supported
...
Merge pull request !1079 from lianliguang/convert-to-AICPU-when-AiCore-not-supported-kernel
5 years ago
aa3f89e74f
mindrecord support read file list
5 years ago
691b0648e3
convert unsupported kernel in aicore to aicpu
5 years ago
85ff90c237
Add input shape condition for transpose_reshape fusion pass
5 years ago
3c643e7298
Move from dataset_dev branch to here
5 years ago
3f323e48e2
Add submodule id for log interface
5 years ago
f0bf438a55
reshape strategy search
5 years ago
9433ca6468
!998 format the func name
...
Merge pull request !998 from guozhijian/enhance_format_func_name
5 years ago
cf352d190f
format func name for mindrecord
5 years ago
12eaaf710b
mul_add_fusion pass supports when add's 2nd is mul
5 years ago
c2d364a573
batch with padding implemented
...
support for 1 specific dimension to be None, added validator
fix various CI complains
another round of CI fixes
ci
refactor parts of the code
code refactor
ci fix
comments added, fix bugs
address review comments
address review comments
review cmts
added simple perf test script
update pad code
perf imprv
5 years ago
def8573275
implementing-searching-strategy-for-inference
5 years ago
aa6f808616
Add batch norm bert fission pass
5 years ago
9a2daae84c
del unused change_mode_op
5 years ago
99c9b48a4d
delete TestHWBatchNormGradSplit
5 years ago
b323199dc1
syn code 430
5 years ago
7185961e89
Enable BatchNorm fusion pass
5 years ago
db3dd02838
!847 Optimize the collectors in manager which listen to the graphs and nodes changes.
...
Merge pull request !847 from ZhangQinghua/opt
5 years ago
2303453753
!869 Random data op
...
Merge pull request !869 from JesseKLee/random_data_op
5 years ago
732c7f8266
!794 fix issues image gradients 4d check
...
Merge pull request !794 from zhaozhenlong/fix-issues-image-gradients-complement-check
5 years ago
270bf831a9
Random Data Op
5 years ago
98939d839c
!856 Fix skip op bug
...
Merge pull request !856 from jiangzhiwen/dataset/skip_thread
5 years ago
66e7a36846
ImageGradients check 4d
...
fix DiagPart constant folding issue
fix argmin output type check
fix atan2 doc error
fix remove FusedBatchNorm and its grad
5 years ago
34bfa2f7c9
fix skip
5 years ago
a22a4a57c2
Modify UT case after adjust the collectors of manager.
5 years ago
0de0aee54e
Add BatchNormGrad split pass
5 years ago
332398d20a
Check return code from WaitPost::Register
5 years ago
6cde5f6d91
auto parallel strategy checkpoint
5 years ago
e6f36e050f
change cpu kernel dir
5 years ago
e537a70808
!657 Fix confusionmulgrad fusion pass cannot work
...
Merge pull request !657 from huanghui/fix-confusionmulgrad-fusion-pass
5 years ago
3d9f1087c6
!695 Check topk supported before converting input to attr
...
Merge pull request !695 from YuJianfeng/master
5 years ago
ce2a13fcda
Check topk supported before converting input to attr
5 years ago
fb5cfe31d5
!430 add buffer fusion bnupdate eltwise pass
...
Merge pull request !430 from Etone.Chan/bufferfusion
5 years ago
d2727d0504
add buffer fusion bnupdate eltwise pass
5 years ago
230e77f923
fix confusionmulgrad fusion pass cannot work
5 years ago
9e29224af9
move add_memcpy_async pass and transdata_split pass
5 years ago
f305d6f8a7
Revert "add pattern AdjustAllReduceMulAdd"
...
This reverts commit ea6958c50a
5 years ago
89f82e1a37
fix cpp ut test TestConvertConvBackpropFilter
5 years ago
53d2da5fe4
!264 static_analysis: remove useless cache in TrivialPrimEvaluator and add cache for PythonPrimEvaluator
...
Merge pull request !264 from xychow/remove-unnecessary-cache-and-add-cache
5 years ago
2440cea732
!621 [MD] adjust mindrecord ut
...
Merge pull request !621 from liyong126/mindrecord_ut
5 years ago
928dcf4ec4
!554 Fix derelu fusion pass
...
Merge pull request !554 from huanghui/fix_derelu_fusion_pass
5 years ago
1f222ddb9e
fix mindrecord c ut
5 years ago
cd6e8d6542
fix ReluV2's mask shape in derelu fusion pass
5 years ago
4a3e5cb944
!492 Add AllGather fusion pass
...
Merge pull request !492 from YuJianfeng/allgather
5 years ago
54e0fa5c09
!556 [Auto Parallel] use DeviceMemory instead of fixed-size memory check
...
Merge pull request !556 from Chong/partition
5 years ago
39945d0f79
Add AllGather fusion pass
5 years ago
f806b72447
use DeviceMemory for memory control
5 years ago
f6a4f3d155
[static_analysis]: remove the TrivialPrimEvaluator cache.
...
add cache for PythonPrimEvaluator. Be careful that
the infer function of PythonPrimitive in python code should
be idempotent.
5 years ago
14df771175
fix confusion_softmax_grad_rule pass
5 years ago
3c1785a121
syn code
5 years ago
672244e0ac
add keep_bn_fp32 parameter
5 years ago
2dabcb9e59
!41 Synchronization code to ms-incubator
...
Merge pull request !41 from changzherui/syn-code
5 years ago
ac25cbae0e
Revert "add pattern AdjustAllReduceMulAdd"
...
This reverts commit d447364417
5 years ago
d99dfbd83d
!390 getnext parallel optimization part III & IV: Loop Control & Stream Dispatch adaptation
...
Merge pull request !390 from gukecai/master
5 years ago
f8208c7c52
Support GetNext Parallel
5 years ago
f1542a90a3
add pk sampler
5 years ago
6369cf27bd
!406 added first row crc check for when reading tfrecord files
...
Merge pull request !406 from Peilin/first-row-crc-check
5 years ago
c705ea5e5b
add filterOp code
5 years ago
9bc2134cb7
added checking of first row crc to find invalid tfrecord files
...
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file
fixed clang format
fixed cppcheck
fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before
fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments
more clang whitespace fixes...
changed print to logger.info
5 years ago
d8176a77f4
!425 New api "TextFileDataset"
...
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
5 years ago
11a4b35caa
!472 Fix inputs size and attr for AddN fission pass
...
Merge pull request !472 from YuJianfeng/master
5 years ago
c5cfb09e66
Repair some MS_LOG problem
5 years ago
679dbd27b3
!478 fix save_graphs_path and log file mode related issues
...
Merge pull request !478 from fary86/fix_log_and_ir_issues
5 years ago
7e23a1a475
Fix issues of save_graphs_path, Type/Value error message and log file mode
5 years ago
bc2df2c913
Fix inputs size and attr for AddN fission pass
5 years ago
2795e492ff
TextFileDataset
5 years ago
3822b4837f
!340 Add a HistogramSummary ops to record tensor value
...
Merge pull request !340 from ougongchang/master
5 years ago
d447364417
add pattern AdjustAllReduceMulAdd
5 years ago
f0c07c3fa6
Realize take op and add ut
5 years ago
71b63c3fcf
!246 [opt pass] AdjustAllReduceMulAdd
...
Merge pull request !246 from vlne-v1/I1E3PI-opt-pass-adjust-allreduce-apply-weight-decy-seq
5 years ago
ea6958c50a
add pattern AdjustAllReduceMulAdd
5 years ago
5eb5379889
Add AdamApplyOne fusion pass
5 years ago
0ed6d9178e
add Histogram summary operator
...
clean clang format errors and cpplint errors
add some test cases for histogram summary operator
5 years ago
3f7054dccb
add skip dataset op
5 years ago
f69a668d98
!350 change tuple output to make tuple
...
Merge pull request !350 from lianliguang/chang-tuple-output-to-make-tuple
5 years ago
00e4306518
convert all tuple output to maketuple
5 years ago
f98efafa16
!317 [IRFusion] add derelu_fusion pass
...
Merge pull request !317 from huanghui/derelu_fusion_pass
5 years ago
cf026096a6
!183 Mindspore.dataset CPP sampler for GeneratorDataset
...
Merge pull request !183 from JunhanHu/cpp_sampler
5 years ago
ee5f3fa240
add pass to insert memcpy_async for get_next outputs
5 years ago
58a70b5f82
!346 getnext parallel optimization part II: Eliminate Memcpy in specify scenario
...
Merge pull request !346 from laiyongqiang/develop
5 years ago
3e05f50f5f
getnext_memcpy_elimination
5 years ago
6d522f0a4f
add parallel op for layernorm
5 years ago
b02e871c1a
[IRFusion] add derelu_fusion pass
5 years ago
9739d3b048
Add CPP sampler support for GeneratorDataset
5 years ago
lizhenyu
huanghui
mindspore-ci-bot
Jesse Lee
hesham
zhoufeng
heleiwang
jinyaohui
Xiaoda Zhang
Peilin Wang
qianlong
leopz
xulei2020
wenchunjiang
Wei Luning
liubuyu
yujianfeng
mindspore-ci-bot
xiefangqi
ms_yan
Kang
panyifeng
etone-chan
dengwentao
liyong
WilliamLian
fary86
yao_yf
jonyguo
Zirui Wu
changzherui
zhaozhenlong
jiangzhiwen
Zhang Qinghua
kswang
ch-l
zhousiyi
chang zherui
gukecai
yanghaitao
ougongchang
jzw
laiyongqiang
yangzhenzhang
Junhan Hu