53d2da5fe4
!264 static_analysis: remove useless cache in TrivialPrimEvaluator and add cache for PythonPrimEvaluator
...
Merge pull request !264 from xychow/remove-unnecessary-cache-and-add-cache
5 years ago
2440cea732
!621 [MD] adjust mindrecord ut
...
Merge pull request !621 from liyong126/mindrecord_ut
5 years ago
928dcf4ec4
!554 Fix derelu fusion pass
...
Merge pull request !554 from huanghui/fix_derelu_fusion_pass
5 years ago
d1add07b5a
change error type
5 years ago
1f222ddb9e
fix mindrecord c ut
5 years ago
cd6e8d6542
fix ReluV2's mask shape in derelu fusion pass
5 years ago
1af894e25f
change error type
5 years ago
4a3e5cb944
!492 Add AllGather fusion pass
...
Merge pull request !492 from YuJianfeng/allgather
5 years ago
54e0fa5c09
!556 [Auto Parallel] use DeviceMemory instead of fixed-size memory check
...
Merge pull request !556 from Chong/partition
5 years ago
57bc30505c
change error type
5 years ago
ad75618ca6
!611 change error message type
...
Merge pull request !611 from JichenZhao/errormsg
5 years ago
5034bc10ce
!612 Bugfix: correct wrong pattern of confusion_softmax_grad_rule pass
...
Merge pull request !612 from huanghui/fix-confusion-softmax-grad-rule-pass
5 years ago
39945d0f79
Add AllGather fusion pass
5 years ago
bd13f9ba33
modify ResizeNearestNeighborV2D
5 years ago
f806b72447
use DeviceMemory for memory control
5 years ago
2d6c703794
!582 Add gpu test case for dynamic lr.
...
Merge pull request !582 from ZPaC/add-dynamic-lr-in-nccl-case
5 years ago
8963e39516
change error type
5 years ago
f6a4f3d155
[static_analysis]: remove the TrivialPrimEvaluator cache.
...
add cache for PythonPrimEvaluator. Be careful that
the infer function of PythonPrimitive in python code should
be idempotent.
5 years ago
14df771175
fix confusion_softmax_grad_rule pass
5 years ago
5ac07bb695
!504 Support Tensor assign A[slice] = u
...
Merge pull request !504 from candanzg/tensor_assign_with_slice
5 years ago
75381bc30c
Add gpu test case for dynamic lr.
5 years ago
3c1785a121
syn code
5 years ago
663d597330
tensor assign with slice index
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
672244e0ac
add keep_bn_fp32 parameter
5 years ago
0bf6717e9a
!454 Fix the check of bool type in auto cast
...
Merge pull request !454 from candanzg/bug_cast_op
5 years ago
2dabcb9e59
!41 Synchronization code to ms-incubator
...
Merge pull request !41 from changzherui/syn-code
5 years ago
ac25cbae0e
Revert "add pattern AdjustAllReduceMulAdd"
...
This reverts commit d447364417
5 years ago
5cf09405e2
!532 [AutoParallel]support multiple subgraphs
...
Merge pull request !532 from lichen/support_multiple_subgraphs_in_auto_parallel
5 years ago
a9e9266149
Deepcopy problem when pyfunc cannot be pickled
5 years ago
c0825e18a7
!588 Add ReluV2/ReluGradV2/ConfusionMulGrad ops for VM
...
Merge pull request !588 from liuxiao/add-reluv2
5 years ago
0a6caa8623
!578 Rename davinci to ascend in ops st test module
...
Merge pull request !578 from leonwanghui/rename
5 years ago
a78420b730
!577 Fix pylint warnings in mindspore st test module
...
Merge pull request !577 from leonwanghui/st-fix
5 years ago
b6e77e5178
Add ReluV2/ReluGradV2/ConfusionMulGrad for VM
5 years ago
1a0d2666b7
!559 Add Fill/Erf op for VM.
...
Merge pull request !559 from liuxiao/fill-op
5 years ago
818acd46d4
!569 fix bug in checkpoint when save scaler
...
Merge pull request !569 from wangnan39/master
5 years ago
c78630d737
support multiple subgraphs
5 years ago
ba43dbc148
Fix pylint warnings in mindspore st test module
5 years ago
ca3aa6071a
!527 gpu dynamic memory pool supports multi-allReduce
...
Merge pull request !527 from limingqi107/master
5 years ago
f38d18c665
fix bug in checkpoint when save scaler
5 years ago
b78b18e669
Rename davinci to ascend in ops st test module
5 years ago
24a9f4974c
!536 support ellipsis and bool for tensor slice
...
Merge pull request !536 from zhangbuxue/support_elipis_for_tensor_slice
5 years ago
2891f0d20d
gpu dynamic memory pool supports multi-allReduce
5 years ago
5b6c8fade8
Add Erf\FillD operator for VM
5 years ago
437bb8c27c
support ellipsis and bool for tensor slice
5 years ago
67057d1309
!541 add average pooling 1D
...
Merge pull request !541 from JichenZhao/avgpooling
5 years ago
4516b8feff
!437 Add L2Loss op for VM.
...
Merge pull request !437 from liuxiao/add-l2-loss
5 years ago
3b083d07bb
!550 support one node communication group
...
Merge pull request !550 from yao_yf/support_one_node_communication_group
5 years ago
c874e2d484
Add L2Loss op for VM
5 years ago
aad5771a62
!524 Added support for UA augmentation ops with tests
...
Merge pull request !524 from alashkari/ua-ops
5 years ago
56e7a7deb5
Added UniformAugment + Python Augmentation Ops
5 years ago
dc0491caf9
!508 [Dataset] Adding sync_wait operator for dataset
...
Merge pull request !508 from EricZ/master
5 years ago
cd94518769
X# This is a combination of 2 commits.
...
Initial commit for dataset op python
Added signature to barrier
Adde compiling barrier code
Rebasing, fixed new compile errors
Final fix for make_unique
Added pybind API for barrier
Fixed pyfunc invocation
python interface - sync_wait
!1 sync_wait python interface
* python interface - sync_wait
fix test
update test
update test
Added new test case
add test case
test for shuffle + batch
Added two-sync test case
Restrited that no shuffle after sync
Added sync to pipeline info
block first databuffer as well
Intelligently get batch size
Fix default case
Lock Pair shares among all iterators
Added fix for empty character
Fixed up test case formatting
Fix end of epoch in sync_wait
Fixing CI
5 years ago
78001ac9e6
Add multiprocessing support for Mindspore.Dataset.GeneratorDataset
5 years ago
fb18671b28
!506 [Dataset] Multiprocessing support for Pyfunc
...
Merge pull request !506 from JunhanHu/multiprocess_pyfunc
5 years ago
b13e7bc31a
Add python multiprocessing support for Mindspore.dataset
5 years ago
371b3338b6
support one node communication group
5 years ago
72f42fc37c
!170 Add prim name to error message for operators in nn_ops.py
...
Merge pull request !170 from fary86/add_prim_name_to_error_message_for_nn_ops
5 years ago
b812b18c02
support update parameter for vm
5 years ago
4740c70fc3
gpu add testcases
5 years ago
6dd72f654a
Add prim name to error message for nn_ops.py
5 years ago
db80f4ff92
The num_samples and numRows in schema for TFRecordDataset are conflict
5 years ago
d99dfbd83d
!390 getnext parallel optimization part III & IV: Loop Control & Stream Dispatch adaptation
...
Merge pull request !390 from gukecai/master
5 years ago
94c99998ae
add AvgPooling layer
5 years ago
d9e4dcc33b
!483 Optimize skip dataset op
...
Merge pull request !483 from jiangzhiwen/dataset/skip_opt
5 years ago
728801301c
!313 GPU add akg kernel float_status
...
Merge pull request !313 from VectorSL/float_status
5 years ago
f8208c7c52
Support GetNext Parallel
5 years ago
862d23fe90
!481 Move args_type_check function to _checkparam.py
...
Merge pull request !481 from leonwanghui/rm-code
5 years ago
7aac50804a
!514 [MD] add Pk Sampler in minddataset
...
Merge pull request !514 from liyong126/mindrecord_pk_sampler_lee
5 years ago
24b26ee1a8
Move args_type_check function to _checkparam.py
5 years ago
f1542a90a3
add pk sampler
5 years ago
0de05b3949
[bug] fixed bool check for cast op
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
27a88a6bc3
!456 Auto cast case for NotEqual op
...
Merge pull request !456 from candanzg/not_equal_auto_cast
5 years ago
e1b109e8b8
optimize skip dataset op
5 years ago
60df369100
Fixup py Normalize doc: takes input CHW
5 years ago
6369cf27bd
!406 added first row crc check for when reading tfrecord files
...
Merge pull request !406 from Peilin/first-row-crc-check
5 years ago
98fbd30a5b
!460 [Data]Add filter operation
...
Merge pull request !460 from xulei/filter_master
5 years ago
822a3160e4
!404 [Dataset] Add Python Sampler support for CPP dataset
...
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
5 years ago
c705ea5e5b
add filterOp code
5 years ago
9bc2134cb7
added checking of first row crc to find invalid tfrecord files
...
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file
fixed clang format
fixed cppcheck
fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before
fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments
more clang whitespace fixes...
changed print to logger.info
5 years ago
d8176a77f4
!425 New api "TextFileDataset"
...
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
5 years ago
11a4b35caa
!472 Fix inputs size and attr for AddN fission pass
...
Merge pull request !472 from YuJianfeng/master
5 years ago
2f1a037f2d
!497 dataset: Modify take Op MS_LOG level etc
...
Merge pull request !497 from ms_yan/take_log
5 years ago
5434a96d85
!493 support python func print and != for list with none
...
Merge pull request !493 from zhangbuxue/support_python_func_print
5 years ago
0cdb1171d5
!87 Take AllToAll as a virtual operator in cost model
...
Merge pull request !87 from gziyan/dev_alltoall
5 years ago
c3ec9712e0
!403 add cell class name to error message
...
Merge pull request !403 from fary86/add_cell_name_to_error_message_for_nn_layer
5 years ago
7c233a57fa
support python func print and != for list with none
5 years ago
c5cfb09e66
Repair some MS_LOG problem
5 years ago
c000fb2f34
gpu add float_status kernel
5 years ago
679dbd27b3
!478 fix save_graphs_path and log file mode related issues
...
Merge pull request !478 from fary86/fix_log_and_ir_issues
5 years ago
3427f1b8a3
syn code
5 years ago
7e23a1a475
Fix issues of save_graphs_path, Type/Value error message and log file mode
5 years ago
bc2df2c913
Fix inputs size and attr for AddN fission pass
5 years ago
3ba31ec15a
!419 Tensor assign with bool Tensor
...
Merge pull request !419 from candanzg/tensor_assign_bool_index
5 years ago
2795e492ff
TextFileDataset
5 years ago
18580a7867
!261 Add summary module python code to extract histogram info from tensor
...
Merge pull request !261 from wenkai/histogram_dev3cp
5 years ago
3822b4837f
!340 Add a HistogramSummary ops to record tensor value
...
Merge pull request !340 from ougongchang/master
5 years ago
15c8ef66ba
!401 Add ops Abs\AbsGrad\Sign\SmoothL1Loss\SmoothL1LossGrad\TopK for VM.
...
Merge pull request !401 from liuxiao/openresource
5 years ago
0d208e00bd
Model ALLTOALL as a single operator in cost model; scale the ALLTOALL,
...
ALLGATHER, and REDUCESCATTER with different factors; change the BETA and
GAMMA value in cost model.
5 years ago
3f087dba1a
Tensor assign syntax:
...
1) A[B]=U
2) A[A>n]=U
A.shape == B.shape
U is a scalar or Tensor(size==1)
B is Tensor(dtype=bool)
n is a Number
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
43a2e99833
Add python sampler support for CPP dataset
5 years ago
79c4312e89
NotEqual op auto cast
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
5 years ago
d447364417
add pattern AdjustAllReduceMulAdd
5 years ago
f0c07c3fa6
Realize take op and add ut
5 years ago
71b63c3fcf
!246 [opt pass] AdjustAllReduceMulAdd
...
Merge pull request !246 from vlne-v1/I1E3PI-opt-pass-adjust-allreduce-apply-weight-decy-seq
5 years ago
093c2caed4
!337 optimize execute order sort
...
Merge pull request !337 from kisnwang/optimize-execute-order-sort
5 years ago
ea6958c50a
add pattern AdjustAllReduceMulAdd
5 years ago
b418b18447
!443 add cpu one hot
...
Merge pull request !443 from kisnwang/add-cpu-onehot-new
5 years ago
5c9791a802
Add Abs\AbsGrad\Sign\SmoothL1Loss\SmoothL1LossGrad and modify TopKV2->TopK for VM
5 years ago
6775190e48
add cpu one hot
5 years ago
0bd0decfaa
!441 Add AdamApplyOne ir fusion pass
...
Merge pull request !441 from YuJianfeng/master
5 years ago
5eb5379889
Add AdamApplyOne fusion pass
5 years ago
cc08fdfd9a
!420 Fix mixed precision usage when const value passed as argument
...
Merge pull request !420 from amongo/FixMixedPrecisionForConstParam
5 years ago
0ed6d9178e
add Histogram summary operator
...
clean clang format errors and cpplint errors
add some test cases for histogram summary operator
5 years ago
80333e9f55
!435 Fix dataset serialize and deserialize for MindDataset
...
Merge pull request !435 from anthonyaje/fix_serdes_dataset
5 years ago
d34afbd61b
!400 Support math operation between float and int for scalar
...
Merge pull request !400 from amongo/FixMathOps
5 years ago
40f0a4a4f4
!333 Add skip op to Dataset
...
Merge pull request !333 from jiangzhiwen/dataset/skip
5 years ago
9e1b5efd1d
!434 Bug in cleaning dataset iterators
...
Merge pull request !434 from h.farahat/multi_itr_bug
5 years ago
ea297c0889
Fix dataset serdes for MindDataset
5 years ago
3c02c82771
Bug in weak reference.
...
Add new test cases
5 years ago
3f7054dccb
add skip dataset op
5 years ago
f69a668d98
!350 change tuple output to make tuple
...
Merge pull request !350 from lianliguang/chang-tuple-output-to-make-tuple
5 years ago
7fae76d10d
add support for calculation between float and int
...
format code
remove test case for fp64
add back scalar manipulation
remove save graph
5 years ago
00e4306518
convert all tuple output to maketuple
5 years ago
f98efafa16
!317 [IRFusion] add derelu_fusion pass
...
Merge pull request !317 from huanghui/derelu_fusion_pass
5 years ago
9cb665e634
add suport for parameter of const value pass as mixed precision args
...
fix pylint
5 years ago
83eeac9310
optimize execute order sort
5 years ago
7214c04114
!402 Add parallel op for Square
...
Merge pull request !402 from yangzhenzhang/square
5 years ago
8cbbbd950e
Add cell name to error message
5 years ago
36ffb66782
add parallel op for square
5 years ago
2d31ae97e8
!383 add cell psnr
...
Merge pull request !383 from zhaozhenlong/cell/psnr
5 years ago
08985a1e56
!286 resolve pynative operator unsupport issue
...
Merge pull request !286 from wangqiuliang/resolve-pynative-operator-issue
5 years ago
cce61d462c
histogram python dev
5 years ago
aa8fbcc06e
add cell psnr
5 years ago
cf026096a6
!183 Mindspore.dataset CPP sampler for GeneratorDataset
...
Merge pull request !183 from JunhanHu/cpp_sampler
5 years ago
75fec82b52
resolve pynative operator issue
5 years ago
d3e4dd06b0
!386 modify test_cell_bprop.py ut test_with_param
...
Merge pull request !386 from changzherui/modify-ut
5 years ago
549bfb97ad
!343 Fix usage of variable arguments in test framework
...
Merge pull request !343 from amongo/FixGradUsingInterfaceExtend
5 years ago
87be386581
!314 GPU add kernel assign
...
Merge pull request !314 from VectorSL/assign
5 years ago
31621467a4
!217 support operator ** // % for scalar and tensor, and "in" "not in" key word, and string concat
...
Merge pull request !217 from zhangbuxue/support_pow_operator
5 years ago
0d0517c22d
!379 Add Group normalization
...
Merge pull request !379 from JichenZhao/groupnorm
5 years ago
7f1816c251
!382 Add parallel operator for SigmoidCrossEntropyWithLogits
...
Merge pull request !382 from yangzhenzhang/sigmoidloss
5 years ago
80978cf3cc
support operator ** // % for scalar and tensor, and in not in for dict, ang str concat
5 years ago
efedcfb530
add test case of Bprop and tester
...
add test case for grad concat
fix usage in test framework
fix testcase
format code
5 years ago
8bdcd8c267
modify test_cell_bprop.py ut
5 years ago
642e6e7e63
!376 GetNext parallel optimization, Part1: Pass to insert memcpy_async for GetNext outputs
...
Merge pull request !376 from wenchunjiang/getnext_pass
5 years ago
57cd9f8188
add parallel op for sigmoidloss
5 years ago
ee5f3fa240
add pass to insert memcpy_async for get_next outputs
5 years ago
04c522d0c6
Add Group Normalization
5 years ago
0b7de6968f
Add Group Normalization
5 years ago
ebe6efff71
Add Group Normalization
5 years ago
4cd237eee4
Add GPU NCCL ci test cases.
5 years ago
58a70b5f82
!346 getnext parallel optimization part II: Eliminate Memcpy in specify scenario
...
Merge pull request !346 from laiyongqiang/develop
5 years ago
3e05f50f5f
getnext_memcpy_elimination
5 years ago
6d522f0a4f
add parallel op for layernorm
5 years ago
eaa4186ba3
!357 fix bug in tests of vm conv2d
...
Merge pull request !357 from wangnan39/fix_bug_in_tests_of_vm
5 years ago
2122a28e1a
fix bug in tests of vm conv2d
5 years ago
ba55a8ed0b
!304 [Auto parallel] Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel
...
Merge pull request !304 from Xiaoda/modify-not-fully-use-devices-and-strategy-checking
5 years ago
c3525d0cf7
!282 fix conv2d performance is worse than pytorch
...
Merge pull request !282 from chujinjin/fix_pynative_conv_pf
5 years ago
62807da0c4
Develop operator Unfold，take the ge backend，dock with tbe's ExtractImagePatches operator
5 years ago
b804d9103d
set default execution mode to pynative
5 years ago
b02e871c1a
[IRFusion] add derelu_fusion pass
5 years ago
ffb2cb03a4
Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel
5 years ago
9739d3b048
Add CPP sampler support for GeneratorDataset
5 years ago
30de261c3c
!243 Support nested repeat
...
Merge pull request !243 from h.farahat/nested_repeat
5 years ago
fe4cde6b1e
!294 Add cell ssim
...
Merge pull request !294 from zhaozhenlong/cell/ssim
5 years ago
150024f089
!312 Implemention of new dataset ops: apply
...
Merge pull request !312 from xiefangqi/xfq_apply_branch
5 years ago
0fc23eee0f
Support nested repeat
5 years ago
6a2cf4b6e6
ssim impl code
5 years ago
1a1cbc6814
implemention of new api: apply
5 years ago
7d7c9c4fee
!311 GPU add akg kernel select
...
Merge pull request !311 from VectorSL/select
5 years ago
7595c91730
!301 add custom op st to ci
...
Merge pull request !301 from dengwentao/ci_st
5 years ago
48f90eb7bc
add custom op st to ci
5 years ago
9e372073e2
gpu add assigin
5 years ago
d248b05a98
gpu add kernel select
5 years ago
b571fabd77
!289 Add cnode mapping after graph match
...
Merge pull request !289 from YuJianfeng/find_op
5 years ago
86911b7cdc
!287 [MS][Docs]Fix "ValueError: The `outputs` is not tuple. ", when use model.eval.
...
Merge pull request !287 from vlne-v1/I1EFUD-the-output-is-not-tuple
5 years ago
e5c67b9088
Add cnode to equal map when opt matching
5 years ago
e1c8f248e0
Fix the output is not tuple, when eval
5 years ago
9bda080bb5
!260 refactor padding strategy
...
Merge pull request !260 from lianliguang/refactor-padding-strategy
5 years ago
1ab430072e
!232 [Auto parallel] Model the memory_cost in cost model
...
Merge pull request !232 from Xiaoda/model-memory-cost-in-auto-parallel
5 years ago
94589ce611
!226 expend conv stride and dilation to 2d
...
Merge pull request !226 from wangnan39/expend_conv_stride_to_2d
5 years ago
0ca4ceb73f
!281 bug fix in gpu aware quantizaiton ops
...
Merge pull request !281 from SanjayChan/origin/quant_liantiao
5 years ago
652ab6c386
add test case for aware quantizaiton
5 years ago
2604acedcb
extend conv stride and dilation to 2d
5 years ago
5d225f934f
change the padding strategy & refactor insert transdata
5 years ago
0ac50a19f5
Model the memory cost in auto-parallel. It is calculated by the output of operators, plus the parameters. Additionally, modify the graph-operations in auto_parallel to include memory_cost.
5 years ago
f1fa2a9941
!273 [MD] update subset random sampler in minddataset
...
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
5 years ago
7ffb8bb19f
!250 Add nn.pad to support three modes
...
Merge pull request !250 from casgj/gaojing_new4
5 years ago
60958d6b25
!239 Add dynamic learning rate decay and review optimizer code
...
Merge pull request !239 from fanglei/master
5 years ago
2db3e64ff2
add operation
5 years ago
298a32f1e2
!132 Add confusion_mul_grad_fusion pass
...
Merge pull request !132 from huanghui/master
5 years ago
7d700295f8
add dynamic lr and enhance optim
5 years ago
0ce83e39e1
fix TestShardSampleWrongNumber
...
adjust internal api
5 years ago
57f953ca38
!216 Implement addn fusion pass
...
Merge pull request !216 from YuJianfeng/master
5 years ago
39a46b9342
!245 Add bool type check in communication operator
...
Merge pull request !245 from chentingting/add_bool_type_check_in_comm_op
5 years ago
77725e81a4
!258 add_minimum_distributed_op
...
Merge pull request !258 from lichen/add_minimum_distributed_op
5 years ago
5bb4e8120d
!208 [mixprecision]fix eval support bug and error cast on ApplyMomentum
...
Merge pull request !208 from vlne-v1/I1D33P-auto-mix-precision-eval-support
5 years ago
2fecdede6b
support amp when model eval, fix example of UnsortSegmentsSum
5 years ago
19ee376cd3
add confusion_mul_grad fusion pass
5 years ago
37c94a5f76
add pass replace_old_param_
5 years ago
mindspore-ci-bot
zhaojichen
liyong
huanghui
YuJianfeng
chang zherui
ch-l
zhousiyi
ZPaC
candanzg
liubuyu
Wei Luning
hesham
liuxiao
lichenever
leonwanghui
wangnan39@huawei.com
limingqi107
buxue
Amir Lashkari
eric
Junhan Hu
yao_yf
VectorSL
fary86
qianlong
gukecai
jiangzhiwen
Cathy Wong
xulei2020
Peilin Wang
ms_yan
yanghaitao
Ziyan
kswang
ougongchang
anthonyaje
jzw
huangdongrun
lianliguang
yangzhenzhang
wenkai
zhaozhenlong
kingfo
wenchunjiang
laiyongqiang
chujinjin
Xiaoda Zhang
xiefangqi
dengwentao
chenzomi
gaojing
root