9bc2134cb7
added checking of first row crc to find invalid tfrecord files
...
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file
fixed clang format
fixed cppcheck
fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before
fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments
more clang whitespace fixes...
changed print to logger.info
6 years ago
d8176a77f4
!425 New api "TextFileDataset"
...
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
6 years ago
5434a96d85
!493 support python func print and != for list with none
...
Merge pull request !493 from zhangbuxue/support_python_func_print
6 years ago
0cdb1171d5
!87 Take AllToAll as a virtual operator in cost model
...
Merge pull request !87 from gziyan/dev_alltoall
6 years ago
c3ec9712e0
!403 add cell class name to error message
...
Merge pull request !403 from fary86/add_cell_name_to_error_message_for_nn_layer
6 years ago
7c233a57fa
support python func print and != for list with none
6 years ago
679dbd27b3
!478 fix save_graphs_path and log file mode related issues
...
Merge pull request !478 from fary86/fix_log_and_ir_issues
6 years ago
7e23a1a475
Fix issues of save_graphs_path, Type/Value error message and log file mode
6 years ago
3ba31ec15a
!419 Tensor assign with bool Tensor
...
Merge pull request !419 from candanzg/tensor_assign_bool_index
6 years ago
2795e492ff
TextFileDataset
6 years ago
18580a7867
!261 Add summary module python code to extract histogram info from tensor
...
Merge pull request !261 from wenkai/histogram_dev3cp
6 years ago
3822b4837f
!340 Add a HistogramSummary ops to record tensor value
...
Merge pull request !340 from ougongchang/master
6 years ago
0d208e00bd
Model ALLTOALL as a single operator in cost model; scale the ALLTOALL,
...
ALLGATHER, and REDUCESCATTER with different factors; change the BETA and
GAMMA value in cost model.
6 years ago
3f087dba1a
Tensor assign syntax:
...
1) A[B]=U
2) A[A>n]=U
A.shape == B.shape
U is a scalar or Tensor(size==1)
B is Tensor(dtype=bool)
n is a Number
Signed-off-by: candanzg <zhangshucheng@huawei.com>
6 years ago
43a2e99833
Add python sampler support for CPP dataset
6 years ago
79c4312e89
NotEqual op auto cast
...
Signed-off-by: candanzg <zhangshucheng@huawei.com>
6 years ago
f0c07c3fa6
Realize take op and add ut
6 years ago
cc08fdfd9a
!420 Fix mixed precision usage when const value passed as argument
...
Merge pull request !420 from amongo/FixMixedPrecisionForConstParam
6 years ago
0ed6d9178e
add Histogram summary operator
...
clean clang format errors and cpplint errors
add some test cases for histogram summary operator
6 years ago
80333e9f55
!435 Fix dataset serialize and deserialize for MindDataset
...
Merge pull request !435 from anthonyaje/fix_serdes_dataset
6 years ago
d34afbd61b
!400 Support math operation between float and int for scalar
...
Merge pull request !400 from amongo/FixMathOps
6 years ago
40f0a4a4f4
!333 Add skip op to Dataset
...
Merge pull request !333 from jiangzhiwen/dataset/skip
6 years ago
9e1b5efd1d
!434 Bug in cleaning dataset iterators
...
Merge pull request !434 from h.farahat/multi_itr_bug
6 years ago
ea297c0889
Fix dataset serdes for MindDataset
6 years ago
3c02c82771
Bug in weak reference.
...
Add new test cases
6 years ago
3f7054dccb
add skip dataset op
6 years ago
7fae76d10d
add support for calculation between float and int
...
format code
remove test case for fp64
add back scalar manipulation
remove save graph
6 years ago
9cb665e634
add suport for parameter of const value pass as mixed precision args
...
fix pylint
6 years ago
7214c04114
!402 Add parallel op for Square
...
Merge pull request !402 from yangzhenzhang/square
6 years ago
8cbbbd950e
Add cell name to error message
6 years ago
36ffb66782
add parallel op for square
6 years ago
2d31ae97e8
!383 add cell psnr
...
Merge pull request !383 from zhaozhenlong/cell/psnr
6 years ago
08985a1e56
!286 resolve pynative operator unsupport issue
...
Merge pull request !286 from wangqiuliang/resolve-pynative-operator-issue
6 years ago
cce61d462c
histogram python dev
6 years ago
aa8fbcc06e
add cell psnr
6 years ago
cf026096a6
!183 Mindspore.dataset CPP sampler for GeneratorDataset
...
Merge pull request !183 from JunhanHu/cpp_sampler
6 years ago
75fec82b52
resolve pynative operator issue
6 years ago
d3e4dd06b0
!386 modify test_cell_bprop.py ut test_with_param
...
Merge pull request !386 from changzherui/modify-ut
6 years ago
549bfb97ad
!343 Fix usage of variable arguments in test framework
...
Merge pull request !343 from amongo/FixGradUsingInterfaceExtend
6 years ago
31621467a4
!217 support operator ** // % for scalar and tensor, and "in" "not in" key word, and string concat
...
Merge pull request !217 from zhangbuxue/support_pow_operator
6 years ago
0d0517c22d
!379 Add Group normalization
...
Merge pull request !379 from JichenZhao/groupnorm
6 years ago
80978cf3cc
support operator ** // % for scalar and tensor, and in not in for dict, ang str concat
6 years ago
efedcfb530
add test case of Bprop and tester
...
add test case for grad concat
fix usage in test framework
fix testcase
format code
6 years ago
8bdcd8c267
modify test_cell_bprop.py ut
6 years ago
57cd9f8188
add parallel op for sigmoidloss
6 years ago
04c522d0c6
Add Group Normalization
6 years ago
0b7de6968f
Add Group Normalization
6 years ago
ebe6efff71
Add Group Normalization
6 years ago
6d522f0a4f
add parallel op for layernorm
6 years ago
ba55a8ed0b
!304 [Auto parallel] Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel
...
Merge pull request !304 from Xiaoda/modify-not-fully-use-devices-and-strategy-checking
6 years ago
62807da0c4
Develop operator Unfold，take the ge backend，dock with tbe's ExtractImagePatches operator
6 years ago
ffb2cb03a4
Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel
6 years ago
9739d3b048
Add CPP sampler support for GeneratorDataset
6 years ago
30de261c3c
!243 Support nested repeat
...
Merge pull request !243 from h.farahat/nested_repeat
6 years ago
fe4cde6b1e
!294 Add cell ssim
...
Merge pull request !294 from zhaozhenlong/cell/ssim
6 years ago
150024f089
!312 Implemention of new dataset ops: apply
...
Merge pull request !312 from xiefangqi/xfq_apply_branch
6 years ago
0fc23eee0f
Support nested repeat
6 years ago
6a2cf4b6e6
ssim impl code
6 years ago
1a1cbc6814
implemention of new api: apply
6 years ago
e1c8f248e0
Fix the output is not tuple, when eval
6 years ago
f1fa2a9941
!273 [MD] update subset random sampler in minddataset
...
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
6 years ago
7ffb8bb19f
!250 Add nn.pad to support three modes
...
Merge pull request !250 from casgj/gaojing_new4
6 years ago
60958d6b25
!239 Add dynamic learning rate decay and review optimizer code
...
Merge pull request !239 from fanglei/master
6 years ago
2db3e64ff2
add operation
6 years ago
7d700295f8
add dynamic lr and enhance optim
6 years ago
0ce83e39e1
fix TestShardSampleWrongNumber
...
adjust internal api
6 years ago
39a46b9342
!245 Add bool type check in communication operator
...
Merge pull request !245 from chentingting/add_bool_type_check_in_comm_op
6 years ago
77725e81a4
!258 add_minimum_distributed_op
...
Merge pull request !258 from lichen/add_minimum_distributed_op
6 years ago
37c94a5f76
add pass replace_old_param_
6 years ago
d62f560b50
add_bool_type_check_in_comm_op
6 years ago
b81cc6ea4f
add minimum distributed op
6 years ago
d64f662c76
quantization aware training frontend operators define.
6 years ago
98e69fc639
!215 fix bprop cache caused error with variable params
...
Merge pull request !215 from penn/fix_print_bprop_error
6 years ago
7bc2cee318
!167 add_squeeze_distributed_op
...
Merge pull request !167 from lichen/add_squeeze_distributed_op
6 years ago
c8cdb6b331
support distributed GatherV2 operator
6 years ago
11403492ae
add mindrecord subset random sampler
6 years ago
5841fe010e
Support pow's second input could be tensor and fix bug in bprop of pow
6 years ago
32cd280c1a
add squeeze distributed op
6 years ago
5141054ecd
!220 Add parallel operator for DropoutDoMask
...
Merge pull request !220 from yangzhenzhang/dropoutdomask
6 years ago
066f20e791
!169 fix the method to calculate the children graph
...
Merge pull request !169 from xychow/fix-manager-children-issue
6 years ago
b34c0e7a17
add parallel op for dropoutdomask
6 years ago
a9443635b7
fix: mindpage enhance parameter check and search by filename failed
6 years ago
2bef22d8a3
fix bprop cache caused error with variable params
6 years ago
59a714c654
Correct shuffle UT buffer_size > #dataset-row as valid
6 years ago
0f0f83e292
modified api name Stack -> Pack, Unstack -> Unpack
6 years ago
0565e4641e
!185 modify comment about normal mode
...
Merge pull request !185 from jinyaohui/master
6 years ago
2e6e94b2b6
!177 prelu operator support parallel on the channel
...
Merge pull request !177 from yao_yf/fix_auto_parallel_prelu
6 years ago
99f22c5b85
fix children issue: missing users of the children's direct users.
6 years ago
0790ef8a85
modify comment
6 years ago
3e36982314
!99 Develop op MaxPoolWithArgMax
...
Merge pull request !99 from zhangbuxue/Dock_MaxPoolWithArgMax
6 years ago
40d4a4baa3
!20 modify _set_dataset_mode_config api param
...
Merge pull request !20 from jinyaohui/master
6 years ago
7541d3b067
Develop op MaxPoolWithArgMax
6 years ago
b5e3fa9593
fix auto parallel prelu
6 years ago
ac62faa388
modify set_dataset_mode_config api param
6 years ago
47d903ff57
Add pack and unpack
6 years ago
e6ea09082c
!153 add api image_gradients
...
Merge pull request !153 from zhaozhenlong/cell/image_gradients
6 years ago
f9d180d413
add api image gradients
6 years ago
a24297f547
!122 Support to config whether to save integeated checkpoint, in auto model parallel scene
...
Merge pull request !122 from WeibiaoYu/master
6 years ago
22c6baeea2
Support to config whether to save integeated checkpoint, in auto model parallel scene
6 years ago
c688265671
fix: when use MindDataset block_reade=True hung
6 years ago
Peilin Wang
mindspore-ci-bot
buxue
fary86
yanghaitao
Ziyan
candanzg
Junhan Hu
ms_yan
ougongchang
anthonyaje
hesham
jzw
huangdongrun
yangzhenzhang
wenkai
zhaozhenlong
kingfo
chang zherui
zhaojichen
Xiaoda Zhang
xiefangqi
Wei Luning
gaojing
root
liyong
c00425699
lichenever
chenzomi
jonyguo
义峰潘
Cathy Wong
liuxiao
zhousiyi
jinyaohui
yao_yf
WeibiaoYu