d89101b95f
add missing test
5 years ago
c268c88220
aware quantization training auto create graph
5 years ago
939cd29d7e
Add a callback named SummaryCollector and delete SummaryStep callback
...
I added a SummaryCollector to help users automatically collect information
such as the network, loss, learning rate and so on, making it easier to collect this information.
It also can collect train lineage and eval lineage information which is
collected by TrainLineage Callback and EvalLineage Callback in
MindInsight.
I also add some UT for SummaryCollect to keep the code correct.
5 years ago
21c67eddd5
!1897 save print data to file
...
Merge pull request !1897 from jinyaohui/print
5 years ago
9f336bb735
fix TextFileDataset and CLUEDataset failed with to_device
5 years ago
ac23a179bf
save print data to file
5 years ago
182215e060
!2284 Add Pass to Eliminate Redundant Depend
...
Merge pull request !2284 from BowenK/fix_depend
5 years ago
b6ff27245f
!1990 fix profiling stream id
...
Merge pull request !1990 from caifubi/fix-profiling-stream-id
5 years ago
2d6d3cc86b
!2339 support catch IndexError in C++
...
Merge pull request !2339 from zhangbuxue/support_catch_index_error_in_c++
5 years ago
8867c67d61
!1935 Summary callback as collector for summary and lineage
...
Merge pull request !1935 from 李鸿章/policy_writer
5 years ago
8f29e7242f
add pass to eliminate depend value
5 years ago
230963d08e
!2332 Fix ConfusionSoftmaxGrad fusion pass work if the ReduceSum's attr of keep_dims set with False
...
Merge pull request !2332 from huanghui/fix-ConfusionSoftmaxGrad-fusion-pass
5 years ago
a49c6f0b13
Fix profiling stream id bug
5 years ago
9958bc479a
!2161 [qat]Export network from quantization aware network to deploy
...
Merge pull request !2161 from vlne-v1/I1IZV3-quant-infer
5 years ago
06b511ca94
!2301 add sparse proximal ada grad optimizer
...
Merge pull request !2301 from lilei/sparse_proximal_ada_grad
5 years ago
0921c1e538
enhance the SummaryRecord with set_mode and add_value
5 years ago
2c9ca199ad
support catch IndexError in C++
5 years ago
c7bda5363d
fix ConfusionSoftmaxGrad fusion pass work if the ReduceSum's attr of keep_dims set False
5 years ago
1d77bf86a9
Exports MindSpore quant predict model to deploy with GEIR
5 years ago
497067d7b2
add sparse proximal ada grad optimizer
5 years ago
1e36b0649f
remove graphengine changes
...
remove graphengine changes
concat op
Truncate Pair
concat_op
remove graph engine changes
ToNumberOp implementation almost done
ToNumberOp complete
ci fix
ci fix
ci fix
ci fix
ci fix
ci fix
ci fix
ci fix
ci fix
ci fix
merge conflicts
5 years ago
11826fb256
DuplicateOp
5 years ago
90bb9320aa
!2314 Implemented RandomHorizontalFlipWithBBox and BoundingBoxAugment C++ Ops
...
Merge pull request !2314 from imaaamin/object_ops_pr
5 years ago
a83baafbf6
!2253 Add ConcatOp to Dataset
...
Merge pull request !2253 from nhussain/concat_op
5 years ago
3784220056
!2317 rework on dataset.text.vocab to support any user special_tokens
...
Merge pull request !2317 from ZiruiWu/vocab_rework
5 years ago
5515016dba
remove graphengine changes
...
remove graphengine changes
concat op
Truncate Pair
concat_op
remove graph engine changes
5 years ago
ffc8a3c362
!2274 add PadEndOp
...
Merge pull request !2274 from xunxue/padend
5 years ago
e4322baece
!2316 [Dataset] Move python tree transformation into cpp pass
...
Merge pull request !2316 from JunhanHu/alter_node_cpp
5 years ago
0af156d169
added two ops for object detection, random horizontal flip with bbox and bouding box augment. along with their unit tests
5 years ago
87aa9c8f7a
PadEndOp
5 years ago
57f3732ac3
Move python tree transformation into cpp pass.
5 years ago
b6e9504b31
phase I of Vocab rework
...
phase II vocab rework
added more test cases
fix api doc string
address review cmts and fix CI
address ci complains
fix review cmts
ci
5 years ago
8f2674850b
address API doc style and content
...
addr review cmts
revert
ci
private class
ci
fix ci
address ci
address review cmts
fix style err
5 years ago
c0fe8c0322
!2273 [AutoParallel]update EmbeddingLookUp op
...
Merge pull request !2273 from lichen/fix_embeding_look_up
5 years ago
5850b99161
!2211 Add TruncatePair Op to dataset
...
Merge pull request !2211 from h.farahat/pair_truncate
5 years ago
563622874a
update
5 years ago
d0c5071cab
!1993 [Dataset] Fix codedex.
...
Merge pull request !1993 from luoyang/pylint
5 years ago
2ecd5bdf25
!2239 [MD] convert csv to mindrecord
...
Merge pull request !2239 from liyong126/csv_to_mindrecord
5 years ago
d9b8da14e2
!2275 [Auto parallel] Changing bprob of EmbeddingLookup
...
Merge pull request !2275 from Xiaoda/4-fix-the-embeddinglookup-errors
5 years ago
9b90d89f6b
!2276 fix eliminate get ref parameter
...
Merge pull request !2276 from fary86/fix_eliminate_get_ref
5 years ago
15b3fba0ef
Fix eliminate get ref parameter
5 years ago
69574f3823
fix the bprob error of embeddinglookup
5 years ago
3559cb5ccd
!2252 dataset: repair bug in config load
...
Merge pull request !2252 from ms_yan/config_load
5 years ago
60f4795f40
!2220 fix binary dump and add test case
...
Merge pull request !2220 from leopz/fix_dump
5 years ago
8d1dae46ac
Throw error when load config failed
5 years ago
7369950a93
convert csv to mindrecord
5 years ago
0c3d96a98b
!2236 Refactor the callback module in an encapsulated way
...
Merge pull request !2236 from 李鸿章/callback
5 years ago
b9495a9ccc
Truncate Pair
5 years ago
9ba6f61d01
!2148 fix hook and bprop debug issue in pynative
...
Merge pull request !2148 from wangqiuliang/fix-hook-bprop-issue
5 years ago
4e3b3711be
!2199 Fix the condition when activation name is 0
...
Merge pull request !2199 from Simson/push-to-opensource
5 years ago
a67132f6b7
fix shape and add testcase
5 years ago
294449697a
!2179 Add sort by index for each group of AllReduce
...
Merge pull request !2179 from YuJianfeng/all_reduce_index
5 years ago
f513bb8f83
!2163 [Auto parallel] Move 'EmbeddingLookup' to internal
...
Merge pull request !2163 from Xiaoda/3-changing-embeddinglookup-internal
5 years ago
358982a98f
fix hook and bprop debug issue
5 years ago
f15cb6b7c9
Add sort by index for each group of AllReduce
5 years ago
ca988e9e69
fix the condition when activation name is 0
5 years ago
a4048e192c
!2256 Rename Sampler::Reset() to Sampler::ResetSampler()
...
Merge pull request !2256 from JesseKLee/sampler
5 years ago
ea829e89c3
!2198 Add MaskOp to dataset
...
Merge pull request !2198 from h.farahat/mask_op
5 years ago
dcfdff6021
Rename Sampler Reset
5 years ago
808380a9f9
!2142 Cleanup dataset UT: refactor visualize()
...
Merge pull request !2142 from Tinazhang/reorg-visualize
5 years ago
fdafc690f8
repair problem in NumpySlicesDataset
5 years ago
2865436fee
!2092 Tokenizers
...
Merge pull request !2092 from qianlong21st/june_third
5 years ago
169eaf73c7
reorganize util function visualize()
5 years ago
c745b6bd9d
回退 'Pull Request !2189 : dataset: repair some bug in NumpySlicesDataset'
5 years ago
11a256536d
!2189 dataset: repair some bug in NumpySlicesDataset
...
Merge pull request !2189 from ms_yan/numpy_slice_repair
5 years ago
4b5cbe5d4a
!2186 Optimization for opt
...
Merge pull request !2186 from Kang/opt
5 years ago
ecc459158e
callback module in encapsulated
5 years ago
65f2212fd3
!2215 Support hccl profiling
...
Merge pull request !2215 from caifubi/support-hccl-profiling
5 years ago
b9ad407dc2
!2204 add check for tensor slice before convert to ops
...
Merge pull request !2204 from zhangbuxue/add_check_for_tensor_slice_before_convert_to_ops
5 years ago
cef901fe0d
!2069 Fix input value check for Momentum, SparseApplyFtrl and SparseApplyAdagrad.
...
Merge pull request !2069 from liuxiao/fix-input-value-check-for-SparseApplyFtrl-and-SparseApplyAdaGrad
5 years ago
dee8471d23
!1993 [Dataset] Fix codedex.
5 years ago
2974b906d3
Optimization for opt
5 years ago
4f16f036be
Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp
...
add CaseFold, NormalizeUTF8
add RegexReplace
add RegexTokenizer
add BasicTokenizer
add WordpieceTokenizer
add BertTokenizer
5 years ago
61857b69ed
add check for tensor slice before convert to ops
5 years ago
5db0d8129c
Support hccl profiling
5 years ago
55e7d9d2b8
move embeddinglookup to the internal
5 years ago
ee438aaf4a
callback as context manager
5 years ago
d162a7a5ab
repair problem in NumpySlicesDataset
5 years ago
df63a3195d
fix input value check for SparseApplyFtrl and SparseApplyAdagrad
5 years ago
f2462bb00d
Mask Op
5 years ago
bb622877e8
!2167 Add a callback module to avoid the size of the callback.py file too large
...
Merge pull request !2167 from ougongchang/adjust_callback
5 years ago
ca94916ef9
!2184 CocoDataset add category_id check
...
Merge pull request !2184 from xiefangqi/xfq_fix_coco_issue
5 years ago
1ffa37ffbc
Add a callback module to avoid the size of the callback.py file to large
5 years ago
4291ea82cf
!2024 Add MixedPrecisionCast for Dict
...
Merge pull request !2024 from Kang/master
5 years ago
625f2421b5
!1977 random walk in gnn node2vec
...
Merge pull request !1977 from JonathanY/randomwalk
5 years ago
a1f194c971
!2188 Remove B+ tree deadcode and add an additional output to Search function
...
Merge pull request !2188 from JesseKLee/deadcode
5 years ago
3adbde56b2
!2162 SliceOp
...
Merge pull request !2162 from h.farahat/slice_op
5 years ago
898b2fdecd
!2187 Fix comment display issues in BuildVocabDataset
...
Merge pull request !2187 from ZiruiWu/vocab_rework
5 years ago
287ca71260
Remove dead code
5 years ago
2794883644
fix selected minor issues
...
fix review comments
5 years ago
3ccbafe71d
!2062 [MD] add splitOP in minddataset
...
Merge pull request !2062 from liyong126/minddataset_split
5 years ago
0b7d4855dd
!2168 Chage combined quant to nn.quant
...
Merge pull request !2168 from chenzhongming/combined
5 years ago
aab190fcdb
CocoDataset add category_id validation
5 years ago
4878616e43
change combined to nn
5 years ago
d4f8f57c7e
add split in minddataset
5 years ago
6089d58d8d
!2171 ssim input shape h and w should be greater than or equal to filter_size
...
Merge pull request !2171 from zhaozhenlong/fix-issues-quant-not-exposed-ssim-ksize-check
5 years ago
6ff3a6dcff
!2175 move AscendQuant and AscendDequant to inner_ops.py
...
Merge pull request !2175 from zhaozhenlong/fix-issues-ascend-quant-move-to-inner-ops
5 years ago
ea681bfb0f
fix ssim filter size check
5 years ago
dbfb4f057c
move AscendQuant AscendDequant to inner_ops.py
5 years ago
aa73abc2f7
Add image.CentralCrop
5 years ago
2d84011504
!2071 optimizer support loss scale for sparse situation
...
Merge pull request !2071 from wangnan39/support_loss_scale_for_sparse_optimizer
5 years ago
2fa2f86619
!2135 add tfrecord to mindrecord tool
...
Merge pull request !2135 from guozhijian/add_tools_tfrecord_to_mindrecord
5 years ago
e2012a1de9
Slice Op
5 years ago
3353a20d8b
add tool: tfrecord to mindrecord
5 years ago
71d27c6854
!2068 Add InplaceAddD and InplaceSubD vm ops
...
Merge pull request !2068 from liuwenhao/master
5 years ago
105dcb1c1e
!2128 hidden range
...
Merge pull request !2128 from jiangjinsheng/issue_fix3
5 years ago
ea96cbcef2
!1979 fix partial primitive poly node
...
Merge pull request !1979 from fary86/fix_patial_primitive_poly_code
5 years ago
be40a90ec6
add InplaceAddD and InplaceSubD vm ops
5 years ago
032e921298
hidden range
5 years ago
cb706951c1
!2126 Refactoring the func graph manager module.
...
Merge pull request !2126 from ZhangQinghua/master
5 years ago
dceb3c2be4
!2026 Change C++ behavior in RandomCropAndResize
...
Merge pull request !2026 from MahdiRahmaniHanzaki/I1K3FL-random-resized-crop
5 years ago
add29f95f5
resolved issues in the comments
5 years ago
2cab44a637
!2028 FillOp for BERT
...
Merge pull request !2028 from nhussain/fillOp_learning
5 years ago
dd9bf09f0a
added FillOp for #119 - special Ops
5 years ago
848e07d022
initial commit, start of BucketBatchByLengthOp
...
c implementation done, just need to call batch/pad
added python api and validator
added pybind/de_pipeline stuff, fixed some compile errors, figure out how null py::function works
added tiny bit of doc
integrated with static batch methods
fixed some bugs
some more bug fixes and cleanup
ci fix
fix ci
ci fix
fix ci
added test_cases and debugged
addressed code review comments
addressed code review comments
ci fix
ci fix
addressed code review comments
addressed code review comments
5 years ago
d4e3d69f37
support loss scale for sparse situation
5 years ago
7b6f13886f
!1962 add vm support for operators include ApproximateEqual, InplaceUpdateD and InTopKD
...
Merge pull request !1962 from zhouneng/add_vm_support_for_ApproximateEqual_InplaceUpdateD_InTopKD
5 years ago
87d2c27c7f
random walk v1
5 years ago
842f8231ba
!2100 add op quant and dequant
...
Merge pull request !2100 from zhaozhenlong/op/quant-dequant-ge-open
5 years ago
971f10d222
!1790 remove transdata only connected with control depend
...
Merge pull request !1790 from lianliguang/remove-the-useless-transdata-connected-with-the-control-depend
5 years ago
ccda0f7b36
add op AscendQuant AscendDequant
5 years ago
928c25ebea
!2047 [Code review] check code files in pre_activate/ascend/buffer_fusion
...
Merge pull request !2047 from huanghui/code-review
5 years ago
923d3fee04
Refactoring the fg manager module.
5 years ago
11f5f88021
!2010 fix operator issues for tuple_to_array and cast
...
Merge pull request !2010 from wangqiuliang/fix-tuple-to-array-issue
5 years ago
b86016a26f
remove the useless transdata and cast of control depend node
5 years ago
9708e58259
fix TupleToArray & Cast operator issue
5 years ago
5cd41905c0
!1820 [Auto parallel] Implementing the backward of 'EmbeddingLookup' primitive
...
Merge pull request !1820 from Xiaoda/the-backward-of-embeddinglookup
5 years ago
a8cf83acf2
!1932 Add CLUE dataset
...
Merge pull request !1932 from jiangzhiwen/dataset/clue
5 years ago
ffa3352088
Fix partial primitive poly node
5 years ago
e0e167a000
add CLUE dataset
5 years ago
51fe3501a4
add vm support for ApproximateEqual, InplaceUpdateD and InTopKD.
5 years ago
4acb61d59d
code review fix for buffer fusion
5 years ago
a22763b612
Bug in CIFAR after removing GetMutabble buffer
...
Fixes # I1KIPC
5 years ago
bb2082daec
fix: MindDataset padded log error
5 years ago
20d2012a0e
implementing the backward of embeddinglookup
5 years ago
403c30c7da
!1919 change tensor dtype and shape from function to attr
...
Merge pull request !1919 from zhangbuxue/change_tensor_dtype_and_shape_from_function_to_attr
5 years ago
c661087b99
!2029 Create TensorRow class that supports a row id
...
Merge pull request !2029 from lixiachen/lixia/tensorrow
5 years ago
6ae88c3987
Create TensorRow class that supports a row id.
5 years ago
66bbdb4a31
change tensor dtype and shape from function to attr
5 years ago
b285c8fa9d
!1973 develop TensorScatterUpdate op and access ge and vm
...
Merge pull request !1973 from zhangbuxue/develop_TensorScatterUpdate_op_and_access_ge_and_vm
5 years ago
8aee6b07d6
develop TensorScatterUpdate op and access ge and vm
5 years ago
3536185f5b
!2007 add lazy adam optimizer and support sparse adam&ftrl for cpu backend
...
Merge pull request !2007 from wangnan39/add_lazy_adam_optim_and_support_sparse_admm_for_cpu_backend
5 years ago
a8378a3357
!1924 Add TBE ops ApplyAdaMax\ ApplyAdadelta\ ApplyAdagrad\ ApplyAdagradV2 for VM.
...
Merge pull request !1924 from liuxiao/ops-for-VM
5 years ago
4042f16ce4
add lazy adam optim and support sparse adam & ftrl for cpu backend
5 years ago
3b809f2b0b
!1996 Fix single BatchNorm fission && SoftmaxGradExt fusion pass
...
Merge pull request !1996 from huanghui/single-batchnorm-fission-pass
5 years ago
ef35e2d990
!2002 Add dump ir function in binary format
...
Merge pull request !2002 from leopz/test_dump
5 years ago
88eec2b894
fix single-batchnorm-fission && softmax-grad-ext-fusion pass
5 years ago
11875d8495
!2044 Add_Sparse_GatherV2_distributed_op
...
Merge pull request !2044 from lichen/add_sparse_gatherv2
5 years ago
c45f4d225d
dump binary ir
5 years ago
ac5878b4b7
!1939 Complete vm ops for DataFormatDimMap and HistogramFixedWidthD
...
Merge pull request !1939 from lihongkang/lhk_master
5 years ago
nhussain
chenzomi
ougongchang
mindspore-ci-bot
yanghaitao
jinyaohui
BowenK
caifubi
Li Hongzhang
buxue
huanghui
Wei Luning
lilei
peilinwang
hesham
islam_amin
xunxue
Junhan Hu
Zirui Wu
lichenever
fary86
Xiaoda Zhang
ms_yan
liyong
leopz
kingfo
yujianfeng
simson
Jesse Lee
Tinazhang
panfengfeng
Yang
Kang
qianlong
liuxiao
xiefangqi
zhaozhenlong
jonyguo
liuwenhao4
jiangjinsheng
Mahdi
wangnan39@huawei.com
Jonathan Yan
Zhang Qinghua
WilliamLian
jiangzhiwen
zhouneng
Lixia Chen