b67aaf6773
!9832 expose_allgather_fusion_to_users
...
From: @gong_zi_yan
Reviewed-by:
Signed-off-by:
4 years ago
728fac6c9f
Expand J for innermost graph first when the graph also contains J primitive
4 years ago
bbf8ec82b9
expose allgather fusion interface to users
4 years ago
cb909c7242
add ut for conv2d
4 years ago
1a7c161e73
support len of a Tensor
4 years ago
24345595f3
added collective send and receive
4 years ago
4df0baa6c7
!10392 getitem fix bug
...
From: @yepei6
Reviewed-by: @zhunaipan,@kingxian,@zhunaipan
Signed-off-by: @kingxian
4 years ago
221d5b67d2
!10442 change code in modelzoo to import dataset APIs from mindspore.dataset rather than mindspore.dataset.engine
...
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
4 years ago
31fed1a2f6
change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine
4 years ago
261bb736de
!10063 Modify profiler directory structure to fit the new Run Package
...
From: @gzhcv
Reviewed-by:
Signed-off-by:
4 years ago
3ba3ffedd4
!10203 Synchronize latest Ascend software suite 18 Dec 2020
...
From: @nicholas_yhr
Reviewed-by:
Signed-off-by:
4 years ago
b8345d03b6
Synchronize latest Ascend software 18 Dec 2020, with profiler fixes
4 years ago
1343c9cca2
!10255 using do_copy option to choose Tensor.from_numpy to do Tensor convert
...
From: @ms_yan
Reviewed-by:
Signed-off-by:
4 years ago
e1248a7246
!10389 Fix the Backward of the AllSwap Operation
...
From: @huangxinjing
Reviewed-by: @stsuteng,@stsuteng,@zhunaipan
Signed-off-by: @stsuteng,@stsuteng
4 years ago
0a31f563a7
minor fixes
4 years ago
4f78ee0077
fix getitem bug
4 years ago
deb1e6e965
use from_numpy and add do_copy option
4 years ago
70dc40551a
!10020 Improve fancy index from 1st dimension to arbitrarily dimension
...
From: @yepei6
Reviewed-by:
Signed-off-by:
4 years ago
20df37e428
!10287 Add ut for dataset to_number
...
From: @luoyang42
Reviewed-by: @heleiwang
Signed-off-by:
4 years ago
565ce81b29
Fix allsawp
4 years ago
a1355a827c
introduce a master switch to turn on and off profiler
4 years ago
176ea4676c
!10261 change the int32 restrict to int restric
...
From: @yepei6
Reviewed-by: @kingxian,@kingxian
Signed-off-by: @kingxian,@kingxian
4 years ago
5c9982729d
fancy index getitem
4 years ago
9b3226c2b6
!10289 Ignore the graphs with defer_inline flag when specializing on graph arguments
...
From: @ginfung
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
4 years ago
236bfb75e3
change the int32 restrict to int
4 years ago
e1aa34a030
Ignore the graphs with defer_inline flag when specializing on graph arguments
4 years ago
00611b1c41
!10175 Add tensor.ndim and rename tensor.size() to tensor.size
...
From: @yanglf1121
Reviewed-by: @kingxian,@zhunaipan
Signed-off-by: @kingxian
4 years ago
f1e1a2afd6
!10223 fixed codex and change bare pointer to shared pointer
...
From: @anancds
Reviewed-by: @limingqi107
Signed-off-by:
4 years ago
0e2f7a9e9e
add validate param to base class DatasetNode
4 years ago
da6de519ae
Add ut for dataset to_number
4 years ago
f8e5bffe4d
!10286 fix Wrong TypeError in numpy_native
...
From: @wangrao124
Reviewed-by: @zhunaipan,@kingxian
Signed-off-by: @kingxian
4 years ago
441e283e21
!10197 Add input check for the embedding
...
From: @huangxinjing
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
4 years ago
2fb3f0ef4f
fix Wrong TypeError in numpy_native
4 years ago
ee23af58d8
fixed codex
4 years ago
c5c905fdf5
add restriction for opt shard
4 years ago
5ff6de83eb
!10173 Fix Strategy Check for UnsortedSegments
...
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
4 years ago
d99189f681
!10207 Fix some minor doc, typo related to AutoNumWorker
...
From: @ziruiwu
Reviewed-by: @mikef
Signed-off-by:
4 years ago
4ae7102fd3
address 2 tickets
4 years ago
dd0da1542d
Add input check
4 years ago
918679daa3
add tensor.ndim and rename tensor.size() to tensor.size
4 years ago
a8446af1ab
Fix condition check
4 years ago
bad8c0e422
Modify profiling dir structure to fit the new Run Package
4 years ago
893d59afd7
!10097 Fix bugs for np.mean, np.asarray, np.concatenate, np.linspace
...
From: @yanglf1121
Reviewed-by:
Signed-off-by:
4 years ago
98ea8fa6ea
Added tests for chain samplers, fixed GetDatasetSize issue with chained samplers
4 years ago
fc11b7dd68
!10074 Fix a testcase error when shuffle is above cache
...
From: @lixiachen
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei,@liucunwei
4 years ago
691e3baab6
!10109 [MD] Fix Decode doc & RandomNode log
...
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
4 years ago
6035823c4b
!10044 fix get num classes of concat
...
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang,@liucunwei
Signed-off-by: @liucunwei,@liucunwei
4 years ago
760cd1870a
corner cases check for np.asarray, np.mean, np.concatenate
4 years ago
595b7a782f
[MD] Fix Decode doc & RandomNode log
4 years ago
734f50f36e
!10083 support non tensor inputs in model predict
...
From: @zhangbuxue
Reviewed-by: @zhunaipan,@zh_qh
Signed-off-by: @zh_qh
4 years ago
f90f77c16e
support non tensor inputs in model predict
4 years ago
aeeef7607a
remove the 'raise' in construct of Cell
4 years ago
a7f0e13234
Remove special treatment for cache above repeat
4 years ago
df9f4f41e8
fix get num classes of concat
4 years ago
26ff566f90
!10002 fix get dataset size in distributed scenario
...
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
4 years ago
633f97bb48
fix get dataset size in distributed scenario
4 years ago
9072283395
fix mindpsore.numpy packaging issue and format API comments
4 years ago
c4f284b928
!9910 [MD][Perf] MindData add NormalizePad for GPU performance
...
From: @xiefangqi
Reviewed-by:
Signed-off-by:
4 years ago
b8faa8293b
!9920 python eager add decode
...
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
4 years ago
dd134d7554
!9926 optimize list setitem in bprop
...
From: @zhangbuxue
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
4 years ago
2530943a7f
optimize list getitem in bprop
4 years ago
3c6cc3c58c
Add NormalizePadOp
4 years ago
18e61a627a
python eager add decode
4 years ago
a9f2de8307
!9737 complete fancy index getitem
...
From: @yepei6
Reviewed-by:
Signed-off-by:
4 years ago
c403948961
!9931 add reset device, fix runtime delete ring buffer failed
...
From: @zhoufeng54
Reviewed-by: @kisnwang,@chujinjin
Signed-off-by: @chujinjin
4 years ago
4c8f0914d0
complete fancy index getitem
4 years ago
fd311cf316
!9843 Added server node
...
From: @anancds
Reviewed-by:
Signed-off-by:
4 years ago
ee7e412def
add reset device, fix runtime delete ring buffer failed
...
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
4 years ago
ca4225a4f3
!9717 amend some script
...
From: @jiangzg001
Reviewed-by: @liangchenghui,@c_34
Signed-off-by: @liangchenghui
4 years ago
058fbd2d1f
!9765 remove serving in mindspore repo
...
From: @xu-yfei
Reviewed-by: @zhoufeng54,@kisnwang
Signed-off-by: @kisnwang
4 years ago
2d2bf2d0ee
added server node
4 years ago
3a803b3c18
!9862 Fix the bug of ImageNetToMR
...
From: @shenwei41
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
4 years ago
9cf856dd25
amend some script
4 years ago
ad6507d88a
!9825 [MD] fix pad, normalize in c_trasnform
...
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
4 years ago
e10dbb4a7f
!9723 add ir passes to unify mindir
...
From: @yuchaojie
Reviewed-by:
Signed-off-by:
4 years ago
1984cf8e20
unify mindir
4 years ago
70d12aae26
add detailed and accurate description for support non tensor inputs for outermost net.
4 years ago
547f96717b
Fix Bug
4 years ago
d5db8872fd
!9834 Fix wrong input argument of Reshape for multi field embedding
...
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
4 years ago
996ee72c50
Fix embedding layer
...
Fix input check
4 years ago
5e35bec957
!9799 change_last_nodes_strategy_in_auto_parallel_when_eval_and_predict
...
From: @yao_yf
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
4 years ago
1cc147df1d
fix pad, normalize in c_trasnform
4 years ago
10d326ee62
!9798 hide arange
...
From: @bairongz
Reviewed-by: @zh_qh,@zhunaipan
Signed-off-by: @zh_qh
4 years ago
19fe28cb9b
hange strategys of last nodes in eval/predict at auto parallel mode
4 years ago
0f2b5d8cac
Changed SamplerObj validate params to return status and added AddChild to it
4 years ago
77521e78d2
staging
4 years ago
8cf43e59e0
hide arange, delete related test case and improve the doc string of nn.Range
4 years ago
60f7a62815
!9439 added worker node
...
From: @anancds
Reviewed-by:
Signed-off-by:
4 years ago
c9b072b94d
remove serving in mindspore repo
4 years ago
8c0d066bf9
!9763 Change name from interpolate to resizeBilinear
...
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh,@zhunaipan
Signed-off-by: @zh_qh
4 years ago
ee4132889e
added worker node
4 years ago
e78228603b
move parallel-related black-list to core/ir, and fix the cloneCNode bug
4 years ago
130c61cfc0
change name from interpolate to resizeBilinear
4 years ago
9ecf062581
!9552 change the import level of dynamic_lr
...
From: @wangnan39
Reviewed-by: @kingxian,@zh_qh,@kingxian
Signed-off-by: @kingxian,@kingxian
4 years ago
78fba32865
!9752 Fix potential hang in RandomData and incorrectly named functions
...
From: @ziruiwu
Reviewed-by: @heleiwang,@pandoublefeng
Signed-off-by: @pandoublefeng
4 years ago
3f82405d17
!9639 Add Numpy Native to Mindspore
...
From: @yanglf1121
Reviewed-by:
Signed-off-by:
4 years ago
91a6b2b0ca
Add checks to RandomData and LookUp
4 years ago
e8a442eeb3
!9700 add ps cache manager
...
From: @limingqi107
Reviewed-by:
Signed-off-by:
4 years ago
59e5afd2bb
Add mindnumpy to mindspore
4 years ago
63d5eb215f
!8965 Synchronize latest Ascend software suite 09 Dec 2020, with refactored GraphEngine
...
From: @nicholas_yhr
Reviewed-by:
Signed-off-by:
4 years ago
eca951c7bc
add ps cache manager
4 years ago
306bbe0e65
Synchronize latest Ascend software suite 09 Dec 2020, with refactored GraphEngine
4 years ago
0fe9e2e4cb
support import dynamic_lr from nn
4 years ago
a2aea8cba5
!9578 add_conv3d_transpose_object
...
From: @jiangzg001
Reviewed-by: @liangchenghui,@liangchenghui
Signed-off-by: @liangchenghui
4 years ago
6d34bacc17
!9470 support arange in functional.py
...
From: @bairongz
Reviewed-by: @ginfung
Signed-off-by:
4 years ago
5060565920
add conv3d_transpose.
4 years ago
317a97e6b9
!9336 auto num_parallel_workers setup
...
From: @ziruiwu
Reviewed-by:
Signed-off-by:
4 years ago
a2c80435ce
!9685 Fix a core dump in TreeConsumer::Terminate() plus minor cache fixes
...
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
d6df1b0832
Implemented AutoNumWorker Pass which sets num_workers of selected parallel ops automatically if enabled
4 years ago
32b82c2737
Fix a core dump in TreeConsumer::Terminate()
...
and other minor cache changes
4 years ago
934005f390
!9636 Remove batch_map multi-process test case
...
From: @hfarahat
Reviewed-by: @nsyca,@mikef
Signed-off-by: @mikef
4 years ago
e1e8f1d429
!9652 add ps cache
...
From: @limingqi107
Reviewed-by: @cristoval
Signed-off-by:
4 years ago
a5f57ce8a0
add ps cache
4 years ago
231fccf66c
!9600 Add Adagrad Optimizer
...
From: @zyx5256
Reviewed-by: @liangchenghui,@kingxian
Signed-off-by: @liangchenghui
4 years ago
ff65f6feb8
Remove batch_map multiprocess test case
4 years ago
0659473535
add TruncateSequencePair, ToNumber C++ API and enable three test cases
4 years ago
f6a22cb455
!9591 Assignment enables negative index
...
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
4 years ago
ec3983b77d
!9577 support distributed predict
...
From: @gong_zi_yan
Reviewed-by: @caozhou_huawei,@yao_yf,@stsuteng,@zh_qh
Signed-off-by: @stsuteng
4 years ago
37bebc751b
add adagrad optim
4 years ago
49fd5308a4
!9564 Tidy up code in dataset compilation phase
...
From: @nsyca
Reviewed-by:
Signed-off-by:
4 years ago
6b5626634c
!9530 add BasicTokenizer and BertTokenizer C++ API
...
From: @tiancixiao
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
41ea1621c5
Tidy up TreeAdapter::Compile
4 years ago
e6ec9be6c2
!9386 l1_regularizer开发
...
From: @dangjiaqi1
Reviewed-by:
Signed-off-by:
4 years ago
39948670dd
new update basic.py which add class L1Regularizer(Cell). new add test_l1_regularizer.py. new add test_l1_regularizer.py
4 years ago
3189868a15
Assignment enable index smaller than 0
4 years ago
2eeaec7512
support arange in functional.py
4 years ago
e7e9dae54d
support distributed predict
4 years ago
186f5394ba
!9155 add_conv3d_object
...
From: @jiangzg001
Reviewed-by:
Signed-off-by:
4 years ago
5d1a8b09db
!9097 Primitive Shape support return range of dynamic shape
...
From: @M20211031
Reviewed-by: @ginfung
Signed-off-by:
4 years ago
3c4a585143
!9545 Move API inner.DynamicGRUV2 to P.DynamicGRUV2.
...
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
4 years ago
aa5d4e08a9
!9544 Fix a possible seg fault in GenerateCRC caused by std::regex
...
From: @lixiachen
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @heleiwang
4 years ago
712ad98a92
Move API inner.DynamicGRUV2 to P.DynamicGRUV2.
4 years ago
921930a3ae
!9524 Add RegexReplace and RegexTokenizer C++ API
...
From: @shenwei41
Reviewed-by:
Signed-off-by:
4 years ago
3b7acc57c9
!9508 [Auto parallel] Set CNODE's fullname when cloning
...
From: @xiaoda_zh
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
4 years ago
206ae1a7c3
Add Three text C++ API
4 years ago
27579fe858
Fix a seg fault caused by std::regex
4 years ago
4cb78f2e03
Remove Repeat(1),Take(-1), and Skip(0) in NodeRemovalPass
4 years ago
3280474d71
!9533 dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix
...
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
0c8dfc68ec
Fix hang on RequestFreeTag
4 years ago
69b269c6cf
dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix
4 years ago
290cc72887
add BasicTokenizer and BertTokenizer C++ API
4 years ago
c45eee9b94
add conv3d object
4 years ago
9a9e3a751e
set cnode's fullname when cloning
4 years ago
4f607e9c26
!9335 Add multiprocessing support to per_batch_map
...
From: @hfarahat
Reviewed-by:
Signed-off-by:
4 years ago
a6b716003f
!9469 Fix minor issues in distribution classes
...
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by: @sunnybeike
4 years ago
4ef9e9e57f
fix minor issues in distribution classes
4 years ago
d69a29a44e
Migrate 3 pre passes to IR optimizer, namely, cache_error_pass, epoch_injection, and removal_pass
4 years ago
73c91e05b1
!9398 Change Build to return status
...
From: @alex-yuyue
Reviewed-by: @mikef
Signed-off-by:
4 years ago
4bb7303463
!9424 [PipelineSplit]Fix Shared Parameter bug
...
From: @lichen666
Reviewed-by: @zh_qh
Signed-off-by:
4 years ago
818e920f02
fix_pipeline_split_param_shared_bug
4 years ago
82268dc703
support DynamicShape and StridedSlice primitive return range of shape value.
4 years ago
ccff3a5316
Change build to return status
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
afe4a5fa81
!9395 [MD] Fix concat issue & fix schema doc
...
From: @luoyang42
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @jonyguo
4 years ago
b9d2392937
!9350 Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end
...
From: @peixu_ren
Reviewed-by: @liangchenghui,@zh_qh
Signed-off-by: @liangchenghui
4 years ago
809f9c91be
Add multiprocessing support to per_batch_map
4 years ago
a2ec7ad5bd
Fix concat issue & fix schema doc
4 years ago
78e131cf15
pipeline_split adapt parallel
4 years ago
79fef0df0e
!9142 fix bug of addn not supported dynamic shape
...
From: @M20211031
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
4 years ago
0c7ba7a7fa
!9354 mode_mindir_suffix
...
From: @bai-yangfan
Reviewed-by: @c_34,@guoqi1024
Signed-off-by: @c_34
4 years ago
efc7e9f89e
!9358 PyNative Bugfix
...
From: @jojobugfree
Reviewed-by: @chujinjin,@jjfeing
Signed-off-by: @jjfeing
4 years ago
c8e7c3edb0
PyNative Hccl Bugfix
4 years ago
c46c4dffe4
mindir_suffix
4 years ago
0adab15de7
Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end
4 years ago
51d885815a
!9281 increase variable_memory_max_size max size from 30GB to 31GB
...
From: @laiyongqiang
Reviewed-by:
Signed-off-by:
4 years ago
6c18c09121
!9266 PyNative Support Hccl(Data Parallel)
...
From: @jojobugfree
Reviewed-by: @chujinjin,@jjfeing
Signed-off-by: @chujinjin
4 years ago
df44e1339e
!9249 Optimizing GetDatasetSize
...
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
4 years ago
9ed31ea2cb
!9339 Disable getter optimization pass
...
From: @ezphlow
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @nsyca
4 years ago
4ffd9b578f
!9331 More cache minor fix for HQ testers
...
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
db2a8b5e1d
Disable getter pass
4 years ago
f80553bc6e
Optimization for GetDatasetSize
4 years ago
2ddb1fb75e
More CRC fix and blocking BatchOp under cache
4 years ago
04d8cd5d8b
Support PyNative Data Parallel
4 years ago
77ef72be30
!9306 fix ndarray field without type in mindrecord
...
From: @jonyguo
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
4 years ago
11244f790a
increase variable_memory_max_size max size from 30GB to 31GB
4 years ago
45b705bca0
!9129 support abs() and mean() method for Tensor object
...
From: @bairongz
Reviewed-by:
Signed-off-by:
4 years ago
847e59bd6c
fix: ndarray field without type in mindrecord
4 years ago
920bbf1541
!9277 fix schema & zip validation
...
From: @luoyang42
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
4 years ago
da8d7d661a
!9283 Modify the dataset ut log message
...
From: @liucunwei
Reviewed-by: @pandoublefeng,@heleiwang,@jonyguo
Signed-off-by: @heleiwang,@jonyguo
4 years ago
c41a21d2c2
!9208 Add four new c++ api of text
...
From: @shenwei41
Reviewed-by: @heleiwang
Signed-off-by:
4 years ago
8ef4b2796e
modify the dataset ut log message
4 years ago
0e6d06c463
!9230 Set trace info of Primitive CNode only for equiv out node, not the whole fprop function.
...
From: @zh_qh
Reviewed-by: @ginfung
Signed-off-by: @ginfung
4 years ago
5cc3b76577
fix schema & zip validation
4 years ago
623b2e3f99
support abs and mean of Tensor
4 years ago
e45f19adc8
!8697 support the outermost layer network inputs are list or dict or scalar
...
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
4 years ago
3bea84d0f7
add four new text API
4 years ago
8310236ff1
Set trace info of Primitive CNode only for equiv out node, not the whole fprop function.
4 years ago
5306c91cb7
!9214 support repeated calculation when the axis of gatherv2 is 0 and split
...
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
4 years ago
ea191ed5da
!8463 Run ops one by one in pynative bp graph
...
From: @HulkTang
Reviewed-by:
Signed-off-by:
4 years ago
af3c27d354
!9244 Fix core dump with concat and getter_pass
...
From: @ziruiwu
Reviewed-by:
Signed-off-by:
4 years ago
ccf637f64a
!9241 SequenceMask gpu kernel
...
From: @peilin-wang
Reviewed-by: @tom__chen
Signed-off-by:
4 years ago
c3e7a8255c
!9248 Add input check to nlp operators
...
From: @ezphlow
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
cf802c839c
Added missing input check for nlp operator
4 years ago
23487fae09
fix get_shape/type and a segfault in getter_pass
...
add test case
4 years ago
f7dc2432a0
initial commit
...
fix ci
fix ci
remove old sequence mask api
fix ci
fix ci
remove old seuqence mask tests
4 years ago
7748ae823a
!9141 Fix DatasetCache C++ API cache sharing behavior
...
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
a37e9710b5
!9038 port name functions from TensorOp to TensorOperation
...
From: @mhmotallebi
Reviewed-by:
Signed-off-by:
4 years ago
d6f91133c3
Support the outermost layer network inputs are list or dict or scalar
4 years ago
762793cb8f
!9175 fix a bug in random resize crop op and some lint
...
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo,@liucunwei
Signed-off-by: @liucunwei
4 years ago
f0671ce513
!9076 [MD] Support vision c_transform python eager: Resize, Rescale, Normalize, HWC2CHW, Pad
...
From: @luoyang42
Reviewed-by:
Signed-off-by:
4 years ago
59f9ac9975
Primitive 'AddN' support dynamic shape
4 years ago
7b33f3e2ac
gatherv2 axis split repeated calculation
4 years ago
b85bcff4b2
!9057 modify export file name
...
From: @changzherui
Reviewed-by:
Signed-off-by:
4 years ago
12da8717b7
1.correct param check for vision op 2.fix config review 3.fix api doc
4 years ago
42f32b7c4b
!9173 support batch size small than dev size in parallel gatherv2
...
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
4 years ago
c36b477568
Run ops one by one in pynative bp graph
4 years ago
a6845395e6
!9181 Add some ut pipeline test case for C++ dataset
...
From: @liucunwei
Reviewed-by: @pandoublefeng,@jonyguo
Signed-off-by: @jonyguo
4 years ago
e612e23a05
Add some ut pipeline test case for C++ dataset
4 years ago
7f13f2ad0e
add some pipeline ut test cases for c++ dataset
4 years ago
7278f5c109
update_gatherv2_op
4 years ago
c79e988b0d
set fullname for reshape after reshape-elimination
4 years ago
a146f982bc
!8983 support variabel length virtual_dataset in auto parallel
...
From: @yao_yf
Reviewed-by:
Signed-off-by:
4 years ago
dcde1fc70a
!9092 Add LBeta op at nn level
...
From: @peixu_ren
Reviewed-by:
Signed-off-by:
4 years ago
aa4bf9a3f2
[MD] Support python-eager: Resize, Rescale, Normalize, HWC2CHW, Pad
4 years ago
91301a6d1a
modify export file name
4 years ago
cf383af36e
!8624 updated cluster config and proto
...
From: @anancds
Reviewed-by:
Signed-off-by:
4 years ago
c1002d2eb4
!9138 Address left over comments from PR8802
...
From: @ziruiwu
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @nsyca
4 years ago
55f7e3dc16
!9135 Minor fixs for cache error message
...
From: @tina_mengting_zhang
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @nsyca
4 years ago
9cfeb08c4d
port name() to TensorOperation and its derived classes
4 years ago
e8247eadef
Same runtime CacheClient if c++ cache is shared
4 years ago
37d40bc495
Add Beta distribution
4 years ago
6f31bdbf67
fix issues for hq testers: I277HD, I277HV
4 years ago
36bfd0d8ad
address left over cmts from 8802
4 years ago
6355f46d32
Add LBeta op at nn level
4 years ago
3e57236fe3
add some new ut test for minddataset
4 years ago
3bed28822d
!9024 Add four text C++ API
...
From: @shenwei41
Reviewed-by:
Signed-off-by:
4 years ago
aa2296bcc1
!9094 Blocking TakeOp/SkipOp under Cache
...
From: @lixiachen
Reviewed-by: @nsyca,@mikef,@nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
fc380b8071
updated cluster config and proto
4 years ago
4e56618d18
Add text C++ API
4 years ago
3fa7233f68
!9072 fix topk fussion help tensor size = 4096*2
...
From: @jjfeing
Reviewed-by: @chujinjin,@kisnwang
Signed-off-by:
4 years ago
27698866d1
Block take/skip under cache and fix docstring
...
and other minor changes per the request of HQ testers
4 years ago
5e1bb0b697
boilerplate code for future IR optimizer
...
add 2 test cases to IRNode Deepcopy()
address review cmts
fix ut
samplerObj copy
ci
fix ci
fix ci round III
address further review cmts
add a missing macro
fix merge conflict
fix complie err
fix lite compile err
fix compile err
fix lite compile round III
address an issue
fix minor comments
4 years ago
9cda064716
auto parallel predict
4 years ago
8fb7d11ecb
fix topk help 4096
4 years ago
421cad24ef
!8715 Add Gamma distribution
...
From: @peixu_ren
Reviewed-by:
Signed-off-by:
4 years ago
adc8e3e707
!8594 [MD] Pybind Pushdown Support for dataset
...
From: @cathwong
Reviewed-by:
Signed-off-by:
4 years ago
809e1d5086
added python api based on cpp api
...
1st draft of python iterator
Added Cifar10 and Cifar100 pybind port
Change pybind to use IR for Skip and Manifest
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
DatasetNode as a base for all IR nodes
namespace change
Fix the namespace issue and make ut tests work
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
Add VOCDataset
!63 Added RandomDataset
* Added RandomDataset
add imagefolder ir
Pybind switch: CelebA and UT
!61 CLUE example with class definition
* Merge branch 'python-api' of gitee.com:ezphlow/mindspore into clue_class_pybind
* Passing testcases
* Added CLUE, not working
add ManifestDataset IR
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
Update Coco & VOC & TFReader, Update clang-format, Reorder
datasets_binding
!69 Add Generator and move c_dataset.Iterator to dataset.Iterator
* Add GeneratorDataset to c_dataset
* Add GeneratorDataset to c_dataset
!67 Moving c_datasets and adding sampler wrapper
* Need to add create() method in datasets.py
* migration from c_dataset to dataset part 1
!71 Fix indent error
* Fix indentation error
!72 Fix c_api tests cases
* Fix c_api tests cases
!73 Added CSV Dataset
* Added CSVDataset
pybind switch: Take and CelebA fixes
!75 move c_dataset functionality to datasets
* Fixed existing testcases
* Added working clue and imagefolder
* Added sampler conversion from pybind
* Added sampler creation
!77 Add Python API tree
* Python API tree
add minddataset
TextFileDataset pybind
Rename to skip test_concat.py and test_minddataset_exception.py
!80 Add batch IR to python-api branch, most test cases work
* staging III
* staging, add pybind
Enable more c_api take and CelebA tests; delete util_c_api
!84 Schema changes in datasets.py
* Schema changes
!85 Remove input_indexes from sub-classes
* remove input_index from each subclass
!83 Remove C datasets
* Removed c_dataset package
* Remove c_datasets
!82 pybind switch: shuffle
* pybind switch: shuffle
!86 Add build_vocab
* Add build_vocab
Rebase with upstream/master
_shuffle conflict
BatchNode error
!88 Fix rebase problem
* fix rebase problem
Enable more unit tests; code typo/nit fixes
!91 Fix python vocag hang
* Fix python vocab hang
!89 Added BucketBatchByLength Pybind switch
* Added BucketBatchByLength
Update and enable more tet_c_api_*.py tests
!95 Add BuildSentencePeiceVocab
* - Add BuildSentencePeiceVocab
!96 Fix more tests
* - Fix some tests
- Enable more test_c_api_*
- Add syncwait
!99 pybind switch for device op
* pybind switch for device op
!93 Add getters to python API
* Add getters to python API
!101 Validate tree, error if graph
* - Add sync wait
!103 TFrecord/Random Datasets schema problem
* - TfRecord/Random schem aproblem
!102 Added filter pybind switch
* Added Filter pybind switch
!104 Fix num_samples
* - TfRecord/Random schem aproblem
!105 Fix to_device hang
* Fix to_device hang
!94 Adds Cache support for CLUE dataset
* Added cache for all dataset ops
* format change
* Added CLUE cache support
* Added Cache conversion
Add save pybind
fix compile err
init modify concat_node
!107 Fix some tests cases
* Fix tests cases
Enable and fix more tests
!109 pybind switch for get dataset size
* pybind_get_dataset_size
some check-code fixes for pylint, cpplint and clang-format
!113 Add callback
* revert
* dataset_sz 1 line
* fix typo
* get callback to work
!114 Make Android compile clean
* Make Android Compile Clean
Fix build issues due to rebase
!115 Fix more tests
* Fix tests cases
* !93 Add getters to python API
fix test_profiling.py
!116 fix get dataset size
* fix get dataset size
!117 GetColumnNames pybind switch
* Added GetColumnNames pybind switch
code-check fixes: clangformat, cppcheck, cpplint, pylint
Delete duplicate test_c_api_*.py files; more lint fixes
!121 Fix cpp tests
* Remove extra call to getNext in cpp tests
!122 Fix Schema with Generator
* Fix Schema with Generator
fix some cases of csv & mindrecord
!124 fix tfrecord get_dataset_size and add some UTs
* fix tfrecord get dataset size and add some ut for get_dataset_size
!125 getter separation
* Getter separation
!126 Fix sampler.GetNumSamples
* Fix sampler.GetNumSampler
!127 Assign runtime getter to each get function
* Assign runtime getter to each get function
Fix compile issues
!128 Match master code
* Match master code
!129 Cleanup DeviceOp/save code
* Cleanup ToDevice/Save code
!130 Add cache fix
* Added cache fix for map and image folder
!132 Fix testing team issues
* Pass queue_name from python to C++
* Add Schema.from_json
!131 Fix Cache op issues and delete de_pipeline
* Roll back C++ change
* Removed de_pipeline and passing all cache tests.
* fixed cache tests
!134 Cleanup datasets.py part1
* Cleanup dataset.py part1
!133 Updated validation for SentencePieceVocab.from_dataset
* Added type_check for column names in SentencePieceVocab.from_dataset
Rebase on master 181120 10:20
fix profiling
temporary solution of catching stauts from Node.Build()
!141 ToDevice Termination
* ToDevice termination
pylint fixes
!137 Fix test team issues and add some corresponding tests
* Fix test team issues and add some corresponding tests
!138 TreeGetter changes to use OptPass
* Getter changes to use OptPass (Zirui)
Rebase fix
!143 Fix cpplint issue
* Fix cpplint issue
pylint fixes in updated testcases
!145 Reset exceptions testcase
* reset exception test to master
!146 Fix Check_Pylint Error
* Fix Check_Pylint Error
!147 fix android
* fix android
!148 ToDevice changes
* Add ToDevice to the iterator List for cleanup at exit
!149 Pylint issue
* Add ToDevice to the iterator List for cleanup at exit
!150 Pylint 2
* Add ToDevice to the iterator List for cleanup at exit
!152 ExecutionTree error
* ET destructor error
!153 in getter_pass, only remove callback, without deleting map op
* getter pass no longer removes map
!156 early __del__ of iterator/to_device
* early __del__ of iterator
!155 Address review comments Eric 1
* Added one liner fix to validators.py
* roll back signature fix
* lint fix
* Eric Address comments 2
* C++ lint fix
* Address comments Eric 1
!158 Review rework for dataset bindings - part 1
* Reorder nodes repeat and rename
* Review rework for dataset bindings - part 1
!154 Fixing minor problems in the comments (datasets.py, python_tree_consumer.cc, iterators_bindings.cc, and iterators.py)
* Fixing minor problems in the comments (datasets.py, python_tree_consum…
!157 add replace none
* Add replace_none to datasets.py, address comments in tests
Trying to resolve copy
Override the deepcopy method of deviceop
Create_ir_tree method
Create_ir_tree method 2
Create_ir_tree method 2
del to_device if already exists
del to_device if already exists
cache getters shapes and types
Added yolov3 relaxation, to be rolled back
Get shapes and types together
bypass yolo
NumWorkers for MapOp
revert Yolo
revert Thor
Print more info
Debug code: Update LOG INFO to LOG ERROR
do not remove epochctrl for getter pass
Remove repeat(1)
pritn batch size
add log to tree_consumer and device_queue op
Revert PR 8744
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
__del__ toDEvice
__del__ toDevice2
!165 add ifndef ENABLE_ANDROID to device queue print
* Add ifndef ENABLE_ANDROID to device queue print
revert some changes
!166 getter: get_data_info
* getter: get_data_info
!168 add back tree print
* revert info to warnning in one log
* add back the missed print tree log
Release GIL in GetDataInfo
4 years ago
979bb26cba
!9031 Fix DatasetCache parameter check
...
From: @lixiachen
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
ab7427f1a9
Minor fix for DatasetCache param validation
4 years ago
93d4ef428f
Add Gamma distribution
4 years ago
22d683a805
!8920 Adapt ops LinSpace for Ascend.
...
From: @liu_xiao_93
Reviewed-by: @liangchenghui,@linqingke,@liangchenghui
Signed-off-by: @liangchenghui,@liangchenghui
4 years ago
d9b4b5c750
!8954 Add SequenceMask operator.
...
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
4 years ago
584e241e29
Adapt ops LinSpace for Ascend.
4 years ago
01f5da0a14
Add Poisson distribution
4 years ago
7c73bc50f4
fixed codex
4 years ago
17c0810f9e
add SequenceMask operator
4 years ago
d532af3a9a
new hccl interface
...
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
4 years ago
0d49650bd5
!8888 Add PyNative Device Profiling
...
From: @jojobugfree
Reviewed-by: @kisnwang,@jjfeing
Signed-off-by: @jjfeing
4 years ago
3d6d820612
!8154 Add nn.MultiFieldEmbedding for the embedding lookup opearations
...
From: @huangxinjing
Reviewed-by:
Signed-off-by:
4 years ago
d915fd9b96
!8592 change repeat_elements to a composite op
...
From: @tom__chen
Reviewed-by:
Signed-off-by:
4 years ago
b0deb7a289
Add dense embedding
4 years ago
mindspore-ci-bot
yujianfeng
Ziyan
LianLiguang
buxue
chendongsheng
Xiao Tianci
yanghaoran
Zirui Wu
Payne
ms_yan
huangxinjing
YangLuo
wangrao
yanglf1121
gzhcv
Mahdi
Lixia Chen
xiefangqi
zhoufeng
jiangzhenguang
jjfeing
shenwei41
yao_yf
Bairong
xuyongfei
Xiaoda Zhang
l00591931
yanglf1121
limingqi107
wangnan39@huawei.com
hesham
zhuyuxiao
Nat Sutyanyong
“dangjiaqi1”
liuxiao93
Jesse Lee
Cathy Wong
Xun Deng
lichenever
mxm
alex-yuyue
caifubi
bai-yangfan
peixu_ren
Eric
laiyongqiang
jonyguo
liucunwei
Zhang Qinghua
Peilin Wang
yangzhenzhang
HulkTang
changzherui
mohammad
tinazhang
anancds