b5e91139e2
add GetDatasetSize to concat node
4 years ago
6394ba3974
!11499 delete useless params in pipeline parallel
...
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
4 years ago
8241dfa443
Add dynamic shape support for the operator Concat
4 years ago
0c5b6107a7
!11475 support dict for isinstance
...
From: @zhangbuxue
Reviewed-by: @ginfung,@zh_qh,@ginfung
Signed-off-by: @ginfung
4 years ago
cbca482e59
delete useless parameter in pipeline parallel
4 years ago
7d9f5f6dba
modify Tensor
4 years ago
2ea8b9e738
add dict for isinstance
4 years ago
7303c3d3b8
add group ckpt
4 years ago
a8675f8227
TextOp decoupling
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
55594db01c
!11348 add check for outermost net inputs type and support isinstance first arg is an empty list
...
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
4 years ago
e8cd572bc2
add check for outermost net inputs type and support isinstance first arg an empty list
4 years ago
775d71f9c1
!11408 Update PP example
...
From: @zichun_ye
Reviewed-by: @wang_zi_dong,@sunnybeike
Signed-off-by:
4 years ago
ca316f4422
update doc example in probability
...
fix typo in probability module
fix pylint in msp
4 years ago
60feffad20
!11332 update Pooling's attr kernel_size, pad_mode
...
From: @yuchaojie
Reviewed-by:
Signed-off-by:
4 years ago
273865a72b
Rename SamplerObj::Build() to SamplerBuild()
4 years ago
91842af2ad
!11245 Pushing down pipeline json serializer logic to C++ IR - PART II
...
From: @tina_mengting_zhang
Reviewed-by:
Signed-off-by:
4 years ago
15593dc98f
improve isinstance function in graph mode
4 years ago
b51b3a6764
update Pool's attr kernel_size, pad_mode
4 years ago
e214c69bc2
!11195 develop dice loss
...
From: @lijiaqi0612
Reviewed-by:
Signed-off-by:
4 years ago
69d9a33ddb
show line of code when parse or resolve phase exception
4 years ago
87ecd44f67
develop dice loss
4 years ago
d3fdbceb61
[Part II] Push down json save logic to IR and add getter to each IR node
4 years ago
eacc8bac89
!10755 [Numpy-Native] Add new numpy-native interfaces to mindspore.numpy
...
From: @yanglf1121
Reviewed-by:
Signed-off-by:
4 years ago
a2d9c5914a
!10944 Tensor op decoupling stage 2
...
From: @alexyuyue
Reviewed-by:
Signed-off-by:
4 years ago
b54e01bfb4
Tensor op decoupling stage 2
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
7eaf84d07a
remove attr support_non_tensor_input of cell
4 years ago
72903c11c8
add array_ops, math_ops and tensor ops
4 years ago
44507b4a64
!11200 support non tensor inputs for ms_function and grad of net
...
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
4 years ago
151c0e2977
!11132 modify batchnormal and fusedbatchnormal
...
From: @Somnus2020
Reviewed-by:
Signed-off-by:
4 years ago
acec35d4d4
support non tensor inputs
4 years ago
9a45c4419c
modify batch_normal
4 years ago
1dd600d416
!11114 add perplexity metric
...
From: @lijiaqi0612
Reviewed-by:
Signed-off-by:
4 years ago
4812fece80
[Part I] Push down json save logic to IR and add getter to each IR node
4 years ago
d6f4421a1d
perplexity
4 years ago
686772cce7
Migrate GeneratorOp resetting logic to IR optimizer (incl. debug code)
...
with comments from the peer view addressed
4 years ago
fb97aa327c
!10881 add the tensor collection feature when record summary
...
From: @jiang-shuqiang
Reviewed-by:
Signed-off-by:
4 years ago
ab5cc10250
add the tensor collection feature when record summary
4 years ago
aacad990c3
Add grad of sort.
4 years ago
7957a3b6f5
!10988 Tensor op decoupling stage 1
...
From: @ezphlow
Reviewed-by:
Signed-off-by:
4 years ago
be46ccf721
Started vision decoupling
...
map validate params
Changing bindings
Change behavior of vision.cc
Added signature and changed Cmake
Compiling
Need to fix compile
Added compiling random transforms
python changes for decoupling
two failed test case remaining
Compiling random choice
passes all ut
Changed assert
review comments
Added validate params
add back return value
Fix lint
py lint fix
pylint 2
Addressing comments
4 years ago
b355f5402b
!10309 Port over getter pass and tensor fusion pass to IR
...
From: @ziruiwu
Reviewed-by:
Signed-off-by:
4 years ago
0e68575e77
port over getter pass
...
port over tensor_op_fusion pass
add fusion support for prebuildOpeartion (TensorOpeartion)
4 years ago
f6de97fc27
bleu_score
4 years ago
62888f23b8
!10400 roc and auc
...
From: @lijiaqi0612
Reviewed-by:
Signed-off-by:
4 years ago
274e0aa750
!10885 add nll_loss operation
...
From: @jiangzg001
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
4 years ago
1276715c11
!10939 surface distance
...
From: @lijiaqi0612
Reviewed-by:
Signed-off-by:
4 years ago
ef3f6d62db
auc_roc
4 years ago
09848d7ef3
!9083 add dice and hausdroff
...
From: @lijiaqi0612
Reviewed-by:
Signed-off-by:
4 years ago
67296c08c7
!9502 add hausdroff distance
...
From: @lijiaqi0612
Reviewed-by:
Signed-off-by:
4 years ago
1c942ce49f
!10221 support grad accumulation for auto parallel
...
From: @yangzhenzhang
Reviewed-by:
Signed-off-by:
4 years ago
1f06cd63f3
!10436 Support to control whether to throw runtime exceptions in SummaryRecord
...
From: @ouwenchang
Reviewed-by:
Signed-off-by:
4 years ago
1d1f6841b9
!10937 keep consistent in Graph mode and PyNative mode for 'isinstance'
...
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
4 years ago
06be546b52
Support to control whether raise RuntimeError exception in SummaryRecord
...
1. Support explainer raise an RuntimeError exception
2. fix the ut of SummaryRecord
4 years ago
9da3f9bec9
mini step grad accumulation
4 years ago
d3f42e7d6b
add nll_loss operation.
4 years ago
03e655f14a
!10070 Fixing GetDatasetSize issue with chained samplers
...
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
4 years ago
6d395c1d3f
keep consistent in Graph mode and PyNative mode for 'isinstance'
4 years ago
a531628dd5
!10325 modify MetaTensor and Tensor
...
From: @Somnus2020
Reviewed-by: @kingxian
Signed-off-by: @kingxian
4 years ago
29cd33a542
3d
4 years ago
9a5b9525de
hausdorff_distance
4 years ago
ed7cf87d0b
surface distance
4 years ago
b858097ae4
modify MetaTensor and Tensor
4 years ago
b12ca2165c
add bool expand dims and wait to test
4 years ago
37a4cbfb3b
!10772 Prevent the multiprocess.pool from capturing KeyboardInterrupt,
...
From: @ouwenchang
Reviewed-by: @wenkai_dist,@wangyue01
Signed-off-by: @wangyue01
4 years ago
e5529230bf
Prevent the multiprocess from capturing KeyboardInterrupt
4 years ago
998483e0c3
!10610 add batchnorm3d and check in conv3d
...
From: @jiangzg001
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
4 years ago
9f950fb16c
add batchnorm3d
4 years ago
2e684df5b1
!10686 fix infer rank list typo and add testcase
...
From: @gong_zi_yan
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
4 years ago
2c3b99ce91
fix infer rank list typo
4 years ago
0d04de8db2
!10455 Expand J for innermost graph first when the graph also contains J primitive
...
From: @ginfung
Reviewed-by: @zhunaipan
Signed-off-by:
4 years ago
b67aaf6773
!9832 expose_allgather_fusion_to_users
...
From: @gong_zi_yan
Reviewed-by:
Signed-off-by:
4 years ago
728fac6c9f
Expand J for innermost graph first when the graph also contains J primitive
4 years ago
bbf8ec82b9
expose allgather fusion interface to users
4 years ago
1a7c161e73
support len of a Tensor
4 years ago
4df0baa6c7
!10392 getitem fix bug
...
From: @yepei6
Reviewed-by: @zhunaipan,@kingxian,@zhunaipan
Signed-off-by: @kingxian
4 years ago
221d5b67d2
!10442 change code in modelzoo to import dataset APIs from mindspore.dataset rather than mindspore.dataset.engine
...
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
4 years ago
31fed1a2f6
change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine
4 years ago
261bb736de
!10063 Modify profiler directory structure to fit the new Run Package
...
From: @gzhcv
Reviewed-by:
Signed-off-by:
4 years ago
1343c9cca2
!10255 using do_copy option to choose Tensor.from_numpy to do Tensor convert
...
From: @ms_yan
Reviewed-by:
Signed-off-by:
4 years ago
e1248a7246
!10389 Fix the Backward of the AllSwap Operation
...
From: @huangxinjing
Reviewed-by: @stsuteng,@stsuteng,@zhunaipan
Signed-off-by: @stsuteng,@stsuteng
4 years ago
4f78ee0077
fix getitem bug
4 years ago
deb1e6e965
use from_numpy and add do_copy option
4 years ago
70dc40551a
!10020 Improve fancy index from 1st dimension to arbitrarily dimension
...
From: @yepei6
Reviewed-by:
Signed-off-by:
4 years ago
20df37e428
!10287 Add ut for dataset to_number
...
From: @luoyang42
Reviewed-by: @heleiwang
Signed-off-by:
4 years ago
565ce81b29
Fix allsawp
4 years ago
a1355a827c
introduce a master switch to turn on and off profiler
4 years ago
176ea4676c
!10261 change the int32 restrict to int restric
...
From: @yepei6
Reviewed-by: @kingxian,@kingxian
Signed-off-by: @kingxian,@kingxian
4 years ago
5c9982729d
fancy index getitem
4 years ago
9b3226c2b6
!10289 Ignore the graphs with defer_inline flag when specializing on graph arguments
...
From: @ginfung
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
4 years ago
236bfb75e3
change the int32 restrict to int
4 years ago
e1aa34a030
Ignore the graphs with defer_inline flag when specializing on graph arguments
4 years ago
00611b1c41
!10175 Add tensor.ndim and rename tensor.size() to tensor.size
...
From: @yanglf1121
Reviewed-by: @kingxian,@zhunaipan
Signed-off-by: @kingxian
4 years ago
da6de519ae
Add ut for dataset to_number
4 years ago
f8e5bffe4d
!10286 fix Wrong TypeError in numpy_native
...
From: @wangrao124
Reviewed-by: @zhunaipan,@kingxian
Signed-off-by: @kingxian
4 years ago
441e283e21
!10197 Add input check for the embedding
...
From: @huangxinjing
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
4 years ago
2fb3f0ef4f
fix Wrong TypeError in numpy_native
4 years ago
c5c905fdf5
add restriction for opt shard
4 years ago
5ff6de83eb
!10173 Fix Strategy Check for UnsortedSegments
...
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
4 years ago
d99189f681
!10207 Fix some minor doc, typo related to AutoNumWorker
...
From: @ziruiwu
Reviewed-by: @mikef
Signed-off-by:
4 years ago
4ae7102fd3
address 2 tickets
4 years ago
dd0da1542d
Add input check
4 years ago
918679daa3
add tensor.ndim and rename tensor.size() to tensor.size
4 years ago
a8446af1ab
Fix condition check
4 years ago
bad8c0e422
Modify profiling dir structure to fit the new Run Package
4 years ago
893d59afd7
!10097 Fix bugs for np.mean, np.asarray, np.concatenate, np.linspace
...
From: @yanglf1121
Reviewed-by:
Signed-off-by:
4 years ago
98ea8fa6ea
Added tests for chain samplers, fixed GetDatasetSize issue with chained samplers
4 years ago
fc11b7dd68
!10074 Fix a testcase error when shuffle is above cache
...
From: @lixiachen
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei,@liucunwei
4 years ago
691e3baab6
!10109 [MD] Fix Decode doc & RandomNode log
...
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
4 years ago
6035823c4b
!10044 fix get num classes of concat
...
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang,@liucunwei
Signed-off-by: @liucunwei,@liucunwei
4 years ago
760cd1870a
corner cases check for np.asarray, np.mean, np.concatenate
4 years ago
595b7a782f
[MD] Fix Decode doc & RandomNode log
4 years ago
734f50f36e
!10083 support non tensor inputs in model predict
...
From: @zhangbuxue
Reviewed-by: @zhunaipan,@zh_qh
Signed-off-by: @zh_qh
4 years ago
f90f77c16e
support non tensor inputs in model predict
4 years ago
aeeef7607a
remove the 'raise' in construct of Cell
4 years ago
a7f0e13234
Remove special treatment for cache above repeat
4 years ago
df9f4f41e8
fix get num classes of concat
4 years ago
26ff566f90
!10002 fix get dataset size in distributed scenario
...
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
4 years ago
633f97bb48
fix get dataset size in distributed scenario
4 years ago
9072283395
fix mindpsore.numpy packaging issue and format API comments
4 years ago
c4f284b928
!9910 [MD][Perf] MindData add NormalizePad for GPU performance
...
From: @xiefangqi
Reviewed-by:
Signed-off-by:
4 years ago
b8faa8293b
!9920 python eager add decode
...
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
4 years ago
dd134d7554
!9926 optimize list setitem in bprop
...
From: @zhangbuxue
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
4 years ago
2530943a7f
optimize list getitem in bprop
4 years ago
3c6cc3c58c
Add NormalizePadOp
4 years ago
18e61a627a
python eager add decode
4 years ago
a9f2de8307
!9737 complete fancy index getitem
...
From: @yepei6
Reviewed-by:
Signed-off-by:
4 years ago
4c8f0914d0
complete fancy index getitem
4 years ago
ca4225a4f3
!9717 amend some script
...
From: @jiangzg001
Reviewed-by: @liangchenghui,@c_34
Signed-off-by: @liangchenghui
4 years ago
3a803b3c18
!9862 Fix the bug of ImageNetToMR
...
From: @shenwei41
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
4 years ago
9cf856dd25
amend some script
4 years ago
ad6507d88a
!9825 [MD] fix pad, normalize in c_trasnform
...
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
4 years ago
e10dbb4a7f
!9723 add ir passes to unify mindir
...
From: @yuchaojie
Reviewed-by:
Signed-off-by:
4 years ago
1984cf8e20
unify mindir
4 years ago
70d12aae26
add detailed and accurate description for support non tensor inputs for outermost net.
4 years ago
547f96717b
Fix Bug
4 years ago
d5db8872fd
!9834 Fix wrong input argument of Reshape for multi field embedding
...
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
4 years ago
996ee72c50
Fix embedding layer
...
Fix input check
4 years ago
5e35bec957
!9799 change_last_nodes_strategy_in_auto_parallel_when_eval_and_predict
...
From: @yao_yf
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
4 years ago
1cc147df1d
fix pad, normalize in c_trasnform
4 years ago
10d326ee62
!9798 hide arange
...
From: @bairongz
Reviewed-by: @zh_qh,@zhunaipan
Signed-off-by: @zh_qh
4 years ago
19fe28cb9b
hange strategys of last nodes in eval/predict at auto parallel mode
4 years ago
77521e78d2
staging
4 years ago
8cf43e59e0
hide arange, delete related test case and improve the doc string of nn.Range
4 years ago
8c0d066bf9
!9763 Change name from interpolate to resizeBilinear
...
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh,@zhunaipan
Signed-off-by: @zh_qh
4 years ago
e78228603b
move parallel-related black-list to core/ir, and fix the cloneCNode bug
4 years ago
130c61cfc0
change name from interpolate to resizeBilinear
4 years ago
9ecf062581
!9552 change the import level of dynamic_lr
...
From: @wangnan39
Reviewed-by: @kingxian,@zh_qh,@kingxian
Signed-off-by: @kingxian,@kingxian
4 years ago
78fba32865
!9752 Fix potential hang in RandomData and incorrectly named functions
...
From: @ziruiwu
Reviewed-by: @heleiwang,@pandoublefeng
Signed-off-by: @pandoublefeng
4 years ago
3f82405d17
!9639 Add Numpy Native to Mindspore
...
From: @yanglf1121
Reviewed-by:
Signed-off-by:
4 years ago
91a6b2b0ca
Add checks to RandomData and LookUp
4 years ago
59e5afd2bb
Add mindnumpy to mindspore
4 years ago
0fe9e2e4cb
support import dynamic_lr from nn
4 years ago
a2aea8cba5
!9578 add_conv3d_transpose_object
...
From: @jiangzg001
Reviewed-by: @liangchenghui,@liangchenghui
Signed-off-by: @liangchenghui
4 years ago
6d34bacc17
!9470 support arange in functional.py
...
From: @bairongz
Reviewed-by: @ginfung
Signed-off-by:
4 years ago
5060565920
add conv3d_transpose.
4 years ago
317a97e6b9
!9336 auto num_parallel_workers setup
...
From: @ziruiwu
Reviewed-by:
Signed-off-by:
4 years ago
a2c80435ce
!9685 Fix a core dump in TreeConsumer::Terminate() plus minor cache fixes
...
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
d6df1b0832
Implemented AutoNumWorker Pass which sets num_workers of selected parallel ops automatically if enabled
4 years ago
32b82c2737
Fix a core dump in TreeConsumer::Terminate()
...
and other minor cache changes
4 years ago
934005f390
!9636 Remove batch_map multi-process test case
...
From: @hfarahat
Reviewed-by: @nsyca,@mikef
Signed-off-by: @mikef
4 years ago
231fccf66c
!9600 Add Adagrad Optimizer
...
From: @zyx5256
Reviewed-by: @liangchenghui,@kingxian
Signed-off-by: @liangchenghui
4 years ago
ff65f6feb8
Remove batch_map multiprocess test case
4 years ago
f6a22cb455
!9591 Assignment enables negative index
...
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
4 years ago
ec3983b77d
!9577 support distributed predict
...
From: @gong_zi_yan
Reviewed-by: @caozhou_huawei,@yao_yf,@stsuteng,@zh_qh
Signed-off-by: @stsuteng
4 years ago
37bebc751b
add adagrad optim
4 years ago
e6ec9be6c2
!9386 l1_regularizer开发
...
From: @dangjiaqi1
Reviewed-by:
Signed-off-by:
4 years ago
39948670dd
new update basic.py which add class L1Regularizer(Cell). new add test_l1_regularizer.py. new add test_l1_regularizer.py
4 years ago
3189868a15
Assignment enable index smaller than 0
4 years ago
2eeaec7512
support arange in functional.py
4 years ago
e7e9dae54d
support distributed predict
4 years ago
186f5394ba
!9155 add_conv3d_object
...
From: @jiangzg001
Reviewed-by:
Signed-off-by:
4 years ago
5d1a8b09db
!9097 Primitive Shape support return range of dynamic shape
...
From: @M20211031
Reviewed-by: @ginfung
Signed-off-by:
4 years ago
3c4a585143
!9545 Move API inner.DynamicGRUV2 to P.DynamicGRUV2.
...
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
4 years ago
aa5d4e08a9
!9544 Fix a possible seg fault in GenerateCRC caused by std::regex
...
From: @lixiachen
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @heleiwang
4 years ago
712ad98a92
Move API inner.DynamicGRUV2 to P.DynamicGRUV2.
4 years ago
3b7acc57c9
!9508 [Auto parallel] Set CNODE's fullname when cloning
...
From: @xiaoda_zh
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
4 years ago
27579fe858
Fix a seg fault caused by std::regex
4 years ago
4cb78f2e03
Remove Repeat(1),Take(-1), and Skip(0) in NodeRemovalPass
4 years ago
3280474d71
!9533 dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix
...
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
0c8dfc68ec
Fix hang on RequestFreeTag
4 years ago
69b269c6cf
dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix
4 years ago
c45eee9b94
add conv3d object
4 years ago
9a9e3a751e
set cnode's fullname when cloning
4 years ago
4f607e9c26
!9335 Add multiprocessing support to per_batch_map
...
From: @hfarahat
Reviewed-by:
Signed-off-by:
4 years ago
a6b716003f
!9469 Fix minor issues in distribution classes
...
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by: @sunnybeike
4 years ago
4ef9e9e57f
fix minor issues in distribution classes
4 years ago
d69a29a44e
Migrate 3 pre passes to IR optimizer, namely, cache_error_pass, epoch_injection, and removal_pass
4 years ago
73c91e05b1
!9398 Change Build to return status
...
From: @alex-yuyue
Reviewed-by: @mikef
Signed-off-by:
4 years ago
4bb7303463
!9424 [PipelineSplit]Fix Shared Parameter bug
...
From: @lichen666
Reviewed-by: @zh_qh
Signed-off-by:
4 years ago
818e920f02
fix_pipeline_split_param_shared_bug
4 years ago
82268dc703
support DynamicShape and StridedSlice primitive return range of shape value.
4 years ago
ccff3a5316
Change build to return status
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
b9d2392937
!9350 Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end
...
From: @peixu_ren
Reviewed-by: @liangchenghui,@zh_qh
Signed-off-by: @liangchenghui
4 years ago
809f9c91be
Add multiprocessing support to per_batch_map
4 years ago
78e131cf15
pipeline_split adapt parallel
4 years ago
79fef0df0e
!9142 fix bug of addn not supported dynamic shape
...
From: @M20211031
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
4 years ago
c46c4dffe4
mindir_suffix
4 years ago
0adab15de7
Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end
4 years ago
51d885815a
!9281 increase variable_memory_max_size max size from 30GB to 31GB
...
From: @laiyongqiang
Reviewed-by:
Signed-off-by:
4 years ago
df44e1339e
!9249 Optimizing GetDatasetSize
...
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
4 years ago
4ffd9b578f
!9331 More cache minor fix for HQ testers
...
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
f80553bc6e
Optimization for GetDatasetSize
4 years ago
2ddb1fb75e
More CRC fix and blocking BatchOp under cache
4 years ago
77ef72be30
!9306 fix ndarray field without type in mindrecord
...
From: @jonyguo
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
4 years ago
11244f790a
increase variable_memory_max_size max size from 30GB to 31GB
4 years ago
45b705bca0
!9129 support abs() and mean() method for Tensor object
...
From: @bairongz
Reviewed-by:
Signed-off-by:
4 years ago
847e59bd6c
fix: ndarray field without type in mindrecord
4 years ago
920bbf1541
!9277 fix schema & zip validation
...
From: @luoyang42
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
4 years ago
5cc3b76577
fix schema & zip validation
4 years ago
623b2e3f99
support abs and mean of Tensor
4 years ago
e45f19adc8
!8697 support the outermost layer network inputs are list or dict or scalar
...
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
4 years ago
5306c91cb7
!9214 support repeated calculation when the axis of gatherv2 is 0 and split
...
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
4 years ago
af3c27d354
!9244 Fix core dump with concat and getter_pass
...
From: @ziruiwu
Reviewed-by:
Signed-off-by:
4 years ago
ccf637f64a
!9241 SequenceMask gpu kernel
...
From: @peilin-wang
Reviewed-by: @tom__chen
Signed-off-by:
4 years ago
c3e7a8255c
!9248 Add input check to nlp operators
...
From: @ezphlow
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
cf802c839c
Added missing input check for nlp operator
4 years ago
23487fae09
fix get_shape/type and a segfault in getter_pass
...
add test case
4 years ago
f7dc2432a0
initial commit
...
fix ci
fix ci
remove old sequence mask api
fix ci
fix ci
remove old seuqence mask tests
4 years ago
d6f91133c3
Support the outermost layer network inputs are list or dict or scalar
4 years ago
762793cb8f
!9175 fix a bug in random resize crop op and some lint
...
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo,@liucunwei
Signed-off-by: @liucunwei
4 years ago
f0671ce513
!9076 [MD] Support vision c_transform python eager: Resize, Rescale, Normalize, HWC2CHW, Pad
...
From: @luoyang42
Reviewed-by:
Signed-off-by:
4 years ago
59f9ac9975
Primitive 'AddN' support dynamic shape
4 years ago
7b33f3e2ac
gatherv2 axis split repeated calculation
4 years ago
b85bcff4b2
!9057 modify export file name
...
From: @changzherui
Reviewed-by:
Signed-off-by:
4 years ago
12da8717b7
1.correct param check for vision op 2.fix config review 3.fix api doc
4 years ago
7278f5c109
update_gatherv2_op
4 years ago
c79e988b0d
set fullname for reshape after reshape-elimination
4 years ago
a146f982bc
!8983 support variabel length virtual_dataset in auto parallel
...
From: @yao_yf
Reviewed-by:
Signed-off-by:
4 years ago
dcde1fc70a
!9092 Add LBeta op at nn level
...
From: @peixu_ren
Reviewed-by:
Signed-off-by:
4 years ago
aa4bf9a3f2
[MD] Support python-eager: Resize, Rescale, Normalize, HWC2CHW, Pad
4 years ago
91301a6d1a
modify export file name
4 years ago
55f7e3dc16
!9135 Minor fixs for cache error message
...
From: @tina_mengting_zhang
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @nsyca
4 years ago
37d40bc495
Add Beta distribution
4 years ago
6f31bdbf67
fix issues for hq testers: I277HD, I277HV
4 years ago
6355f46d32
Add LBeta op at nn level
4 years ago
27698866d1
Block take/skip under cache and fix docstring
...
and other minor changes per the request of HQ testers
4 years ago
9cda064716
auto parallel predict
4 years ago
421cad24ef
!8715 Add Gamma distribution
...
From: @peixu_ren
Reviewed-by:
Signed-off-by:
4 years ago
adc8e3e707
!8594 [MD] Pybind Pushdown Support for dataset
...
From: @cathwong
Reviewed-by:
Signed-off-by:
4 years ago
809e1d5086
added python api based on cpp api
...
1st draft of python iterator
Added Cifar10 and Cifar100 pybind port
Change pybind to use IR for Skip and Manifest
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
DatasetNode as a base for all IR nodes
namespace change
Fix the namespace issue and make ut tests work
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
Add VOCDataset
!63 Added RandomDataset
* Added RandomDataset
add imagefolder ir
Pybind switch: CelebA and UT
!61 CLUE example with class definition
* Merge branch 'python-api' of gitee.com:ezphlow/mindspore into clue_class_pybind
* Passing testcases
* Added CLUE, not working
add ManifestDataset IR
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
Update Coco & VOC & TFReader, Update clang-format, Reorder
datasets_binding
!69 Add Generator and move c_dataset.Iterator to dataset.Iterator
* Add GeneratorDataset to c_dataset
* Add GeneratorDataset to c_dataset
!67 Moving c_datasets and adding sampler wrapper
* Need to add create() method in datasets.py
* migration from c_dataset to dataset part 1
!71 Fix indent error
* Fix indentation error
!72 Fix c_api tests cases
* Fix c_api tests cases
!73 Added CSV Dataset
* Added CSVDataset
pybind switch: Take and CelebA fixes
!75 move c_dataset functionality to datasets
* Fixed existing testcases
* Added working clue and imagefolder
* Added sampler conversion from pybind
* Added sampler creation
!77 Add Python API tree
* Python API tree
add minddataset
TextFileDataset pybind
Rename to skip test_concat.py and test_minddataset_exception.py
!80 Add batch IR to python-api branch, most test cases work
* staging III
* staging, add pybind
Enable more c_api take and CelebA tests; delete util_c_api
!84 Schema changes in datasets.py
* Schema changes
!85 Remove input_indexes from sub-classes
* remove input_index from each subclass
!83 Remove C datasets
* Removed c_dataset package
* Remove c_datasets
!82 pybind switch: shuffle
* pybind switch: shuffle
!86 Add build_vocab
* Add build_vocab
Rebase with upstream/master
_shuffle conflict
BatchNode error
!88 Fix rebase problem
* fix rebase problem
Enable more unit tests; code typo/nit fixes
!91 Fix python vocag hang
* Fix python vocab hang
!89 Added BucketBatchByLength Pybind switch
* Added BucketBatchByLength
Update and enable more tet_c_api_*.py tests
!95 Add BuildSentencePeiceVocab
* - Add BuildSentencePeiceVocab
!96 Fix more tests
* - Fix some tests
- Enable more test_c_api_*
- Add syncwait
!99 pybind switch for device op
* pybind switch for device op
!93 Add getters to python API
* Add getters to python API
!101 Validate tree, error if graph
* - Add sync wait
!103 TFrecord/Random Datasets schema problem
* - TfRecord/Random schem aproblem
!102 Added filter pybind switch
* Added Filter pybind switch
!104 Fix num_samples
* - TfRecord/Random schem aproblem
!105 Fix to_device hang
* Fix to_device hang
!94 Adds Cache support for CLUE dataset
* Added cache for all dataset ops
* format change
* Added CLUE cache support
* Added Cache conversion
Add save pybind
fix compile err
init modify concat_node
!107 Fix some tests cases
* Fix tests cases
Enable and fix more tests
!109 pybind switch for get dataset size
* pybind_get_dataset_size
some check-code fixes for pylint, cpplint and clang-format
!113 Add callback
* revert
* dataset_sz 1 line
* fix typo
* get callback to work
!114 Make Android compile clean
* Make Android Compile Clean
Fix build issues due to rebase
!115 Fix more tests
* Fix tests cases
* !93 Add getters to python API
fix test_profiling.py
!116 fix get dataset size
* fix get dataset size
!117 GetColumnNames pybind switch
* Added GetColumnNames pybind switch
code-check fixes: clangformat, cppcheck, cpplint, pylint
Delete duplicate test_c_api_*.py files; more lint fixes
!121 Fix cpp tests
* Remove extra call to getNext in cpp tests
!122 Fix Schema with Generator
* Fix Schema with Generator
fix some cases of csv & mindrecord
!124 fix tfrecord get_dataset_size and add some UTs
* fix tfrecord get dataset size and add some ut for get_dataset_size
!125 getter separation
* Getter separation
!126 Fix sampler.GetNumSamples
* Fix sampler.GetNumSampler
!127 Assign runtime getter to each get function
* Assign runtime getter to each get function
Fix compile issues
!128 Match master code
* Match master code
!129 Cleanup DeviceOp/save code
* Cleanup ToDevice/Save code
!130 Add cache fix
* Added cache fix for map and image folder
!132 Fix testing team issues
* Pass queue_name from python to C++
* Add Schema.from_json
!131 Fix Cache op issues and delete de_pipeline
* Roll back C++ change
* Removed de_pipeline and passing all cache tests.
* fixed cache tests
!134 Cleanup datasets.py part1
* Cleanup dataset.py part1
!133 Updated validation for SentencePieceVocab.from_dataset
* Added type_check for column names in SentencePieceVocab.from_dataset
Rebase on master 181120 10:20
fix profiling
temporary solution of catching stauts from Node.Build()
!141 ToDevice Termination
* ToDevice termination
pylint fixes
!137 Fix test team issues and add some corresponding tests
* Fix test team issues and add some corresponding tests
!138 TreeGetter changes to use OptPass
* Getter changes to use OptPass (Zirui)
Rebase fix
!143 Fix cpplint issue
* Fix cpplint issue
pylint fixes in updated testcases
!145 Reset exceptions testcase
* reset exception test to master
!146 Fix Check_Pylint Error
* Fix Check_Pylint Error
!147 fix android
* fix android
!148 ToDevice changes
* Add ToDevice to the iterator List for cleanup at exit
!149 Pylint issue
* Add ToDevice to the iterator List for cleanup at exit
!150 Pylint 2
* Add ToDevice to the iterator List for cleanup at exit
!152 ExecutionTree error
* ET destructor error
!153 in getter_pass, only remove callback, without deleting map op
* getter pass no longer removes map
!156 early __del__ of iterator/to_device
* early __del__ of iterator
!155 Address review comments Eric 1
* Added one liner fix to validators.py
* roll back signature fix
* lint fix
* Eric Address comments 2
* C++ lint fix
* Address comments Eric 1
!158 Review rework for dataset bindings - part 1
* Reorder nodes repeat and rename
* Review rework for dataset bindings - part 1
!154 Fixing minor problems in the comments (datasets.py, python_tree_consumer.cc, iterators_bindings.cc, and iterators.py)
* Fixing minor problems in the comments (datasets.py, python_tree_consum…
!157 add replace none
* Add replace_none to datasets.py, address comments in tests
Trying to resolve copy
Override the deepcopy method of deviceop
Create_ir_tree method
Create_ir_tree method 2
Create_ir_tree method 2
del to_device if already exists
del to_device if already exists
cache getters shapes and types
Added yolov3 relaxation, to be rolled back
Get shapes and types together
bypass yolo
NumWorkers for MapOp
revert Yolo
revert Thor
Print more info
Debug code: Update LOG INFO to LOG ERROR
do not remove epochctrl for getter pass
Remove repeat(1)
pritn batch size
add log to tree_consumer and device_queue op
Revert PR 8744
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
__del__ toDEvice
__del__ toDevice2
!165 add ifndef ENABLE_ANDROID to device queue print
* Add ifndef ENABLE_ANDROID to device queue print
revert some changes
!166 getter: get_data_info
* getter: get_data_info
!168 add back tree print
* revert info to warnning in one log
* add back the missed print tree log
Release GIL in GetDataInfo
4 years ago
979bb26cba
!9031 Fix DatasetCache parameter check
...
From: @lixiachen
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
ab7427f1a9
Minor fix for DatasetCache param validation
4 years ago
93d4ef428f
Add Gamma distribution
4 years ago
22d683a805
!8920 Adapt ops LinSpace for Ascend.
...
From: @liu_xiao_93
Reviewed-by: @liangchenghui,@linqingke,@liangchenghui
Signed-off-by: @liangchenghui,@liangchenghui
4 years ago
d9b4b5c750
!8954 Add SequenceMask operator.
...
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
4 years ago
584e241e29
Adapt ops LinSpace for Ascend.
4 years ago
01f5da0a14
Add Poisson distribution
4 years ago
17c0810f9e
add SequenceMask operator
4 years ago
3d6d820612
!8154 Add nn.MultiFieldEmbedding for the embedding lookup opearations
...
From: @huangxinjing
Reviewed-by:
Signed-off-by:
4 years ago
d915fd9b96
!8592 change repeat_elements to a composite op
...
From: @tom__chen
Reviewed-by:
Signed-off-by:
4 years ago
mohammad
mindspore-ci-bot
hedongdong
yangzhenzhang
lilei
buxue
alex-yuyue
Zichun Ye
Lixia Chen
yuchaojie
Jiaqi
TinaMengtingZhang
yanglf1121
Nat Sutyanyong
jiangshuqiang
liuxiao93
Eric
Zirui Wu
ougongchang
jiangzhenguang
Payne
Ziyan
yujianfeng
Xiao Tianci
ms_yan
huangxinjing
YangLuo
wangrao
gzhcv
Mahdi
xiefangqi
jjfeing
shenwei41
yao_yf
Bairong
Xiaoda Zhang
l00591931
yanglf1121
wangnan39@huawei.com
hesham
zhuyuxiao
“dangjiaqi1”
Jesse Lee
Cathy Wong
Xun Deng
lichenever
mxm
bai-yangfan
peixu_ren
laiyongqiang
jonyguo
Peilin Wang
changzherui