f90f77c16e
support non tensor inputs in model predict
4 years ago
aeeef7607a
remove the 'raise' in construct of Cell
4 years ago
a7f0e13234
Remove special treatment for cache above repeat
4 years ago
df9f4f41e8
fix get num classes of concat
4 years ago
26ff566f90
!10002 fix get dataset size in distributed scenario
...
From: @tiancixiao
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
4 years ago
633f97bb48
fix get dataset size in distributed scenario
4 years ago
9072283395
fix mindpsore.numpy packaging issue and format API comments
4 years ago
c4f284b928
!9910 [MD][Perf] MindData add NormalizePad for GPU performance
...
From: @xiefangqi
Reviewed-by:
Signed-off-by:
4 years ago
b8faa8293b
!9920 python eager add decode
...
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
4 years ago
dd134d7554
!9926 optimize list setitem in bprop
...
From: @zhangbuxue
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
4 years ago
2530943a7f
optimize list getitem in bprop
4 years ago
3c6cc3c58c
Add NormalizePadOp
4 years ago
18e61a627a
python eager add decode
4 years ago
a9f2de8307
!9737 complete fancy index getitem
...
From: @yepei6
Reviewed-by:
Signed-off-by:
4 years ago
c403948961
!9931 add reset device, fix runtime delete ring buffer failed
...
From: @zhoufeng54
Reviewed-by: @kisnwang,@chujinjin
Signed-off-by: @chujinjin
4 years ago
4c8f0914d0
complete fancy index getitem
4 years ago
fd311cf316
!9843 Added server node
...
From: @anancds
Reviewed-by:
Signed-off-by:
4 years ago
ee7e412def
add reset device, fix runtime delete ring buffer failed
...
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
4 years ago
ca4225a4f3
!9717 amend some script
...
From: @jiangzg001
Reviewed-by: @liangchenghui,@c_34
Signed-off-by: @liangchenghui
4 years ago
058fbd2d1f
!9765 remove serving in mindspore repo
...
From: @xu-yfei
Reviewed-by: @zhoufeng54,@kisnwang
Signed-off-by: @kisnwang
4 years ago
2d2bf2d0ee
added server node
4 years ago
3a803b3c18
!9862 Fix the bug of ImageNetToMR
...
From: @shenwei41
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
4 years ago
9cf856dd25
amend some script
4 years ago
ad6507d88a
!9825 [MD] fix pad, normalize in c_trasnform
...
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
4 years ago
e10dbb4a7f
!9723 add ir passes to unify mindir
...
From: @yuchaojie
Reviewed-by:
Signed-off-by:
4 years ago
1984cf8e20
unify mindir
4 years ago
70d12aae26
add detailed and accurate description for support non tensor inputs for outermost net.
4 years ago
547f96717b
Fix Bug
4 years ago
d5db8872fd
!9834 Fix wrong input argument of Reshape for multi field embedding
...
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
4 years ago
996ee72c50
Fix embedding layer
...
Fix input check
4 years ago
5e35bec957
!9799 change_last_nodes_strategy_in_auto_parallel_when_eval_and_predict
...
From: @yao_yf
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
4 years ago
1cc147df1d
fix pad, normalize in c_trasnform
4 years ago
10d326ee62
!9798 hide arange
...
From: @bairongz
Reviewed-by: @zh_qh,@zhunaipan
Signed-off-by: @zh_qh
4 years ago
19fe28cb9b
hange strategys of last nodes in eval/predict at auto parallel mode
4 years ago
0f2b5d8cac
Changed SamplerObj validate params to return status and added AddChild to it
4 years ago
77521e78d2
staging
4 years ago
8cf43e59e0
hide arange, delete related test case and improve the doc string of nn.Range
4 years ago
60f7a62815
!9439 added worker node
...
From: @anancds
Reviewed-by:
Signed-off-by:
4 years ago
c9b072b94d
remove serving in mindspore repo
4 years ago
8c0d066bf9
!9763 Change name from interpolate to resizeBilinear
...
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh,@zhunaipan
Signed-off-by: @zh_qh
4 years ago
ee4132889e
added worker node
4 years ago
e78228603b
move parallel-related black-list to core/ir, and fix the cloneCNode bug
4 years ago
130c61cfc0
change name from interpolate to resizeBilinear
4 years ago
9ecf062581
!9552 change the import level of dynamic_lr
...
From: @wangnan39
Reviewed-by: @kingxian,@zh_qh,@kingxian
Signed-off-by: @kingxian,@kingxian
4 years ago
78fba32865
!9752 Fix potential hang in RandomData and incorrectly named functions
...
From: @ziruiwu
Reviewed-by: @heleiwang,@pandoublefeng
Signed-off-by: @pandoublefeng
4 years ago
3f82405d17
!9639 Add Numpy Native to Mindspore
...
From: @yanglf1121
Reviewed-by:
Signed-off-by:
4 years ago
91a6b2b0ca
Add checks to RandomData and LookUp
4 years ago
e8a442eeb3
!9700 add ps cache manager
...
From: @limingqi107
Reviewed-by:
Signed-off-by:
4 years ago
59e5afd2bb
Add mindnumpy to mindspore
4 years ago
63d5eb215f
!8965 Synchronize latest Ascend software suite 09 Dec 2020, with refactored GraphEngine
...
From: @nicholas_yhr
Reviewed-by:
Signed-off-by:
4 years ago
eca951c7bc
add ps cache manager
4 years ago
306bbe0e65
Synchronize latest Ascend software suite 09 Dec 2020, with refactored GraphEngine
4 years ago
0fe9e2e4cb
support import dynamic_lr from nn
4 years ago
a2aea8cba5
!9578 add_conv3d_transpose_object
...
From: @jiangzg001
Reviewed-by: @liangchenghui,@liangchenghui
Signed-off-by: @liangchenghui
4 years ago
6d34bacc17
!9470 support arange in functional.py
...
From: @bairongz
Reviewed-by: @ginfung
Signed-off-by:
4 years ago
5060565920
add conv3d_transpose.
4 years ago
317a97e6b9
!9336 auto num_parallel_workers setup
...
From: @ziruiwu
Reviewed-by:
Signed-off-by:
4 years ago
a2c80435ce
!9685 Fix a core dump in TreeConsumer::Terminate() plus minor cache fixes
...
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
d6df1b0832
Implemented AutoNumWorker Pass which sets num_workers of selected parallel ops automatically if enabled
4 years ago
32b82c2737
Fix a core dump in TreeConsumer::Terminate()
...
and other minor cache changes
4 years ago
934005f390
!9636 Remove batch_map multi-process test case
...
From: @hfarahat
Reviewed-by: @nsyca,@mikef
Signed-off-by: @mikef
4 years ago
e1e8f1d429
!9652 add ps cache
...
From: @limingqi107
Reviewed-by: @cristoval
Signed-off-by:
4 years ago
a5f57ce8a0
add ps cache
4 years ago
231fccf66c
!9600 Add Adagrad Optimizer
...
From: @zyx5256
Reviewed-by: @liangchenghui,@kingxian
Signed-off-by: @liangchenghui
4 years ago
ff65f6feb8
Remove batch_map multiprocess test case
4 years ago
0659473535
add TruncateSequencePair, ToNumber C++ API and enable three test cases
4 years ago
f6a22cb455
!9591 Assignment enables negative index
...
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
4 years ago
ec3983b77d
!9577 support distributed predict
...
From: @gong_zi_yan
Reviewed-by: @caozhou_huawei,@yao_yf,@stsuteng,@zh_qh
Signed-off-by: @stsuteng
4 years ago
37bebc751b
add adagrad optim
4 years ago
49fd5308a4
!9564 Tidy up code in dataset compilation phase
...
From: @nsyca
Reviewed-by:
Signed-off-by:
4 years ago
6b5626634c
!9530 add BasicTokenizer and BertTokenizer C++ API
...
From: @tiancixiao
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
41ea1621c5
Tidy up TreeAdapter::Compile
4 years ago
e6ec9be6c2
!9386 l1_regularizer开发
...
From: @dangjiaqi1
Reviewed-by:
Signed-off-by:
4 years ago
39948670dd
new update basic.py which add class L1Regularizer(Cell). new add test_l1_regularizer.py. new add test_l1_regularizer.py
4 years ago
3189868a15
Assignment enable index smaller than 0
4 years ago
2eeaec7512
support arange in functional.py
4 years ago
e7e9dae54d
support distributed predict
4 years ago
186f5394ba
!9155 add_conv3d_object
...
From: @jiangzg001
Reviewed-by:
Signed-off-by:
4 years ago
5d1a8b09db
!9097 Primitive Shape support return range of dynamic shape
...
From: @M20211031
Reviewed-by: @ginfung
Signed-off-by:
4 years ago
3c4a585143
!9545 Move API inner.DynamicGRUV2 to P.DynamicGRUV2.
...
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
4 years ago
aa5d4e08a9
!9544 Fix a possible seg fault in GenerateCRC caused by std::regex
...
From: @lixiachen
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @heleiwang
4 years ago
712ad98a92
Move API inner.DynamicGRUV2 to P.DynamicGRUV2.
4 years ago
921930a3ae
!9524 Add RegexReplace and RegexTokenizer C++ API
...
From: @shenwei41
Reviewed-by:
Signed-off-by:
4 years ago
3b7acc57c9
!9508 [Auto parallel] Set CNODE's fullname when cloning
...
From: @xiaoda_zh
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
4 years ago
206ae1a7c3
Add Three text C++ API
4 years ago
27579fe858
Fix a seg fault caused by std::regex
4 years ago
4cb78f2e03
Remove Repeat(1),Take(-1), and Skip(0) in NodeRemovalPass
4 years ago
3280474d71
!9533 dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix
...
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
0c8dfc68ec
Fix hang on RequestFreeTag
4 years ago
69b269c6cf
dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix
4 years ago
290cc72887
add BasicTokenizer and BertTokenizer C++ API
4 years ago
c45eee9b94
add conv3d object
4 years ago
9a9e3a751e
set cnode's fullname when cloning
4 years ago
4f607e9c26
!9335 Add multiprocessing support to per_batch_map
...
From: @hfarahat
Reviewed-by:
Signed-off-by:
4 years ago
a6b716003f
!9469 Fix minor issues in distribution classes
...
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by: @sunnybeike
4 years ago
4ef9e9e57f
fix minor issues in distribution classes
4 years ago
d69a29a44e
Migrate 3 pre passes to IR optimizer, namely, cache_error_pass, epoch_injection, and removal_pass
4 years ago
73c91e05b1
!9398 Change Build to return status
...
From: @alex-yuyue
Reviewed-by: @mikef
Signed-off-by:
4 years ago
4bb7303463
!9424 [PipelineSplit]Fix Shared Parameter bug
...
From: @lichen666
Reviewed-by: @zh_qh
Signed-off-by:
4 years ago
818e920f02
fix_pipeline_split_param_shared_bug
4 years ago
82268dc703
support DynamicShape and StridedSlice primitive return range of shape value.
4 years ago
ccff3a5316
Change build to return status
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
afe4a5fa81
!9395 [MD] Fix concat issue & fix schema doc
...
From: @luoyang42
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @jonyguo
4 years ago
b9d2392937
!9350 Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end
...
From: @peixu_ren
Reviewed-by: @liangchenghui,@zh_qh
Signed-off-by: @liangchenghui
4 years ago
809f9c91be
Add multiprocessing support to per_batch_map
4 years ago
a2ec7ad5bd
Fix concat issue & fix schema doc
4 years ago
78e131cf15
pipeline_split adapt parallel
4 years ago
79fef0df0e
!9142 fix bug of addn not supported dynamic shape
...
From: @M20211031
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
4 years ago
0c7ba7a7fa
!9354 mode_mindir_suffix
...
From: @bai-yangfan
Reviewed-by: @c_34,@guoqi1024
Signed-off-by: @c_34
4 years ago
efc7e9f89e
!9358 PyNative Bugfix
...
From: @jojobugfree
Reviewed-by: @chujinjin,@jjfeing
Signed-off-by: @jjfeing
4 years ago
c8e7c3edb0
PyNative Hccl Bugfix
4 years ago
c46c4dffe4
mindir_suffix
4 years ago
0adab15de7
Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end
4 years ago
51d885815a
!9281 increase variable_memory_max_size max size from 30GB to 31GB
...
From: @laiyongqiang
Reviewed-by:
Signed-off-by:
4 years ago
6c18c09121
!9266 PyNative Support Hccl(Data Parallel)
...
From: @jojobugfree
Reviewed-by: @chujinjin,@jjfeing
Signed-off-by: @chujinjin
4 years ago
df44e1339e
!9249 Optimizing GetDatasetSize
...
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
4 years ago
9ed31ea2cb
!9339 Disable getter optimization pass
...
From: @ezphlow
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @nsyca
4 years ago
4ffd9b578f
!9331 More cache minor fix for HQ testers
...
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
db2a8b5e1d
Disable getter pass
4 years ago
f80553bc6e
Optimization for GetDatasetSize
4 years ago
2ddb1fb75e
More CRC fix and blocking BatchOp under cache
4 years ago
04d8cd5d8b
Support PyNative Data Parallel
4 years ago
77ef72be30
!9306 fix ndarray field without type in mindrecord
...
From: @jonyguo
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
4 years ago
11244f790a
increase variable_memory_max_size max size from 30GB to 31GB
4 years ago
45b705bca0
!9129 support abs() and mean() method for Tensor object
...
From: @bairongz
Reviewed-by:
Signed-off-by:
4 years ago
847e59bd6c
fix: ndarray field without type in mindrecord
4 years ago
920bbf1541
!9277 fix schema & zip validation
...
From: @luoyang42
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
4 years ago
da8d7d661a
!9283 Modify the dataset ut log message
...
From: @liucunwei
Reviewed-by: @pandoublefeng,@heleiwang,@jonyguo
Signed-off-by: @heleiwang,@jonyguo
4 years ago
c41a21d2c2
!9208 Add four new c++ api of text
...
From: @shenwei41
Reviewed-by: @heleiwang
Signed-off-by:
4 years ago
8ef4b2796e
modify the dataset ut log message
4 years ago
0e6d06c463
!9230 Set trace info of Primitive CNode only for equiv out node, not the whole fprop function.
...
From: @zh_qh
Reviewed-by: @ginfung
Signed-off-by: @ginfung
4 years ago
5cc3b76577
fix schema & zip validation
4 years ago
623b2e3f99
support abs and mean of Tensor
4 years ago
e45f19adc8
!8697 support the outermost layer network inputs are list or dict or scalar
...
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
4 years ago
3bea84d0f7
add four new text API
4 years ago
8310236ff1
Set trace info of Primitive CNode only for equiv out node, not the whole fprop function.
4 years ago
5306c91cb7
!9214 support repeated calculation when the axis of gatherv2 is 0 and split
...
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
4 years ago
ea191ed5da
!8463 Run ops one by one in pynative bp graph
...
From: @HulkTang
Reviewed-by:
Signed-off-by:
4 years ago
af3c27d354
!9244 Fix core dump with concat and getter_pass
...
From: @ziruiwu
Reviewed-by:
Signed-off-by:
4 years ago
ccf637f64a
!9241 SequenceMask gpu kernel
...
From: @peilin-wang
Reviewed-by: @tom__chen
Signed-off-by:
4 years ago
c3e7a8255c
!9248 Add input check to nlp operators
...
From: @ezphlow
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
cf802c839c
Added missing input check for nlp operator
4 years ago
23487fae09
fix get_shape/type and a segfault in getter_pass
...
add test case
4 years ago
f7dc2432a0
initial commit
...
fix ci
fix ci
remove old sequence mask api
fix ci
fix ci
remove old seuqence mask tests
4 years ago
7748ae823a
!9141 Fix DatasetCache C++ API cache sharing behavior
...
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
a37e9710b5
!9038 port name functions from TensorOp to TensorOperation
...
From: @mhmotallebi
Reviewed-by:
Signed-off-by:
4 years ago
d6f91133c3
Support the outermost layer network inputs are list or dict or scalar
4 years ago
762793cb8f
!9175 fix a bug in random resize crop op and some lint
...
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo,@liucunwei
Signed-off-by: @liucunwei
4 years ago
f0671ce513
!9076 [MD] Support vision c_transform python eager: Resize, Rescale, Normalize, HWC2CHW, Pad
...
From: @luoyang42
Reviewed-by:
Signed-off-by:
4 years ago
59f9ac9975
Primitive 'AddN' support dynamic shape
4 years ago
7b33f3e2ac
gatherv2 axis split repeated calculation
4 years ago
b85bcff4b2
!9057 modify export file name
...
From: @changzherui
Reviewed-by:
Signed-off-by:
4 years ago
12da8717b7
1.correct param check for vision op 2.fix config review 3.fix api doc
4 years ago
42f32b7c4b
!9173 support batch size small than dev size in parallel gatherv2
...
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
4 years ago
c36b477568
Run ops one by one in pynative bp graph
4 years ago
a6845395e6
!9181 Add some ut pipeline test case for C++ dataset
...
From: @liucunwei
Reviewed-by: @pandoublefeng,@jonyguo
Signed-off-by: @jonyguo
4 years ago
e612e23a05
Add some ut pipeline test case for C++ dataset
4 years ago
7f13f2ad0e
add some pipeline ut test cases for c++ dataset
4 years ago
7278f5c109
update_gatherv2_op
4 years ago
c79e988b0d
set fullname for reshape after reshape-elimination
4 years ago
a146f982bc
!8983 support variabel length virtual_dataset in auto parallel
...
From: @yao_yf
Reviewed-by:
Signed-off-by:
4 years ago
dcde1fc70a
!9092 Add LBeta op at nn level
...
From: @peixu_ren
Reviewed-by:
Signed-off-by:
4 years ago
aa4bf9a3f2
[MD] Support python-eager: Resize, Rescale, Normalize, HWC2CHW, Pad
4 years ago
91301a6d1a
modify export file name
4 years ago
cf383af36e
!8624 updated cluster config and proto
...
From: @anancds
Reviewed-by:
Signed-off-by:
4 years ago
c1002d2eb4
!9138 Address left over comments from PR8802
...
From: @ziruiwu
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @nsyca
4 years ago
55f7e3dc16
!9135 Minor fixs for cache error message
...
From: @tina_mengting_zhang
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @nsyca
4 years ago
9cfeb08c4d
port name() to TensorOperation and its derived classes
4 years ago
e8247eadef
Same runtime CacheClient if c++ cache is shared
4 years ago
37d40bc495
Add Beta distribution
4 years ago
6f31bdbf67
fix issues for hq testers: I277HD, I277HV
4 years ago
36bfd0d8ad
address left over cmts from 8802
4 years ago
6355f46d32
Add LBeta op at nn level
4 years ago
3e57236fe3
add some new ut test for minddataset
4 years ago
3bed28822d
!9024 Add four text C++ API
...
From: @shenwei41
Reviewed-by:
Signed-off-by:
4 years ago
aa2296bcc1
!9094 Blocking TakeOp/SkipOp under Cache
...
From: @lixiachen
Reviewed-by: @nsyca,@mikef,@nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
fc380b8071
updated cluster config and proto
4 years ago
4e56618d18
Add text C++ API
4 years ago
3fa7233f68
!9072 fix topk fussion help tensor size = 4096*2
...
From: @jjfeing
Reviewed-by: @chujinjin,@kisnwang
Signed-off-by:
4 years ago
27698866d1
Block take/skip under cache and fix docstring
...
and other minor changes per the request of HQ testers
4 years ago
5e1bb0b697
boilerplate code for future IR optimizer
...
add 2 test cases to IRNode Deepcopy()
address review cmts
fix ut
samplerObj copy
ci
fix ci
fix ci round III
address further review cmts
add a missing macro
fix merge conflict
fix complie err
fix lite compile err
fix compile err
fix lite compile round III
address an issue
fix minor comments
4 years ago
9cda064716
auto parallel predict
4 years ago
8fb7d11ecb
fix topk help 4096
4 years ago
421cad24ef
!8715 Add Gamma distribution
...
From: @peixu_ren
Reviewed-by:
Signed-off-by:
4 years ago
adc8e3e707
!8594 [MD] Pybind Pushdown Support for dataset
...
From: @cathwong
Reviewed-by:
Signed-off-by:
4 years ago
809e1d5086
added python api based on cpp api
...
1st draft of python iterator
Added Cifar10 and Cifar100 pybind port
Change pybind to use IR for Skip and Manifest
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
DatasetNode as a base for all IR nodes
namespace change
Fix the namespace issue and make ut tests work
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
Add VOCDataset
!63 Added RandomDataset
* Added RandomDataset
add imagefolder ir
Pybind switch: CelebA and UT
!61 CLUE example with class definition
* Merge branch 'python-api' of gitee.com:ezphlow/mindspore into clue_class_pybind
* Passing testcases
* Added CLUE, not working
add ManifestDataset IR
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
Update Coco & VOC & TFReader, Update clang-format, Reorder
datasets_binding
!69 Add Generator and move c_dataset.Iterator to dataset.Iterator
* Add GeneratorDataset to c_dataset
* Add GeneratorDataset to c_dataset
!67 Moving c_datasets and adding sampler wrapper
* Need to add create() method in datasets.py
* migration from c_dataset to dataset part 1
!71 Fix indent error
* Fix indentation error
!72 Fix c_api tests cases
* Fix c_api tests cases
!73 Added CSV Dataset
* Added CSVDataset
pybind switch: Take and CelebA fixes
!75 move c_dataset functionality to datasets
* Fixed existing testcases
* Added working clue and imagefolder
* Added sampler conversion from pybind
* Added sampler creation
!77 Add Python API tree
* Python API tree
add minddataset
TextFileDataset pybind
Rename to skip test_concat.py and test_minddataset_exception.py
!80 Add batch IR to python-api branch, most test cases work
* staging III
* staging, add pybind
Enable more c_api take and CelebA tests; delete util_c_api
!84 Schema changes in datasets.py
* Schema changes
!85 Remove input_indexes from sub-classes
* remove input_index from each subclass
!83 Remove C datasets
* Removed c_dataset package
* Remove c_datasets
!82 pybind switch: shuffle
* pybind switch: shuffle
!86 Add build_vocab
* Add build_vocab
Rebase with upstream/master
_shuffle conflict
BatchNode error
!88 Fix rebase problem
* fix rebase problem
Enable more unit tests; code typo/nit fixes
!91 Fix python vocag hang
* Fix python vocab hang
!89 Added BucketBatchByLength Pybind switch
* Added BucketBatchByLength
Update and enable more tet_c_api_*.py tests
!95 Add BuildSentencePeiceVocab
* - Add BuildSentencePeiceVocab
!96 Fix more tests
* - Fix some tests
- Enable more test_c_api_*
- Add syncwait
!99 pybind switch for device op
* pybind switch for device op
!93 Add getters to python API
* Add getters to python API
!101 Validate tree, error if graph
* - Add sync wait
!103 TFrecord/Random Datasets schema problem
* - TfRecord/Random schem aproblem
!102 Added filter pybind switch
* Added Filter pybind switch
!104 Fix num_samples
* - TfRecord/Random schem aproblem
!105 Fix to_device hang
* Fix to_device hang
!94 Adds Cache support for CLUE dataset
* Added cache for all dataset ops
* format change
* Added CLUE cache support
* Added Cache conversion
Add save pybind
fix compile err
init modify concat_node
!107 Fix some tests cases
* Fix tests cases
Enable and fix more tests
!109 pybind switch for get dataset size
* pybind_get_dataset_size
some check-code fixes for pylint, cpplint and clang-format
!113 Add callback
* revert
* dataset_sz 1 line
* fix typo
* get callback to work
!114 Make Android compile clean
* Make Android Compile Clean
Fix build issues due to rebase
!115 Fix more tests
* Fix tests cases
* !93 Add getters to python API
fix test_profiling.py
!116 fix get dataset size
* fix get dataset size
!117 GetColumnNames pybind switch
* Added GetColumnNames pybind switch
code-check fixes: clangformat, cppcheck, cpplint, pylint
Delete duplicate test_c_api_*.py files; more lint fixes
!121 Fix cpp tests
* Remove extra call to getNext in cpp tests
!122 Fix Schema with Generator
* Fix Schema with Generator
fix some cases of csv & mindrecord
!124 fix tfrecord get_dataset_size and add some UTs
* fix tfrecord get dataset size and add some ut for get_dataset_size
!125 getter separation
* Getter separation
!126 Fix sampler.GetNumSamples
* Fix sampler.GetNumSampler
!127 Assign runtime getter to each get function
* Assign runtime getter to each get function
Fix compile issues
!128 Match master code
* Match master code
!129 Cleanup DeviceOp/save code
* Cleanup ToDevice/Save code
!130 Add cache fix
* Added cache fix for map and image folder
!132 Fix testing team issues
* Pass queue_name from python to C++
* Add Schema.from_json
!131 Fix Cache op issues and delete de_pipeline
* Roll back C++ change
* Removed de_pipeline and passing all cache tests.
* fixed cache tests
!134 Cleanup datasets.py part1
* Cleanup dataset.py part1
!133 Updated validation for SentencePieceVocab.from_dataset
* Added type_check for column names in SentencePieceVocab.from_dataset
Rebase on master 181120 10:20
fix profiling
temporary solution of catching stauts from Node.Build()
!141 ToDevice Termination
* ToDevice termination
pylint fixes
!137 Fix test team issues and add some corresponding tests
* Fix test team issues and add some corresponding tests
!138 TreeGetter changes to use OptPass
* Getter changes to use OptPass (Zirui)
Rebase fix
!143 Fix cpplint issue
* Fix cpplint issue
pylint fixes in updated testcases
!145 Reset exceptions testcase
* reset exception test to master
!146 Fix Check_Pylint Error
* Fix Check_Pylint Error
!147 fix android
* fix android
!148 ToDevice changes
* Add ToDevice to the iterator List for cleanup at exit
!149 Pylint issue
* Add ToDevice to the iterator List for cleanup at exit
!150 Pylint 2
* Add ToDevice to the iterator List for cleanup at exit
!152 ExecutionTree error
* ET destructor error
!153 in getter_pass, only remove callback, without deleting map op
* getter pass no longer removes map
!156 early __del__ of iterator/to_device
* early __del__ of iterator
!155 Address review comments Eric 1
* Added one liner fix to validators.py
* roll back signature fix
* lint fix
* Eric Address comments 2
* C++ lint fix
* Address comments Eric 1
!158 Review rework for dataset bindings - part 1
* Reorder nodes repeat and rename
* Review rework for dataset bindings - part 1
!154 Fixing minor problems in the comments (datasets.py, python_tree_consumer.cc, iterators_bindings.cc, and iterators.py)
* Fixing minor problems in the comments (datasets.py, python_tree_consum…
!157 add replace none
* Add replace_none to datasets.py, address comments in tests
Trying to resolve copy
Override the deepcopy method of deviceop
Create_ir_tree method
Create_ir_tree method 2
Create_ir_tree method 2
del to_device if already exists
del to_device if already exists
cache getters shapes and types
Added yolov3 relaxation, to be rolled back
Get shapes and types together
bypass yolo
NumWorkers for MapOp
revert Yolo
revert Thor
Print more info
Debug code: Update LOG INFO to LOG ERROR
do not remove epochctrl for getter pass
Remove repeat(1)
pritn batch size
add log to tree_consumer and device_queue op
Revert PR 8744
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
__del__ toDEvice
__del__ toDevice2
!165 add ifndef ENABLE_ANDROID to device queue print
* Add ifndef ENABLE_ANDROID to device queue print
revert some changes
!166 getter: get_data_info
* getter: get_data_info
!168 add back tree print
* revert info to warnning in one log
* add back the missed print tree log
Release GIL in GetDataInfo
4 years ago
979bb26cba
!9031 Fix DatasetCache parameter check
...
From: @lixiachen
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
ab7427f1a9
Minor fix for DatasetCache param validation
4 years ago
93d4ef428f
Add Gamma distribution
4 years ago
22d683a805
!8920 Adapt ops LinSpace for Ascend.
...
From: @liu_xiao_93
Reviewed-by: @liangchenghui,@linqingke,@liangchenghui
Signed-off-by: @liangchenghui,@liangchenghui
4 years ago
d9b4b5c750
!8954 Add SequenceMask operator.
...
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
4 years ago
584e241e29
Adapt ops LinSpace for Ascend.
4 years ago
01f5da0a14
Add Poisson distribution
4 years ago
7c73bc50f4
fixed codex
4 years ago
17c0810f9e
add SequenceMask operator
4 years ago
d532af3a9a
new hccl interface
...
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
4 years ago
0d49650bd5
!8888 Add PyNative Device Profiling
...
From: @jojobugfree
Reviewed-by: @kisnwang,@jjfeing
Signed-off-by: @jjfeing
4 years ago
3d6d820612
!8154 Add nn.MultiFieldEmbedding for the embedding lookup opearations
...
From: @huangxinjing
Reviewed-by:
Signed-off-by:
4 years ago
d915fd9b96
!8592 change repeat_elements to a composite op
...
From: @tom__chen
Reviewed-by:
Signed-off-by:
4 years ago
b0deb7a289
Add dense embedding
4 years ago
ab26dd71dc
!8789 Enable value inference in Concat; Support const input in graph_ir convertor.
...
From: @c_34
Reviewed-by: @liangchenghui,@guoqi1024
Signed-off-by: @liangchenghui
4 years ago
12643a33dd
Add profiling reporter
4 years ago
2eee1c06f0
!8842 Change Ones/Zeros operator
...
From: @liangzhibo
Reviewed-by: @chenfei52
Signed-off-by:
4 years ago
7f725b93a3
!8234 Remove expm1_generic and log1p_generic from PP utils
...
From: @peixu_ren
Reviewed-by:
Signed-off-by:
4 years ago
f1e92d0ea7
Change Ones/zeros
4 years ago
e3371a01d5
!8751 Fix minor bugs in bijector and distribution
...
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by:
4 years ago
4132228c10
Add c++ api of randomresizecropwithbbox
4 years ago
f6d7fc7eeb
!8746 fixed get post message return type
...
From: @anancds
Reviewed-by:
Signed-off-by:
4 years ago
cfb9fb40d0
!8794 Add nn.Interpolate() function.
...
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
4 years ago
05e26f4739
Add nn.interpolate()
4 years ago
69338af0f5
fixed get post message return type
4 years ago
81dfd70ece
!8785 Add Parallel Operator UnsortedSegmentMax
...
From: @huangxinjing
Reviewed-by: @yangzhenzhang,@stsuteng,@kisnwang
Signed-off-by: @stsuteng
4 years ago
a52cd685fc
change repeat_element op to a composite op
4 years ago
812095de8f
!8753 Adds execute testcase and fix get_dataset_size
...
From: @ezphlow
Reviewed-by:
Signed-off-by:
4 years ago
b3add83bf0
support const input in graph_ir convertor, add value inference in Concat
4 years ago
8980bc3de7
!8675 support allreduce prod
...
From: @yao_yf
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
4 years ago
39352ca658
!8580 Add Operation AllSwap Primitive
...
From: @huangxinjing
Reviewed-by:
Signed-off-by:
4 years ago
89e7778497
Add UnsortedSegmentMax Operation
4 years ago
fa2185b8ef
!8661 Add nn.Tril() and nn.Triu()
...
From: @liangzhibo
Reviewed-by:
Signed-off-by:
4 years ago
f827c18f1d
!8289 Add Parallel Implements of Slice Op
...
From: @huangxinjing
Reviewed-by:
Signed-off-by:
4 years ago
45292abdfd
Added execute test case
...
Added execute tests for server
4 years ago
a3ae3b9794
!8695 add AdamOffload optimizer
...
From: @wangnan39
Reviewed-by: @stsuteng,@stsuteng,@kingxian
Signed-off-by: @kingxian
4 years ago
e1dba1337c
Add nn.Tril function
4 years ago
b5e05472ce
fix minor bugs in bijector and distribution utils, fix docs issues
4 years ago
c8047a35ab
!8632 [MD] Add Multiply op for Lite Dataset
...
From: @jiangzhiwen8
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
4 years ago
215fce192e
!8737 [MD] Fix the Pad function return false if bottom value is 0
...
From: @jiangzhiwen8
Reviewed-by: @xulei2020,@liucunwei,@heleiwang
Signed-off-by: @liucunwei
4 years ago
f1ef84e1a6
!8714 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size
...
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
f352f9a54a
!8511 [MD] Decouple more Transform Ops
...
From: @luoyang42
Reviewed-by:
Signed-off-by:
4 years ago
8e1ce841b4
!8688 dataset: modify the error log msg in python layer to be more acceptable
...
From: @ms_yan
Reviewed-by:
Signed-off-by:
4 years ago
8129806475
Add slice parallel op
4 years ago
ee72de1db2
!8441 Add Parallel Implements of UniformCandidateSampler
...
From: @huangxinjing
Reviewed-by:
Signed-off-by:
4 years ago
cd6236c0a0
!8712 update pipeline parallel interface
...
From: @yangzhenzhang
Reviewed-by: @kisnwang
Signed-off-by:
4 years ago
fb0e866ad1
!8269 forward unique dynamic shape
...
From: @yao_yf
Reviewed-by:
Signed-off-by:
4 years ago
23284f0b35
Add AllSwap Op
4 years ago
0cb5c47856
add err modify
4 years ago
bc91f7b3ac
fix pad zero
4 years ago
ab811fca8f
add AdamOffload optimizer
4 years ago
31819bb4a7
support forward unique
4 years ago
d43155b5b0
[MD] Decouple more Transform Ops
4 years ago
278e82a849
update pipeline parallel
4 years ago
1529d544b9
add allreduce prod
4 years ago
f40a4781e4
!8656 Adapt DynamicGRUV2Grad for Ascend new backend.
...
From: @liu_xiao_93
Reviewed-by: @jjfeing,@liangchenghui
Signed-off-by: @liangchenghui
4 years ago
2730cef047
Uniform Sampler Base Update
4 years ago
7fd2db437b
!8484 Add Digamma op
...
From: @peixu_ren
Reviewed-by: @zh_qh,@liangchenghui,@zh_qh
Signed-off-by: @liangchenghui
4 years ago
e3b1814401
!8713 Fix for GetDatasetSize issue in TextFile
...
From: @mahdirahmanihanzaki
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @nsyca
4 years ago
e5f62013f4
dataset Python UT: Add Sampler Chain Tests, with get_dataset_size
4 years ago
449e1526dc
Fixed GetDatasetSize for TextFile
4 years ago
4aa836dae1
Add Digamma op
4 years ago
ff5999fc2f
add removal pass for getters
...
fix CI round I
fix ci round II
address review cmts
fix ci round II
4 years ago
2aaf5e2e1b
Adapt DynamicGRUV2Grad for Ascend new backend.
4 years ago
88c91f4618
!8482 Add IGamma operator
...
From: @peixu_ren
Reviewed-by: @zh_qh
Signed-off-by:
4 years ago
65d50861ec
Remove expm1_generic and log1p_generic from PP utils
4 years ago
ecde0f03a2
Updated GetNumSamples logic
4 years ago
5e9178c5b6
Add IGamma operator
4 years ago
52eb2d3401
!8477 Add Cauchy distribution
...
From: @shallydeng
Reviewed-by: @zichun_ye
Signed-off-by:
4 years ago
b411c05de0
!8495 Adapt DynamicGRUV2 forward for Ascend new backend.
...
From: @liu_xiao_93
Reviewed-by:
Signed-off-by:
4 years ago
b30c1045e1
add lite_mat multiply
4 years ago
a321f402c8
!8579 Add view function for tensor
...
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
4 years ago
9c957072e2
!8097 Remove redundant phi nodes
...
From: @ginfung
Reviewed-by:
Signed-off-by:
4 years ago
7a192973ff
Add view function for tensor
4 years ago
2bf165c0b4
!8557 run cast before allgather in parallel optimzier
...
From: @gong_zi_yan
Reviewed-by:
Signed-off-by:
4 years ago
3176d377e6
Remove redundant phi nodes
4 years ago
0c2c76d037
update get rank in parallel ops
4 years ago
edcb0cd86b
!8370 [MD] Use neon instruction set to accelerate the Substract and Divide ops
...
From: @jiangzhiwen8
Reviewed-by: @xulei2020
Signed-off-by:
4 years ago
c11c79170e
!8554 Add expand_as function to tensor
...
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
4 years ago
d471ac491e
Adapt DynamicGRUV2 forward for Ascend new backend.
4 years ago
0ddb754edb
run cast before parallel optimizer
4 years ago
ba7ee2aa13
add expand_as function
4 years ago
c54a4a4494
!8540 Added GetColumnNames to C++
...
From: @mahdirahmanihanzaki
Reviewed-by: @nsyca,@jonyguo
Signed-off-by: @nsyca
4 years ago
5a7515e48f
Added GetColumnNames to C++
4 years ago
d2427b6e89
!8538 fix get_num_class in imagefolder
...
From: @ziruiwu
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @nsyca
4 years ago
3555d19b07
fix get num_class in imagefolder
...
address cmt
review cmts
4 years ago
ffc5209c09
!8476 Merge CacheOp_dev fixes for HQ system test.
...
From: @jkl_lee
Reviewed-by:
Signed-off-by:
4 years ago
c795879313
CacheOp delivery for HQ tester
4 years ago
a442024604
!8510 Add Ones and Zeros operators
...
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
4 years ago
7aa7ece5ce
!8497 add stage id for pipeline parallel
...
From: @yangzhenzhang
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
4 years ago
03bbe5f2a8
neon acceleration for subtract
4 years ago
886ef520d7
Add Ones and Zeros operators
4 years ago
f16509388c
!8409 Multi-dimensional list value assignment
...
From: @liangzhibo
Reviewed-by: @chenfei52
Signed-off-by:
4 years ago
1a68ccb40b
added Cauchy distribution
4 years ago
41d925b68a
set stage id
4 years ago
f60ae8925d
!8480 Add RandomNode fix
...
From: @ezphlow
Reviewed-by: @pandoublefeng,@heleiwang
Signed-off-by:
4 years ago
510a0399fc
!8335 added cluster config and message handler unit test,change namespace from comm to core
...
From: @anancds
Reviewed-by:
Signed-off-by:
4 years ago
a21eb2d527
Added random node fix
4 years ago
0de9d3e5b7
!6989 split sort for parallel run
...
From: @kisnwang
Reviewed-by:
Signed-off-by:
4 years ago
156980778b
!8416 Fix RealDiv Type Error when insert an VirtualDiv Operation
...
From: @huangxinjing
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
4 years ago
222a0bccf4
!8431 Add more check in unsorted_segment_sum_fission pass to avoid doing wrong optimize which cause runtime error
...
From: @irmo
Reviewed-by:
Signed-off-by:
4 years ago
96d8c411e7
added message handler unit test
4 years ago
1c6c280da7
fix unsorted_segment_sum_fission pass
4 years ago
12e9107162
Fix VirtualDiv Int32 error
4 years ago
c5b5a6719c
Enable multi-dimensional list value assignment
4 years ago
70f5775711
!8387 Add support for GetClassIndexing in C++ API
...
From: @alex-yuyue
Reviewed-by:
Signed-off-by:
4 years ago
d7c3a9ba00
Add GetClassIndexing
...
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
b88e722e12
add graph partition
4 years ago
e62285e8e7
!8396 Adapt UnsortedSegmentMax for Ascend.
...
From: @liu_xiao_93
Reviewed-by: @liangchenghui,@c_34
Signed-off-by: @liangchenghui
4 years ago
bc12c647a5
!8380 [MD]remove opencv api with lite_cv in lite train
...
From: @xulei2020
Reviewed-by: @heleiwang
Signed-off-by:
4 years ago
92ba9d94df
Adapt UnsortedSegmentMax for Ascend.
4 years ago
4e07f43dff
!8323 [Auto parallel] Supporting for-loop in strategy-searching
...
From: @xiaoda_zh
Reviewed-by:
Signed-off-by:
4 years ago
f8d1b20873
init litemat from memory
4 years ago
f8f2d127cd
!7999 optimize cpu unique
...
From: @kisnwang
Reviewed-by:
Signed-off-by:
4 years ago
buxue
Lixia Chen
YangLuo
mindspore-ci-bot
Xiao Tianci
yanglf1121
xiefangqi
Payne
zhoufeng
chendongsheng
jiangzhenguang
jjfeing
shenwei41
huangxinjing
yao_yf
Mahdi
Zirui Wu
Bairong
xuyongfei
Xiaoda Zhang
l00591931
yanglf1121
limingqi107
yanghaoran
wangnan39@huawei.com
hesham
zhuyuxiao
Nat Sutyanyong
“dangjiaqi1”
Ziyan
liuxiao93
Jesse Lee
Cathy Wong
Xun Deng
lichenever
mxm
alex-yuyue
caifubi
bai-yangfan
peixu_ren
Eric
laiyongqiang
jonyguo
liucunwei
Zhang Qinghua
Peilin Wang
yangzhenzhang
HulkTang
changzherui
mohammad
tinazhang
anancds
tom__chen
chenhaozhe
ms_yan
jiangzhiwen
yangzhenzhang
yujianfeng
huanghui
kswang
xulei2020