79fef0df0e
!9142 fix bug of addn not supported dynamic shape
...
From: @M20211031
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
4 years ago
0c46093496
!9346 add profiler st
...
From: @yanghaitao1
Reviewed-by: @lilongfei15,@ouwenchang
Signed-off-by: @ouwenchang
4 years ago
2190da9946
support atomic clean and change package for akg.
4 years ago
0c7ba7a7fa
!9354 mode_mindir_suffix
...
From: @bai-yangfan
Reviewed-by: @c_34,@guoqi1024
Signed-off-by: @c_34
4 years ago
efc7e9f89e
!9358 PyNative Bugfix
...
From: @jojobugfree
Reviewed-by: @chujinjin,@jjfeing
Signed-off-by: @jjfeing
4 years ago
c8e7c3edb0
PyNative Hccl Bugfix
4 years ago
c46c4dffe4
mindir_suffix
4 years ago
c3896df390
add profiler st
4 years ago
0adab15de7
Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end
4 years ago
51d885815a
!9281 increase variable_memory_max_size max size from 30GB to 31GB
...
From: @laiyongqiang
Reviewed-by:
Signed-off-by:
4 years ago
eb7cbd49ac
!8595 Add Cholesky op at GPU back-end
...
From: @peixu_ren
Reviewed-by: @zichun_ye,@wilfchen
Signed-off-by:
4 years ago
6c18c09121
!9266 PyNative Support Hccl(Data Parallel)
...
From: @jojobugfree
Reviewed-by: @chujinjin,@jjfeing
Signed-off-by: @chujinjin
4 years ago
df44e1339e
!9249 Optimizing GetDatasetSize
...
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
4 years ago
9ed31ea2cb
!9339 Disable getter optimization pass
...
From: @ezphlow
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @nsyca
4 years ago
4ffd9b578f
!9331 More cache minor fix for HQ testers
...
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
db2a8b5e1d
Disable getter pass
4 years ago
f80553bc6e
Optimization for GetDatasetSize
4 years ago
2ddb1fb75e
More CRC fix and blocking BatchOp under cache
4 years ago
e2e6bf59b2
Cast half to int by rounding down
4 years ago
04d8cd5d8b
Support PyNative Data Parallel
4 years ago
77ef72be30
!9306 fix ndarray field without type in mindrecord
...
From: @jonyguo
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
4 years ago
11244f790a
increase variable_memory_max_size max size from 30GB to 31GB
4 years ago
01df2341ff
!9245 Fixes some typos and formatting errors in docstring.
...
From: @peilin-wang
Reviewed-by: @robingrosman,@robingrosman,@tom__chen
Signed-off-by: @tom__chen
4 years ago
45b705bca0
!9129 support abs() and mean() method for Tensor object
...
From: @bairongz
Reviewed-by:
Signed-off-by:
4 years ago
847e59bd6c
fix: ndarray field without type in mindrecord
4 years ago
920bbf1541
!9277 fix schema & zip validation
...
From: @luoyang42
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
4 years ago
da8d7d661a
!9283 Modify the dataset ut log message
...
From: @liucunwei
Reviewed-by: @pandoublefeng,@heleiwang,@jonyguo
Signed-off-by: @heleiwang,@jonyguo
4 years ago
ca66aef549
!8775 remove "is_grad" in SoftmaxCrossEntropyWithLogits and correct its comments
...
From: @wanyiming
Reviewed-by: @kingxian,@zh_qh
Signed-off-by: @kingxian
4 years ago
a16c87ded4
!8972 add auto-parallel use case
...
From: @big_hair_big_hair
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
4 years ago
1ffecf1874
!9180 fix dnnl binary broadcast
...
From: @zhao_ting_v
Reviewed-by:
Signed-off-by:
4 years ago
c41a21d2c2
!9208 Add four new c++ api of text
...
From: @shenwei41
Reviewed-by: @heleiwang
Signed-off-by:
4 years ago
8ef4b2796e
modify the dataset ut log message
4 years ago
0e6d06c463
!9230 Set trace info of Primitive CNode only for equiv out node, not the whole fprop function.
...
From: @zh_qh
Reviewed-by: @ginfung
Signed-off-by: @ginfung
4 years ago
5cc3b76577
fix schema & zip validation
4 years ago
623b2e3f99
support abs and mean of Tensor
4 years ago
e45f19adc8
!8697 support the outermost layer network inputs are list or dict or scalar
...
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
4 years ago
3bea84d0f7
add four new text API
4 years ago
8310236ff1
Set trace info of Primitive CNode only for equiv out node, not the whole fprop function.
4 years ago
af6ded28e3
Add Cholesky op at GPU back-end
4 years ago
102b74682b
fix dnnl binary broadcast
4 years ago
5306c91cb7
!9214 support repeated calculation when the axis of gatherv2 is 0 and split
...
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
4 years ago
ea191ed5da
!8463 Run ops one by one in pynative bp graph
...
From: @HulkTang
Reviewed-by:
Signed-off-by:
4 years ago
af3c27d354
!9244 Fix core dump with concat and getter_pass
...
From: @ziruiwu
Reviewed-by:
Signed-off-by:
4 years ago
e4444a1c12
initial commit
...
fix testcases
fix ci
4 years ago
ccf637f64a
!9241 SequenceMask gpu kernel
...
From: @peilin-wang
Reviewed-by: @tom__chen
Signed-off-by:
4 years ago
c3e7a8255c
!9248 Add input check to nlp operators
...
From: @ezphlow
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
cf802c839c
Added missing input check for nlp operator
4 years ago
23487fae09
fix get_shape/type and a segfault in getter_pass
...
add test case
4 years ago
f7dc2432a0
initial commit
...
fix ci
fix ci
remove old sequence mask api
fix ci
fix ci
remove old seuqence mask tests
4 years ago
7748ae823a
!9141 Fix DatasetCache C++ API cache sharing behavior
...
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
4 years ago
a37e9710b5
!9038 port name functions from TensorOp to TensorOperation
...
From: @mhmotallebi
Reviewed-by:
Signed-off-by:
4 years ago
5835095e07
!9134 Equal op dynamic shape
...
From: @jonwe
Reviewed-by: @robingrosman,@tom__chen
Signed-off-by: @tom__chen
4 years ago
dc62360eed
!9140 [MS][GPU][CUDA][DynamicShape] - New GPU kernel -> UnsortedSegmentMin + DynamicShape support changes to API + inferImpl func (+SegMax ST correction)
...
From: @danishnxt
Reviewed-by:
Signed-off-by:
4 years ago
d6f91133c3
Support the outermost layer network inputs are list or dict or scalar
4 years ago
762793cb8f
!9175 fix a bug in random resize crop op and some lint
...
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo,@liucunwei
Signed-off-by: @liucunwei
4 years ago
f0671ce513
!9076 [MD] Support vision c_transform python eager: Resize, Rescale, Normalize, HWC2CHW, Pad
...
From: @luoyang42
Reviewed-by:
Signed-off-by:
4 years ago
59f9ac9975
Primitive 'AddN' support dynamic shape
4 years ago
7b33f3e2ac
gatherv2 axis split repeated calculation
4 years ago
b85bcff4b2
!9057 modify export file name
...
From: @changzherui
Reviewed-by:
Signed-off-by:
4 years ago
12da8717b7
1.correct param check for vision op 2.fix config review 3.fix api doc
4 years ago
ff2c44c935
!9178 add some pynative st test_cases in gpu
...
From: @lvchangquan
Reviewed-by: @kisnwang
Signed-off-by:
4 years ago
b30b7b2d5e
add use case
4 years ago
cabefafa13
add some pynative st test_cases in gpu env
4 years ago
42f32b7c4b
!9173 support batch size small than dev size in parallel gatherv2
...
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
4 years ago
c36b477568
Run ops one by one in pynative bp graph
4 years ago
a6845395e6
!9181 Add some ut pipeline test case for C++ dataset
...
From: @liucunwei
Reviewed-by: @pandoublefeng,@jonyguo
Signed-off-by: @jonyguo
4 years ago
0b615a7e93
!9171 Add some pipeline ut test cases for c++ dataset
...
From: @liucunwei
Reviewed-by: @jonyguo,@pandoublefeng
Signed-off-by: @jonyguo
4 years ago
e612e23a05
Add some ut pipeline test case for C++ dataset
4 years ago
2a03fa79f9
!9161 add pynative st
...
From: @echo_hua
Reviewed-by: @chujinjin,@kisnwang
Signed-off-by: @kisnwang
4 years ago
7f13f2ad0e
add some pipeline ut test cases for c++ dataset
4 years ago
7278f5c109
update_gatherv2_op
4 years ago
2370828043
!8586 fix GatherD and add Randperm for aicpu
...
From: @yanzhenxiang2020
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @wuxuejian
4 years ago
4acdcad5d6
add st test_pynative_control_flow.py
4 years ago
c79e988b0d
set fullname for reshape after reshape-elimination
4 years ago
a146f982bc
!8983 support variabel length virtual_dataset in auto parallel
...
From: @yao_yf
Reviewed-by:
Signed-off-by:
4 years ago
dcde1fc70a
!9092 Add LBeta op at nn level
...
From: @peixu_ren
Reviewed-by:
Signed-off-by:
4 years ago
aa4bf9a3f2
[MD] Support python-eager: Resize, Rescale, Normalize, HWC2CHW, Pad
4 years ago
91301a6d1a
modify export file name
4 years ago
cf383af36e
!8624 updated cluster config and proto
...
From: @anancds
Reviewed-by:
Signed-off-by:
4 years ago
c1002d2eb4
!9138 Address left over comments from PR8802
...
From: @ziruiwu
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @nsyca
4 years ago
55f7e3dc16
!9135 Minor fixs for cache error message
...
From: @tina_mengting_zhang
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @nsyca
4 years ago
9f82393b24
!9137 Add Beta distribution
...
From: @peixu_ren
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by: @sunnybeike
4 years ago
9cfeb08c4d
port name() to TensorOperation and its derived classes
4 years ago
e8247eadef
Same runtime CacheClient if c++ cache is shared
4 years ago
450f1ee886
First Commit - UnsortedSegMin Kernel + DynamicSupport
...
lint fix + SegMAX st fix
removing unreq whitspace
lint fix
lint fix2
4 years ago
3e2eb70fc0
!8669 Split op extending PrimitiveWithCheck
...
From: @tom__chen
Reviewed-by:
Signed-off-by:
4 years ago
442217314d
!8861 [MS][GPU][DynamicShapeUpdate] Converting UnsortedSegmentMax from normal to dynamic shape op
...
From: @danishnxt
Reviewed-by:
Signed-off-by:
4 years ago
37d40bc495
Add Beta distribution
4 years ago
28772d4fb7
!9132 Fix bug for SparseGatherV2 GPU and add dynamic shape testcase
...
From: @TFbunny
Reviewed-by:
Signed-off-by:
4 years ago
6f31bdbf67
fix issues for hq testers: I277HD, I277HV
4 years ago
9b0ec824c4
!9096 DynamicShapeOp int64 support and bug fix
...
From: @peilin-wang
Reviewed-by: @robingrosman,@tom__chen
Signed-off-by: @robingrosman
4 years ago
2e31899101
!9095 [MS][DynamicShape][API] Fixes for UnsortedSegementSum DynamicShape support API + InferImpl func
...
From: @danishnxt
Reviewed-by:
Signed-off-by:
4 years ago
36bfd0d8ad
address left over cmts from 8802
4 years ago
b76c7cc7bf
!9025 ReLU gpu op supports int32 and int64
...
From: @jonwe
Reviewed-by: @tom__chen,@robingrosman
Signed-off-by: @tom__chen
4 years ago
4fa6238dde
change Split op to extend PrimitiveWithCheck
4 years ago
6ae8573803
Equal op dynamic shape
4 years ago
419f8bf72a
fix dynamic shape and add testcase for SparseGatherV2 GPU
4 years ago
6355f46d32
Add LBeta op at nn level
4 years ago
f28b73f231
!9040 ExpandDims dynamic shape
...
From: @jonwe
Reviewed-by: @tom__chen,@robingrosman
Signed-off-by: @robingrosman
4 years ago
28e6c7f29e
!9034 [MS][DynamicShape] - Converting P.Square to DynamicShape op
...
From: @danishnxt
Reviewed-by: @robingrosman
Signed-off-by:
4 years ago
0856639fc5
!9130 add some new ut test case for C++ minddataset
...
From: @liucunwei
Reviewed-by: @pandoublefeng,@jonyguo
Signed-off-by: @pandoublefeng
4 years ago
b0496aaa10
!8673 Add min/max_shape to ScatterAdd/Update and Transpose and add new dynamic shape testcases
...
From: @TFbunny
Reviewed-by: @robingrosman
Signed-off-by:
4 years ago
3e57236fe3
add some new ut test for minddataset
4 years ago
9f70ebac64
Cast/ReLU dynamic shapelsgpu op supports int32 and int64
4 years ago
36ea519009
ExpandDims dynamic shape
4 years ago
3bed28822d
!9024 Add four text C++ API
...
From: @shenwei41
Reviewed-by:
Signed-off-by:
4 years ago
aa2296bcc1
!9094 Blocking TakeOp/SkipOp under Cache
...
From: @lixiachen
Reviewed-by: @nsyca,@mikef,@nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
40222f59a7
!9043 Add support to op L2Loss on gpu
...
From: @yuan_shen_zhou
Reviewed-by: @liangchenghui,@liangchenghui
Signed-off-by: @liangchenghui,@liangchenghui
4 years ago
fc380b8071
updated cluster config and proto
4 years ago
715ca637e1
!9107 ps testcast
...
From: @chopin_syp
Reviewed-by: @xsmq,@kisnwang
Signed-off-by: @kisnwang
4 years ago
67505ef198
!9050 Mix bugs in Categorical distribution
...
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by: @sunnybeike
4 years ago
6da2169439
ps
4 years ago
4e56618d18
Add text C++ API
4 years ago
cfc3542261
First Commit SegMax changes + typo in SegSum InferImpl
...
UnsortedSegmentMax update + new STs
switch to lambda function
SegmentSum - InferImpl min/max shape pushback fix
lint fix
revert segSum due to sep pr + addressing comments:
4 years ago
3fa7233f68
!9072 fix topk fussion help tensor size = 4096*2
...
From: @jjfeing
Reviewed-by: @chujinjin,@kisnwang
Signed-off-by:
4 years ago
1dd302ae93
int64 support and typo fix
...
fixed typo
fix pylint
4 years ago
f6e87143c6
add support to op L2Loss on gpu
4 years ago
0aa63f21c5
!9039 register FastGelu for activation
...
From: @shibeiji
Reviewed-by:
Signed-off-by:
4 years ago
6f64fffdb4
Adding API fix for handling dynamic_shape correctly plus STs for SegSum dyn_shape
...
Updating InferImpl function
adding check to inferImpl function
lint
lint2
4 years ago
27698866d1
Block take/skip under cache and fix docstring
...
and other minor changes per the request of HQ testers
4 years ago
bd8522aff7
!8802 Boilerplate code for IR Tree optimizer
...
From: @nsyca
Reviewed-by:
Signed-off-by:
4 years ago
5e19a642f9
fix and add testcase for dynamic shape scatteradd/update transpose
4 years ago
e6ebb310eb
!8928 [MS][GPU][CUDA] - New GPU kernel -> LinSpace
...
From: @danishnxt
Reviewed-by:
Signed-off-by:
4 years ago
64a6769d3f
Update Square Op to support Dynamic Shape
4 years ago
c3b057bd69
!8825 [MS][GPU] GatherV2_Dynamic_BugFix
...
From: @danishnxt
Reviewed-by:
Signed-off-by:
4 years ago
5e1bb0b697
boilerplate code for future IR optimizer
...
add 2 test cases to IRNode Deepcopy()
address review cmts
fix ut
samplerObj copy
ci
fix ci
fix ci round III
address further review cmts
add a missing macro
fix merge conflict
fix complie err
fix lite compile err
fix compile err
fix lite compile round III
address an issue
fix minor comments
4 years ago
dabb82ec7a
!8846 host cpu support dynamic shape
...
From: @liubuyu
Reviewed-by: @jjfeing
Signed-off-by:
4 years ago
32aa790f43
!9071 add testcase for ps
...
From: @chopin_syp
Reviewed-by: @cristoval,@limingqi107
Signed-off-by: @limingqi107
4 years ago
ebef1df00b
!8994 split dropout op and expand dropout
...
From: @zengzitao
Reviewed-by:
Signed-off-by:
4 years ago
9130660a2f
!9055 add yolov3 export file and fix bert exprt bug
...
From: @yuzhenhua666
Reviewed-by: @liangchenghui
Signed-off-by:
4 years ago
9cda064716
auto parallel predict
4 years ago
8fb7d11ecb
fix topk help 4096
4 years ago
c191deff1d
ps
4 years ago
a1db640211
fix bert bug and add export file for yolov3 and add test file for maskrcnn
4 years ago
9f5ab8f76f
host cpu support dynamic shape
4 years ago
082cb4e7fd
add Randperm/GatherDGrad and fix GatherD for aicpu
4 years ago
d6f6269ff1
!8310 fix example of categorical and rnntloss
...
From: @yanzhenxiang2020
Reviewed-by: @c_34
Signed-off-by: @c_34
4 years ago
5d0a4f3995
!9005 add st testcase for heterogeneous_excutor
...
From: @mindspore_boy
Reviewed-by: @c_34,@guoqi1024
Signed-off-by: @guoqi1024
4 years ago
a17f76dd1d
Initial Commit - GPU LinSpace
...
comment fix
docString fix
added asserts in test file atop np checks
lint
lint-2
lint3
4 years ago
cd850bd210
register activation operator fast_gelu
4 years ago
a058881b90
fix minor bug in catgorical distribution
4 years ago
3ef0e9f053
substitute dropout by cudnnuniformreal and dropout
4 years ago
421cad24ef
!8715 Add Gamma distribution
...
From: @peixu_ren
Reviewed-by:
Signed-off-by:
4 years ago
241c8f3d96
GatherUpdate
...
test file finishing pending
Update to GatherV2_Bug_Fix
lint fix
lint fix - 2
lint fix
Update to GatherV2 - fixed default inferImpl func + CudeStreamSync
lint fix
SyncDevice
added dynamic shape init_size input
lint
4 years ago
adc8e3e707
!8594 [MD] Pybind Pushdown Support for dataset
...
From: @cathwong
Reviewed-by:
Signed-off-by:
4 years ago
809e1d5086
added python api based on cpp api
...
1st draft of python iterator
Added Cifar10 and Cifar100 pybind port
Change pybind to use IR for Skip and Manifest
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
DatasetNode as a base for all IR nodes
namespace change
Fix the namespace issue and make ut tests work
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
Add VOCDataset
!63 Added RandomDataset
* Added RandomDataset
add imagefolder ir
Pybind switch: CelebA and UT
!61 CLUE example with class definition
* Merge branch 'python-api' of gitee.com:ezphlow/mindspore into clue_class_pybind
* Passing testcases
* Added CLUE, not working
add ManifestDataset IR
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
Update Coco & VOC & TFReader, Update clang-format, Reorder
datasets_binding
!69 Add Generator and move c_dataset.Iterator to dataset.Iterator
* Add GeneratorDataset to c_dataset
* Add GeneratorDataset to c_dataset
!67 Moving c_datasets and adding sampler wrapper
* Need to add create() method in datasets.py
* migration from c_dataset to dataset part 1
!71 Fix indent error
* Fix indentation error
!72 Fix c_api tests cases
* Fix c_api tests cases
!73 Added CSV Dataset
* Added CSVDataset
pybind switch: Take and CelebA fixes
!75 move c_dataset functionality to datasets
* Fixed existing testcases
* Added working clue and imagefolder
* Added sampler conversion from pybind
* Added sampler creation
!77 Add Python API tree
* Python API tree
add minddataset
TextFileDataset pybind
Rename to skip test_concat.py and test_minddataset_exception.py
!80 Add batch IR to python-api branch, most test cases work
* staging III
* staging, add pybind
Enable more c_api take and CelebA tests; delete util_c_api
!84 Schema changes in datasets.py
* Schema changes
!85 Remove input_indexes from sub-classes
* remove input_index from each subclass
!83 Remove C datasets
* Removed c_dataset package
* Remove c_datasets
!82 pybind switch: shuffle
* pybind switch: shuffle
!86 Add build_vocab
* Add build_vocab
Rebase with upstream/master
_shuffle conflict
BatchNode error
!88 Fix rebase problem
* fix rebase problem
Enable more unit tests; code typo/nit fixes
!91 Fix python vocag hang
* Fix python vocab hang
!89 Added BucketBatchByLength Pybind switch
* Added BucketBatchByLength
Update and enable more tet_c_api_*.py tests
!95 Add BuildSentencePeiceVocab
* - Add BuildSentencePeiceVocab
!96 Fix more tests
* - Fix some tests
- Enable more test_c_api_*
- Add syncwait
!99 pybind switch for device op
* pybind switch for device op
!93 Add getters to python API
* Add getters to python API
!101 Validate tree, error if graph
* - Add sync wait
!103 TFrecord/Random Datasets schema problem
* - TfRecord/Random schem aproblem
!102 Added filter pybind switch
* Added Filter pybind switch
!104 Fix num_samples
* - TfRecord/Random schem aproblem
!105 Fix to_device hang
* Fix to_device hang
!94 Adds Cache support for CLUE dataset
* Added cache for all dataset ops
* format change
* Added CLUE cache support
* Added Cache conversion
Add save pybind
fix compile err
init modify concat_node
!107 Fix some tests cases
* Fix tests cases
Enable and fix more tests
!109 pybind switch for get dataset size
* pybind_get_dataset_size
some check-code fixes for pylint, cpplint and clang-format
!113 Add callback
* revert
* dataset_sz 1 line
* fix typo
* get callback to work
!114 Make Android compile clean
* Make Android Compile Clean
Fix build issues due to rebase
!115 Fix more tests
* Fix tests cases
* !93 Add getters to python API
fix test_profiling.py
!116 fix get dataset size
* fix get dataset size
!117 GetColumnNames pybind switch
* Added GetColumnNames pybind switch
code-check fixes: clangformat, cppcheck, cpplint, pylint
Delete duplicate test_c_api_*.py files; more lint fixes
!121 Fix cpp tests
* Remove extra call to getNext in cpp tests
!122 Fix Schema with Generator
* Fix Schema with Generator
fix some cases of csv & mindrecord
!124 fix tfrecord get_dataset_size and add some UTs
* fix tfrecord get dataset size and add some ut for get_dataset_size
!125 getter separation
* Getter separation
!126 Fix sampler.GetNumSamples
* Fix sampler.GetNumSampler
!127 Assign runtime getter to each get function
* Assign runtime getter to each get function
Fix compile issues
!128 Match master code
* Match master code
!129 Cleanup DeviceOp/save code
* Cleanup ToDevice/Save code
!130 Add cache fix
* Added cache fix for map and image folder
!132 Fix testing team issues
* Pass queue_name from python to C++
* Add Schema.from_json
!131 Fix Cache op issues and delete de_pipeline
* Roll back C++ change
* Removed de_pipeline and passing all cache tests.
* fixed cache tests
!134 Cleanup datasets.py part1
* Cleanup dataset.py part1
!133 Updated validation for SentencePieceVocab.from_dataset
* Added type_check for column names in SentencePieceVocab.from_dataset
Rebase on master 181120 10:20
fix profiling
temporary solution of catching stauts from Node.Build()
!141 ToDevice Termination
* ToDevice termination
pylint fixes
!137 Fix test team issues and add some corresponding tests
* Fix test team issues and add some corresponding tests
!138 TreeGetter changes to use OptPass
* Getter changes to use OptPass (Zirui)
Rebase fix
!143 Fix cpplint issue
* Fix cpplint issue
pylint fixes in updated testcases
!145 Reset exceptions testcase
* reset exception test to master
!146 Fix Check_Pylint Error
* Fix Check_Pylint Error
!147 fix android
* fix android
!148 ToDevice changes
* Add ToDevice to the iterator List for cleanup at exit
!149 Pylint issue
* Add ToDevice to the iterator List for cleanup at exit
!150 Pylint 2
* Add ToDevice to the iterator List for cleanup at exit
!152 ExecutionTree error
* ET destructor error
!153 in getter_pass, only remove callback, without deleting map op
* getter pass no longer removes map
!156 early __del__ of iterator/to_device
* early __del__ of iterator
!155 Address review comments Eric 1
* Added one liner fix to validators.py
* roll back signature fix
* lint fix
* Eric Address comments 2
* C++ lint fix
* Address comments Eric 1
!158 Review rework for dataset bindings - part 1
* Reorder nodes repeat and rename
* Review rework for dataset bindings - part 1
!154 Fixing minor problems in the comments (datasets.py, python_tree_consumer.cc, iterators_bindings.cc, and iterators.py)
* Fixing minor problems in the comments (datasets.py, python_tree_consum…
!157 add replace none
* Add replace_none to datasets.py, address comments in tests
Trying to resolve copy
Override the deepcopy method of deviceop
Create_ir_tree method
Create_ir_tree method 2
Create_ir_tree method 2
del to_device if already exists
del to_device if already exists
cache getters shapes and types
Added yolov3 relaxation, to be rolled back
Get shapes and types together
bypass yolo
NumWorkers for MapOp
revert Yolo
revert Thor
Print more info
Debug code: Update LOG INFO to LOG ERROR
do not remove epochctrl for getter pass
Remove repeat(1)
pritn batch size
add log to tree_consumer and device_queue op
Revert PR 8744
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
__del__ toDEvice
__del__ toDevice2
!165 add ifndef ENABLE_ANDROID to device queue print
* Add ifndef ENABLE_ANDROID to device queue print
revert some changes
!166 getter: get_data_info
* getter: get_data_info
!168 add back tree print
* revert info to warnning in one log
* add back the missed print tree log
Release GIL in GetDataInfo
4 years ago
979bb26cba
!9031 Fix DatasetCache parameter check
...
From: @lixiachen
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
ab7427f1a9
Minor fix for DatasetCache param validation
4 years ago
93d4ef428f
Add Gamma distribution
4 years ago
a0e4db6aae
!9016 delete input_mask_from_dataset option in transformer's config
...
From: @yuchaojie
Reviewed-by: @liangchenghui,@linqingke
Signed-off-by: @linqingke
4 years ago
7aaca7d721
!8970 add control flow st testcase
...
From: @zhiyuan_mei
Reviewed-by: @chenfei52,@youui
Signed-off-by: @youui
4 years ago
dca109c9a5
fix example of categorical and rnntloss
4 years ago
f13388ee6b
delete input_mask_from_dataset option in transformer's config
4 years ago
b5e289333e
add st testcase
4 years ago
22d683a805
!8920 Adapt ops LinSpace for Ascend.
...
From: @liu_xiao_93
Reviewed-by: @liangchenghui,@linqingke,@liangchenghui
Signed-off-by: @liangchenghui,@liangchenghui
4 years ago
d9b4b5c750
!8954 Add SequenceMask operator.
...
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
4 years ago
21b501bb94
!8752 Add Poisson distribution
...
From: @peixu_ren
Reviewed-by:
Signed-off-by:
4 years ago
584e241e29
Adapt ops LinSpace for Ascend.
4 years ago
01f5da0a14
Add Poisson distribution
4 years ago
9a6ced3cc7
DinNoNan gpu kernel supports int8/uint8
4 years ago
b80c289caa
control_flow case
4 years ago
7c73bc50f4
fixed codex
4 years ago
5353cd196b
!8935 remove quantization_aware option in Mobilenetv2-quant config
...
From: @yuchaojie
Reviewed-by: @chenfei52
Signed-off-by:
4 years ago
17c0810f9e
add SequenceMask operator
4 years ago
d532af3a9a
new hccl interface
...
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
4 years ago
9051c56436
remove quantization_aware option in Mobilenetv2-quant config
4 years ago
0ad2c31b56
!8453 Add GPU p2p kernels
...
From: @zpac
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
4 years ago
fd9cd7afcd
!8744 [MD] support ascend dynamic shape in sink mode
...
From: @liyong126
Reviewed-by:
Signed-off-by:
4 years ago
c60f413ee2
!8933 modify Resnet50-quant data_load_mode value
...
From: @yuchaojie
Reviewed-by: @sanjaychan,@chenfei52
Signed-off-by: @sanjaychan
4 years ago
db3a2d60cb
GPU supports p2p nccl interfaces
4 years ago
d8b26d9425
!8874 add st testcases
...
From: @zsj_mind
Reviewed-by:
Signed-off-by:
4 years ago
48e688c166
add dynamic shape support
4 years ago
2bd37b79c8
add new testcase for access control
...
Signed-off-by: zhushujing <zhushujing@huawei.com>
4 years ago
0d49650bd5
!8888 Add PyNative Device Profiling
...
From: @jojobugfree
Reviewed-by: @kisnwang,@jjfeing
Signed-off-by: @jjfeing
4 years ago
0793198891
!8917 Add grad definition for sigmoidGrad.
...
From: @david-he91
Reviewed-by: @liangchenghui,@linqingke
Signed-off-by: @liangchenghui
4 years ago
c32139f3fa
modify Resnet50-quant data_load_mode value
4 years ago
3d6d820612
!8154 Add nn.MultiFieldEmbedding for the embedding lookup opearations
...
From: @huangxinjing
Reviewed-by:
Signed-off-by:
4 years ago
6a04c21456
!8875 Fix some bug about GatherD and GatherDGrad op on gpu
...
From: @yuan_shen_zhou
Reviewed-by:
Signed-off-by:
4 years ago
d915fd9b96
!8592 change repeat_elements to a composite op
...
From: @tom__chen
Reviewed-by:
Signed-off-by:
4 years ago
b0deb7a289
Add dense embedding
4 years ago
0279323b99
add grad definition for sigmoidGrad operation
4 years ago
ab26dd71dc
!8789 Enable value inference in Concat; Support const input in graph_ir convertor.
...
From: @c_34
Reviewed-by: @liangchenghui,@guoqi1024
Signed-off-by: @liangchenghui
4 years ago
12643a33dd
Add profiling reporter
4 years ago
e1026961f7
fix some bug in gather and gathergrad op
4 years ago
2eee1c06f0
!8842 Change Ones/Zeros operator
...
From: @liangzhibo
Reviewed-by: @chenfei52
Signed-off-by:
4 years ago
7f725b93a3
!8234 Remove expm1_generic and log1p_generic from PP utils
...
From: @peixu_ren
Reviewed-by:
Signed-off-by:
4 years ago
f1e92d0ea7
Change Ones/zeros
4 years ago
e3371a01d5
!8751 Fix minor bugs in bijector and distribution
...
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by:
4 years ago
4132228c10
Add c++ api of randomresizecropwithbbox
4 years ago
82456e3f2b
!8749 batchnorm2d test case for use_batch_statistics is false
...
From: @jonwe
Reviewed-by: @robingrosman
Signed-off-by:
4 years ago
f6d7fc7eeb
!8746 fixed get post message return type
...
From: @anancds
Reviewed-by:
Signed-off-by:
4 years ago
cfb9fb40d0
!8794 Add nn.Interpolate() function.
...
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
4 years ago
7689062c7d
!8727 Clean code for gnmt_v2 network
...
From: @gaojing22
Reviewed-by: @yingjy,@guoqi1024
Signed-off-by: @yingjy
4 years ago
044c7d183c
!8803 Validate SampledSoftmaxLoss Args
...
From: @jonwe
Reviewed-by: @tom__chen,@robingrosman
Signed-off-by: @robingrosman
4 years ago
a23ddaf409
clean_code
4 years ago
05e26f4739
Add nn.interpolate()
4 years ago
69338af0f5
fixed get post message return type
4 years ago
81dfd70ece
!8785 Add Parallel Operator UnsortedSegmentMax
...
From: @huangxinjing
Reviewed-by: @yangzhenzhang,@stsuteng,@kisnwang
Signed-off-by: @stsuteng
4 years ago
036e28bb96
batchnorm2d use_batch_statistics false test case
4 years ago
2e0981faec
!8801 gpu op for testing dynamic shape
...
From: @peilin-wang
Reviewed-by: @robingrosman
Signed-off-by:
4 years ago
a52cd685fc
change repeat_element op to a composite op
4 years ago
812095de8f
!8753 Adds execute testcase and fix get_dataset_size
...
From: @ezphlow
Reviewed-by:
Signed-off-by:
4 years ago
22cb2814e8
validate SampledSoftmaxLoss args
4 years ago
3d4d5ec77f
initial commit for gpu dynamic shape testing op
...
fix ci
fix ci
4 years ago
b3add83bf0
support const input in graph_ir convertor, add value inference in Concat
4 years ago
8980bc3de7
!8675 support allreduce prod
...
From: @yao_yf
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
4 years ago
39352ca658
!8580 Add Operation AllSwap Primitive
...
From: @huangxinjing
Reviewed-by:
Signed-off-by:
4 years ago
89e7778497
Add UnsortedSegmentMax Operation
4 years ago
fa2185b8ef
!8661 Add nn.Tril() and nn.Triu()
...
From: @liangzhibo
Reviewed-by:
Signed-off-by:
4 years ago
dad47cf2dd
mod_comments
4 years ago
f827c18f1d
!8289 Add Parallel Implements of Slice Op
...
From: @huangxinjing
Reviewed-by:
Signed-off-by:
4 years ago
99fc0a4e64
!8526 Add 'in_channel' and 'out_channel' to cell_attr_register
...
From: @wanyiming
Reviewed-by: @kingxian
Signed-off-by: @kingxian
4 years ago
45292abdfd
Added execute test case
...
Added execute tests for server
4 years ago
a3ae3b9794
!8695 add AdamOffload optimizer
...
From: @wangnan39
Reviewed-by: @stsuteng,@stsuteng,@kingxian
Signed-off-by: @kingxian
4 years ago
e1dba1337c
Add nn.Tril function
4 years ago
b5e05472ce
fix minor bugs in bijector and distribution utils, fix docs issues
4 years ago
c8047a35ab
!8632 [MD] Add Multiply op for Lite Dataset
...
From: @jiangzhiwen8
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
4 years ago
215fce192e
!8737 [MD] Fix the Pad function return false if bottom value is 0
...
From: @jiangzhiwen8
Reviewed-by: @xulei2020,@liucunwei,@heleiwang
Signed-off-by: @liucunwei
4 years ago
b07f6383cb
!8674 Fix doc example for ScatterUpdate and support int8/uint8
...
From: @TFbunny
Reviewed-by: @robingrosman,@tom__chen,@robingrosman
Signed-off-by: @robingrosman
4 years ago
f1ef84e1a6
!8714 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size
...
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
4 years ago
f352f9a54a
!8511 [MD] Decouple more Transform Ops
...
From: @luoyang42
Reviewed-by:
Signed-off-by:
4 years ago
8e1ce841b4
!8688 dataset: modify the error log msg in python layer to be more acceptable
...
From: @ms_yan
Reviewed-by:
Signed-off-by:
4 years ago
8129806475
Add slice parallel op
4 years ago
ee72de1db2
!8441 Add Parallel Implements of UniformCandidateSampler
...
From: @huangxinjing
Reviewed-by:
Signed-off-by:
4 years ago
cd6236c0a0
!8712 update pipeline parallel interface
...
From: @yangzhenzhang
Reviewed-by: @kisnwang
Signed-off-by:
4 years ago
fb0e866ad1
!8269 forward unique dynamic shape
...
From: @yao_yf
Reviewed-by:
Signed-off-by:
4 years ago
23284f0b35
Add AllSwap Op
4 years ago
0cb5c47856
add err modify
4 years ago
bc91f7b3ac
fix pad zero
4 years ago
ab811fca8f
add AdamOffload optimizer
4 years ago
31819bb4a7
support forward unique
4 years ago
d43155b5b0
[MD] Decouple more Transform Ops
4 years ago
3b946d4eb2
!8678 expand logsoftmax and grad, delete cast in softmax and fix layernorm compute dsl
...
From: @zengzitao
Reviewed-by: @gaoxiong1,@ryanww
Signed-off-by: @ryanww
4 years ago
278e82a849
update pipeline parallel
4 years ago
1529d544b9
add allreduce prod
4 years ago
f40a4781e4
!8656 Adapt DynamicGRUV2Grad for Ascend new backend.
...
From: @liu_xiao_93
Reviewed-by: @jjfeing,@liangchenghui
Signed-off-by: @liangchenghui
4 years ago
2730cef047
Uniform Sampler Base Update
4 years ago
7fd2db437b
!8484 Add Digamma op
...
From: @peixu_ren
Reviewed-by: @zh_qh,@liangchenghui,@zh_qh
Signed-off-by: @liangchenghui
4 years ago
e3b1814401
!8713 Fix for GetDatasetSize issue in TextFile
...
From: @mahdirahmanihanzaki
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @nsyca
4 years ago
e5f62013f4
dataset Python UT: Add Sampler Chain Tests, with get_dataset_size
4 years ago
449e1526dc
Fixed GetDatasetSize for TextFile
4 years ago
fb1a65c469
add int8 and uint8 support to scatteradd and fix doc example
4 years ago
4aa836dae1
Add Digamma op
4 years ago
ff5999fc2f
add removal pass for getters
...
fix CI round I
fix ci round II
address review cmts
fix ci round II
4 years ago
2aaf5e2e1b
Adapt DynamicGRUV2Grad for Ascend new backend.
4 years ago
1bd0ed450c
!8630 fix mul broadcast and tanhgrad bug
...
From: @zhao_ting_v
Reviewed-by: @kisnwang,@wuxuejian
Signed-off-by: @liangchenghui
4 years ago
88c91f4618
!8482 Add IGamma operator
...
From: @peixu_ren
Reviewed-by: @zh_qh
Signed-off-by:
4 years ago
266bfa50bf
expand logsoftmax and logsoftmax_grad, delete softmax's cast and fix layernorm op
4 years ago
65d50861ec
Remove expm1_generic and log1p_generic from PP utils
4 years ago
ecde0f03a2
Updated GetNumSamples logic
4 years ago
mindspore-ci-bot
tronzhang
caifubi
bai-yangfan
yanghaitao1
peixu_ren
Eric
Mahdi
Lixia Chen
jonwe
laiyongqiang
jonyguo
liucunwei
YangLuo
Bairong
shenwei41
Zhang Qinghua
zhaoting
Peilin Wang
Zirui Wu
buxue
mxm
yangzhenzhang
Xiao Tianci
zhangrunjiao
lvchangquan
HulkTang
wanghua
Xiaoda Zhang
changzherui
mohammad
danishnxt
tinazhang
tom__chen
TFbunny
anancds
shenyeping
zhouyuanshen
Nat Sutyanyong
yao_yf
jjfeing
yuzhenhua
liubuyu
yanzhenxiang2020
shibeiji
Xun Deng
zengzitao
yuchaojie
yinwei
liuxiao93
meizhiyuan
l00591931
zhoufeng
ZPaC
liyong
zhushujing
huangxinjing
hedongodng
gaojing
chenhaozhe
wanyiming
ms_yan
jiangzhiwen
wangnan39@huawei.com
yangzhenzhang
Cathy Wong