ecba84ae7c
!8447 export script for VGG16 and Bert，fix faster-rcnn and inceptionv3 bug
...
From: @yuzhenhua666
Reviewed-by:
Signed-off-by:
4 years ago
9e387e3b56
!8514 dataset_attr_name
...
From: @bai-yangfan
Reviewed-by:
Signed-off-by:
4 years ago
8eab1d20f7
add gpt2 preprocess
4 years ago
b4e020d081
dataset_attr_name
4 years ago
d0f05a7670
add export script for vgg16,bert. fix faster-rcnn and inception bug
4 years ago
335f3b95c1
modified cast32 to cast64
4 years ago
cc7993355c
!8288 update transformer scripts
...
From: @pandoublefeng
Reviewed-by:
Signed-off-by:
4 years ago
4ae8285809
update transformer scripts
4 years ago
6ac5be72d9
upload gnmt_v2
4 years ago
6b57cc705f
disable somas when variable_memory_max_size is set
4 years ago
4851a67bb5
add layer of clipbyglobalnorm.
4 years ago
fafe817ad5
!7957 fix tinybert bug and add export script file for mass
...
Merge pull request !7957 from 于振华/master
4 years ago
c4eafb9820
fix tinybert bug and add export script file for mass
4 years ago
fc8479a459
!7945 Add self-realized Softmax and LayerNorm
...
Merge pull request !7945 from wangjun/master
4 years ago
c2c2b65010
!7916 update lstm README
...
Merge pull request !7916 from caojian05/ms_master_lstm_bugfix
4 years ago
a7b1d0518b
add self-realized Softmax and LayerNorm
...
delete reduntant parameters
4 years ago
c6982d1f1b
update lstm README
4 years ago
02f9a1c010
fix mass gpu run script bug.
4 years ago
82b5e5251c
!7828 edit readme
...
Merge pull request !7828 from yoonlee666/editreadme
4 years ago
acb44b91b9
edit readme
4 years ago
30e63c6e15
!7853 mass and cnnctc readme fix.
...
Merge pull request !7853 from linqingke/psenet
4 years ago
1999774b3e
!7847 update transformer's ms version
...
Merge pull request !7847 from yuchaojie/transformer
4 years ago
988e1c1782
!7830 modify mass beam_search's floordiv and mod to adapt to 310.
...
Merge pull request !7830 from linqingke/mass
4 years ago
e92a0dbd79
mass and cnnctc readme fix.
4 years ago
0d20b99ad1
update transformer's ms version
4 years ago
7c98803ad6
!7646 eval result only return probs
...
Merge pull request !7646 from wanghua/master
4 years ago
a084532a6e
modify mass beam_search's floordiv and mod to adapt to 310.
4 years ago
f09087a68a
update tinybert_model.py
4 years ago
e5227c9f89
GPT scripts bug fix
4 years ago
4c129b12e4
!7768 export script for TinyBert and Transformer
...
Merge pull request !7768 from 于振华/master
4 years ago
df07a0e3d4
!7740 Add GPT
...
Merge pull request !7740 from wangjun/master
4 years ago
9417620bf5
export script for tinybert and transformer
4 years ago
837f1a160c
Add GPT
4 years ago
44bf4c3e37
[ME] format code
4 years ago
1138b08a1e
add prophetnet into model zoo
4 years ago
4b31189ebd
!7476 modify resnet50-quant readme
...
Merge pull request !7476 from yuchaojie/quant
4 years ago
8114352c2a
modify resnet50-quant readme
4 years ago
3655db526d
!7491 modify transformer's floordiv and mod to adapt to 310
...
Merge pull request !7491 from yuchaojie/transformer
4 years ago
188dfac57c
modify floordiv and mod to adapt to 310
4 years ago
792b2977e8
!7447 fix transformer eval device id
...
Merge pull request !7447 from yuchaojie/transformer2
4 years ago
55ee90e696
fix transformer eval device id
4 years ago
2b56b87734
!7234 update mass gpu support.
...
Merge pull request !7234 from linqingke/mass
4 years ago
771042a457
update mass gpu network.
4 years ago
5b769dfb20
[ME] Bug fix
4 years ago
f3860f5111
Fix typo of hccl time out options
4 years ago
752035795f
update trantransformer scripts
4 years ago
1464bf3dd8
add hccl_time_out options in bert distribute launcher
4 years ago
f27f047f14
Add training and evaluation of Transformer on GPU
...
Add gradients clipping to NASNet training and adjust hyper-parameters
4 years ago
b1ac85bde9
!7172 bugfix tinybert
...
Merge pull request !7172 from yoonlee666/tinybertbugfix
4 years ago
0e85c5c9a4
bugfix tinybert
4 years ago
f5b481d776
!7127 edit readme
...
Merge pull request !7127 from yoonlee666/tinybertbugfix
4 years ago
55e369a125
!7144 [ME] change `check_integer` to format `check_positive_int` and `check_integeter`
...
Merge pull request !7144 from chenzhongming/zomi_master
4 years ago
d471d32e87
[ME] change `check_integer` to format `check_positive_int` and `check_integeter`
4 years ago
3d21c80e3b
!7110 [ME] delete check_bool and replace with Validate.check_bool
...
Merge pull request !7110 from chenzhongming/zomi_master
4 years ago
263a591473
edit readme
4 years ago
d4e8e94981
[ME] delete check_bool and replace with Validate.check_bool
4 years ago
8fa83cca87
delete device id for gpu
4 years ago
2a799fe90e
!6018 Set the number of epochs in mode.train() non-sink Mode
...
Merge pull request !6018 from h.farahat/ms_nonsink_epochs
4 years ago
a2af684dd4
bugfix tinybert
4 years ago
9cee0d2143
Add num_epochs to non-sink training
4 years ago
a4de9ba0eb
fix tinybert failes if run 1p
4 years ago
7ad8452617
Update invalid links.
4 years ago
bd5a8b42ac
!6724 redundant codes clean
...
Merge pull request !6724 from TuDouNi/master
4 years ago
132dae4849
modify transformer hub file
4 years ago
c291e0b2ba
!6666 Add fasterrcnn, mass, unet, psenet hub conf file.
...
Merge pull request !6666 from linqingke/mass
4 years ago
a712489a28
!6643 Modifying the hardware information in Readme.
...
Merge pull request !6643 from linqingke/modelzoo
4 years ago
4e85071055
redundant codes clean
4 years ago
d6110a3cd5
!6656 move batch_size from net_cfg to outer cfg
...
Merge pull request !6656 from yoonlee666/hub
4 years ago
b309850036
!6616 add tokenization and score file
...
Merge pull request !6616 from yoonlee666/token
4 years ago
25b2c1944f
tinybert hub
4 years ago
6df923f286
add fasterrcnn, mass, unet, psenet hub conf file.
4 years ago
bf1ba1bdd2
!6632 add transformer hub_conf
...
Merge pull request !6632 from yuchaojie/transformer2
4 years ago
01c9e8b373
add tokenization and score file
4 years ago
3f7a5ed394
README A+X to A+K
4 years ago
3120e51e7c
add bert_thor hub file
4 years ago
9e69f9fac0
add transformer hub_conf
4 years ago
10add158f8
!6592 bugfix bert config
...
Merge pull request !6592 from yoonlee666/master
4 years ago
92d0a29911
bugfix bert config
4 years ago
957dba0b4d
!6572 update links for README
...
Merge pull request !6572 from TingWang/update-link
4 years ago
ac627e046b
update links for README
...
Signed-off-by: Ting Wang <kathy.wangting@huawei.com>
4 years ago
659839a250
densenet121 and mass fix.
4 years ago
cdff9412dc
!6483 remove parameter broadcast
...
Merge pull request !6483 from gziyan/rm——parameter_broadcast
4 years ago
cc131193ec
remove parameter broadcast
4 years ago
8d525fc051
adjust order of split allreduce
4 years ago
31ad1654a1
!6267 delete redundant codes in model zoo
...
Merge pull request !6267 from zhaoting/clean_warnings
4 years ago
59d9f8bf6a
remove importing _selected_ops from model_zoo
4 years ago
cc4859f0b2
!6358 fix loss print in bert, change epoch number to integer
...
Merge pull request !6358 from chenhaozhe/fix-loss-print
4 years ago
d421f49e60
delete redundant codes
4 years ago
63ae2c3639
!6374 LSTM API optimization
...
Merge pull request !6374 from caojian05/ms_master_lstm_api_optimation
4 years ago
db0c0caf10
!6393 bugfix delete batch_size
...
Merge pull request !6393 from yoonlee666/master
4 years ago
1a8dffe4c6
change epoch to integer while print loss
4 years ago
65c960d3e2
!6389 transformer ckpt path
...
Merge pull request !6389 from TuDouNi/master
4 years ago
c95ed54fe1
!5239 reduce cyclomatic complexity in model zoo
...
Merge pull request !5239 from zhaoting/master
4 years ago
f352204aaa
transformer ckpt path
4 years ago
d90ac3c6d1
bugfix
4 years ago
207e515fce
LSTM API optimization
4 years ago
a8851f308b
!6274 new add densenet121 and update resnet, vgg.
...
Merge pull request !6274 from linqingke/fasterrcnn
4 years ago
3671244ff8
!6233 move batch_size from bert_cfg_cfg to cfg
...
Merge pull request !6233 from yoonlee666/master
4 years ago
069a1cfbd7
!6256 modify ckpt path
...
Merge pull request !6256 from TuDouNi/master
4 years ago
528072f45f
move batch_size from bert_cfg_cfg to cfg
4 years ago
c8200af525
modify the ckpt path
4 years ago
a4a65ffe06
reduce cyclomatic complexity
4 years ago
25579c4523
new add densenet121 and update resnet, vgg.
4 years ago
dc78af7365
fix bug in bert
4 years ago
105422fbb9
!6188 fix loss print of bert, add attention about bind cores in README
...
Merge pull request !6188 from chenhaozhe/fix-bert-loss-print
4 years ago
8b0793eb84
!6137 modify the model_zoo ckpt path
...
Merge pull request !6137 from TuDouNi/master
4 years ago
122e966277
!6174 delete transformer's enable_data_sink option
...
Merge pull request !6174 from yuchaojie/transformer2
4 years ago
7578f23632
optim TrainOneStepCell
4 years ago
786de3252e
delete transformer's enable_data_sink option && modify create_data
4 years ago
e1f4c066b3
fix loss print in bert and corresponding downstream task
4 years ago
aa16811ba5
!6139 fix hccl environ in get_distribute_pretrain_cmd.py
...
Merge pull request !6139 from chenhaozhe/fix-hccl-env
4 years ago
144998894f
!6057 transformer bucket batch modification
...
Merge pull request !6057 from yuchaojie/transformer2
4 years ago
ec947ebf3d
modify the ckpt path
4 years ago
4e587420c0
fix hccl environ in get_distribute_pretrain_cmd.py
4 years ago
fa1247a85e
transformer bucket batch modification
4 years ago
91c65a734a
fix some doc error
4 years ago
326feab42f
!6067 Generate cmd file for distributed_pretrain in bert scripts
...
Merge pull request !6067 from chenhaozhe/fix-bert-codex
4 years ago
1bcffd29dd
!6066 transformer loss fix.
...
Merge pull request !6066 from linqingke/fasterrcnn
4 years ago
d8c09067ce
!5801 [MD][Feature] minddata iterator output ms_tensor
...
Merge pull request !5801 from xiefangqi/md_modify_output_tensor
4 years ago
28cb0da168
remove os.system in launch scripts
4 years ago
bab4757904
transformer loss fix.
4 years ago
9b3c33e157
minddata iterator output ms_tensor
4 years ago
be62fd7fa6
!5768 Save the GPU backend multi card output in different folders.
...
Merge pull request !5768 from linqingke/fasterrcnn
4 years ago
92e99ff224
change map calls
4 years ago
eedbbb3649
!5958 Modify interface for function and remove duplicated def
...
Merge pull request !5958 from lilei/modify_bug
4 years ago
fdac02feed
delete DataWrapper and optim Model
4 years ago
845ff342ed
Save the GPU backend multi card output in different folders.
4 years ago
994cfcb8a0
!5914 edit bert hub config file and tinybert script bugfix
...
Merge pull request !5914 from yoonlee666/master
4 years ago
71adabd944
modify_bug
4 years ago
cd07acc8a4
!5903 add set_grad() for pynative mode in model_zoo networks
...
Merge pull request !5903 from lvchangquan/master
4 years ago
16c2c17436
edit bert hub config
4 years ago
3bac9d3713
switch input columns and operation
...
change ImagefolderDV2 name
change ds.transforms.vision to ds.vision
change batch api to match map api more closely
compose op changes
test_pylint
remove compose op from vision, move to transform module, refactor map and batch to use column_order
4 years ago
7abe692fb5
add set_grad() for pynative mode in model_zoo network
4 years ago
947247bbc5
!5888 add bert hub config
...
Merge pull request !5888 from yoonlee666/master
4 years ago
0a2f472578
add hub config for bert base and nezha
4 years ago
87bf2a7dcd
Add PS context.
4 years ago
ad186e79d8
!5599 Collect input data when `dataset_sink_mode` set on GPU
...
Merge pull request !5599 from LiHongzhang/dataset_sink_mode
4 years ago
066950f69e
GPU dataset_sink_mode collect inputs
4 years ago
f2d3fd34ce
rectification_allreduce_fusion_api
4 years ago
d4cfe55c04
rename mirror_mean to gradients_mean
5 years ago
4d9d8c3e74
Modelzoo interface change.
5 years ago
1cd4ac2ad4
!5708 support startup script of bert_thor with relative path
...
Merge pull request !5708 from wangmin0104/master
5 years ago
a50bc2182e
!5665 delete enable_fused_layernorm
...
Merge pull request !5665 from yoonlee666/bugfix
5 years ago
fc79997de5
!5502 Mod SoftmaxCrossEntropyWithlogits
...
Merge pull request !5502 from wanyiming/mod_SoftmaxCrossEntropyWithlogits
5 years ago
0ec70068ae
mod_SoftmaxCrossEntropyWithLogits
5 years ago
d63b1f16bd
support startup bert_thor script with relative path
5 years ago
dfd85caa1b
delete enable_fused_layernorm
5 years ago
4ec343961e
!5482 modify save_checkpoint
...
Merge pull request !5482 from liuyang/md_save_checkpoint
5 years ago
76694059a2
!5639 fix bug of bert_thor and update readme.md
...
Merge pull request !5639 from wangmin0104/master
5 years ago
44a9c25251
!5632 Add clip_by_global_nrom in bert
...
Merge pull request !5632 from chenhaozhe/add-global-norm-to-bert
5 years ago
d24ce34c36
fix bug of bert_thor
5 years ago
ac95836257
add global norm in bert
5 years ago
f08a05975e
fix: data_tpye var error
5 years ago
314fef8ecc
fix: arg_opt is not defined
5 years ago
d5e02cf474
!5584 delete the redundant argument while initializing the class of GradOperation
...
Merge pull request !5584 from shibeiji/master
5 years ago
d57960ed4c
delete the redundant argument while initializing class of GradOperation
5 years ago
4683de3443
modify save_checkpoint
5 years ago
ff4e02a09d
bert script bugfix
5 years ago
3f1e05881d
!5474 bert script bugfix
...
Merge pull request !5474 from yoonlee666/bugfix
5 years ago
954f53da9e
enhancement
5 years ago
e6a4d932b4
!5350 [AutoParallel]Rectification distributed init
...
Merge pull request !5350 from lichen/rectification_init
5 years ago
d3e55b543e
rectification init
5 years ago
c247f5cdbf
!5325 add schema file introduce for BERT and TinyBERT
...
Merge pull request !5325 from wanghua/master
5 years ago
be13688e29
!5431 update lstm readme
...
Merge pull request !5431 from caojian05/ms_lstm_readme_update
5 years ago
f347d1c9e7
add schema for BERT and TinyBERT
5 years ago
c465f2bf5c
update lstm readme
5 years ago
820f2cb4eb
!5351 move ParalleMode to Context
...
Merge pull request !5351 from yao_yf/parallel_context_collation
5 years ago
07117e4dd4
mv ParallelMode to context
5 years ago
a8c5dfae3b
!4957 lstm readme
...
Merge pull request !4957 from chenweifeng/lstm-readme
5 years ago
734993e21a
lstm readme
5 years ago
f3fc24c82a
!5368 fix sink_size bug for transformer
...
Merge pull request !5368 from yuchaojie/transformer_st
5 years ago
9fb6f0c34b
fix sink_size bug for transformer
5 years ago
fe016d321c
update tiny bert script and readme
5 years ago
7127304c67
!4814 support minddateset for tinybert
...
Merge pull request !4814 from dengyutao/tinybert
5 years ago
586d6673b3
!5307 change enable_data_sink value to true for transformer
...
Merge pull request !5307 from yuchaojie/transformer2
5 years ago
e4909f9050
!5277 add option choices for transformer
...
Merge pull request !5277 from yuchaojie/transformer_st
5 years ago
15b366307e
change enable_data_sink value to true for transformer
5 years ago
df9d67c0dc
!5235 add tinybert gpu readme
...
Merge pull request !5235 from hanhuifeng/tinybert_readme
5 years ago
48efc182e0
change option choices for transformer
5 years ago
92e2d21ea4
!5088 Fix MASS and FasterRcnn CI Problem.
...
Merge pull request !5088 from linqingke/mass
5 years ago
fbafedf135
add tinybert gpu readme
5 years ago
4e0447b05e
support minddataset for tinybert
5 years ago
1a54785fe2
remove name arg from gradoperation
5 years ago
40fc11e9a4
Mimic higher batch size by accumulating gradients N times before weight update
5 years ago
ad8b98b476
fix fasterrcnn and mass bug.
5 years ago
a40cc12fae
modify BERT and TinyBERT README.md
5 years ago
6511491a7c
!4691 Fix MASS and FasterRcnn README.
...
Merge pull request !4691 from linqingke/new_ops
5 years ago
e6be30a094
modify ReadMe
5 years ago
91accd1ed4
for readme modify
5 years ago
642d48e9dd
fix floordiv and iou ops.
5 years ago
4815dcbb1d
!4517 The teacher use fp16 calculations to imporve the performance of tinybert on gpu
...
Merge pull request !4517 from hanhuifeng/tinybert_gpu_perf
5 years ago
7cec00b491
!4577 Optimize the print of bert
...
Merge pull request !4577 from chenhaozhe/optimize-print-of-bert
5 years ago
cc9bd8a3e5
!4182 add_tf_and_ms_checkpoint_transfer_tools
...
Merge pull request !4182 from Guomenghao319/add_tf_and_ms_checkpoint_transfer_tools
5 years ago
bb125cb309
change unsupport to unsupported
5 years ago
fa10a4e483
optimize print of bert scripts'
5 years ago
9e2b38c961
The teacher use fp16 calculations to optimize the performance of tinybert on the gpu
5 years ago
510ae7c88c
!4500 [net] update transformer README
...
Merge pull request !4500 from yuchaojie/transformer_st
5 years ago
df8fcef457
!4412 MASS support running on GPU.
...
Merge pull request !4412 from linqingke/mass
5 years ago
3c1e7011e0
update transformer readme
5 years ago
eb4749642d
!4460 update the codes of bert_thor
...
Merge pull request !4460 from zongha/master
5 years ago
mindspore-ci-bot
liyong
bai-yangfan
yuzhenhua
gaojing
panfengfeng
laiyongqiang
jzg
alouhahaha
CaoJian
linqingke
yoonlee666
yuchaojie
wanghua
chenzomi
y00488820
chenhaozhe
dessyang
hesham
yanghaitao1
zhangyi
root
wangmin
yoonlee666
Ting Wang
Ziyan
dayschan
zhaoting
cj
wangnan39@huawei.com
xiefangqi
nhussain
lilei
lvchangquan
ZPaC
Li Hongzhang
lichenever
yao_yf
wanyiming
jonyguo
shibeiji
liuyang_655
wilfChen
hanhuifeng2020
dengyutao
panyifeng
zongha