Commit Graph

95 Commits (a9cba56191336a60d7b8b8be4248e6395c991585)

Author SHA1 Message Date
lichenever f2d3fd34ce rectification_allreduce_fusion_api 5 years ago
yao_yf d4cfe55c04 rename mirror_mean to gradients_mean 5 years ago
linqingke 4d9d8c3e74 Modelzoo interface change. 5 years ago
yoonlee666 dfd85caa1b delete enable_fused_layernorm 5 years ago
mindspore-ci-bot 44a9c25251 Add clip_by_global_nrom in bert 5 years ago
chenhaozhe ac95836257 add global norm in bert 5 years ago
mindspore-ci-bot d5e02cf474 delete the redundant argument while initializing the class of GradOperation 5 years ago
shibeiji d57960ed4c delete the redundant argument while initializing class of GradOperation 5 years ago
yoonlee666 ff4e02a09d bert script bugfix 5 years ago
mindspore-ci-bot 3f1e05881d bert script bugfix 5 years ago
yoonlee666 954f53da9e enhancement 5 years ago
mindspore-ci-bot e6a4d932b4 [AutoParallel]Rectification distributed init 5 years ago
lichenever d3e55b543e rectification init 5 years ago
mindspore-ci-bot c247f5cdbf add schema file introduce for BERT and TinyBERT 5 years ago
wanghua f347d1c9e7 add schema for BERT and TinyBERT 5 years ago
yao_yf 07117e4dd4 mv ParallelMode to context 5 years ago
panyifeng 1a54785fe2 remove name arg from gradoperation 5 years ago
shibeiji 40fc11e9a4 Mimic higher batch size by accumulating gradients N times before weight update 5 years ago
wanghua a40cc12fae modify BERT and TinyBERT README.md 5 years ago
mindspore-ci-bot 7cec00b491 Optimize the print of bert 5 years ago
mindspore-ci-bot cc9bd8a3e5 add_tf_and_ms_checkpoint_transfer_tools 5 years ago
chenhaozhe fa10a4e483 optimize print of bert scripts' 5 years ago
yoonlee666 32846d791b bugfix bert script 5 years ago
mindspore-ci-bot 1f7d72dd2a fix pylint warning in model_zoo 5 years ago
panbingao 3f60bf6dfe fix pylint warnings in model_zoo 5 years ago
yoonlee666 a5ac2427a7 bugfix bert script 5 years ago
GuoMengHao 52f2d581cb add_tf_and_ms_checkpoint_transfer_tools 5 years ago
mindspore-ci-bot b535b6427b fix bug in bert script 5 years ago
yoonlee666 e18c7292d6 bug fix 5 years ago
Wei Luning 776d094c5b quant export fix up for atc tools 5 years ago
mindspore-ci-bot 7113f1f22c modify bert and tinybert scripts and README 5 years ago
wanghua 89fa2d3708 modify bert and tinybert readme 5 years ago
mindspore-ci-bot 59530248a3 remove old MINDSPORE_HCCL_CONFIG_PATH in model zoo 2 5 years ago
mindspore-ci-bot 6e21618fe1 add shuffle switch for finetune dataset 5 years ago
mindspore-ci-bot 1165b27f41 Change the column order and add drop_reminder option to make the generated dataset compatible with BertCLS 5 years ago
yoonlee666 9bdece71d4 add switch for data shuffle 5 years ago
panbingao 98b76b9020 remove old MINDSPORE_HCCL_CONFIG_PATH in model zoo 2 5 years ago
dessyang 4307c1fa61 change the column order and add drop_reminder option to make this script compatible with BertCLS model 5 years ago
GuoMengHao 2309e7369a add_python_distribute_pretrain_script 5 years ago
shibeiji 29e35a31c0 add order params for bert to improve performance 5 years ago
shibeiji af4923123c script update for bert 5 years ago
chenhaozhe 6fdf380923 fix bert scripts to adapt the new concept of repeatcount in minddata 5 years ago
wangnan39@huawei.com 082433183d uniform learning_rate behavior of optimizers 5 years ago
mindspore-ci-bot 8e4c0a9d93 GetDatasize feature 5 years ago
chenhaozhe 541bf81c1f move bert to new model zoo directory 5 years ago