7ba21f8d8c
!12900 Add communication parallel mode.
...
From: @liujunzhu
Reviewed-by: @zhoufeng54,@guoqi1024
Signed-off-by: @guoqi1024
4 years ago
6541b96c40
Add communication parallel mode.
4 years ago
ec9793861f
fix grad accu
4 years ago
7ff2b3b499
!12781 fix bug of amp bn cast
...
From: @jojobugfree
Reviewed-by:
Signed-off-by:
4 years ago
a6959c2a13
fix bn cast bug
4 years ago
a70d616841
mini step grad accumulation
4 years ago
72e938eb06
change dimension of input for FusedBatchNormEx from 2D to 4D in test_two_matmul_batchnorm_ex.
4 years ago
7d9a783993
[auto-monad] Support side-effects by auto-monad
...
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
4 years ago
30a27b2adb
modify Gelu、FastGelu to GeLU and FastGeLU
4 years ago
74652eb942
!12044 modify pack to stack
...
From: @jinyaohui
Reviewed-by:
Signed-off-by:
4 years ago
8022f9a6ed
modify pack to stack
4 years ago
726ea32778
merge parameter slice compile graph only once
4 years ago
9ec100d069
Change TensorAdd to Add, from r1.1 to master
4 years ago
9fa0499fa0
Change GatherV2 to Gather r1.1 to master
4 years ago
cbca482e59
delete useless parameter in pipeline parallel
4 years ago
7303c3d3b8
add group ckpt
4 years ago
9a45c4419c
modify batch_normal
4 years ago
9da3f9bec9
mini step grad accumulation
4 years ago
2e684df5b1
!10686 fix infer rank list typo and add testcase
...
From: @gong_zi_yan
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
4 years ago
2c3b99ce91
fix infer rank list typo
4 years ago
b67aaf6773
!9832 expose_allgather_fusion_to_users
...
From: @gong_zi_yan
Reviewed-by:
Signed-off-by:
4 years ago
bbf8ec82b9
expose allgather fusion interface to users
4 years ago
deb1e6e965
use from_numpy and add do_copy option
4 years ago
c5c905fdf5
add restriction for opt shard
4 years ago
a8446af1ab
Fix condition check
4 years ago
1984cf8e20
unify mindir
4 years ago
d5db8872fd
!9834 Fix wrong input argument of Reshape for multi field embedding
...
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
4 years ago
996ee72c50
Fix embedding layer
...
Fix input check
4 years ago
19fe28cb9b
hange strategys of last nodes in eval/predict at auto parallel mode
4 years ago
e78228603b
move parallel-related black-list to core/ir, and fix the cloneCNode bug
4 years ago
ec3983b77d
!9577 support distributed predict
...
From: @gong_zi_yan
Reviewed-by: @caozhou_huawei,@yao_yf,@stsuteng,@zh_qh
Signed-off-by: @stsuteng
4 years ago
e7e9dae54d
support distributed predict
4 years ago
9a9e3a751e
set cnode's fullname when cloning
4 years ago
818e920f02
fix_pipeline_split_param_shared_bug
4 years ago
78e131cf15
pipeline_split adapt parallel
4 years ago
7b33f3e2ac
gatherv2 axis split repeated calculation
4 years ago
7278f5c109
update_gatherv2_op
4 years ago
c79e988b0d
set fullname for reshape after reshape-elimination
4 years ago
9cda064716
auto parallel predict
4 years ago
3d6d820612
!8154 Add nn.MultiFieldEmbedding for the embedding lookup opearations
...
From: @huangxinjing
Reviewed-by:
Signed-off-by:
4 years ago
d915fd9b96
!8592 change repeat_elements to a composite op
...
From: @tom__chen
Reviewed-by:
Signed-off-by:
4 years ago
b0deb7a289
Add dense embedding
4 years ago
a52cd685fc
change repeat_element op to a composite op
4 years ago
89e7778497
Add UnsortedSegmentMax Operation
4 years ago
8129806475
Add slice parallel op
4 years ago
ee72de1db2
!8441 Add Parallel Implements of UniformCandidateSampler
...
From: @huangxinjing
Reviewed-by:
Signed-off-by:
4 years ago
cd6236c0a0
!8712 update pipeline parallel interface
...
From: @yangzhenzhang
Reviewed-by: @kisnwang
Signed-off-by:
4 years ago
fb0e866ad1
!8269 forward unique dynamic shape
...
From: @yao_yf
Reviewed-by:
Signed-off-by:
4 years ago
31819bb4a7
support forward unique
4 years ago
278e82a849
update pipeline parallel
4 years ago
mindspore-ci-bot
liujunzhu
Ziyan
caifubi
yangzhenzhang
wangshuide2020
He Wei
jinyaohui
l00591931
lilei
ms_yan
huangxinjing
jjfeing
yao_yf
Xiaoda Zhang
lichenever
tom__chen
yangzhenzhang