Skip to content

Commit 1292bfe

Browse files
author
Yang Liu
committed
add Cuda memory demand docs
1 parent 8c690d4 commit 1292bfe

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

app/docs/ai/compute-platforms/model-compuational-resource-demand.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -32,12 +32,12 @@ tags:
3232

3333
1. **权重 W**
3434
- 存储方式:BF16 (2 Byte)
35-
- 显存:$W = N × 2$ Byte
35+
- 显存:$W = N \times 2$ Byte
3636
- 例:2B 参数 → ≈ 4 GB
3737

3838
2. **梯度 G**
3939
- 存储方式:BF16 (2 Byte)
40-
- 显存:$G = N × 2$ Byte
40+
- 显存:$G = N \times 2$ Byte
4141
- 例:2B 参数 → ≈ 4 GB
4242

4343
3. **优化器状态(Adam)**

0 commit comments

Comments
 (0)