ideniece

V2EX member #28943, joined on 2012-10-26 20:26:12 +08:00

ideniece 提问技术话题好玩工作信息交易信息城市相关

ideniece's recent replies

2 days ago

Replied to a topic by KaiWuBOSS › Local LLM › 我做了个工具让 8GB 显卡跑 30B 模型从 3 tok/s 提到 21 tok/s，记录一下技术发现

没事了。
@ideniece #56

2 days ago

Replied to a topic by KaiWuBOSS › Local LLM › 我做了个工具让 8GB 显卡跑 30B 模型从 3 tok/s 提到 21 tok/s，记录一下技术发现

我在运行本地模型，为什么去提示去下载？

kaiwu.exe run .\Qwen3.5-35B-A3B-Q4_K_M.gguf
[2/6] Selecting configuration...
Model: Qwen3.5-35B-A3B (moe, 37B total / 1B active)
Quant: Q4_K_M (20.5 GB)
Mode: moe_offload (experts on CPU)
Accel: Flash Attention + SWA-Full (hybrid arch)

[3/6] Checking files...
Using bundled iso3 binary: llama-server-cuda.exe
Binary: llama-server-cuda.exe [cached]
Downloading model: Qwen3.5-35B-A3B-Q4_K_M.gguf
From: https://hf-mirror.com//resolve/main/Qwen3.5-35B-A3B-Q4_K_M.gguf
Error: failed to ensure model file: failed to download model: failed to download: Get "https://hf-mirror.com//resolve/main/Qwen3.5-35B-A3B-Q4_K_M.gguf": EOF

Mar 14, 2024

Replied to a topic by Z1R0 › 电动汽车 › 君子约定，猜测小米 SU7 价格，胜者为最贴近 3.28 公布丐版实际价格的人，参与回复的人每人送他 10 铜币。

20.58 万

Dec 18, 2023

Replied to a topic by lijianmin321 › 分享创造 › V 站老哥太热情了， Airy 永久会员加送 9000，凑到 1 万

支持楼主

» More replies by ideniece