abcfreedom
V2EX  ›  OpenAI

怎么测试显卡跑大模型的性能

  •  
  •   abcfreedom · Jul 18, 2024 · 1049 views
    This topic created in 762 days ago, the information mentioned may be changed or developed.

    之前好像看到大佬们能测出来在一个大模型下,该显卡处理 token 的速度,不知道是怎么做到的。有了解的大佬吗,求指导

    No Comments Yet
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   5314 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 51ms · UTC 07:50 · PVG 15:50 · LAX 00:50 · JFK 03:50
    ♥ Do have faith in what you're doing.