cm0002@lemmy.world to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 2 months agoOpen Source DeepSeek R1 Runs at 200 Tokens Per Second on Raspberry Piwww.nextbigfuture.comexternal-linkmessage-square9fedilinkarrow-up132arrow-down12
arrow-up130arrow-down1external-linkOpen Source DeepSeek R1 Runs at 200 Tokens Per Second on Raspberry Piwww.nextbigfuture.comcm0002@lemmy.world to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 2 months agomessage-square9fedilink
minus-squareBetaDoggo_@lemmy.worldlinkfedilinkEnglisharrow-up6·2 months ago200 tokens per second isn’t achievable with a 1.5B even on low-midrange GPUs. Unless they’re attaching an external GPU it’s not happening on a raspberry pi. This article is disjointed and smells like AI.
200 tokens per second isn’t achievable with a 1.5B even on low-midrange GPUs. Unless they’re attaching an external GPU it’s not happening on a raspberry pi.
This article is disjointed and smells like AI.