misk@sopuli.xyz to Technology@lemmy.worldEnglish · 1 month agoFramework’s first desktop is a strange—but unique—mini ITX gaming PCarstechnica.comexternal-linkmessage-square288fedilinkarrow-up1647arrow-down110
arrow-up1637arrow-down1external-linkFramework’s first desktop is a strange—but unique—mini ITX gaming PCarstechnica.commisk@sopuli.xyz to Technology@lemmy.worldEnglish · 1 month agomessage-square288fedilink
minus-squareToes♀@ani.sociallinkfedilinkEnglisharrow-up2·1 month agoWould 256GB/s be too slow for large llms?
minus-squareActers@lemmy.worldlinkfedilinkEnglisharrow-up2·1 month agoMany LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
Would 256GB/s be too slow for large llms?
It runs on the gpu
Many LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
Huh?