POTOOOOOOOO@reddthat.com to Asklemmy@lemmy.mlEnglish · 4 days agoHave you found any cool uses/life hacks for AI?message-squaremessage-square86linkfedilinkarrow-up182arrow-down122
arrow-up160arrow-down1message-squareHave you found any cool uses/life hacks for AI?POTOOOOOOOO@reddthat.com to Asklemmy@lemmy.mlEnglish · 4 days agomessage-square86linkfedilink
minus-squarebrucethemoose@lemmy.worldlinkfedilinkarrow-up4·4 days agoNvidia. Back then I had a 980 TI RN I am lucky enough to have snagged a 3090 before they shot up. I would buy a 7900, or a 395 APU, if they were even reasonably affordable for the VRAM, but AMD is not pricing their stuff well… But FYI you can fit Qwen 32B on a 16GB card with the right backend/settings.
Nvidia.
Back then I had a 980 TI RN I am lucky enough to have snagged a 3090 before they shot up.
I would buy a 7900, or a 395 APU, if they were even reasonably affordable for the VRAM, but AMD is not pricing their stuff well…
But FYI you can fit Qwen 32B on a 16GB card with the right backend/settings.