If there was an AI model that ran locally on a PC for basic things and cloud sourced computer power for more complex tasks, all of these data centers would become obsolete in an instant. All of the invested capital and materials wasted in a flash.
Edit: lots of great counter points in the comments.
Not close to enough for frontier models unfortunately. Ideally you’d want at least a DGX B200 server, costing about 400-500k. It has 8 GPUs each of which has a TDP of 1 kW so at least it would keep your house warm in the winter lol
Yeah, $100K will run 8 bit quant on the latest open Chinese models. The ex-OpenAI team just released a 975B parameter 16 bit model and the price estimate I got to run that was $650K in hardware (including cooling) and 12,000kWh per month if you actually use it.