“It” is very ill defined. The AI they are selling you was never supposed to cure cancer. It was meant to make money. The AI which cures cancers is of a completely different kind than LLMs and media generation. And it does not have any of the same drawbacks nor any of the same funding despite it’s far greater usefulness.
Funny thing, right now federal funding is hyper focused on AI because the people who bought Trump expect a return on their money. The things is, the people on the federal side more or less fall into two camps- political appointees who know nothing about anything and old guards who know that “AI” has been around for decades in various forms. This is creating fun situations where a funding opportunity might as well read “please find a way for fElon to make money using AI”, but they never specify “LLMs” so submitting a neural network or machine learning proposal fits the guidelines. Time will tell how that plays out.
The AI which cures cancers is architecturally pretty similar to LLMs in that it’s based on transformers and GPT in particular is also based on transformers (that’s the T in GPT). It is also generative AI, you give it tokens that describe proteins and it generates folding structures. It’s like an LLM except the tokens aren’t words or syllables like in LLMs.
It’s used very differently and the energy cost is a few orders of magnitude less (you can run it on a single H200 with 141 GB VRAM for ~9000 tokens or an A100 or H100 for ~5000 according to this university and it even has a slow CPU/IO heavy first stage preparing everything so they can minimize the GPU time in stage 2).
There is yet hope that such AI applications will eventually benefit from all the research that’s been put into LLMs. Obviously not everything will carry over, but there may be architectural improvements to be made in research models too.
Yeah, and any “it will cure cancer” usually boils down to “uhmm, if we feed it enough training material, it will turn into a sentient superintelligence, which will cure cancer”.
Lol I kid. You’re right though: how we use it matters. How we build it matters. I wish it wasn’t destroying the environment a little bit more each month
This is exactly my thoughts when I’m trying to say “misused” to people who don’t seem to understand the sheer resources that would require to solve certain problems which would be a perfect fit. But it’s just not being used for those(not to the extent it should be supported). instead, it’s being funnelled to suck every value out of living a fulfilling life.
It’s like plastic. Certain medical procedures would be unthinkable without it. But then capitalism happens and it becomes beyond reproach real fast.
This is the important difference between defining something as ‘evil’ and using something that is truly innocuous and neutral with evil intentions.
It was supposed to cure cancer and other diseases, not make us homeless and surveil us.
“It” is very ill defined. The AI they are selling you was never supposed to cure cancer. It was meant to make money. The AI which cures cancers is of a completely different kind than LLMs and media generation. And it does not have any of the same drawbacks nor any of the same funding despite it’s far greater usefulness.
Funny thing, right now federal funding is hyper focused on AI because the people who bought Trump expect a return on their money. The things is, the people on the federal side more or less fall into two camps- political appointees who know nothing about anything and old guards who know that “AI” has been around for decades in various forms. This is creating fun situations where a funding opportunity might as well read “please find a way for fElon to make money using AI”, but they never specify “LLMs” so submitting a neural network or machine learning proposal fits the guidelines. Time will tell how that plays out.
The AI which cures cancers is architecturally pretty similar to LLMs in that it’s based on transformers and GPT in particular is also based on transformers (that’s the T in GPT). It is also generative AI, you give it tokens that describe proteins and it generates folding structures. It’s like an LLM except the tokens aren’t words or syllables like in LLMs.
It’s used very differently and the energy cost is a few orders of magnitude less (you can run it on a single H200 with 141 GB VRAM for ~9000 tokens or an A100 or H100 for ~5000 according to this university and it even has a slow CPU/IO heavy first stage preparing everything so they can minimize the GPU time in stage 2).
There is yet hope that such AI applications will eventually benefit from all the research that’s been put into LLMs. Obviously not everything will carry over, but there may be architectural improvements to be made in research models too.
Fair
Yeah, and any “it will cure cancer” usually boils down to “uhmm, if we feed it enough training material, it will turn into a sentient superintelligence, which will cure cancer”.
It’s a tool. Blame the humans who use this tool to make you homeless and surveil you.
Leave the orphan crushing machine alone!
Lol I kid. You’re right though: how we use it matters. How we build it matters. I wish it wasn’t destroying the environment a little bit more each month
Or better yet: Use the tool for one’s own goals.
This is exactly my thoughts when I’m trying to say “misused” to people who don’t seem to understand the sheer resources that would require to solve certain problems which would be a perfect fit. But it’s just not being used for those(not to the extent it should be supported). instead, it’s being funnelled to suck every value out of living a fulfilling life.
It’s like plastic. Certain medical procedures would be unthinkable without it. But then capitalism happens and it becomes beyond reproach real fast.
This is the important difference between defining something as ‘evil’ and using something that is truly innocuous and neutral with evil intentions.