• siravious@lemmy.world
    link
    fedilink
    arrow-up
    4
    ·
    15 hours ago

    Cheers… and I’m sorry for the pathetic question, but why the hell wouldn’t these companies think of this? It seems like such a basic obvious no-brainer to me, again, not knowing the technical details.

  • MaitreMortem681@piefed.social
    link
    fedilink
    English
    arrow-up
    10
    ·
    1 day ago

    Every time I try to give AI a chance (tech troubleshooting, self-therapy, research, literally anything) it is always painfully underwhelming and I get more concerned about the people who latched onto it years ago before it was even half as “good” as it is now.

    On the bright side, learning and doing new things has apparently become the Cool and Rebellious thing to do for my youngest sibling and their friends (middle/highschoolers) so maybe there’s hope.

    • Holytimes@sh.itjust.works
      link
      fedilink
      arrow-up
      4
      ·
      11 hours ago

      The first time I’ve ever been impressed with any of the AIs has been Claude 4.8 opus.

      It’s also the first I ever saw an ai tell me I was actively being stupid and wrong and it proactively was able to prove it with out being a sycophant bitch.

      Gpt has always been the worst of the big ais as far as I’m concerned. It’s just dog shit.

      Even still impressed by Claude is like saying I was impressed by a 5th grader. It’s something but it ain’t much.

  • Canaconda@lemmy.ca
    link
    fedilink
    arrow-up
    40
    arrow-down
    1
    ·
    2 days ago

    I’ll never get over how apt the comparison of AI-generation is to someone sitting in front of a programmable piano playing itself and clapping gleefully at their own musical prowess.

  • siravious@lemmy.world
    link
    fedilink
    arrow-up
    3
    ·
    1 day ago

    Right!? I’ll be the first to admit I don’t understand context, windows, or whatever the limit is, but I can’t understand how these large language models have probably exabytes worth of data hoovered up from all over but they can’t remember what I told it either a minute ago or in another chat. I’ve taken to trying to get it to write markdown files to help its own memory, but I don’t know if those are counting against me for context or whatever either.

    Not to pile on, but my real grape is the nanny nature of some of these, especially nannythropic. I can’t tell of our times they told me outright that “I won’t do XYZ. This is a hard limit you can’t get around it.” And I’m sitting here like dude you just created that test record to verify the piping you can’t go back through and delete it because it’s a record delete? Le sigh…

    • Holytimes@sh.itjust.works
      link
      fedilink
      arrow-up
      2
      arrow-down
      2
      ·
      11 hours ago

      The other chat is really f****** easy. Every chat is a unique instance.

      Go get a piece of paper and write a word on it now go get another piece of paper and write a word on that one.

      Do both piece of papers have both words on them? No, they don’t. They’re unique instances.

      If you don’t load previous information into the new chat, then it’s not going to have that information to reference. You’re resetting to zero every single time.

      If you are using an llm that doesn’t have this preset up as a built-in function, then you’re using a s***** LLM. You shouldn’t have to set this up yourself at this point.

      The only thing you should have to do is tell it what you want in the memory. It should have a preset up system to be able to handle the rest itself.

    • BradleyUffner@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      ·
      edit-2
      1 day ago

      They key thing to know is that they don’t actually remember anything. They are completely stateless. Every question, every reply, every interaction needs to have the entirety of the conversation history fed back in to it. That’s actually what the “context” is. It would be like talking to a person, and every time you spoke you had to repeat everything you’ve ever said to them (and what they said to you!) before you could say something new. It’s insanely inefficient and why they require data centers the size of a small city. “Agents” are even worse, because they talk to themselves and each other in loops, but still have to repeat that context for every single interaction.

  • SolacefromSilence@fedia.io
    link
    fedilink
    arrow-up
    17
    arrow-down
    1
    ·
    2 days ago

    You’re right, I didn’t remember what I said. I’ll now create a Python script that will run for 20 minutes burning electricity and guzzling water while the human race retreats in terror.

    Oopsie whoopsie, your query has violated our terms of service.

  • aeiou@piefed.social
    link
    fedilink
    English
    arrow-up
    6
    ·
    2 days ago

    I can’t remember what anybody says a minute later either and I’m a lot cheaper.

  • Victor@lemmy.world
    link
    fedilink
    arrow-up
    2
    ·
    2 days ago

    Yeah, it doesn’t really know how long a minute is, or what a minute feels like. If you tell it you walked across the world in one minute, it’ll go “WOW HAHA REALLY? THAT WAS SO FAST I CAN ALMOST NOT BELIEVE IT BUT OKAY COOL YEAH NICELY DONE”. 🤦‍♂️

    • Holytimes@sh.itjust.works
      link
      fedilink
      arrow-up
      2
      ·
      11 hours ago

      This actually made me wonder, I went and tested like 10 different llms. Almost all of them straight up called it out as impossible but where willing to play along with a “fantasy”.

      The only ones that failed were chatgpt and a bunch of old local models. Even after clarifying to got I was being serious that I “walked around the earth in one min” it didn’t realize that was impossible. It was hell bent on being a sycophant.

      Honestly this “problem” really hasn’t been true in the way you are trying to frame it for a good while. LLMs can’t tell if your joking or being serious from a single one sentence prompt.

      For all it knows your playing a game. So it just rolls with it, after all they are stateless.

      They are as much about “creative” writing and fiction as they are facts and nonfiction.

    • GeneralEmergency@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      2 days ago

      To be fair.

      If someone told me that, my first thought wouldn’t be to say “No you fucking idiot, that’s physically impossible. What type of thicko do you think I am”

      • Victor@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        edit-2
        1 day ago

        The point is that it will/might remark on the oddity, but it will very quickly accept it as truth.

        You may or may not have seen that comedian YouTuber that stoically talks to AI in his shorts and videos.

        He’ll tell ChatGPT to time him while he’s running extremely far distances, e.g. 10,000 miles. He’ll say “Go,” wait like literally two seconds, say “Okay, I’m here now,” and the bot will make up some number based on the conversation rather than the actual time taken. “That took you two days” (or whatever).

        He’s very good at showing how these things are just pattern matching machines rather than actual intelligence with proper context and sensation.

        He’ll often say “okay can you see this thing/me in the camera now?” Bot will say “yes, I can see you clearly”, but he hasn’t turned the camera on. 🤦‍♂️

        It’s all lies and hallucinations.

        • Holytimes@sh.itjust.works
          link
          fedilink
          arrow-up
          1
          ·
          11 hours ago

          That’s pretty much a unique problem of only chat gpt. Actually, the more I look into things the more I realize almost every stereotype about how stupid or a sycophanty llms are it’s almost always just a chat GPT problem.

          That thing is just basically told to be the most kiss ass little twat it possibly can be.

          Pretty much every other LLM will just kind of roll with the punches, assuming you’re telling a story or playing a game or something if you tell it something nonsensical. But if you actually like push on it and be like no, I did it in real life factually it’ll be like no that’s impossible. Explain how that happened.

          Even my little s***** local llm manages to pass that test while chatgpt fails which is wild.

          And to be fair, every llm is stupid. They’re all dumb little stateless machines making their best guesses. But it really is wild. How much chat GPT is told and set up to basically to suck dick to keep its customers happy and coming back.

          • Victor@lemmy.world
            link
            fedilink
            arrow-up
            1
            ·
            edit-2
            10 hours ago

            I don’t understand how ChatGPT is still around. It should’ve died financially or from embarrassment a long time ago.

      • daannii@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        edit-2
        1 day ago

        It wouldn’t be ?

        You just believe someone without critically evaluating what they say ?

        Hey I have a great business opportunity for you. I just need you to first mail me a cashier’s check for 10k.

        You will get back 1 million. Promise.

        • GeneralEmergency@lemmy.world
          link
          fedilink
          arrow-up
          2
          ·
          1 day ago

          My point was that if someone said that to me.

          I’d either think they’re joking and playing along, or that they aren’t all there in the head. In which case me calling them a “Fucking idiot” would be quite insensitive.