• saltesc@lemmy.world
    link
    fedilink
    arrow-up
    40
    ·
    edit-2
    1 day ago

    At my work, it’s become common for people to say “AI level” when giving a confidence score. Without saying anything else, everyone seems to perfectly understand the situation, even if hearing it for the first time.

    Keep in mind, we have our own in-house models that are bloody fantastic, used for different sciences and research. We’d never talk ill of those, but it’s not the first thing that comes to mind when people hear “AI” these days.

      • lemmyknow@lemmy.today
        link
        fedilink
        arrow-up
        3
        ·
        9 hours ago

        Don’t think those are separate letters. Just pronounced differently. I mean, rr is just 2 r’s. Not a new letter. And this isn’t an ß-type case either. Phonetically different, yes. Different letters? Creo que no. Could be wrong, though. Hispanohablantes de Lemmy, corrijanme

        • exasperation@lemmy.dbzer0.com
          link
          fedilink
          arrow-up
          1
          ·
          6 hours ago

          In Spanish, up until 1994, “ll” and “ch” were considered distinct letters from the component parts. But “rr” has never been considered distinct from “r,” even though it is pronounced differently, in large part because no words start with “rr” and any word that starts with “r” is pronounced with the rolling R sound.

  • sykaster@feddit.nl
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    1
    ·
    1 day ago

    I asked this question to a variety of LLM models, never had it go wrong once. Is this very old?

      • RidderSport@feddit.org
        link
        fedilink
        arrow-up
        3
        arrow-down
        3
        ·
        21 hours ago

        You’re shitting me right? They did not just use an entry grade java command to rectify and issue that a LLM should figure out by learning right?

        • boonhet@sopuli.xyz
          link
          fedilink
          arrow-up
          12
          ·
          21 hours ago

          Well firstly it’s Python, secondly it’s not a command and thirdly it’s a joke - however, they have manually patched some outputs for sure. Probably by adding to the setup/initialization prompt

          • RidderSport@feddit.org
            link
            fedilink
            arrow-up
            1
            arrow-down
            1
            ·
            20 hours ago

            Java is the only code I have any (tiny) knowledge of, which is why the line reminded me of that.

            • boonhet@sopuli.xyz
              link
              fedilink
              arrow-up
              3
              ·
              edit-2
              20 hours ago

              Ah, but in Java, unless they’ve changed things lately, you have the curly brace syntax of most C-like languages

              if ("strawberry" in token_list) {
                  return something;
              }
              

              Python is one of the very few languages where you use colons and whitespace to denote blocks of code

    • BootLoop@sh.itjust.works
      link
      fedilink
      arrow-up
      13
      ·
      edit-2
      21 hours ago

      Try “Jerry strawberry”. ChatGPT couldn’t give me the right number of r’s a month ago. I think “strawberry” by itself was either manually fixed or trained in from feedback.

    • Ignotum@lemmy.world
      link
      fedilink
      arrow-up
      10
      ·
      1 day ago

      Smaller models still struggle with it, and the large models did too like a year ago

      It has to do with the fact that the model doesn’t “read” individual letters, but groups of letters, so it’s less straight forward to count letters

    • psx_crab@lemmy.zip
      link
      fedilink
      English
      arrow-up
      1
      ·
      18 hours ago

      Seeing how it start with an apology, it must’ve been told they’re wrong about the amount. Basically being bullied to say this.