Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds. Researchers found wild fluctuations—called drift—in the technology’s abi…::ChatGPT went from answering a simple math correctly 98% of the time to just 2%, over the course of a few months.

  • CaptainAniki@lemmy.flight-crew.org
    link
    fedilink
    English
    arrow-up
    35
    ·
    1 year ago

    At the start I used to use ChatGPT to help me write really rote and boring code but now it’s not even useful for that. Half the stuff it sends me (very basic functions) LOOK correct but don’t return the correct values or the parameters are completely wrong or something absolutely critical.

    • Boinketh@lemm.ee
      link
      fedilink
      English
      arrow-up
      9
      ·
      1 year ago

      I have noticed that it’s gotten less useful as a syntax helper. I hope something better comes along.

      • aquinteros@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        1 year ago

        idk what you guys mean but GitHub copilot still works absolutely well, the suggestions are fast and precise, with little Tweeks here and there… and gpt4 with code interpreter are absolute game changers … idk about basic chatgpt 3.5 turbo though

        • Boinketh@lemm.ee
          link
          fedilink
          English
          arrow-up
          4
          ·
          1 year ago

          I heard they put copilot behind a paywall. Does the free version still hold up?

          • aquinteros@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 year ago

            I use the payed version, it’s about 10usd a month I believe I don’t know if there is a free version still

        • danwardvs@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 year ago

          Github Copilot is a bit different, it’s powered by OpenAI Codex which is trained on all public repos. And yes, it’s quite effective!