• halloween_spookster@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    3 months ago

    I once asked ChatGPT to generate some random numerical passwords as I was curious about its capabilities to generate random data. It told me that it couldn’t. I asked why it couldn’t (I knew why it was resisting but I wanted to see its response) and it promptly gave me a bunch of random numerical passwords.

      • ForgotAboutDre@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        3 months ago

        It won’t generate random numbers. It’ll generate random numbers from its training data.

        If it’s asked to generate passwords I wouldn’t be surprised if it generated lists of leaked passwords available online.

        These models are created from masses of data scraped from the internet. Most of which is unreviewed and unverified. They really don’t want to review and verify it because it’s expensive and much of their data is illegal.

        • dukk@programming.dev
          link
          fedilink
          arrow-up
          1
          ·
          3 months ago

          Also, researchers asking ChatGPT for long lists of random numbers were able to extract its training data from the output (which OpenAI promptly blocked).

          Or maybe that’s what you meant?