In a Reddit Q&A, OpenAI CEO Sam Altman let slip that he wants the company to be able to generate “NSFW stuff” for users — and he has examples of just what kind of “stuff” he means.

During the exchange, which took place in the r/ChatGPT subreddit over the weekend after OpenAI published its “Model Spec” document outlining its governing rules, another user asked Altman to expound on a curious disclaimer in the document, stipulating that its models “should not serve content” that’s NSFW, including “erotica, extreme gore, slurs, and unsolicited profanity.”

“We believe developers and users should have the flexibility to use our services as they see fit, so long as they comply with our usage policies,” the spec reads. “We’re exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API and ChatGPT. We look forward to better understanding user and societal expectations of model behavior in this area.”

Fascinatingly, Altman was dived right in.

“We really want to get to a place where we can enable NSFW stuff (e.g. text erotica, gore) for your personal use in most cases,” he wrote, “but not do stuff like make deepfakes.”

Unsurprisingly, the comments in that follow-up thread showed Redditors veritably salivating over the concept of OpenAI-produced gore and erotica, with one calling Altman “sam basedman” and another referring to the CEO as the new “king of Reddit.”

  • kbal@fedia.io
    link
    fedilink
    arrow-up
    28
    arrow-down
    4
    ·
    6 months ago

    Altman and OpenAI greatly overestimate their ability to control what is done with this technology. The more they tighten their grip, the more open-weights sexbots will slip through their fingers.

    • conditional_soup@lemm.ee
      link
      fedilink
      English
      arrow-up
      17
      ·
      edit-2
      6 months ago

      I think this might be part of their rationale. Llama2 models have been used pretty extensively for these purposes and completely (gasp) for free, it’s not creating any value for their investors :(

      Otoh, not everyone has the frankly marginal technical skills it requires to download and use KoboldCPP, but using ChatGPT really couldn’t be any easier. They and their investors stand to benefit enormously from redefining what they consider to be ethical while also limiting the impact on LLM use attitudes that derive from open source model use.

      • Skullgrid@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        arrow-down
        1
        ·
        6 months ago

        Otoh, not everyone has the frankly marginal technical skills it requires to download and use KoboldCPP,

        if it’s anything like Stable diffusion, there’s probably a webui that lets you run it if you can follow basic instructions

        • Terrasque@infosec.pub
          link
          fedilink
          English
          arrow-up
          4
          ·
          6 months ago

          Koboldcpp is way easier. Download exe, double click exe, open gguf file with the AI model, click start.

          Then put on your robe and wizard hat

    • DarkThoughts@fedia.io
      link
      fedilink
      arrow-up
      4
      ·
      6 months ago

      But they’re talking about being less restrictive, likely because they obviously lose people to those alternatives that do not have those restrictions.