Jump to content
BeatKing.com | Music News | Downloads | Forums | Videos | Lyrics

Sites scramble to block ChatGPT web crawler after instructions emerge

DudeAsInCool

By DudeAsInCool,
in Digital/Internet News

 Share

Recommended Posts

DudeAsInCool Apprentice

DudeAsInCool

Posted
Posted
A woman hiding behind a cloud.

Enlarge (credit: Getty Images)

Without announcement, OpenAI recently added details about its web crawler, GPTBot, to its online documentation site. GPTBot is the name of the user agent that the company uses to retrieve webpages to train the AI models behind ChatGPT, such as GPT-4. Earlier this week, some sites quickly announced their intention to block GPTBot's access to their content.

In the new documentation, OpenAI says that webpages crawled with GPTBot "may potentially be used to improve future models," and that allowing GPTBot to access your site "can help AI models become more accurate and improve their general capabilities and safety."

OpenAI claims it has implemented filters ensuring that sources behind paywalls, those collecting personally identifiable information, or any content violating OpenAI's policies will not be accessed by GPTBot.

Read 12 remaining paragraphs | Comments

View the full article

Link to comment
Share on other sites

Please sign in to comment

You will be able to leave a comment after signing in



Sign In Now
 Share
Go to topic listing

  • Recently Browsing   0 members

    • No registered users viewing this page.

  • Our picks

    • Wait, Burning Man is going online-only? What does that even look like?

      Wait, Burning Man is going online-only? What does that even look like?

      NelsonG posted a topic in General News,

      You could have been forgiven for missing the announcement that actual physical Burning Man has been canceled for this year, if not next. Firstly, the nonprofit Burning Man organization, known affectionately to insiders as the Borg, posted it after 5 p.m. PT Friday. That, even in the COVID-19 era, is the traditional time to push out news when you don't want much media attention. 
      But secondly, you may have missed its cancellation because the Borg is being careful not to use the C-word. The announcement was neutrally titled "The Burning Man Multiverse in 2020." Even as it offers refunds to early ticket buyers, considers layoffs and other belt-tightening measures, and can't even commit to a physical event in 2021, the Borg is making lemonade by focusing on an online-only version of Black Rock City this coming August.    Read more...
      More about Burning Man, Tech, Web Culture, and Live EventsView the full article
      • 0 replies
      NelsonG

      Picked By

      NelsonG,
    • Post in What Are You Listening To?

      Post in What Are You Listening To?

      DudeAsInCool posted a post in a topic,

      Post in What Are You Listening To?
      DudeAsInCool

      Picked By

      DudeAsInCool,
    • Post in What Are You Listening To?

      Post in What Are You Listening To?

      DudeAsInCool posted a post in a topic,

      Post in What Are You Listening To?
      DudeAsInCool

      Picked By

      DudeAsInCool,
    • Post in What Are You Listening To?

      Post in What Are You Listening To?

      DudeAsInCool posted a post in a topic,

      Post in What Are You Listening To?
      DudeAsInCool

      Picked By

      DudeAsInCool,
    • Post in What Are You Listening To?

      Post in What Are You Listening To?

      DudeAsInCool posted a post in a topic,

      Post in What Are You Listening To?
      DudeAsInCool

      Picked By

      DudeAsInCool,
    View All
×
×
  • Create New...