• 1 Post
  • 20 Comments
Joined 11 months ago
cake
Cake day: August 11th, 2023

help-circle







  • But for large website operators, the choice to block large language model (LLM) crawlers isn’t as easy as it may seem. Making some LLMs blind to certain website data will leave gaps of knowledge that could serve some sites very well (such as sites that don’t want to lose visitors if ChatGPT supplies their information for them), but it may also hurt others. For example, blocking content from future AI models could decrease a site’s or a brand’s cultural footprint if AI chatbots become a primary user interface in the future. As a thought experiment, imagine an online business declaring that it didn’t want its website indexed by Google in the year 2002—a self-defeating move when that was the most popular on-ramp for finding information online.

    Really curious how this will end up











  • breaks@lemmy.studiotoLemmy@lemmy.studioWelcome!
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    11 months ago

    Hey, thanks for the instance. Is anyone else unable to visit the site via their browser at the moment? Is there a Matrix channel or something we could check for status updates in the future?

    Firefox and Samsung internet on Android aren’t working for me right now. Was fine a few hours ago.

    Just tried on desktop (Firefox) and I’m getting the same issue. I was able to get in using a custom frontend though. Must be a lemmyui problem? Since the instance is still accessible otherwise.