You've probably heard me complain about the "AI crawlers" before, but now I actually have some hard numbers I can put up to show their im...
  • Kissaki@programming.devEnglish
    6·
    2 months ago

    TL;DR: we spend more CPU cycles rendering commits for scrapers than we spend on all other kinds of legitimate access, including git clones.

    I’ve read similar and even worse before. Probably from Codeberg, or maybe a smaller host of Forgejo or GitLab.

    The blame html pages were repeatedly being requested. Which is even worse and even less plausibly useful than a commit html page.