Anubis -- Stopping AI Crawlers

Post any website technical issues, suggestions, or requests here
Post Reply
Lah Ca
Victor IV
Posts: 1407
Joined: Sun Nov 21, 2021 10:22 pm

Anubis -- Stopping AI Crawlers

Post by Lah Ca »

Linux Musicians for a long while was having such problems that they were forced to take their website offline periodically. It was up and down like a yo-yo.

Gaining access to the site was very hit and miss .

They have implemented Anubis, a solution aimed at stopping AI crawlers.

To see it in action go to:

https://linuxmusicians.com

Github site for Anubis:

https://github.com/TecharoHQ/anubis
About
Weighs the soul of incoming HTTP requests to stop AI crawlers
Top
User avatar
epigramophone
Victor Monarch Special
Posts: 5812
Joined: Mon Oct 24, 2011 1:21 pm
Personal Text: An analogue relic trapped in a digital world.
Location: The Somerset Levels, UK.

Re: Anubis -- Stopping AI Crawlers

Post by epigramophone »

Unfamiliar with the term "AI Crawlers" I looked it up. Scary :shock: .
Top
User avatar
poodling around
Victor V
Posts: 2482
Joined: Tue Feb 20, 2018 11:52 am

Re: Anubis -- Stopping AI Crawlers

Post by poodling around »

epigramophone wrote: Wed Mar 25, 2026 3:01 pm Unfamiliar with the term "AI Crawlers" I looked it up. Scary :shock: .
Me too.

If I had AI web Crawlers every-where trying to scrape my headless browsers (what-ever that means) I would set the dogs on them, nasty little things :)
Top
Post Reply

Return to “TMF Tech Support”