I guess Anubis also prevents “good” bots such as search engine bots to access a webpage…
yes but you can configure anubis to allow specific bots with botPolicy.yaml; the allow-good include already whitelists internet archive.
Can they please add “Dillo/3.2.0”?
look in the crawlers directory and you can add any allows you want with the proper user agent. :)
Nah, that was a joke; Dillo is basicslly a graphical Lynx (both have useragent-exceptions on some big “js-only” sites). And the Anubis dev is, for a while now, working on a static version, if you believe the error message. Though that would be hard to do, if at all possible.
ooh i’m sorry i didn’t catch that <3
Is there anything AI doesn’t ruin?
Well, AI forces people to rethink a broken economy.
Don’t forget “intelligence”-as-a-service™®©!
Hi ChatGPT, I can’t find a job due to the AI bubble. What should I do?
