Nah, that was a joke; Dillo is basicslly a graphical Lynx (both have useragent-exceptions on some big “js-only” sites). And the Anubis dev is, for a while now, working on a static version, if you believe the error message. Though that would be hard to do, if at all possible.
yes but you can configure anubis to allow specific bots with botPolicy.yaml; the allow-good include already whitelists internet archive.
Can they please add “Dillo/3.2.0”?
look in the crawlers directory and you can add any allows you want with the proper user agent. :)
Nah, that was a joke; Dillo is basicslly a graphical Lynx (both have useragent-exceptions on some big “js-only” sites). And the Anubis dev is, for a while now, working on a static version, if you believe the error message. Though that would be hard to do, if at all possible.
ooh i’m sorry i didn’t catch that <3