In my opinion, the use of Anubis is debatable. It won't be that hard or costly for those crawlers to implement an algorithm that solves the Anubis challenge on default difficulty. I'm not opposed to it, just want to point out that it's not a guaranteed solution.
What I mean is described in the...