Roundabout – A high-performance, distributed crawler

Ruby RPC hurdles

Arachni grid, draft design

Arachni: XMLRPC service dispatcher — distributed design and implementation