A few changes from upstream:
1) the executable is patched to support a --no-robots flag to ignore
robots.txto
2) the GUI doesn't work (for now), so this is CLI only
A few changes from upstream:
1) the executable is patched to support a --no-robots flag to ignore
robots.txto
2) the GUI doesn't work (for now), so this is CLI only