Fetch page after page from a slow, flaky web without losing a link to a crash or getting stuck on a dead site.