Nightcrawler is a standalone BFS web crawler, optimized for low-latency concurrent crawling with cacheline-aware synchronization.