Colly

A fast, idiomatic scraping framework for Go.

Colly is a lightning-fast, elegant scraping and crawling framework for Go, offering a clean callback-based API for navigating links and extracting data. It supports parallel scraping, rate limiting, caching, proxy switching, and respects robots.txt out of the box. It is notable for its performance and minimal footprint, making it popular for high-throughput Go-based crawlers.