TECHSY.communityby techsy.io
Registrarse
Todo el código abierto
Código abiertoScraping24k

Colly

A fast, idiomatic scraping framework for Go.

Colly is a lightning-fast, elegant scraping and crawling framework for Go, offering a clean callback-based API for navigating links and extracting data. It supports parallel scraping, rate limiting, caching, proxy switching, and respects robots.txt out of the box. It is notable for its performance and minimal footprint, making it popular for high-throughput Go-based crawlers.

Ver repo

Repositorio

gocolly/colly

Lenguaje

Go

Lo que construirías con esto

  • Building high-throughput crawlers where Go's concurrency beats Python
  • Collecting structured web data with built-in rate limiting and caching
  • Embedding a scraper into a Go service or data pipeline

Etiquetas

crawlingscrapinggoconcurrency