One repo to rule them all !!?!?!! 🤓 😎

World’s single largest Internet domains dataset

A Go-based web scraping project that extracts articles from a static website and dynamically displays them using HTMX for seamless updates.

It is a reverse image generator built using golang, google wire and serp APIs. Also it has a great support for llm models for web scraping

A command line application designed to crawl a given set of URLs and scrape the JSON Linked Data (JSON-LD) contained within the webpage before writing the data entries out to a CSV file.

golang spider Crawler 爬虫 电影

Minimalistic Terminal Video-Game Price Scraper

GoCrawler is a web crawling framework written in Go, inspired by Scrapy. Support this project at https://ko-fi.com/gocrawl

MongoDB Storage For Colly

A Go scraper to efficiently retrieve and parse website data.

Scripts used to scrape tennis match results from the web and update my Racquet Rivals database.

This is a crawler application designed to connect automatically with LinkedIn members. The app utilizes web scraping techniques to gather data from LinkedIn profiles and establish connections with members based on specified criteria.

python 爬虫, golang 爬虫: 涩涩网站 学习资料 视频爬取下载工具 完美适配 miya(蜜芽)和 yysp(夜夜视频, 夜夜視頻)

cli tool for scraping product data from Ebay

WebScraper for TBATE light novel written in GoLang

Simple IMDB movie scraper with golang and colly

NRC = dutch news website. A simple NRC Scraper API written in GO with Colly (scraping framework) and Gin (web framework). This API can be used for building NRC-news web or mobile app (https://github.com/ciCciC/nrcnewsapp)

When you play FIFA with your friends and can't choose which teams to play, this bot can help to select both for you and your friend to make your competition more exciting.

🔍 A Go command-line tool that counts sub-URLs by scraping links from a webpage