Skip to content

A Scrapy-based web crawler for extracting product data from Carrefour and Watsons websites.

Notifications You must be signed in to change notification settings

yucc11/Carrefour-and-Watsons-Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 

Repository files navigation

Carrefour and Watsons Scraper

This repository is a Scrapy-based web crawler for extracting product data from Carrefour and Watsons websites. The scraper collects product details, prices, images, and other relevant information.

How to use

  1. Clone the repository:
    git clone $REMOTE_URL$
  2. Navigate to the project directory:
    cd $REPO_NAME$
  3. Run the Scrapy spider for Carrefour:
    scrapy crawl carrefour
  4. Run the Scrapy spider for Watsons:
    scrapy crawl watsons
  5. The scraped data will be stored in MongoDB.

About

A Scrapy-based web crawler for extracting product data from Carrefour and Watsons websites.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages