This repository is a Scrapy-based web crawler for extracting product data from Carrefour and Watsons websites. The scraper collects product details, prices, images, and other relevant information.
- Clone the repository:
git clone $REMOTE_URL$
- Navigate to the project directory:
cd $REPO_NAME$
- Run the Scrapy spider for Carrefour:
scrapy crawl carrefour
- Run the Scrapy spider for Watsons:
scrapy crawl watsons
- The scraped data will be stored in
MongoDB
.