Objective: Build a Python script to scrape product data from Amazon and Best Buy to identify trends and insights during the winter sale season. The project focuses on web scraping, data analysis, and visualization.
-
Use BeautifulSoup and Requests (or Scrapy for advanced users) to scrape product details:
-
Product Name, Price, Discount Percentage, and URL
-
Target Categories: Laptops and headphones
- Use Pandas to clean and organize the data
-
Identify top deals (highest discount percentage)
-
Calculate average discounts per category
-
Generate simple visualizations (e.g., bar charts) using Matplotlib or Seaborn
-
Python script submitted via GitHub
-
CSV file of scraped data (sample of at least 20 products)
-
Screenshots of visualizations
-
A short write-up (300-500 words) explaining the scraping process and insights gained