Python Scraper

python_scraper.ipynb · January 15, 2024 · portfolio / projects

PythonBeautifulSoupAPIsTableau

This was a personal project where I used Python to build a price scraper. The two hottest commodities right now are Stanley Cups and Cryptocurrencies. There are two parts to this project.

Part 1 · Stanley Cups

First, I worked on using BeautifulSoup to scrape the prices of Stanley Cups on Amazon. It will check the price every five seconds. The output is put into a CSV file. This entire process is automated.

Part 2 · Cryptocurrencies

For the cryptocurrencies, I used the CoinMarketCap API to pull in the data. Same as the Stanley's, the information is turned into a CSV. For this part of the project, I made a visual using Tableau.

Tableau dashboard: cryptocurrency coin price over time

View source on GitHub ↗📓 View notebook · Part 1 · Stanley Cup scraper 📓 View notebook · Part 2 · Crypto prices

-- the scraped output, as a table
SELECT product, ROUND(AVG(price),2) AS avg_price, MIN(price) AS low, MAX(price) AS high
FROM daily_prices
GROUP BY product
ORDER BY avg_price DESC;