feat: initial commit for oil price scraper service

FastAPI-based scraper for commodity ticker prices (HO, CL, RB futures)
and competitor oil pricing from NewEnglandOil. Includes cron-driven
scraping, PostgreSQL storage, and REST endpoints for price retrieval.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-08 17:57:44 -05:00
commit af9c2f99e7
25 changed files with 1566 additions and 0 deletions

18
requirements.txt Normal file
View File

@@ -0,0 +1,18 @@
# eamco_scraper dependencies
# FastAPI web framework and server
fastapi>=0.109.0,<1.0.0
uvicorn[standard]>=0.27.0,<1.0.0
pydantic>=2.5.0,<3.0.0
# Database
sqlalchemy>=2.0.0,<3.0.0
psycopg2-binary>=2.9.9,<3.0.0
# Web scraping
beautifulsoup4>=4.12.0,<5.0.0
requests>=2.31.0,<3.0.0
lxml>=5.0.0,<6.0.0
# Configuration
python-dotenv>=1.0.0,<2.0.0
yfinance>=0.2.36