FastAPI-based scraper for commodity ticker prices (HO, CL, RB futures) and competitor oil pricing from NewEnglandOil. Includes cron-driven scraping, PostgreSQL storage, and REST endpoints for price retrieval. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
19 lines
362 B
Plaintext
19 lines
362 B
Plaintext
# eamco_scraper dependencies
|
|
# FastAPI web framework and server
|
|
fastapi>=0.109.0,<1.0.0
|
|
uvicorn[standard]>=0.27.0,<1.0.0
|
|
pydantic>=2.5.0,<3.0.0
|
|
|
|
# Database
|
|
sqlalchemy>=2.0.0,<3.0.0
|
|
psycopg2-binary>=2.9.9,<3.0.0
|
|
|
|
# Web scraping
|
|
beautifulsoup4>=4.12.0,<5.0.0
|
|
requests>=2.31.0,<3.0.0
|
|
lxml>=5.0.0,<6.0.0
|
|
|
|
# Configuration
|
|
python-dotenv>=1.0.0,<2.0.0
|
|
yfinance>=0.2.36
|