Aller au contenu

Data & pipelines

Building a Web Technology Detector with Scrapy

This project started in the simplest way possible: avoiding having to open 15 tabs manually just to understand a company's stack.

It's probably the project that taught me the most about real-world scraping, technical signals, the limits of the modern web, and the difference between a script that works and a system that holds up over time.