Hi, I'm Michael

Web Scraping Engineer

You give me the targets. I deliver the data.

I build automated extraction systems that collect structured data from public websites. My systems handle JavaScript-heavy websites, browser and TLS fingerprinting, Cloudflare, Akamai, CAPTCHAs, and other common scraping challenges.
I deliver clean, structured data in formats such as JSON, CSV, Excel, Google Sheets, and databases, ready for business use.

Request a Custom Dataset

# Procurement Tracking

$ python monitor.py

[RUNNING] Monitoring RS Components for price changes

[ALERT] Change detected → Notification sent

# Property Sourcing Automation

CRITICAL: Bypassing Cloudflare & CAPTCHAs...

[SCRAPING] Capturing foreclosure listings & auction details

[UPDATE] Fresh auction listings captured → CSV generated

Our Services

Web Scraping & Automation Solutions

Custom Web Scraping Systems

Extract structured data from complex JavaScript-heavy websites, marketplaces, and dynamic platforms, including APIs, hidden endpoints, and structured JSON sources. Built to handle TLS fingerprinting, Cloudflare, Akamai and authentication reliably.

Automated Price & Competitor Intelligence

Develop automated monitoring systems for e-commerce products and real estate listings, tracking price changes, inventory or listing status, and competitor activity across multiple channels, with real-time alerts for significant market events.

Business Directory & Lead Data Extraction

Automate the collection of business listings, contact information, and public company data from directories and websites like Google Maps, Yellow Pages, and more into clean, structured datasets.

Complex PDF Extraction

Extract tables, records, and text from PDFs, scanned files, invoices, reports, and business documents.

Python Automation

Create end-to-end automation workflows for recurring data collection, scheduling, and direct delivery into clean CSV, Excel, JSON, or database formats.

Industries Covered

Industries We Serve

Real Estate

Capture up-to-date real estate data, live foreclosure listings, agent details, and historical pricing changes directly from regional marketplaces and property portals, delivered in clean, structured format, no manual tracking.

Retail & E-Commerce

Extract live product variations, inventory stock levels, and real-time competitor pricing changes on a continuous schedule, with competitor datasets mapped by SKU for faster pricing decisions.

B2B Directories & Data Aggregators

Extract public business listings, company profiles, contact information, and local business directories automatically into structured datasets, no manual copy-pasting.

Featured Projects

PriceVecta: Automated Price Monitoring Platform

PriceVecta is an automated price-monitoring platform that continuously tracks product prices and stock availability across client-specified e-commerce, retail, and distributor websites. It delivers real-time Telegram and email alerts when changes are detected while centralising historical data, pricing activity, and CSV exports into a single dashboard. PriceVecta helps businesses react faster to competitor pricing, monitor supplier changes, and make informed pricing decisions using up-to-date market data.

Python Flask Scrapy SQLAlchemy SQLite Docker GCP Compute Engine Linux Cron Jobs

View Code on GitHub

Foreclosure Monitoring System

Foreclosure listings change constantly as auctions are scheduled, postponed, cancelled, or sold, making manual tracking repetitive and time consuming, often leading to missed opportunities. This automated monitoring system collects active foreclosure listings from Auction.com on a scheduled basis, standardises the data, and delivers structured datasets for property sourcing, market monitoring, historical tracking, ROI analysis, and investment decision-making. By using API Reverse Engineering to extract structured listing records, it eliminates the overhead of browser automation.

Python Requests Pandas API Reverse Engineering GitHub Actions

View Code on GitHub

Movoto Real Estate Listings Scraper

This system automates the collection of property listings from Movoto by navigating search results, collecting listing URLs, and extracting structured property information from individual listing pages. The system supports configurable search locations, handles pagination, synchronises with dynamic page content using explicit Playwright waits, and exports clean, structured datasets for real estate research, market analysis, and property monitoring.

Python Playwright Pandas

View Code on GitHub

Adidas Sneaker Product API Scraper

This system collects structured men's sneaker product data from Adidas through API reverse engineering, covering 1,101 product listings and extracting pricing, ratings, model numbers, images, colour variations, product URLs, and other product attributes. The collected data is standardised and exported as CSV for product research, price monitoring, catalogue analysis, and competitor tracking.

Python Requests Pandas API Reverse Engineering

View Code on GitHub

Automated Daily Price Intelligence Tracker – Samsung Galaxy A06

A fully automated Python and Playwright price monitoring system that tracks Samsung Galaxy A06 listings on Jumia Nigeria daily via GitHub Actions. The pipeline detects price changes, maintains historical datasets, and automatically classifies new, increased, decreased, and unchanged listings. Built for reliable, unattended operation, it provides continuous pricing intelligence to support competitor monitoring, pricing strategies, and informed business decisions.

Python Playwright Pandas GitHub Actions

View Code on GitHub

All Projects

My Recent Projects

NigeriaPropertyCentre Listings Scraper

Configurable system that extracts structured real estate listings using search filters for location, listing type, and bedroom count.

Python Playwright Pandas

View Code on GitHub

Automated E-Commerce Price & Availability Tracker

Daily automated tracking of price, stock, and ratings changes, producing a validated dataset for trend analysis.

Python BeautifulSoup Requests Pandas

View Code on GitHub

Future Property Auctions Scraper

Scrapes UK property auction listings across multiple categories, extracting property and auction details from listing pages.

Python Scrapy

View Code on GitHub

WhiskyExchange API Data Pipeline

Extracts whisky product data directly from The Whisky Exchange’s internal search API.

Python API Reverse Engineering Requests Pandas

View Code on GitHub

Argetra Real Estate Scraper

Parameterised scraper that extracts real estate and foreclosure listings using JSON-LD and TLS fingerprinting for anti-bot protection.

Python curl_cffi BeautifulSoup

View Code on GitHub

LuxuryEstate Property Data Scraper

Collects detailed luxury property listings across a market, built to adapt easily to new cities.

Python BeautifulSoup httpx Pandas

View Code on GitHub

Thomann UK Guitars Dynamic Web Scraper

Simulates real browser behavior to reliably extract product data from a dynamic, JavaScript-rendered site.

Python Playwright

View Code on GitHub

Customer Value Segmentation

Segmented nearly 43,000 transactions into customer value tiers to reveal revenue trends and support growth strategy.

Python Pandas Matplotlib Seaborn Excel

View Code on GitHub

Customer Churn Prediction using Machine Learning

Built a churn-prediction model that flags at-risk customers early, enabling proactive retention decisions.

Python Pandas scikit-learn Random Forest

View Code on GitHub

Natural Gas Storage Contract Valuation

Forecasted natural gas prices using seasonal trend modeling to support storage and trading decisions.

Python Pandas Numpy ARIMA scikit-learn

View Code on GitHub

About Me

I’m a Web Scraping Engineer focused on building reliable, automated extraction systems that pull data from websites, PDFs, and APIs, then clean and structure it into usable formats such as CSV, Excel, Google Sheets, and databases.

I build solutions for competitor monitoring, change detection, price tracking, inventory monitoring, lead generation, market research, supply chain data, and automated web data collection that support business decision-making

I handle JavaScript-rendered content, browser and TLS fingerprinting, Cloudflare and Akamai, CAPTCHAs, and other common scraping challenges. Where possible, I reverse engineer APIs to reduce overhead and use PDF and OCR tools for complex document extraction. When needed, I build Flask applications to make extracted data easier to search, monitor, and use.

My approach is shaped by my background in mathematics and years of teaching, which trained me to break down problems and choose the most efficient solution, whether through API access, browser automation, or HTML parsing.

The result is simple: cleaned, structured, reliable data delivered in the format you need.

If you’re working with data that’s difficult to collect or organise, I can help simplify it.

My Skills

My Technical Skills

Web Scraping & Automation

Python
Web Scraping
Data Extraction
API Reverse Engineering
Scrapy
Playwright
BeautifulSoup
SeleniumBase
Requests
TLS Fingerprinting
Python Automation
Linux Cron
GitHub Actions
Complex PDF Parsing

Backend & Deployment

Flask
SQLAlchemy
SQL
PostgreSQL
SQLite
Docker
Google Cloud
GCP Compute Engine
API Integration

Data Processing & Output

Pandas
Microsoft Excel
Google Sheets

Frontend

JavaScript
HTML
CSS
Bootstrap

What Clients Say

"Michael's extraction system saved us countless hours of work. Reliable, fast, and exactly what we needed.

I was trying to track prices for both new and used lenses and camera bodies across five different sites to find a deal. Michael set up a way for me to see every listing in one place without having to click through dozens of pages. It's like having a personal assistant doing the boring stuff for me."

Badmus Opeyimi, Photographer

"Great communication and excellent results. Highly recommend working with Michael.

I wanted to start shipping my spices and packaged food abroad but didn't know where to start. Michael complied a list of international African food stores and distributors across the UK and US, including their store locations and phone numbers. He saved me months of searching on Google. Now I have a solid list of businesses to reach out to."

Motella XX, CEO. Cravings by Tella

"Fast, accurate, and very reliable. The results were exactly what I needed.

I needed a way to track viral content ideas and trending topics across multiple platforms so I could stay ahead with my content. Michael collated structured lists of trending posts, hashtags, and creator pages from different websites. Instead of jumping between apps for hours, I now have a steady pool of content ideas to work with every week."

Diamond Chuks, Content Creator

"Professional, efficient, and detail-oriented. The job was flawless and delivered ahead of schedule.

I needed a list of all the top hair salons and beauty parlors in Lagos, Abuja, and Ibadan to market my bulk bundles. Michael extracted their phone numbers and addresses from multiple directories online. Instead of searching on Instagram one by one, I now have a full directory to send my price list to."

Temmy Goldie, Hair Vendor and Stylist

"Fast turnaround and highly reliable work. Delivered exactly what we needed under tight pressure.

We contacted Michael very close to the start of a construction project and urgently needed safety equipment suppliers. He quickly compiled a detailed list with contact information and product availability. This helped us to source everything in time for site operations."

Adekunle Daodu, HSE Manager

Leave Feedback

My Experience

My Work Experience

Extensive

Experience in The Field

A Diverse

Portfolio of Projects

Numerous

Satisfied Customers

Available for freelance & contract work — Let's talk

My Contact

Contact Us At

mathiasmichael2@gmail.com

+234 912 146 1656