Flash Deals & Price Tracking from Costco, IGA, Metro

Real-Time Regional Insights with Customizable E-commerce Dashboards

Overview

Retail competitiveness in the Canadian grocery market has intensified with the rise of e-commerce and consumer price sensitivity. Major retailers like Costco, IGA, and Metro frequently update product prices and flash deals. For businesses aiming to gain a competitive edge or provide price comparison tools to consumers, having real-time access to such data is crucial.

Actowiz Solutions built a robust web scraping solution to extract grocery product prices, flash deals, promotions, and availability from these multiple platforms in real-time. This case study outlines how we executed this at scale and delivered actionable insights.

Objective

To build a reliable and scalable solution that:

Extracts daily product prices, discounts, and flash deals from Costco, IGA, Metro, and Super C
Monitors sales trends across different categories (e.g., dairy, beverages, produce, frozen foods)
Delivers structured data via API or CSV for analytics and retail benchmarking

Challenges

1. Different site structures: Each retailer uses unique layouts and product page structures.

2. Frequent DOM changes: Promotions and banners often use dynamic HTML or JavaScript elements.

3. Anti-bot mechanisms: Rate limits, captchas, and session tokens blocked standard crawlers.

4. Flash sale timing: Deals often appear for a limited time or during off-hours, requiring scheduled scraping.

Solution by Actowiz Solutions

Our engineering team designed a multi-layered web scraping system using custom scripts and headless browsers (like Puppeteer and Selenium). Key components included:

Dynamic HTML parsing using BeautifulSoup and lxml for static pages
JavaScript rendering via Puppeteer for pages with dynamic loading
Smart scheduling: Cron-based triggers set to run during peak promotional updates (e.g., 6 AM, 12 PM, 6 PM)
Proxy rotation & user-agent spoofing to bypass anti-bot restrictions
Error detection & fallback mechanisms to handle site downtimes

Data Fields Extracted

Field	Description
Product Name	Title of the item
SKU/ID	Unique identifier if available
Original Price	Price before discount
Discounted Price	Flash deal price
Discount %	Calculated discount
Category	Grocery section (e.g., dairy, snacks)
Store Name	Costco, IGA, Metro, Super C
Deal Validity	Duration or expiry of the offer
Availability	In-stock or out-of-stock status
Date & Time	When the data was scraped

Sample Data Extracted

Product Name,Original Price,Discounted Price,Discount %,Store,Category,Availability,Deal Validity,Date
Kirkland Almonds 1KG,17.99,14.99,16.7%,Costco,Nuts & Dry Fruits,In Stock,2 Days,2025-06-01
IGA Milk 2L,5.49,4.29,21.8%,IGA,Dairy,In Stock,Today Only,2025-06-01
Metro Frozen Pizza,8.99,6.99,22.2%,Metro,Frozen Foods,Out of Stock,While Supplies Last,2025-06-01

Delivery Mechanism

CSV Downloads for batch reports
Real-Time API endpoints for live retail platforms or dashboards
Google Sheets Integration for retail teams and merchandisers

Business Impact

1. Retail Analytics Company: Built a dashboard to compare daily prices across stores and highlight flash deals, increasing user engagement by 35%.

2. Grocery Delivery Startups: Used the scraped data to auto-adjust pricing on their own platforms in sync with major retailers.

3. Consumers Apps: Developers integrated our APIs into their apps to help users find the best grocery deals nearby.

Performance Highlights

Accuracy: > 98% product identification across multiple platforms
Update Frequency: 3x daily scraping across all stores
Coverage: 10,000+ SKUs tracked daily across 4 stores
Latency: < 3 minutes data delivery post-scraping via API

Tech Stack Used

Python (Scrapy, Requests, BeautifulSoup, Pandas)
Puppeteer & Selenium (for dynamic scraping)
Flask (API layer)
AWS Lambda (task orchestration)
MongoDB & PostgreSQL (data storage)

Interested in Similar Solutions?

Get in touch with Actowiz Solutions today for customized web scraping and data intelligence for retail and e-commerce.

Conclusion

With the grocery retail landscape becoming increasingly data-driven, Actowiz Solutions enables companies to stay ahead with real-time flash deal tracking and price intelligence. Our scalable web scraping infrastructure for Canadian grocery giants empowers clients with timely, accurate, and actionable insights to inform marketing, pricing, and inventory decisions.

Real Results from Real Clients

Hear It Directly from Our Clients

Watch how businesses like yours are using Actowiz data to drive growth.

▶

1 min

★★★★★

"Actowiz Solutions offered exceptional support with transparency and guidance throughout. Anna and Saga made the process easy for a non-technical user like me. Great service, fair pricing!"

Thomas Galido

Co-Founder / Head of Product at Upright Data Inc.

▶

2 min

★★★★★

"Actowiz delivered impeccable results for our company. Their team ensured data accuracy and on-time delivery. The competitive intelligence completely transformed our pricing strategy."

Iulen Ibanez

CEO / Datacy.es

▶

1:30

★★★★★

"What impressed me most was the speed — we went from requirement to production data in under 48 hours. The API integration was seamless and the support team is always responsive."

Febbin Chacko

-Fin, Small Business Owner

⭐ 4.8/5 Average Rating

📹 50+ Video Testimonials

🔄 92% Client Retention

🌍 50+ Countries Served