Hourly 12-Supermarket Price Tracker for a UK Shopping App

12

UK SUPERMARKETS

1 hr

REFRESH CYCLE

85K

SKUs TRACKED

£3.8M

ANNUAL UPLIFT

Client Overview

The client is a London-headquartered GroceryTech startup running a UK shopping app that helps British households save money on weekly grocery shopping. The app surfaces the cheapest supermarket for a user's specific basket — letting families decide whether to drive to Asda, click-and-collect from Tesco, or order from Ocado for the same week's groceries.

UK grocery is one of the most competitive retail markets in the world. The 'Big Four' (Tesco, Sainsbury's, Asda, Morrisons) plus disruptors (Aldi, Lidl), premium players (Waitrose, M&S), specialists (Ocado, Iceland, Co-op), and the digital-native entrant (Amazon Fresh) make every shopping decision a multi-way comparison. The £200 billion UK grocery market sees price changes happen multiple times a day — often in response to competitors moving first.

For a UK shopping app to be genuinely useful, the data behind it has to move at the speed of the market. Daily refresh is not enough when Tesco can drop a price on milk at 7 AM and Sainsbury's matches within 90 minutes. The app's founder explicitly required hourly refresh — and built the business around that promise to consumers.

Why UK Grocery Demands Hourly Refresh

UK supermarkets reprice multiple times per day, especially on staples — milk, bread, eggs, fresh produce. Competitive matching happens within hours. Loyalty pricing (Tesco Clubcard, Sainsbury's Nectar) adds another dynamic layer. Daily snapshots miss 60-70% of real price movements. Hourly tracking is the threshold where the data actually reflects the market.

Business Challenges

Building an hourly-refresh API across 12 UK supermarkets — at scale, sustainably, and within UK GDPR — presented five distinct challenges:

Challenge #1 — 12 Heterogeneous Platforms

Each of the 12 supermarkets runs a completely different e-commerce platform. Tesco's site behaves nothing like Sainsbury's. Ocado has its own engineering culture. Amazon Fresh inherits Amazon's infrastructure. M&S Food redirects to Ocado for some categories. Building 12 separate integrations — each with its own anti-bot defences, refresh patterns, and quirks — required dedicated chain expertise.

Challenge #2 — Hourly Refresh at Scale

Hourly refresh across 12 chains × 85,000 SKUs means over 2 million data points per hour, 50 million per day. Sustaining this without disruption — without exhausting proxy budgets, triggering anti-bot defences, or hitting platform rate limits — required serious infrastructure engineering.

Challenge #3 — Loyalty Pricing (Clubcard, Nectar) Complexity

Tesco Clubcard prices, Sainsbury's Nectar prices, and similar loyalty tiers create dual price structures. The same product shows £3.50 for non-members and £2.50 for Clubcard holders. For a consumer app to be accurate, both prices have to be captured cleanly and presented honestly.

Challenge #4 — UK GDPR Compliance

The UK GDPR (under the UK Data Protection Act 2018) imposes strict rules on data scraping. The client needed an absolute guarantee that no personal data was captured — only product and pricing information. ICO complaints over scraping practices have grown significantly in recent years; compliance was not optional.

Challenge #5 — Cross-Chain Product Matching

Tesco's 'British Whole Milk 2.272L' had to match Sainsbury's 'Whole Milk 4 Pint', Asda's 'Whole Milk 2.272L', and Ocado's '2.272L Whole Milk'. Without canonical matching, the app could not show 'Tesco £1.45 vs Sainsbury's £1.55 vs Asda £1.40' — it could only show four unrelated products. Matching is what makes comparison possible.

Project Objectives

Together with Actowiz Solutions, the client defined six measurable objectives:

• Track approximately 85,000 SKUs across all 12 priority UK supermarkets
• Refresh pricing data on an hourly cycle, with sub-hour latency on critical price changes
• Capture both base prices and loyalty (Clubcard / Nectar) tier prices accurately
• Build canonical product matching for true cross-chain comparison
• Maintain UK GDPR compliance — no personal data captured anywhere in the pipeline
• Deliver via REST API with webhook events on price changes for real-time app updates

Actowiz Solutions Approach

Actowiz built a 5-stage hourly pricing pipeline tuned to UK grocery's specific dynamics and the UK GDPR regulatory environment:

• CAPTURE
  12 chain-specific hourly crawlers
• MATCH
  Canonical UK product taxonomy
• ENRICH
  Loyalty pricing + multi-buy parsing
• DETECT
  Price change events + alerts
• SERVE
  REST API + webhooks + snapshots

Stage 1 — 12 Dedicated Chain Crawlers

Actowiz built 12 separate chain-specific crawlers — each engineered for its target platform's structure, defences, and refresh tolerances. UK-region residential proxy infrastructure rotated across English, Scottish, Welsh, and Northern Irish IP pools, ensuring authentic regional pricing where chains differ by geography. Browser automation handled JavaScript-heavy frontends (Tesco, Ocado); mobile API capture handled chains with stronger app interfaces (Asda).

Stage 2 — Canonical UK Product Taxonomy

A UK-specific product taxonomy was built — handling British grocery conventions like pint vs litre measures, '2 for £3' multi-buy offers, weight-based produce pricing, and loyalty-tier variants. Each chain's native SKU was mapped to a canonical UK product ID, enabling 'whole milk 2.272L' across all 12 chains to roll up to a single comparable entity.

Stage 3 — Loyalty & Multi-Buy Enrichment

Loyalty pricing was captured separately and labelled clearly — Tesco Clubcard prices, Sainsbury's Nectar prices, and Asda Rewards prices were tagged as loyalty variants rather than mixed into base pricing. Multi-buy offers ('3 for £5', 'Buy 1 Get 1 Free') were parsed into structured offer records so the app could surface real per-unit costs.

Stage 4 — Price-Change Event Detection

An hourly diff engine compared each refresh against the prior snapshot, surfacing every price change as a structured event — including direction (up/down), magnitude, percentage change, and competitive context. These events fired webhooks to the client's app within minutes of detection, enabling near-real-time consumer alerts ('Bread just dropped 22% at Tesco near you').

Stage 5 — UK GDPR-Compliant Delivery

Data delivery was strictly product-only — no personal data, no customer reviews with identifiable information, no scraped account data. Every pipeline component was audited against UK ICO guidance. Authentication, rate-limiting, and per-app data scoping enabled secure multi-tenant use as the client onboarded enterprise partners.

Strategic Wins

• Launched flagship 12-chain hourly coverage feature in just 9 weeks — a differentiator no competitor app matched
• 180,000 active users by month 7, growing at 22% month-over-month
• Average user reported £412/year basket savings using the app's recommendations
• Enterprise API licensing deals signed with 4 UK grocery analytics firms
• App featured in major UK consumer press as 'the smartest grocery savings app for British families'
• Premium tier (real-time alerts) launched 4 months in — adopted by 24% of paid users within 60 days
• UK GDPR audit passed with zero findings — ICO complaint risk eliminated

Client Feedback

"We made an audacious promise to UK shoppers: see real prices, refreshed every hour, across every supermarket that matters. Daily-refresh data would have made that promise a lie. Actowiz delivered exactly the infrastructure that turned the promise into a product — 12 chains, hourly cycles, loyalty pricing, UK GDPR clean. Seven months later, we have 180,000 active users, £2.95M in revenue, and enterprise deals in the pipeline. None of it works without the data partnership we have here."

— Founder & CEO, London-Based UK Shopping App

Conclusion

UK grocery is one of the world's most price-competitive retail markets — and one of the fastest-moving. Tesco can move first on milk pricing at 7 AM and force Sainsbury's, Asda, and Morrisons to match by lunchtime. Loyalty schemes create dual pricing structures. Discounters like Aldi and Lidl set the price floor. Premium chains hold the ceiling. A consumer app trying to make sense of this with daily-refresh data is already lying to its users.

Actowiz Solutions delivered the alternative: hourly-refresh capture across 12 priority UK supermarkets, with loyalty pricing layered cleanly, multi-buy offers parsed, and webhook events firing on every detected change. All built within UK GDPR boundaries from day one. The result for the client: £3.8M annualised revenue uplift, 180K active app users, enterprise licensing deals signed, and a 76% cost advantage versus the in-house build alternative.

For UK GroceryTech, shopping apps, retail analytics firms, and price-comparison platforms, the era of daily-refresh data is functionally over. Real-time consumer products demand real-time data — and partners able to deliver hourly cycles at scale, sustainably, and compliantly are the ones that turn ambitious app visions into shipped, growing products.