Case Study: Grocery Price Monitoring in Berlin – Using Scraped Data to Track Retail Trends

Background

As Berlin continues to evolve as a digital-first urban hub, its grocery retail sector has become more competitive than ever. Online platforms of leading grocery chains like Lidl and REWE update prices, discounts, and product availability daily. For retailers and FMCG companies, real-time visibility into these changes is crucial.

To address this, Actowiz Solutions provided a Berlin-based retail analytics firm with a web scraping solution that continuously monitored grocery prices across top products and categories—enabling fast, data-driven responses to retail trends.

Client Overview

• Client: Berlin-based retail analytics startup
• Target Market: Supermarkets, FMCG brands, retail consultants
• Main Challenge: Inability to track dynamic pricing across Lidl and REWE websites in real time
• Goal: Use web-scraped data to create a live grocery pricing dashboard for Berlin

Project Objectives

• 1. Scrape grocery prices and stock status from Lidl.de and REWE.de for Berlin-based stores
• 2. Monitor competitor discount patterns and weekly offers
• 3. Create a city-specific price index across product categories
• 4. Deliver trend visualizations to support client strategy teams

Technology Stack Used

• Selenium + Scrapy for dynamic page rendering
• Geo-targeting to simulate Berlin user location
• Python-based scheduler for hourly data fetches
• Google Data Studio dashboard for visual output
• API + CSV export for client teams and BI integration

Results for the Client

1. Live Grocery Dashboard for Berlin

The client launched a dashboard showing real-time price changes across categories like dairy, snacks, beverages, and cleaning supplies, localized to Berlin districts.

2. Discount Detection Alerts

Actowiz integrated alert flags that detected flash sales, bundle offers, and weekend promotions—allowing retailers to match or respond within hours.

3. Retail Trend Analysis

The data enabled weekly reports showing:

• Price movement patterns
• Discount frequency by product category
• Stock shortages as demand indicators

4. Improved Price Strategy

The client’s FMCG customers used the scraped data to adjust online and in-store pricing strategies, leading to better margin control and reduced price mismatch penalties.

Challenges Resolved

• Geo-specific Data Extraction: Handled using Berlin-targeted scraping scripts and IP routing
• Promotion Tracking: Captured temporary banners, bundle deals, and loyalty card discounts
• Hourly Update Syncing: Used lightweight scrapers to avoid detection and ensure fast refresh rates
• Unit Normalization: Converted all pricing to per-unit basis (e.g., €/L, €/kg) for clean comparisons

Client Testimonial

“Actowiz Solutions helped us bring Berlin’s grocery market into focus. Their web scraping solution gave our analysts real-time access to pricing and promo trends. It’s become a vital tool for our clients.”

— Head of Data Operations, Berlin Retail Insights

Conclusion

In Berlin’s fast-moving grocery environment, static reports and delayed audits no longer suffice. Real-time insights from web scraping are transforming how retailers and brands monitor prices, detect trends, and stay competitive.

With Actowiz Solutions, the client created a first-of-its-kind city-level grocery price tracker empowering Berlin’s retailers to make better, faster, and data-backed decisions.