Start Your Project with Us

Whatever your project size is, we will handle it well with all the standards fulfilled! We are here to give 100% satisfaction.

  • Any feature, you ask, we develop
  • 24x7 support worldwide
  • Real-time performance dashboard
  • Complete transparency
  • Dedicated account manager
  • Customized solutions to fulfill data scraping goals
Careers

For job seekers, please visit our Career Page or send your resume to hr@actowizsolutions.com

Real-Time Regional Insights with Customizable E-commerce Dashboards

Background

As Berlin continues to evolve as a digital-first urban hub, its grocery retail sector has become more competitive than ever. Online platforms of leading grocery chains like Lidl and REWE update prices, discounts, and product availability daily. For retailers and FMCG companies, real-time visibility into these changes is crucial.

To address this, Actowiz Solutions provided a Berlin-based retail analytics firm with a web scraping solution that continuously monitored grocery prices across top products and categories—enabling fast, data-driven responses to retail trends.

Client Overview

  • Client: Berlin-based retail analytics startup
  • Target Market: Supermarkets, FMCG brands, retail consultants
  • Main Challenge: Inability to track dynamic pricing across Lidl and REWE websites in real time
  • Goal: Use web-scraped data to create a live grocery pricing dashboard for Berlin

Project Objectives

The-Client
  • 1. Scrape grocery prices and stock status from Lidl.de and REWE.de for Berlin-based stores
  • 2. Monitor competitor discount patterns and weekly offers
  • 3. Create a city-specific price index across product categories
  • 4. Deliver trend visualizations to support client strategy teams

Scraping Strategy by Actowiz Solutions

Targeted Sites:
  • [✓] Lidl Berlin Storefront (Online weekly deals, product listings)
  • [✓] REWE Berlin Store Page (Online catalog, member pricing, availability)
Scraped Data Fields:
Data Field Sample – Lidl Berlin Sample – REWE Berlin
Product Name Ja! Organic Whole Milk 1L REWE Beste Wahl Milk 1L
Category Dairy Dairy
Price (EUR) €0.95 €1.09
Discount 10% Off 2 for €2
Availability In Stock Low Stock
Unit Size 1 Liter 1 Liter
Store Location Berlin – Alexanderplatz Berlin – Prenzlauer Berg
Last Updated Hourly Hourly

Technology Stack Used

The-Client
  • Selenium + Scrapy for dynamic page rendering
  • Geo-targeting to simulate Berlin user location
  • Python-based scheduler for hourly data fetches
  • Google Data Studio dashboard for visual output
  • API + CSV export for client teams and BI integration

Key Insights Delivered

📉 Price Comparison by Store
Product Lidl Price REWE Price Price Difference
Coca-Cola Zero 1.5L €1.29 €1.45 -11%
Nutella 750g €3.39 €3.19 +6%
Fresh Bananas (per kg) €1.89 €2.09 -9.6%
Persil Gel Detergent 1.5L €5.49 €5.75 -4.5%

Insight: Lidl often undercut REWE by 5–10% on essentials like beverages, bananas, and household items, while REWE retained premium pricing on branded goods.

Results for the Client

The-Client
1. Live Grocery Dashboard for Berlin

The client launched a dashboard showing real-time price changes across categories like dairy, snacks, beverages, and cleaning supplies, localized to Berlin districts.

2. Discount Detection Alerts

Actowiz integrated alert flags that detected flash sales, bundle offers, and weekend promotions—allowing retailers to match or respond within hours.

3. Retail Trend Analysis

The data enabled weekly reports showing:

  • Price movement patterns
  • Discount frequency by product category
  • Stock shortages as demand indicators
4. Improved Price Strategy

The client’s FMCG customers used the scraped data to adjust online and in-store pricing strategies, leading to better margin control and reduced price mismatch penalties.

Challenges Resolved

  • Geo-specific Data Extraction: Handled using Berlin-targeted scraping scripts and IP routing
  • Promotion Tracking: Captured temporary banners, bundle deals, and loyalty card discounts
  • Hourly Update Syncing: Used lightweight scrapers to avoid detection and ensure fast refresh rates
  • Unit Normalization: Converted all pricing to per-unit basis (e.g., €/L, €/kg) for clean comparisons

Client Testimonial

“Actowiz Solutions helped us bring Berlin’s grocery market into focus. Their web scraping solution gave our analysts real-time access to pricing and promo trends. It’s become a vital tool for our clients.”

— Head of Data Operations, Berlin Retail Insights

📩 Want to monitor grocery prices in your city? Reach out to Actowiz Solutions to build your own city-wise price tracking system.
Contact Us Today!

Conclusion

In Berlin’s fast-moving grocery environment, static reports and delayed audits no longer suffice. Real-time insights from web scraping are transforming how retailers and brands monitor prices, detect trends, and stay competitive.

With Actowiz Solutions, the client created a first-of-its-kind city-level grocery price tracker empowering Berlin’s retailers to make better, faster, and data-backed decisions.