German companies rarely buy web data on price alone. Before a contract is signed, Einkauf wants a clear scope and SLA, the Datenschutzbeauftragte wants to know whether personal data is involved, and IT security wants to see how data reaches your systems. A good web scraping provider in Germany should make all three conversations easy.
Short answer: To choose a web scraping provider in Germany, confirm five things in writing: which public sources and fields are in scope, whether any personal data is collected (this decides if you need an Art. 28 AVV), how database-right and site-terms questions are handled, where data is processed and delivered (EU options), and which SLA, QA checks and pilot you get before committing.
This guide covers the German sources that matter, the legal basics with official sources, a due-diligence table for your RFP, and a sensible pilot. It is general information, not legal advice; involve your own counsel and DPO.
Most demand comes from pricing, category and channel teams that need one reliable view of many shops:
Building this in-house means maintaining scrapers, handling layout changes and matching products by EAN/GTIN. That is why many teams prefer a managed feed from a web scraping provider, and why procurement treats the choice as a vendor-risk decision.
Coverage is the first filter. Ask each provider to confirm the exact sources, the fields per source, and the refresh frequency they can support. The table below shows the platforms German buyers ask about most often, with typical public fields and practical notes.
| Platform | Category | Typical public fields | Practical notes for buyers |
|---|---|---|---|
| Amazon.de | Marketplace, all categories | Price (EUR), Buy Box seller, offers count, rating count, rank, availability, delivery promise | Prices change many times per day; check refresh options and Buy Box logic |
| Otto (otto.de) | Marketplace, home, fashion, electronics | Price, former price, seller, availability, delivery time | Growing third-party seller share; capture the seller field |
| Kaufland.de | Marketplace, broad assortment | Price, seller, shipping cost, availability | Same EAN often has several sellers; ask how offers are grouped |
| MediaMarkt / Saturn | Consumer electronics | Online price, promo price, online stock, click-and-collect signal | Variant resolution (colour, memory size) matters for matching |
| idealo | Price comparison | Lowest price, offer count, shop list per product | Useful as a market-wide price index; read the listed shop prices, not personal data |
| Zalando | Fashion and lifestyle | Price, discount, size availability, brand | Size-level stock is often the key signal |
| eBay.de | Marketplace, new and used | Fixed price, condition, seller type, shipping cost | Many sellers are private individuals; exclude or minimise seller identity fields |
| Lidl / Aldi online | Discount retail, non-food online shops | Price, weekly offer flags, availability | Online assortment differs from store; confirm what "price" means |
| REWE / EDEKA online | Grocery | Shelf price, unit price (Grundpreis), promotions, availability | Prices and assortment can depend on delivery postcode or store; agree the postcodes in scope |
| dm / Rossmann | Drugstore | Price, unit price, promotions, availability | Strong private-label share; matching to brand equivalents needs rules |
| Check24 | Comparison (travel, energy, insurance and more) | Public, non-personalised listing results only (for example published hotel or package prices) | No quote flows that require personal details; agree search parameters in advance |
Write two points into the contract: public pages only, with no login to customer accounts, and a fixed field list per source, so nobody adds personal data later "because it was on the page".
A clear field list prevents most disputes. A typical German price-intelligence feed covers:
Ask how products are matched: EAN first, then model and attributes, with confidence scores and manual review.
This is usually the first question from the DPO. The GDPR (DSGVO) applies only to personal data, meaning information about an identified or identifiable natural person (Art. 4(1) GDPR, https://eur-lex.europa.eu/eli/reg/2016/679/oj).
A contract under Art. 28 GDPR, called an Auftragsverarbeitungsvertrag (AVV) in Germany, is needed when a provider processes personal data on your behalf and on your instructions. The EDPB explains how to decide who is controller and who is processor in its Guidelines 07/2020 (https://www.edpb.europa.eu/our-work-tools/our-documents/guidelines/guidelines-072020-concepts-controller-and-processor-gdpr_en). The German federal commissioner, the BfDI (https://www.bfdi.bund.de), and the state data protection authorities publish guidance in German as well.
In practice, three situations come up:
| Situation | Personal data involved? | AVV typically needed? |
|---|---|---|
| Product prices, stock, EANs and business seller names (GmbH, AG, shops) | Generally no | Usually not for the data itself; many buyers still sign a standard AVV or data protection addendum for support contacts and accounts |
| Marketplace offers where some sellers are private individuals or sole traders (eBay.de, Amazon.de, Kaufland.de) | Possibly yes (names of natural persons) | Exclude or pseudonymise these fields; if they stay in scope, agree roles and an AVV with your DPO |
| Reviews with reviewer names, profile links or free text about people | Yes | Avoid unless there is a clear purpose and legal basis; prefer aggregated rating counts |
Two more points for the DPO:
For a deeper look at lawful basis and BDSG specifics, see our guide on GDPR and BDSG web scraping compliance in Germany (link in Related reading).
Data protection is only one part. German law also protects databases and copyright works. These rules are summarised neutrally here; whether they apply depends on the facts, so ask your counsel.
For buyers, this means asking your web scraping provider how it limits extraction to the fields and volumes you need, how it respects machine-readable reservations and site terms, and how it handles an objection from a source. A provider that collects "everything just in case" creates risk for you.
German IT security teams usually send a questionnaire first. Expect questions on:
Actowiz Solutions' security documentation and any certifications. Do not accept vague claims from any provider; ask for the certificate, its scope and its validity date.
Data residency is often a requirement in German RFPs, even when the data is not personal. Discuss these options with your provider:
Actowiz delivery options and processing locations for German projects
Peak seasons stress every pipeline. Agree higher refresh rates and support cover in advance.
| Event | Typical timing | What to monitor | Suggested refresh |
|---|---|---|---|
| Amazon Prime Day / Prime Big Deal Days | Summer event, plus an autumn deals event | Deal prices, Lightning Deals, competitor reactions on Otto and Kaufland.de | Hourly or several times per day on key SKUs |
| Singles Day | 11 November | Fashion and electronics promotions, Zalando and marketplace coupons | Daily, with intraday checks on the day |
| Black Friday / Cyber Week | Late November to Cyber Monday | Strike-through prices, UVP comparisons, stock-outs, idealo lowest price | Several times per day across the week |
| Christmas season | Late November to 24 December | Availability, delivery cut-off promises, price moves in toys, electronics, drugstore gift sets | Daily, plus stock checks on bestsellers |
Put peak-season refresh, delivery and fix times into the SLA.
Copy this table into your RFP when assessing any web scraping provider in Germany.
| Question | Why it matters | What a good answer looks like |
|---|---|---|
| Which German sources, fields and refresh rates are in scope? | Prevents scope creep and surprise costs | A written source-by-field list with refresh frequency per source |
| Is any personal data collected? | Decides GDPR obligations and AVV need | "No by default"; private-seller and reviewer fields excluded or pseudonymised in writing |
| Will you sign an AVV / data protection addendum if needed? | DPO sign-off | Yes, with clear roles, sub-processor list and deletion terms |
| How do you handle site terms, robots.txt and machine-readable TDM reservations? | Database right, § 44b UrhG and contract risk | A documented source policy, no login bypass, a takedown process |
| Where is data processed and stored? | Data residency and transfer rules | Named locations, EU delivery options such as Frankfurt regions |
| Which security certifications and documents can you share? | IT security approval | Certificates with scope and dates, or a completed questionnaire |
| What QA checks run before delivery? | Bad data leads to bad pricing decisions | Schema checks, price sanity ranges, duplicate checks, coverage reports per run |
| How are products matched across retailers? | Comparisons are only as good as matching | EAN-first matching, attribute rules, confidence scores, manual review |
| What is the SLA? | Business continuity in peak season | Delivery time, uptime, fix time for broken sources, peak-season terms |
| Who may use the delivered data, and how? | Usage rights | Clear licence terms for internal analysis and named use cases |
| Can we run a paid or free pilot on our own SKUs? | Proof before commitment | A short pilot on your retailers, your SKUs, with a sample in 48 hours |
A short pilot answers most questions faster than long RFP rounds:
Not always. Prices, EANs and stock data about companies are generally not personal data, so Art. 28 GDPR may not apply to the data itself. If private-seller names, reviewer details or other personal data are in scope, agree roles and an AVV with your DPO.
Collecting publicly available business data can be lawful, but it depends on the data, the volume and the source. GDPR, the database maker's right (§§ 87a ff. UrhG), § 44b UrhG and site terms can all be relevant. This guide is not legal advice; ask your counsel.
Yes, this is a common requirement. Discuss delivery into your own EU cloud, for example S3 in Frankfurt or Azure Germany West Central, and ask where collection and processing take place.
Typical scopes include Amazon.de, Otto, Kaufland.de, MediaMarkt/Saturn, idealo, Zalando, eBay.de, REWE, EDEKA, dm and Rossmann, using public pages only. Confirm fields and refresh rates per source.
A focused pilot on a few retailers and a few hundred SKUs can produce a sample within 48 hours. Use it to check accuracy, matching and delivery before you sign.
You can also reach us for all your mobile app scraping, data collection, web scraping, and instant data scraper service requirements!
Our web scraping expertise is relied on by 4,000+ global enterprises including Zomato, Tata Consumer, Subway, and Expedia — helping them turn web data into growth.
Watch how businesses like yours are using Actowiz data to drive growth.
From Zomato to Expedia — see why global leaders trust us with their data.
Backed by automation, data volume, and enterprise-grade scale — we help businesses from startups to Fortune 500s extract competitive insights across the USA, UK, UAE, and beyond.
We partner with agencies, system integrators, and technology platforms to deliver end-to-end solutions across the retail and digital shelf ecosystem.
Use this web data RFP checklist to define scope, sources, fields, SLA, QA and pricing models, then score vendors fairly.
Sensitive Skin Skincare Product Data API helps brands track cleansers, serums, moisturizers, and sunscreens with structured product data.
German marketplace data report 2026: online retail size, Amazon.de, Otto, Kaufland and Zalando price signals, PAngV rules and peak seasons.
Whether you're a startup or a Fortune 500 — we have the right plan for your data needs.