A client needing roughly 30 different websites scraped for specific fields — with full source code to re-run in-house anytime, precise clean data, and output ready to import straight into WordPress.

Service

Custom Web Scraping • Source-Code Delivery

Scope

~30 target websites

Ownership

Full source + project files handed over

Websites Scraped

Unified Config-Driven Codebase

Manual

Run-Anytime Control

WP-Ready

Clean Import Export

Contact Sales

Client Overview

The client needed specific data extracted from roughly 30 different websites and consolidated into clean, structured records ready to import into a WordPress installation. Beyond a one-time data pull, they wanted lasting control: full source code and all project files, so their own team could run any scraper manually whenever needed — without depending on an external service each time.

Their two non-negotiables were precision and portability. Every exported field had to be clean and correctly typed, and the final output had to drop straight into WordPress without manual reformatting. Actowiz proposed a single, config-driven scraper architecture that covers all sites from one maintainable codebase while keeping each site independently runnable.

The Challenge

30 structurally different websites. Each target site has its own HTML structure, pagination, and rendering behaviour, yet all had to feed one consistent output — demanding an architecture that isolates per-site logic without fragmenting into 30 unmaintainable scripts.
Run-anytime, in-house. The client needed to execute any scraper manually on demand, so the deliverable had to be self-contained, documented, and simple to run — not a black-box hosted service.
Full ownership, no lock-in. All source code and project files had to be handed over, giving the client complete control and independence from any single vendor.
Exact-precision export. Fields had to be captured and typed with precision — no truncation, no HTML artefacts, no malformed values — so downstream data could be trusted.
WordPress-ready output. The export had to conform to a clean, predictable schema that imports directly into WordPress, with the right columns, encoding, and formatting.
Maintainability over time. Websites change; the solution had to make adding, fixing, or updating a single site straightforward rather than a full rebuild.

The Solution by Actowiz Solutions

Actowiz delivered a single config-driven scraper: one core engine plus a lightweight configuration for each of the ~30 sites. This gives the client the best of both worlds — one codebase to maintain, and the ability to run every site individually or all at once.

Architecture

Unified core engine. Shared logic handles requests, retries, rendering, pagination, field cleaning, validation, and export — written once, reused across every site.
Per-site config modules. Each website is defined by its own config (URLs, selectors/field mapping, pagination rules). Adding or fixing a site means editing one config, not touching the engine.
Manual run interface (CLI). A simple command runs one site, a subset, or all sites — e.g., run everything, or target a single site on demand — matching the client's "run anytime" requirement.
Cleaning & validation layer. Every field passes through type enforcement, whitespace/HTML stripping, encoding normalisation, and rule checks so output is exact and consistent.
WordPress-ready exporter. Records are written to a clean, WordPress-import-friendly file (CSV/XML) with standardised headers, UTF-8 encoding, and correct field formatting for direct import.
Full handover. Complete source code, all per-site configs, and run/setup documentation delivered to the client for permanent in-house use.

Project Structure (Illustrative)

Component	Role
/core	Shared engine — fetching, rendering, pagination, cleaning, export
/sites/site_01 … site_30	One config per website: URLs, field mapping, pagination rules
/output	Generated WordPress-ready CSV/XML files
run.py	CLI entry point — run one site, several, or all
/docs	Setup and run instructions for the client's team

Field Cleaning & Precision Rules

Rule	What It Guarantees
Type enforcement	Prices, dates, and numbers stored in correct, consistent formats
HTML / whitespace stripping	No stray tags, entities, or padding in text fields
Encoding normalisation	UTF-8 output — no broken characters on WordPress import
Required-field checks	Mandatory fields never blank; incomplete records flagged
Deduplication	No duplicate records across a run
Schema conformance	Output columns match the agreed WordPress import mapping exactly

Implementation Workflow

Step	Phase	Description
1	Scope & Field Mapping	Confirm the ~30 target sites, the exact fields per site, and the WordPress import target (columns, post type, media handling).
2	Schema Design	Define one clean output schema aligned to the WordPress importer, with per-site field mapping into it.
3	Core Engine Build	Build the shared engine — fetching, rendering, pagination, cleaning, validation, export.
4	Per-Site Configs	Implement and test a config for each website against the unified schema.
5	QA & Precision Validation	Validate output for accuracy, cleanliness, encoding, and WordPress import compatibility.
6	Handover	Deliver full source, all configs, and run documentation for in-house, run-anytime use.

Sample Output (Illustrative)

A representative WordPress-ready row — clean, typed, and import-ready:

Column	Value
post_title	Wireless Noise-Cancelling Headphones
post_content	Clean description text — no HTML tags or entities
price	249.00
sku	WH-1000-BLK
category	Audio > Headphones
image_url	https://…/images/wh-1000-blk.jpg
source_site	site_07
scraped_at	2026-08-25 (UTC)

Results & Business Impact

One codebase, thirty sites. A single config-driven scraper replaced the burden of 30 separate scripts — far easier to run, maintain, and extend.
Full in-house control. With complete source code and configs handed over, the client re-runs any scraper manually, anytime, with no external dependency.
Import-ready, zero reformatting. Clean, precise, WordPress-ready output imports directly — no manual cleanup between extraction and publishing.
Trustworthy data. Type enforcement, HTML stripping, encoding normalisation, and validation guaranteed exact-precision fields.
Future-proof & maintainable. Adding or fixing a site is a config change, not a rebuild — protecting the investment as target sites evolve.

Why the Client Chose Actowiz Solutions

Right architecture, not just scripts. A maintainable, config-driven design over 30 brittle one-off scrapers.
True ownership. Full source-code and project-file handover — no vendor lock-in.
Run-anytime simplicity. A clean CLI so the client's own team runs any site on demand.
Precision-first QA. Cleaning and validation built into the pipeline, not bolted on afterward.
WordPress-native output. Export designed around the client's import process from day one.

Project at a Glance

Metric	Value
Service	Custom multi-site web scraping with source-code delivery
Scope	~30 target websites
Architecture	Single config-driven codebase (core engine + per-site configs)
Execution	Manual run — one site, several, or all, on demand
Data Quality	Type-enforced, HTML-stripped, UTF-8, validated, deduplicated
Output Format	WordPress-import-ready CSV / XML
Deliverables	Full source code, all configs, run documentation
Ownership	100% handed over to the client — no lock-in

Client Feedback

"We expected thirty tangled scripts we'd be afraid to touch. Instead we got one clean project we actually understand — we run whichever sites we need, and the data drops straight into WordPress with nothing to fix. Exactly what we asked for."

— Project Owner, Client Team

Need a custom multi-site scraper you fully own?

Actowiz Solutions designs custom, maintainable scraping codebases with rigorous QA, clean import-ready output, and full source-code handover. Visit actowizsolutions.com to discuss your data requirement.

Hear It Directly from Our Clients

Watch how businesses like yours are using Actowiz data to drive growth.

▶

1 min

★★★★★

"Actowiz Solutions offered exceptional support with transparency and guidance throughout. Anna and Saga made the process easy for a non-technical user like me. Great service, fair pricing!"

Thomas Galido

Co-Founder / Head of Product at Upright Data Inc.

▶

2 min

★★★★★

"Actowiz delivered impeccable results for our company. Their team ensured data accuracy and on-time delivery. The competitive intelligence completely transformed our pricing strategy."

Iulen Ibanez

CEO / Datacy.es

▶

1:30

★★★★★

"What impressed me most was the speed — we went from requirement to production data in under 48 hours. The API integration was seamless and the support team is always responsive."

Febbin Chacko

-Fin, Small Business Owner