Product SKU Data Scraping: Description, Image & Specifications Extraction

About the Client

Location: Chicago, USA

Industry: E-commerce & Product Distribution

Objective: To extract detailed product data for 200 SKUs (initial batch) — including images, descriptions, specifications, and identifiers (UPC/MPN) — from multiple manufacturer and retailer websites.

The client's ultimate goal was to build a comprehensive master catalog for internal listing and marketplace uploads. Upon successful delivery, the project would scale to 2,000+ SKUs across multiple brands and categories.

Project Overview

The client required structured product data suitable for uploading to marketplaces like Amazon, Walmart, Shopify, and eBay. Each SKU needed verified and enriched fields including:

Primary Fields (High Priority)

• Product Name
• Full Description
• High-Resolution Image URLs

Secondary Fields

• MPN / UPC / EAN
• Weight & Dimensions
• Color / Material
• Technical Specifications
• Category / Subcategory
• Price (where public)

Output Format: Excel or CSV

Accuracy Target: ≥ 98% verified completeness

The Challenge

Extracting detailed product data across hundreds of SKUs seems simple, but it presents multiple technical and operational challenges:

• Inconsistent Product Pages: Each manufacturer's layout and tag structure vary, requiring site-specific scrapers.
• Image Handling: Some websites store multiple image versions or use lazy loading, which complicates direct URL extraction.
• Incomplete or Hidden Data: Many product pages hide MPN, weight, or specifications behind tabs or JavaScript.
• Data Quality: Descriptions may include HTML tags, repeated text, or embedded special characters that must be cleaned.
• Volume & Scalability: While the initial batch was 200 SKUs, the long-term plan involved 2,000+ SKUs, demanding scalable infrastructure.

Goals & Deliverables

Actowiz Solutions was tasked to:

• Scrape product data for 200 SKUs with no missing entries.
• Deliver the following key fields per SKU:
• Description (text + HTML cleaned)
• Primary Image URL(s)
• MPN/UPC/EAN
• Weight, Color, Specifications
• Output the dataset in Excel and CSV.
• Maintain a data quality report outlining:
• Total items processed
• Fields completed per item
• Missing or inferred values

Scraping Workflow

[ Product URLs / SKU List ]

↓

[ Scrapy Spider → Playwright Renderer (for dynamic sites) ]

↓

[ Extraction Layer ]

→ Product Title

→ Description (clean HTML)

→ Image URLs

→ Specs (Weight, Color, etc.)

↓

[ Validation & Deduplication ]

↓

[ Data Cleaning & Normalization ]

↓

[ Export → Excel / CSV + Quality Report ]

Data Cleaning Example

Before Cleaning:

<p><b>Features:</b><br>High-quality material<br>Available in red and black<br><script>alert('promo');</script></p>

After Cleaning:

Features: • High-quality material • Available in red and black

Infographic Concept – "How Actowiz Scrapes SKU-Level Product Data"

Challenges Solved

• Multiple Layouts, One Parser: Unified schema mapping allowed extraction from dozens of page structures.
• Image Parsing Consistency: Implemented fallback logic for alternate <meta property="og:image"> tags.
• Data Gaps: Implemented rule-based inference (e.g., color from title text).
• Scalability: Pipeline prepared for 10× more SKUs without performance issues.

Project Outcome

• Delivered clean Excel dataset with all 200 products fully enriched.
• Met 100% of priority field requirements.
• Validated images and descriptions for eCommerce listing readiness.
• Developed scraper capable of handling 2,000+ SKUs in future batches.

Client Benefits

• Faster Catalog Creation: Eliminated manual entry time.
• Accurate Product Data: Improved buyer confidence on listings.
• Marketplace Compatibility: CSV ready for Amazon, Shopify, WooCommerce.
• Scalable Framework: Easily expandable to thousands of SKUs.

Client Testimonial

“Actowiz Solutions provided a complete product dataset, clean and verified. The SKU scraping was accurate, and every image and specification matched perfectly. We plan to expand to 2,000+ items with their support.”

— Product Data Manager, Chicago-based E-commerce Distributor

Ethical & Compliance Practices

• Collected publicly available product information only.
• No bypassing of CAPTCHAs or restricted data sources.
• Followed robots.txt and fair-use scraping policies.
• Data used solely for internal product catalog creation.

Actowiz Solutions ensures full compliance with international data protection standards and ethical data sourcing norms.

Why Choose Actowiz Solutions

• Experience with large-scale SKU & eCommerce scraping.
• Expertise in image extraction, HTML cleaning, and spec mapping.
• Scalable, reliable Python-based infrastructure.
• End-to-end delivery with accuracy and documentation.

Future Enhancements

• Add real-time price monitoring from multiple retailers.
• Integrate AI-based product classification by category.
• Enable API-based delivery to sync SKU data automatically.
• Expand to competitor benchmarking and stock tracking.

Conclusion

This case study demonstrates how Actowiz Solutions helped an eCommerce client automate SKU-level data extraction from multiple product websites, covering descriptions, images, and technical specs with near-perfect accuracy.

By leveraging Python Scrapy + Playwright, the solution delivered verified, ready-to-use product data—reducing manual effort by over 90% and setting the stage for future large-scale catalog updates.

Whether for marketplaces, distributors, or analytics teams, Actowiz Solutions provides the tools and expertise to convert scattered web data into structured, actionable product intelligence.