Shein, Temu & Pinduoduo — Fast Fashion Trend Tracking via Web Scraping

Introduction

Beauty is the category where retail data is simultaneously the most abundant and the least cleanly instrumented. There are more SKUs, more brand launches, more promotional layers, and more creator-driven discovery moments per quarter in beauty than in almost any other category online. And yet most beauty brands and retailers still operate on quarterly competitive audits, last-month sell-through reports, and a vague sense of "what's trending."

The brands closing this gap in 2026 — across legacy department store labels, fast-growing DTC challengers, and multi-brand specialists — are starting to compound advantages that take years to catch up to. The two players that anchor the multi-brand beauty conversation in the US, Sephora and Ulta, are running visibly different data strategies. And the broader category is being reshaped by social commerce, AI-driven discovery, and the resurgence of in-store experience as a digital data input.

This is a look at how beauty e-commerce intelligence actually works, what brands and retailers should be tracking, and where the next wave of competitive insight is heading.

Why Beauty Is a Different Data Problem

Why Beauty Is a Different Data Problem

Beauty has structural characteristics that separate it from most other e-commerce categories:

  • High SKU velocity: Hundreds of new SKUs launch each month across the major beauty retailers. Limited editions, seasonal palettes, dupes of viral products — the catalog churn is constant.
  • Creator-led discovery: A higher share of beauty purchase decisions originate from social content (TikTok, Instagram, YouTube tutorials) than in almost any other category. Tracking creator activity is not optional; it's foundational.
  • Sample, swatch, and shade complexity: Foundation in 50 shades, lipstick in 30 colors, fragrance with multiple "notes" — beauty SKUs have attribute complexity that fashion doesn't, much less packaged goods.
  • Loyalty programs as data engines: Sephora's Beauty Insider, Ulta's Ultamate Rewards — these aren't just promotional tools; they're consumer behavior databases that shape merchandising, pricing, and assortment decisions internally.
  • Brand exclusives and launches: A meaningful share of beauty growth comes from retailer-exclusive launches. The category strategist who doesn't track exclusives across competitors is missing the most important signal.
  • Price elasticity that varies dramatically by sub-category: Prestige beauty (Tom Ford, La Mer) and masstige (NYX, e.l.f.) and indie (Glossier, Saie) all behave differently. A unified pricing intelligence strategy fails if it doesn't segment.

Put together: beauty intelligence is a multi-dimensional problem, and the brands and retailers winning are the ones with the breadth and granularity to handle it.

How Sephora and Ulta Compete Differently

From the outside, Sephora and Ulta operate visibly different data strategies that reflect their different competitive positions:

Sephora

Sephora's positioning leans prestige + luxury, with strong anchors in masstige and selective indie. Its data investments visibly emphasize brand launch curation, in-store + digital experience integration, and loyalty-program-driven personalization. The Beauty Insider program is one of the deepest behavioral databases in beauty, and the merchandising team's catalog decisions visibly reflect that data depth.

Ulta

Ulta's positioning is broader — prestige + mass + drugstore-tier all in the same store and on the same site. Ulta's data investments visibly emphasize breadth of assortment, services-as-a-data-stream (the salon and brow services generate unique customer behavior data), and price-tier-aware personalization. The Ultamate Rewards program shapes promotional cadence in ways that differ meaningfully from Sephora's approach.

The DTC Beauty Layer

Beyond Sephora and Ulta, a constantly evolving layer of DTC beauty brands (Glossier, Rare Beauty, Fenty Beauty, e.l.f., Saie, Tower 28, Kosas, and dozens of category-specific challengers) compete with multi-brand retailers for the same customer attention. Many launch in DTC first, then expand to Sephora or Ulta as a scaling channel — making "DTC vs. retailer" data a strategic conversation, not a binary choice.

The Five Data Streams Every Beauty Brand and Retailer Should Be Tracking

If you're a beauty brand, retailer, or DTC operator, here is the minimum data spine for serious competitive intelligence:

1. SKU-Level Pricing Across Multi-Brand Retailers + DTC

For your top 100 SKUs, the price across Sephora.com, Ulta.com, Amazon, Target, Walmart, and the brand's own DTC site, captured multiple times per day. With cardholder discount layers (Sephora Beauty Insider tiers, Ulta Ultamate Rewards) factored in.

2. New Launch Tracking (Yours and Competitors')

Every new SKU launched on Sephora or Ulta in the last 30 days, by category, by brand, by exclusivity status. New launches are the leading indicator of category strategy shifts — competitors expanding into your strongest categories, or retreating from them.

3. Shade and Variant Availability

For shade-and-variant-heavy categories (foundation, concealer, lipstick), tracking which variants are in stock, out of stock, or newly launched. A competitor who suddenly extends shade range is making a positioning move; missing it is missing the move.

4. Review and Rating Velocity

Beauty has some of the highest review volumes in e-commerce. A drop in your hero SKU's rating from 4.6 to 4.3 over four weeks usually signals product, packaging, or fulfillment issues that internal data hasn't surfaced. Sentiment trends are leading; sales are lagging.

5. Creator and Social Mention Activity

Beauty is the category where creator-driven mentions most directly translate to sell-through. Tracking creator activity around your SKUs and competitor SKUs across TikTok, Instagram Reels, and YouTube is now table stakes.

A Concrete Example: How Beauty Blindness Costs a DTC Brand

Consider a hypothetical mid-sized DTC beauty brand selling a hero $32 cream blush. Internal e-commerce metrics are healthy. The brand recently expanded distribution to Sephora. Initial sell-through looks promising. The team feels good about the launch.

What internal data isn't showing:

  • Two competing brands have launched cream blush variants priced at $24 and $19 respectively, both on Ulta's "Sephora-but-cheaper" positioning, and both gaining shelf space in Sephora's broader category browse.
  • A specific viral TikTok has identified the brand's $32 cream blush as a "dupe target" — meaning content creators are recommending the cheaper alternative as "basically the same product for less." The trend has quietly built over six weeks.
  • The brand's Sephora ratings have dropped from 4.5 to 4.2 stars due to a packaging issue (the formula ages faster than originally tested), but the brand's customer service team — operating with internal review aggregation — hasn't escalated this as a category-level issue yet.
  • Sephora's algorithmic ranking has quietly de-prioritized the brand's cream blush in search results for "cream blush" and adjacent keywords, given the conversion-to-rating ratio shift.

By the time the brand's leadership sees the picture, sell-through has flattened, and Sephora is having a conversation about whether to continue expanding the brand's footprint or de-list the underperforming SKU. Recovery will take 2–3 quarters of coordinated work.

The fix is not "marketing fix it." The fix is continuous beauty intelligence — pricing, ranking, ratings, and creator activity feeding into the same dashboards the merchandising and brand teams already use.

What a Beauty Intelligence Pipeline Looks Like

A serious beauty data layer typically does five things:

  • Multi-retailer crawling across Sephora, Ulta, Amazon, Target, Walmart, plus the brand's own DTC sites and direct competitors' DTC sites.
  • Shade-and-variant resolution — matching SKUs across retailers when colors are named differently, photographed differently, or sized differently.
  • Effective-price computation — applying loyalty tier discounts, promotional codes, and bundle pricing to surface the real out-the-door price.
  • Creator and social listening integration — feeding TikTok, Instagram, and YouTube creator activity into the same dashboard as pricing and ranking data, so brand teams see the picture in one place.
  • Delivery into the BI tools the team uses — Power BI, Looker, Tableau, or a purpose-built dashboard.

The hard part isn't crawling one Sephora product page. The hard part is doing it across thousands of beauty SKUs, with shade-variant resolution accurate enough that a brand manager can confidently take the data into a category review.

Shoptalk 2026: What to Watch in the Beauty Track

The beauty conversation at Shoptalk Spring 2026 will run through several sessions under the "Retail in the Age of AI" theme. Expect serious airtime for:

  • Sephora's leadership speaking to digital-physical integration, prestige positioning, and loyalty-driven personalization.
  • The DTC beauty playbook — how brands like Rare Beauty, Saie, Tower 28, and Kosas have built community-led growth.
  • Beauty + AI — virtual try-on, generative content for beauty, AI-driven shade matching, and personalization at scale.
  • Mass beauty's resurgence — e.l.f.'s positioning, Walmart's beauty growth, and the masstige category's continued expansion.
  • Social commerce in beauty — TikTok Shop's outsized impact on beauty sales, and how brand strategies are evolving in response.

The brands and retailers arriving at Shoptalk with hard data on their own digital shelf performance and creator strategy will get more out of the hallway conversations than those arriving with quarterly aggregate numbers.

What to Do Before Shoptalk

Three concrete moves any beauty brand or retailer can make in the next four weeks:

  • Pull a 30-day pricing and ranking snapshot of your top 30 SKUs across Sephora, Ulta, Amazon, and your DTC site. If you can't do this in an afternoon, you have a tooling gap.
  • Audit your hero SKUs' rating trajectory over the last 90 days. Anything trending down by more than 0.2 stars is a category emergency.
  • Map creator mention velocity for your top 10 SKUs vs. your top 5 competitors over the last 90 days. If you're behind, you have a creator strategy conversation, not a marketing budget conversation.
Want a head start? Download our Free Beauty Category Digital Shelf Report — a 30-day snapshot of pricing, ranking, ratings, and creator activity across the top 50 beauty brands on Sephora, Ulta, and Amazon. Useful before, during, and after Shoptalk.
Get the Free Report →

Conclusion

Actowiz Solutions builds beauty e-commerce intelligence pipelines for prestige, masstige, and DTC beauty brands. Track pricing, digital shelf visibility, ratings, new-launch velocity, and creator activity across Sephora, Ulta, Amazon, Target, and DTC sites through a single API or dashboard.

You can also reach us for all your mobile app scraping, data collection, web scraping , and instant data scraper service requirements!

Social Proof That Converts

Trusted by Global Leaders Across Q-Commerce, Travel, Retail, and FoodTech

Our web scraping expertise is relied on by 4,000+ global enterprises including Zomato, Tata Consumer, Subway, and Expedia — helping them turn web data into growth.

4,000+ Enterprises Worldwide
50+ Countries Served
20+ Industries
Join 4,000+ companies growing with Actowiz →
Real Results from Real Clients

Hear It Directly from Our Clients

Watch how businesses like yours are using Actowiz data to drive growth.

1 min
★★★★★
"Actowiz Solutions offered exceptional support with transparency and guidance throughout. Anna and Saga made the process easy for a non-technical user like me. Great service, fair pricing!"
TG
Thomas Galido
Co-Founder / Head of Product at Upright Data Inc.
2 min
★★★★★
"Actowiz delivered impeccable results for our company. Their team ensured data accuracy and on-time delivery. The competitive intelligence completely transformed our pricing strategy."
II
Iulen Ibanez
CEO / Datacy.es
1:30
★★★★★
"What impressed me most was the speed — we went from requirement to production data in under 48 hours. The API integration was seamless and the support team is always responsive."
FC
Febbin Chacko
-Fin, Small Business Owner
icons 4.8/5 Average Rating
icons 50+ Video Testimonials
icons 92% Client Retention
icons 50+ Countries Served

Join 4,000+ Companies Growing with Actowiz

From Zomato to Expedia — see why global leaders trust us with their data.

Why Global Leaders Trust Actowiz

Backed by automation, data volume, and enterprise-grade scale — we help businesses from startups to Fortune 500s extract competitive insights across the USA, UK, UAE, and beyond.

icons
7+
Years of Experience
Proven track record delivering enterprise-grade web scraping and data intelligence solutions.
icons
4,000+
Projects Delivered
Serving startups to Fortune 500 companies across 50+ countries worldwide.
icons
200+
In-House Experts
Dedicated engineers across scrapers, AI/ML models, APIs, and data quality assurance.
icons
9.2M
Automated Workflows
Running weekly across eCommerce, Quick Commerce, Travel, Real Estate, and Food industries.
icons
270+ TB
Data Transferred
Real-time and batch data scraping at massive scale, across industries globally.
icons
380M+
Pages Crawled Weekly
Scaled infrastructure for comprehensive global data coverage with 99% accuracy.

AI Solutions Engineered
for Your Needs

LLM-Powered Attribute Extraction: High-precision product matching using large language models for accurate data classification.
Advanced Computer Vision: Fine-grained object detection for precise product classification using text and image embeddings.
GPT-Based Analytics Layer: Natural language query-based reporting and visualization for business intelligence.
Human-in-the-Loop AI: Continuous feedback loop to improve AI model accuracy over time.
icons Product Matching icons Attribute Tagging icons Content Optimization icons Sentiment Analysis icons Prompt-Based Reporting

Connect the Dots Across
Your Retail Ecosystem

We partner with agencies, system integrators, and technology platforms to deliver end-to-end solutions across the retail and digital shelf ecosystem.

icons
Analytics Services
icons
Ad Tech
icons
Price Optimization
icons
Business Consulting
icons
System Integration
icons
Market Research
Become a Partner →

Popular Datasets — Ready to Download

Browse All Datasets →
icons
Amazon
eCommerce
Free 100 rows
icons
Zillow
Real Estate
Free 100 rows
icons
DoorDash
Food Delivery
Free 100 rows
icons
Walmart
Retail
Free 100 rows
icons
Booking.com
Travel
Free 100 rows
icons
Indeed
Jobs
Free 100 rows

Latest Insights & Resources

View All Resources →
thumb
Blog

How We Empowered a Cereal Brand to Win 18% More Shelf Visibility Using Albertsons Product & Promotion Data Scraping?

Albertsons Product & Promotion Data Scraping helps brands track pricing, discounts, inventory, and promotional trends for smarter retail decisions.

thumb
Case Study

Sharaf DG & Jumbo Electronics Pricing for a UAE Consumer Tech Brand

Real-time pricing across Sharaf DG, Jumbo & Lulu Electronics for UAE consumer tech brands. MAP enforcement & festival promo tracking by Actowiz Solutions.

thumb
Report

Mother's Day 2025 E-commerce Insights — What Brands Should Expect in 2026

Mother's Day 2025 E-commerce Insights report — 47,000+ SKUs across 12 platforms. Pricing, discounts, stock-outs & what brands should expect in 2026.

Start Where It Makes Sense for You

Whether you're a startup or a Fortune 500 — we have the right plan for your data needs.

icons
Enterprise
Book a Strategy Call
Custom solutions, dedicated support, volume pricing for large-scale needs.
icons
Growing Brand
Get Free Sample Data
Try before you buy — 500 rows of real data, delivered in 2 hours. No strings.
icons
Just Exploring
View Plans & Pricing
Transparent plans from $500/mo. Find the right fit for your budget and scale.
Get in Touch
Let's Talk About
Your Data Needs
Tell us what data you need — we'll scope it for free and share a sample within hours.
  • icons
    Free Sample in 2 HoursShare your requirement, get 500 rows of real data — no commitment.
  • icons
    Plans from $500/monthFlexible pricing for startups, growing brands, and enterprises.
  • icons
    US-Based SupportOffices in New York & California. Aligned with your timezone.
  • icons
    ISO 9001 & 27001 CertifiedEnterprise-grade security and quality standards.
Request Free Sample Data
Fill the form below — our team will reach out within 2 hours.
+1
Free 500-row sample · No credit card · Response within 2 hours

Request Free Sample Data

Our team will reach out within 2 hours with 500 rows of real data — no credit card required.

+1
Free 500-row sample · No credit card · Response within 2 hours