Logistics & Freight Data Scraping

No. Contracted rates are confidential commercial terms between shipper and carrier, and they are not available from any public source — not to us and not to any vendor claiming otherwise.

What we collect is published tariff rates, spot indicative rates where published, and retail list pricing for parcel. Every record carries rate_type so the basis is never ambiguous. Published rates sit above contracted levels, and we state that rather than implying they represent market clearing prices.

Because surcharges are frequently half the all-in cost, change on different cycles from the base rate, and are published in separate documents. A stable base rate with three new surcharges is a rate increase that base-rate tracking will never show.

We deliver surcharges as an array with codes, amounts and effective dates, plus an all-in convenience estimate whose applicability assumptions we document. Which surcharges apply depends on your terms, so a single all-in number that assumes someone else's terms is not your cost.

Yes, and it is the core technical work in this service. Our surcharge extraction rate is around 94%, with every figure carrying a source_ref pointing at the document and page.

That traceability matters because freight cost figures get challenged in procurement conversations. A surcharge amount you can trace to a specific page of a carrier's own circular is evidence; the same number without provenance is an assertion.

Near real time on official notice sources, typically within minutes of publication. But speed is not the constraint that matters in this category — relevance is.

We match events against your lane, port and service set before delivery, deduplicate the same event announced by a port authority and three carriers into one record, and classify by type and severity. An alert stream you read daily is worth far more than one that is ten minutes faster and ignored within a fortnight.

Ocean FCL and LCL, air cargo, road and parcel, each with mode-appropriate structure rather than forced into one schema. Ocean carries equipment type and transhipment structure; air carries weight breaks; parcel carries zone pairs and dimensional weight rules.

Parcel has the most complete published pricing because small shippers genuinely pay list rates, which makes it the mode where public data most closely reflects transacted cost. Ocean published tariffs diverge furthest from contracted reality.

Yes, as structured events with affected service, voyage and effective dates. Blank sailing announcements are among the more valuable disruption signals because they precede capacity tightening and rate movement.

The caveat is announcement discipline: carriers publish these with varying notice and completeness, and some capacity changes are never formally announced. We collect what is published and are explicit that this is not a complete view of actual capacity deployed.

We collect publicly published index levels where the publisher makes them public without licence restriction. Several major freight indices are licensed commercial products, and those we do not redistribute — if you need them, a licence from the publisher is the route.

Where an index is licensed, we will tell you during scoping rather than substituting a proxy series and letting you assume it is the index. A proxy presented as an index is exactly the kind of thing that fails an audit.

We supply the transport cost components — base rate, surcharge line items with applicability, transit times — plus published customs and duty notices where available. Building the landed cost model stays with you, because it depends on your Incoterms, your duty classifications and your own contracted rates.

Clients typically join our published surcharge data to their own contracted base rates, since surcharges usually apply to contracted shippers on the same published terms. That combination is where most of the practical value in this service sits.

We quote individually. The drivers are lane count, carrier count, how many modes you need, PDF tariff extraction depth, and whether disruption alerting is included.

PDF-heavy ocean tariff scopes cost more than parcel list pricing, which is largely page-based. A defined lane set across a handful of carriers with weekly refresh sits at the lighter end; multi-mode global coverage with near real time disruption alerting sits higher. One scoping call, a free pilot on your own lanes within 48 hours, then a fixed monthly quote. Request a quote.