Robert Hu
E-commerce Strategy

Agentic Commerce Has a Measurement Problem

Robert Hu··6 min read
A shopping journey where discovery and comparison happen inside an AI answer, leaving no observable record for the brands that were considered but never clicked

A brand can open three dashboards on the same morning and still not answer a simple question.

Sales sit in one. Site traffic sits in another. Search visibility sits in a third. Together they describe a shopper who searched, clicked, browsed, and bought. None of them describes a shopper who asked an assistant for a recommendation, compared four products inside the answer, and never visited three of those brands at all.

On September 2, NIQ and Similarweb announced they are building something for that gap. The diagnosis in the announcement is more interesting than the news in it.

What they actually announced

The two companies announced a collaboration on a product NIQ calls Agentic Commerce Measurement. NIQ contributes "product intelligence, consumer behavior data and retail sales measurement." Similarweb contributes what the release calls "the foundational digital data," adding visibility into AI-driven consumer behavior inside generative AI platforms and along the agentic path to purchase.

It does not exist yet. NIQ's own FAQ asks whether Agentic Commerce Measurement is available today and answers with one word: "No." An initial version is expected in Q4 2026, beginning with a focused set of categories and markets. Planned coverage spans ChatGPT, Gemini, Google AI Mode, Perplexity and Claude, across five areas: consumer intent, agentic shelf visibility, product content readiness, AI-driven traffic, and AI-driven conversion.

So this is a roadmap rather than a capability, and I would not plan a budget around it. What makes it worth reading is the problem statement. NIQ writes that existing measurement approaches "provide visibility into areas such as retail, ecommerce, search and media, but do not provide a comprehensive view of the AI-mediated purchase journey." That is a measurement company describing a hole in the measurement stack it helped build.

Newsletter

Follow the research

Research notes and analysis on how AI, digital transformation, product discovery, and customer behavior are changing commerce.

Subscribe to Hu's Weekly Hoot

The click was never just traffic

Web analytics works well because shopping journeys used to contain hyperlinks.

An impression, a click, a session, a conversion. Many of the most important steps left records on surfaces somebody could instrument, and the click often stitched those records into a usable sequence. Attribution has always been contested, but the arguments were about how to weight observable events. The events themselves existed.

An AI answer can remove that transition without removing the influence. A shopper asks for the best option under a hundred dollars, reads a comparison of four products, and clicks once. Four brands were in the consideration set. Three of them have no record that they were ever in the running.

This is the part I keep returning to. The click was not only a traffic event. It was the mechanism that made influence observable at all.

Visibility is arriving before traffic

We are getting the first half of the picture before the second.

I wrote in August about Google Search Console's new generative AI report, which shows impressions inside AI Overviews and AI Mode. It reports pages, countries, devices and dates. It does not report queries, clicks, or click-through rate, and it does not separate the two surfaces. Real progress, and a genuinely partial instrument: I can see that Google surfaced a page, and I cannot see what was asked or what happened next.

Commerce operators face a harder version of the same problem, because visibility is not the economic question. The question is whether the visibility changed a purchase. It is the same asymmetry retailers run into when the assistant keeps the conversation and the merchant gets the order.

Why neither dataset answers it alone

The shape of the collaboration makes sense even though the product does not.

Traffic data is good at visits. It can already show that AI-referred traffic arrived and that it behaves differently once it lands. It is structurally weaker on brands that were considered and never clicked, because there is no visit to observe.

Retail sales data has the opposite shape. It shows what sold, where, and when, with real transactions underneath. It does not carry the reason. A unit that sold because an assistant recommended it and a unit that sold because it was on an endcap look identical in the data.

Each dataset is missing something. They are not missing the same thing.

What is actually being reconstructed

This next part is my interpretation rather than anything either company claimed.

The measurement problem in agentic commerce is not attribution after the click. It is reconstruction of what happened before a click existed.

Traditional analytics assumes exposure happens on a trackable page and that consideration happens somewhere an operator can instrument. AI shopping moves both inside the answer. NIQ's second focus area, agentic shelf visibility, is described as where products appear when AI assistants recommend options and how a brand compares with competitors. That is an attempt to instrument the consideration set itself rather than the traffic it happens to produce.

If it works, the useful unit expands beyond the visit to include something closer to the appearance: whether the product entered the machine's consideration set at all.

The objections that survive

Attribution was already broken before any of this. Multi-touch journeys were never fully observable, and measurement vendors have been selling solutions to that for twenty years.

The sharper issue is that neither company has explained how the joint product will work, and the methodology is the entire question. Similarweb's most recent public account of how it observes activity inside AI platforms comes from a separate August announcement about AI advertising, where it says its insights are "drawn from real user panel conversations, not synthetic prompts." A panel is a legitimate method. It is also a sample rather than a census, and it is observation of users rather than access to the platform. Similarweb's own standard disclaimer describes its outputs as "estimated metrics and digital insights generated by Similarweb using its proprietary algorithms."

I want to be careful here. That August description covers the AI Ads dataset, not this collaboration. Neither release explains the methodology of the joint product.

And the strongest objection outlives all of it. The platform that owns the most important part of this journey does not expose it. OpenAI and Google can observe the prompt or query and what their systems returned. Third parties cannot see the full decision process behind those outputs. Joining two datasets widens the surface you can correlate across. It does not by itself establish that AI created demand rather than rerouting demand that was already there, which is the same incrementality question that keeps surfacing everywhere AI touches commerce.

Worth noting too that the channel's size is still soft. NIQ's own August research says nearly 75% of shoppers use AI during product discovery, and in the same release says 20% of consumers already use AI as part of the shopping process. Both numbers come from NIQ, neither is defined in the release, and the distance between them is most of the argument about how material this is today.

What remains true

The structural change holds regardless of whether this particular product ships well.

Discovery, comparison, and recommendation are moving onto surfaces brands do not own and cannot instrument. Measurement has to follow them, and the honest position today is that it has not yet.

For years commerce measurement started with the click. Agentic commerce may force it to start one step earlier, with whether a product entered the consideration set at all.

If an assistant considered your product, recommended a competitor, and the shopper never visited your site, what would your analytics show?

Follow the research

I publish research notes and analysis on how AI, digital transformation, product discovery, and customer behavior are changing commerce.

Subscribe to Hu's Weekly Hoot