The Metrics That Used to Tell the Whole Story Don't Anymore

Look at organic traffic alone over the past year, and you could talk yourself into believing nothing has changed.

Ashlie Kim, SVP of Advertising at Scorpion, has seen that exact number up close. "Our organic lead traffic dropped by roughly half over the past year, but our lead performance nearly doubled in the same period," he says. "Net, that looks flat. But underneath that flat number, a new pattern is forming. Our highest-intent searches are increasingly starting inside AI-assisted channels instead of a traditional results page."

Flat isn't the same as unchanged. It just means two big shifts happened to land in the same place on a spreadsheet.

The industry-wide version of the same story

Scorpion's own data lines up with what's showing up across the broader search landscape. Google still drives roughly 210 times more searches than ChatGPT, but that gap has narrowed fast, down from about 373 times as recently as 2024, according to SparkToro and Datos data. AI Overviews now appear in more than half of all Google queries and are expanding every year. And when an AI Overview shows up above the number one organic result, that top result sees roughly a 58 percent drop in click-through rate, per research from Ahrefs' analysis of 25 million AI Overviews.

The pattern shows up even more clearly at the top of the funnel. Nearly 60 percent of all Google searches now end without a click to any website, and on mobile that number climbs to 77 percent. AI Overviews show up for 92 percent of informational queries, like "why is my furnace making a rattling noise," before a user ever reaches a business's site. But for simple local searches like "attorney near me," that number drops to just 15 percent. The research and discovery layer of the customer journey is being answered before a website gets the chance to make its case.

Holly Holder, Director of SEO at Scorpion, sums up what that shift actually means: "Your site is now becoming evidence for AI, rather than a destination for people to do their research."

None of this means organic search stopped working. It means a large and growing share of the work organic search used to do now happens somewhere a ranking report can't see.

Why the old scorecard can't keep up

Traditional SEO reporting was built around one clean question: does this page rank? That question still matters, but it no longer covers the ground it used to. A business can hold its position on page one and still lose visibility in an AI-generated answer, because those are now two different systems measuring two different things.

The metrics that capture what's happening today look different:

• Whether a brand shows up at all in an AI answer

• Whether its content gets cited when someone asks a related question

• Whether AI can clearly articulate what the business actually does

• How often it gets recommended relative to competitors

None of those show up on a traditional rank tracker.

Holly Holder puts it plainly: "Attribution is messy. We need to go back to overall success, leads, and revenue from the organic platform as a whole, rather than always chasing channel-level detail."

They also don't move in sync with each other. Research from Ahrefs found that AI Overviews and Google's AI Mode produce answers that are 86 percent similar in substance, but the sources they actually cite overlap by only 14 percent. Two systems can agree almost entirely on what to say and still pull that answer from almost entirely different places.

What this means for how a business should look at its own numbers

Traditional reporting still has a place. The problem is relying on a single number, ranking position or raw traffic, to tell the whole story. A business that only tracks page-one rankings is looking at one instrument on a dashboard that now has five or six that matter.

The businesses that adapt well are the ones asking a broader set of questions:

• Is our brand showing up when AI answers questions in our category?

• When it does show up, is the tone accurate and favorable?

• Are we being cited as a source, or is a competitor with a stronger digital footprint getting that citation instead?

Third-party coverage matters more here than most businesses assume. Research from AirOps found that a business is roughly 6.5 times more likely to be cited in an AI answer through outside coverage than through its own website content.

That's not a reason to abandon owned content, but it is a reason to treat earned coverage, reviews, and mentions as part of the same measurement conversation as the website itself, because increasingly, that's exactly how AI treats them too.

If you're already with Scorpion, ask your account manager to walk you through what your visibility actually looks like across these newer metrics, not just where you rank. If you're not, let's talk.