Are Marketing Agencies Making Up Your ROI Reports? What Local Business Owners Need to Know
BUYER BEWARE · THE LOCAL AIM · ORANGE COUNTY, CA
Are Marketing Agencies Making Up Your ROI Reports?
What Local Business Owners Need to Know About the Metrics They’re Being Sold
By: Kirby, Editor — The Local Aim
Column: Buyer Beware
Topic: Agency Reporting, Vanity Metrics, ROI Transparency
SEO Description: Most local marketing agencies report metrics that look impressive and mean nothing. Here’s how the reporting game works, why it persists, and what numbers actually connect to revenue.
Every month, thousands of local small business owners receive a marketing report. It arrives as a PDF or a dashboard link. It has charts. The charts go up. Impressions are up 40%. Reach is up 22%. Engagement is strong.
And somewhere in the back of their mind, the owner wonders — why aren’t the phones ringing more?
The answer is that most agency reporting is built on metrics that were chosen specifically because they are easy to produce, easy to present, and almost impossible for a client to connect to actual revenue. That isn’t a bug in the system. It is the system.
This is not about fraud. Most of what agencies report is technically accurate. The number is real. The implication that it matters to your business is where the deception lives — and it has been standard practice in local marketing for over a decade.
The number is real. The implication that it matters to your business is where the deception lives.
The Measurement Problem No One Talks About
Here is the first thing to understand: most agencies don’t actually know whether their work is producing results for you. This is not an accusation. It is a documented industry reality.
▸ Only 36% of marketers say they can accurately measure ROI.
Source: Firework, 2025 — firework.com/blog/marketing-roi-statistics
▸ 47% of marketers struggle to measure ROI across multiple channels.
Source: Firework, 2025 — firework.com/blog/marketing-roi-statistics
▸ 34.2% of marketers rarely or never measure the return on their marketing spend at all.
Source: Marketing Week Language of Effectiveness Survey, 2024 — marketingweek.com
▸ 39.7% of marketers rarely or never measure whether a campaign drove pipeline growth.
Source: Marketing Week Language of Effectiveness Survey, 2024 — marketingweek.com
Let that sit for a moment. The people who sell you marketing services largely cannot tell you whether those services are working. So they report the things they can measure — impressions, reach, engagement — and present them as if they are the point.
They are not the point. Calls to your business are the point. Booked appointments are the point. Revenue is the point.
The Three Ways Agencies Inflate Your Results
1. Cherry Picking
Your agency reports the metrics that went up and buries the ones that didn’t. If impressions rose while calls dropped, you will see a chart about impressions. This is not lying, technically. It is selection. The result is the same: you pay for a story, not a result.
2. Framing Inflation
This is the most common form of reporting deception and almost no one calls it out. “Impressions up 40%” is technically accurate. It is also functionally meaningless for a local HVAC company trying to fill its service schedule. The metric is real. The implication that it represents business progress is manufactured.
Likes, shares, reach, and engagement fall into the same category. A 2025 analysis found that Facebook’s algorithm now shows brand posts to roughly 5% of followers. That means your “engagement” metric is already measuring a fraction of an audience that may not be your customers.
3. The Black Box Report
Many agencies control both the activity and the reporting on that activity. You receive a polished PDF with top-line numbers — impressions, clicks, CTR — but you have no way to verify whether the results are accurate or even connected to real activity.
“You put dollars in, results come out, and no one can quite tell you why.” — LeadGenius, 2025
This is what the industry calls the data black box. When a partner controls campaign setup, targeting, optimization, and reporting, but gives you limited visibility into the underlying data, you cannot validate what you are being told.
▸ In one documented case, Gannett accidentally mis-routed billions of ad impressions for nine months. Not a single verification vendor, agency, or brand detected it.
Source: Robert Collings, citing Wall Street Journal reporting — robertcollings.com
Why Agencies Built It This Way
The agency business model does not reward results. It rewards retention. An agency that keeps a client for 24 months at $1,500 a month earns $36,000 regardless of whether that client saw a single new customer from the engagement.
The simplest way to retain a client who can’t measure results is to keep showing them numbers that feel like progress. Impressions going up feels like progress. Charts with upward lines feel like progress. A PDF with your logo on it feels like accountability.
It is not accountability. It is optics.
▸ Many agencies are paid on volume, not quality. They make the same fees whether they are buying real audiences or fake ones.
Source: Robert Collings — robertcollings.com/100-billion-black-box
▸ 83% of marketing leaders now say demonstrating ROI is their top priority — yet only 36% can actually measure it accurately.
Source: Firework / HubSpot State of Marketing, 2025
The pressure to demonstrate ROI has never been higher. The ability to actually measure it has barely moved. That gap is where agency reporting lives.
What the Numbers Should Actually Show You
For a local service business — HVAC, plumbing, roofing, home services of any kind — there are exactly four numbers that matter:
▸ Calls. How many phone calls did your Google Business Profile generate this month?
▸ Clicks to website. How many people clicked from your GBP listing to your site?
▸ Direction requests. How many people asked for directions to your location?
▸ Review count and velocity. How many new reviews did you receive, and is the number growing?
Every other metric is secondary at best and noise at worst. If your agency’s monthly report does not lead with these four numbers in plain language, ask why.
If they cannot answer that question directly, you have your answer.
The AI Problem Nobody Is Talking About
There is a new layer to this problem that most agencies are not telling you about, because it threatens their entire model.
Artificial intelligence is changing how customers find local businesses. Google’s AI Overviews, ChatGPT, Perplexity, and other AI tools are increasingly the first stop for consumers researching a service. And what does AI use to determine which businesses to recommend?
Human content. Human reviews. Real experiences written by real people about real interactions with real businesses.
The automated review blasts, the templated GBP posts, the AI-generated social captions — the entire automated content stack that agencies have been selling for the last five years — is producing exactly what AI engines are learning to discount.
AI visibility is built on human content, human reviews, and human interactions. The agencies selling you automation are producing exactly what AI is learning to ignore.
This is the irony of the current moment. The same agencies pitching AI tools as the solution are deploying automation in a way that actively undermines AI visibility for their clients.
If you want to verify this yourself, search “Google AI Overviews human content signals” or “AI search E-E-A-T human experience.” The documentation is Google’s own.
The Questions to Ask Before You Sign Anything
Here are the questions every local business owner should ask a marketing agency before spending a dollar:
▸ What specific metrics will you report on every month, and how do they connect to revenue?
▸ How do you measure phone calls and direction requests from my Google Business Profile specifically?
▸ Can I have direct access to the underlying data — not just your dashboard?
▸ What happens to the work you’ve built if I cancel?
▸ How do you generate reviews — automated software or personal outreach?
▸ What is your response rate on review requests?
A good agency answers these questions directly and without hesitation. An agency that pivots to talking about impressions, reach, or brand awareness when you ask about revenue is telling you something important.
What This Column Exists to Do
The Local Aim publishes Buyer Beware because the information asymmetry between marketing agencies and local small business owners is real, persistent, and expensive.
We are not anti-marketing. Marketing works. The right marketing, measured the right way, connected to actual revenue, is one of the highest-return investments a local business can make.
We are anti-BS. And the current state of local marketing agency reporting is, by the numbers, overwhelmingly BS.
You deserve to know what you are buying. That is what this column is for.
SOURCES
Firework (2025). Marketing ROI Statistics. firework.com/blog/marketing-roi-statistics
Marketing Week / Kantar (2024). Language of Effectiveness Survey. marketingweek.com/no-measure-marketing-roi
HubSpot State of Marketing Report (2025 / 2026). hubspot.com/marketing-statistics
LeadGenius (2025). Take Back Control from Black-Box Advertising. leadgenius.com
Robert Collings (2025). $100 Billion Black Box: Your Ad Budget’s Vanishing Act. robertcollings.com
Sender.net (2025–2026). Marketing ROI Statistics: Benchmarks by Industry and Channels. sender.net
Abacum (2025). How to Calculate ROI on Marketing Campaigns. abacum.ai
Data-Dynamix (2025). Avoid the Data Black Box: Demand Media Partner Transparency. data-dynamix.com
Google Search Central. E-E-A-T and Search Quality Evaluator Guidelines. developers.google.com/search
BrightLocal (2025). Local Consumer Review Survey. brightlocal.com
— END —