Vanity Metrics vs Revenue: How to Judge Whether Your SEO Agency Is Working

A multi-site clinic group had worked with an SEO agency that reported steady progress. Page views were up, impressions were up and the monthly slides looked healthy. Yet over the same period, the return the group earned for each pound of marketing fell sharply, from a comfortable level to one that no longer made commercial sense. The agency had been optimising for numbers that looked good rather than numbers that paid.
This is the trap of vanity metrics. Here is how to recognise them, and how to judge an SEO agency by what matters to a clinic: enquiries, bookings and revenue.
What vanity metrics are
Vanity metrics are numbers that look good and are easy to grow, but do not show whether the business is doing better. Page views, impressions, followers and total keyword counts all qualify. They can rise because a few broad articles attract the wrong readers, or because a report counts visits that never lead anywhere. They are not worthless, but alone they can disguise a decline in the things that matter.
Why they appeal to agencies and clients alike
Vanity metrics are comfortable. They usually go up, they are easy to chart and they make a monthly meeting feel positive. Agencies can be tempted to emphasise them, and clients can be tempted to accept them, because the harder numbers, such as bookings and revenue, depend on factors beyond SEO. But avoiding the hard numbers means nobody is accountable for what the clinic truly wants.
What a clinic really needs to know
The questions that matter are simple. How many enquiries did search bring? How many became consultations? How many became treatment, and what revenue followed? What did marketing cost, and what did it return? Rankings and traffic are useful steps along that path, but the path must be visible. If a report cannot connect SEO activity to those outcomes, it is only half a report.
Return on marketing spend as the central test
Return on marketing spend compares revenue linked to marketing with what you paid. If it falls while traffic rises, something is wrong, however cheerful the charts look. Track the figure over time, by service where possible, and discuss it openly with your agency. A return that is slipping is an early warning, and a good partner will welcome the conversation instead of steering it back to impressions. Our healthcare marketing ROI calculator lets you model that return from your own figures.
Ask better questions in review meetings
Move the discussion from what went up to what changed for patients. Ask which pages brought the most enquiries, and which services grew or shrank. Ask what the agency would do differently if revenue were the only measure. Ask what is blocking progress. Good answers are specific and honest. Vague answers, or a quick return to the traffic graph, tell you something about the partnership.
Agree measures and a baseline at the start
Many disputes arise because nobody agreed what success meant. Before work begins, decide which measures matter, how they will be measured and where the data will come from. Record a baseline for enquiries, bookings and revenue, so later progress can be judged fairly. Include realistic timescales, since SEO takes time, and be wary of anyone who promises specific rankings or guaranteed results.
Insist on access to your own data
You should be able to see your analytics, search console and tracking accounts without asking permission. If an agency holds the only login, or shares only screenshots, you cannot verify anything. Ask for direct access, and for reports built from numbers you can check. Transparency is a basic sign of a healthy relationship, and reluctance to share data deserves a polite but firm conversation.
Connect SEO data to your booking system
The strongest reports link search activity to what happens in the diary. That may mean tagging enquiries by source, recording which page a patient first visited or matching bookings to campaigns. The set-up does not have to be perfect. Even approximate links are far better than none, and they can be improved over time. They also make it much harder for vanity metrics to hide a poor result.
Spot the warning signs early
Be cautious if reports grow longer while outcomes stay vague, if the agency changes which metrics it highlights month to month, or if it blames outside factors without evidence. Other signs include avoiding questions about revenue, relying on screenshots and celebrating small ranking gains for phrases nobody searches. One of these may be innocent. Several together suggest the agency is managing perception more than performance.
Put the real figures in front of leadership
Reports are only useful if the people who make decisions read them. Ask for a single page that shows enquiries, bookings, revenue linked to search and return on marketing spend, with the trend over several months. Leave the supporting detail for appendices. A short, honest summary helps directors ask the right questions, and it makes it much harder for flattering but empty numbers to dominate the conversation.
Decide what to do when the numbers do not add up
Start with a direct, calm conversation. Share your concern, show the numbers that worry you and ask for a plan with measurable steps and dates. If the response is defensive or unclear, consider an independent audit before making a decision. Switching agencies is disruptive, so be sure of the diagnosis first, but do not let comfortable charts keep you in a relationship that no longer pays. If you decide to look elsewhere, our roundup of top healthcare marketing agencies is a place to start.
Our companion article on SEO for clinic expansion shows why a revenue-first approach matters when growth is planned, and our guide to auditing your Google Ads agency covers a similar check for paid search. Our SEO performance reporting service explains how we report. We are glad at Pulse Digital Health to talk.
Frequently asked questions
What are vanity metrics in SEO?
They are numbers that look impressive and are easy to grow but say little about business results, such as page views, impressions and total keyword counts. They can rise while enquiries and revenue fall, so treat them as context rather than evidence that SEO is working.
Ask for numbers you can check against your own diary.
What should a clinic ask its SEO agency to report?
Enquiries from search, how many became consultations and treatments, the revenue linked to them and what marketing cost. Rankings and traffic can sit alongside as supporting steps, but the report should connect them to patient outcomes and show change over time.
A report that cannot show this is only half a report.
What is return on marketing spend?
It compares revenue linked to marketing with what you spent on it, giving a measure of payback. If it falls while traffic rises, something is wrong. Track it over time and by service, and discuss it openly with your agency.
A falling trend is an early warning, so act on it quickly.
How can I tell if an agency is hiding poor results?
Warning signs include vague reports, shifting highlighted metrics, reluctance to share raw data, screenshots instead of access and constant blame on outside factors. One sign may be innocent, but several together suggest the agency is managing perception more than performance. Short, calm conversations tend to produce the best results.
Should I have direct access to my analytics?
Yes. You should be able to see your analytics, search console and tracking accounts yourself. If the agency holds the only login or shares only screenshots, you cannot verify anything. Ask for access and for reports built from numbers you can check.
Transparency is the foundation of any healthy agency relationship.
What should I do if the numbers do not add up?
Raise it calmly with evidence, and ask for a plan with measurable steps and dates. If the response is defensive or vague, consider an independent audit before switching. Changing agencies is disruptive, so be sure of the diagnosis first.
Keep a record of the conversations and the numbers in front of you.