Most agencies can make a dashboard look busy. Far fewer can explain, in pounds and margin, whether your paid media is creating profitable new customer growth or simply recycling demand you would have won anyway. That is the real purpose of an ecommerce agency evaluation: to separate capable commercial operators from teams that optimise for activity, platform metrics and impressive-sounding reports.
For an established retailer, choosing an agency is not a branding exercise or a procurement tick-box. It is a decision that affects cash flow, stock planning, contribution margin and the pace at which you can scale. The right partner should be able to improve the economics of acquisition. The wrong one can spend heavily for months while hiding behind clicks, reach and attributed revenue.
Start with your numbers, not the agency pitch
A serious evaluation begins internally. If you do not know your gross margin, repeat purchase behaviour, average order value and breakeven cost of sale, no agency can set a credible target. They can build campaigns, but they cannot make sound commercial decisions on your behalf.
Be clear about what profitable growth means for your business. A brand with high margins, healthy cash reserves and repeat purchases can often acquire first-time customers more aggressively than a low-margin retailer with seasonal stock risk. A 3x return on ad spend may be excellent for one product range and damaging for another.
Give potential agencies enough context to respond properly: current spend by channel, revenue, contribution margin, best-selling categories, product feeds, stock constraints and your tracking setup. You are not looking for an instant promise. You are looking for the quality of the questions they ask before offering an answer.
An agency that claims it can guarantee a return on ad spend without understanding those variables is selling certainty it has not earned. Paid media has controllable levers, but it is not isolated from pricing, product-market fit, conversion rate, fulfilment and availability.
Ecommerce agency evaluation: assess depth of specialism
The first major filter is straightforward: does the agency genuinely specialise in eCommerce paid media, or is it a generalist business with eCommerce listed among a long menu of services?
Google Ads for lead generation and Google Ads for a retailer are not the same discipline. Retail performance depends on product data, shopping feed quality, category structure, margin variation, promotional timing, search demand and the relationship between prospecting and remarketing. Meta advertising brings another layer of creative testing, audience signals and measurement constraints. Performance Max can perform brilliantly or burn budget behind weak feed data and loose account controls.
Ask what percentage of the agency’s work is eCommerce PPC. Then ask how it manages Google Shopping, Performance Max, standard search, paid social and feed optimisation together. A specialist should explain the relationship clearly, without turning every answer into jargon.
Look for evidence that they understand problems such as disapproved products, inconsistent variant data, weak titles, missing attributes, low-margin products absorbing spend, branded search inflating results and shopping campaigns prioritising revenue over profit. These are operational issues, not theoretical ones. They determine whether an account can scale cleanly.
Specialism does not mean every retailer needs every channel. If your catalogue is small, your creative resource is limited or your conversion rate is weak, adding more platforms may create more complexity rather than more profit. A credible agency should be willing to say where the next pound is best spent, even when that answer is not another campaign.
Examine how the agency defines performance
The most revealing part of an ecommerce agency evaluation is the measurement conversation. Ask what appears in a monthly report and, more importantly, what triggers action during the month.
Revenue and return on ad spend matter, but neither is sufficient in isolation. Your agency should be able to work towards a view of performance that reflects commercial reality. Depending on your data maturity, that may include profit after advertising, new customer acquisition cost, contribution margin, blended efficiency and the cost of clearing inventory.
A useful performance framework normally considers at least these five areas:
- Revenue quality: whether spend is growing incremental sales, not merely harvesting branded demand.
- Margin: whether promoted products can absorb advertising cost after discounts, shipping and returns.
- Customer value: whether new buyers return, subscribe or purchase higher-value products later.
- Channel mix: whether Google, Meta and other activity are being credited fairly rather than judged in silos.
- Operational constraints: whether stock, fulfilment capacity and site conversion support further scale.
Do not expect perfect attribution. No agency can produce it, particularly across devices and channels. What you should expect is intellectual honesty about attribution limits, a consistent reporting method and decisions that do not blindly follow platform-reported revenue.
Be wary if reports lead with impressions, clicks or follower growth while profit sits at the bottom of the page, if it appears at all. Those metrics can be useful diagnostics. They are not the commercial outcome.
Test the audit, not the sales presentation
Strong sales presentations are easy to prepare. A meaningful account review is harder. If you are already spending at a level that justifies agency support, ask prospective partners to explain where they would investigate waste and opportunity in your current setup.
The best response will not be a sweeping promise to rebuild everything. It will identify hypotheses: poor feed segmentation, uncontrolled Performance Max allocation, excessive brand spend, inefficient search terms, stale creative, weak exclusions, tracking gaps or budget being pushed into products that cannot meet target efficiency.
Then ask how they would validate each hypothesis. This matters because good paid media management is a cycle of analysis, test design, implementation and review. It is not a one-off restructure followed by months of minor bid adjustments.
You should also ask what they would leave alone. Accounts often suffer when a new agency changes campaign structures simply to demonstrate activity. There are times when rebuilding is necessary, particularly after years of unmanaged complexity. There are also times when preserving historical learning while fixing specific weaknesses is the more profitable choice.
Check ownership, access and accountability
Your advertising accounts, merchant centre, pixels, product feeds and conversion data should remain under your control. Agency access should be managed properly, but no serious retailer should be trapped because critical assets sit inside an agency-owned account.
Clarify who will manage the account day to day. Will the strategist who sells the service be involved after onboarding? How many accounts does the account manager handle? What work is completed in-house, and what is outsourced? Generic answers here are a warning sign.
Cadence matters too, but more meetings do not automatically mean better management. You need regular strategic contact, clear priorities and reporting that tells you what changed, why it changed and what happened next. If performance misses target, the agency should be direct about the cause and the corrective action. Accountability is not a polished explanation after the fact.
Contract terms also reveal confidence. A fair notice period can protect both sides, because paid media needs time to gather data and prove a strategy. Long lock-ins used to prevent a client leaving are a different proposition. The agency should retain your business through performance, communication and commercial value.
Price the decision against waste, not retainers alone
A lower management fee is not automatically lower cost. An inexpensive agency that misallocates a meaningful monthly budget can become very expensive. Equally, a premium fee is not proof of expertise. The question is whether the level of attention, strategic input and specialist capability is proportionate to your spend and growth opportunity.
Ask how fees change as budget rises, whether feed work and creative strategy are included, and what sits outside the core remit. A clear proposal should make it obvious what you are buying and what success is expected to look like.
For smaller or early-stage brands, the honest answer may be that an agency is premature. If you lack consistent demand, have not validated product margins or cannot fund testing, a specialist partner cannot manufacture readiness. Build the foundations first. Established brands with proven sales and meaningful media budgets, however, should expect more than basic campaign administration.
The agency you choose should make paid media easier to trust because its decisions are visible, commercially grounded and open to challenge. That standard protects more than your advertising budget. It gives your business a better chance of scaling without sacrificing the profit that made growth worthwhile in the first place.