You’re shopping for a marketing agency. Every agency you talk to says it uses ‘AI,’ and every pitch includes the word ‘AI-powered.’ So what does that mean in practice?
One agency uses ChatGPT to write outlines. Another built its own systems that generate 200 landing pages automatically. Both will claim to use AI, and they’re very different.
These questions help you test whether an agency’s AI claims are real. Ask them, and you’ll know if the agency uses technology to scale your results or only uses the buzzwords.
Many agencies that call themselves ‘AI-powered’ use off-the-shelf tools with old strategies. Real AI skill shows up in how an agency structures projects, what it delivers and how it measures results.
Question 1: What specific AI tools do you use, and why?
Ask them to list every AI tool they use and what each one does. Then listen closely.
Bad answer: ‘We use AI for content creation, technical SEO, and data analysis.’ That’s vague. It could mean anything.
Good answer: ‘We use SEMrush for technical SEO audits, Market Muse for content strategy, Copy.ai for outline generation, and custom scripts for programmatic page generation.’ A good answer follows the pattern ‘tool X for purpose Y, because Z.’
The first agency doesn’t know exactly what it’s doing, and the second does. Ask follow-ups: ‘Why did you choose that tool? What results did it produce?’ How deep their answers go shows how well they know the work.
Question 2: Can you show me programmatic content you’ve built?
Programmatic SEO is where AI multiplies your output. Ask the agency for examples. Have they built systems that generate 100+ pages automatically, or is their ‘programmatic’ work just templates?
A real example: 400 location pages for a restaurant group, all generated from a database and a programmatic template. Or 200 comparison pages for a SaaS company, generated from feature combinations.
If they can’t show examples, they probably haven’t done it. If they can, dig deeper. How long did it take? What were the results? How many pages ranked?
Question 3: How do you measure attribution, and can I see your tracking?
Ask: ‘How do you know which marketing activity drove which customer?’ This question separates good agencies from great ones.
Bad answer: ‘We track traffic and rankings. That’s the proof that SEO works.’
Good answer: ‘We set up UTM tracking, connect your CRM integration, build multi-touch attribution and create dashboards that show which keyword led to which deal. We know the quality and revenue impact of the traffic we drive, as well as the volume.’
Ask to see an example: a real client dashboard showing traffic, leads, customers and revenue impact. If they don’t have one, they don’t know whether their work is working.
Question 4: How do you set realistic timelines?
Be wary of agencies that promise fast results, such as ‘Triple your organic traffic in 3 months.’ SEO takes time. An agency that promises quick wins is lying or overselling.
Good agencies say:
- Months 1 to 2 are strategy and setup.
- In months 3 to 4, you’ll see the first ranking changes.
- By months 6 to 9, compounding shows up as real traffic growth.
- By month 12, you hold an established position.
Your timeline should match your goals. Aggressive growth takes 12+ months. Quick wins are usually fake wins.
Question 5: How do you handle scope creep and disappointing results?
Ask: ‘If we hit a wall or results slow down, how does that conversation go? Can we adjust strategy? Are you willing to pivot?’ Good agencies adapt. Bad agencies blame the client and ask for more time or budget.
Also ask about scope. ‘If we want to add a new channel or go beyond what we agreed, how does that work?’ Check whether they have a clear process or will keep expanding the work for the same fee.
Question 6: Who actually does the work?
Will you work with a strategist or only an account manager? Will the same people stay on your account for 12 months, or will they rotate? Will you talk to the people doing the work, or go through layers?
The best agencies give you one dedicated strategist, one or two execution leads and access to specialists as needed. The worst give you one account manager who tries to handle everything.
| Team Structure | Pros | Cons | Cost Impact |
| Dedicated Strategy + Execution | Best results, accountability | More expensive | Higher cost |
| Account Manager + Shared Execution | Cost-efficient | Less accountability, slow | Lower cost |
| One Person Doing Everything | Cheap | Stretched thin, poor results | Lowest cost |
| Client Access to Execution Team | Direct communication, speed | Requires effort | Varies |
Question 7: How do you price your work?
Watch out for pricing models that set the agency’s interests against yours.
Bad: ‘We charge per deliverable (blog posts, backlinks, etc.).’ This rewards volume over results. The agency would rather publish 10 mediocre posts than 2 great ones.
Good: ‘We charge a retainer tied to your growth goals. If we hit targets, the price stays the same. If we miss, we adjust and try something new.’ This lines up their incentives with yours.
Fair: ‘Retainer + success bonus.’ The agency gets a base fee, then earns more if it delivers exceptional results. This is the sweet spot.
Question 8: What’s your worst client experience, and what did you learn?
This question shows character. A good agency will answer honestly: ‘We once worked with a company that didn’t give us access to their CRM, so we couldn’t track attribution. We learned to ask for that up front.’ That answer shows humility and learning.
A bad agency says, ‘We’ve never had a bad client relationship.’ A claim of a perfect record usually means they’re hiding something.
Question 9: Can I talk to references like my company?
Ask for 3 to 5 references in your industry, at a similar revenue size, with similar goals. Then call them. Ask: ‘Would you hire them again? What was hard? What surprised you?’
Don’t take the agency’s word for it. Check.
Question 10: What’s your plan for year 2?
Year 1 builds the foundation and early wins. Year 2 is for scale and compounding. Ask the agency what changes in year 2. Should you expect different results, different investments or a different strategy?
Good agencies think long-term and have a 2 to 3 year roadmap. Bad agencies want the retainer renewed with no change.
How to score each agency
Score each answer 0 (bad), 1 (okay) or 2 (good).
| Question | Bad (0) | Okay (1) | Good (2) |
| AI Tools | Vague or none | Uses tools but unclear why | Specific tools with clear purpose |
| Programmatic Example | None or unclear | Has examples, lacks depth | Clear examples with results |
| Attribution | Doesn’t track | Tracks traffic only | Full multi-touch attribution |
| Timelines | Promises quick results | Reasonable timeline with caveats | Realistic with clear milestones |
| Scope Management | Unclear or always expanding | Process exists but unclear | Clear process, rigid scope |
| Team | One person doing everything | Account manager + shared team | Dedicated strategist + team |
| Pricing | Per-deliverable | Fixed retainer | Retainer + success bonus |
| Honesty | Claim perfection | Some self-awareness | Honest about failures and learning |
| References | No references or all generic | References but not relevant | 3+ similar companies, all positive |
| Long-term Vision | No plan | Plan exists but vague | Clear 2-3 year roadmap |
A total of 15+ probably means a good agency. A score of 10 to 15 could work, but check references. Below 10, keep looking.
Frequently asked questions
Q: Should we do a trial period before committing long-term?
A: Yes. Run a 3-month trial with clear KPIs and expected results. Serious agencies will accept this. If they push back, treat it as a red flag.
Q: What’s a reasonable agency cost?
A: For mid-market companies, $8K to $25K a month, depending on scope. Less than that probably isn’t enough. If you pay more, expect results to match.
Q: Should we hire multiple agencies?
A: Usually not. One good agency beats three average ones, and several agencies will muddle your strategy. Stick with one and review it after 6 months.
Q: What’s the difference between a ‘growth’ agency and a ‘traditional’ agency?
A: Growth agencies focus on revenue. Traditional agencies focus on metrics such as traffic and rankings. You want growth.
Q: How do we know if the agency is using AI or just claiming they are?
A: Ask to see the actual output, such as a programmatic landing page or an AI-generated comparison tool. Ask for something you can open and check.
Before you sign
Hire an agency on proven skill, shared revenue goals and references you’ve checked. A polished pitch isn’t enough. Ask these 10 questions, score honestly and check everything. The right agency can multiply your growth. The wrong one wastes a year and the budget.
The best partnerships start when a company checks an agency’s real capability and agrees on revenue goals from day one.
You're All Set!
We have your request.
Expect a reply from our team within 24 hours. Want to talk sooner? Pick a time below.
Or call us at +1 (914) 297-6638

