The AI Startup CFO Playbook: Token COGS, R&D Capitalization, and the New SaaS Metrics
Collated by Harry Prabandham
Curated by Rubric Financial
1 / 6
Why AI Companies Need a Different Finance Setup
- SaaS gross margins are 70-85% because the marginal cost to serve a customer is near zero. AI companies have REAL COGS: inference compute scales linearly with usage.
- Implication: 'flat-tier pricing' breaks at AI companies. A $99/mo tier that includes unlimited usage becomes loss-making when one customer hits 100x normal usage.
- Margins range wildly: pure inference resellers (OpenAI wrappers) often run 20-40% gross margin. Companies with proprietary models can hit 60-75%. Edge inference + smaller models can approach SaaS-like 80%+.
- Most early-stage AI startup financial models DON'T model token costs properly; they apply a flat 'COGS %' assumption that breaks at scale. Get this right early.
Related Resources
What Belongs in SaaS COGS and How to Compute Gross Margin
A practical guide to defining SaaS cost of revenue and calculating gross margin correctly, including AI inference costs and benchmarks.
CFO & StrategyDunning Management: Recovering Revenue Lost to Failed Payments
How SaaS finance teams design dunning workflows that recover involuntary churn before it becomes permanent lost revenue.
CFO & StrategyAI Data Moats vs Infrastructure: Where Startups Can Win
Why competing on AI infrastructure is a losing game for startups, and how proprietary data moats create the only defensible advantage in the age of commoditized foundation models.
About the author
Harry PrabandhamFounder & CEO
Founder and CEO of StartupCFO. MBA from Wharton, MS in Computer Science, and decades of experience building and advising venture-backed startups.
More articles by Harry →Related tools and reading
What Belongs in SaaS COGS and How to Compute Gross Margin
A practical guide to defining SaaS cost of revenue and calculating gross margin correctly, including AI inference costs and benchmarks.
InsightStartup CFO Digest — Week 30, July 2026
This week's digest focuses on the unglamorous fundamentals that separate sustainable startups from cautionary tales: cash collection discipline, contract strategy shifts in the AI era, and where capital is actually flowing in fintech. We are also seeing emerging alternatives to traditional VC for founders building patient, sustainable businesses rather than growth-at-all-costs plays.
GlossaryARR (Annual Recurring Revenue)
Annualized value of your subscription revenue at a point in time.
InsightStartup CFO Digest: Week 29, July 2026
This week's top startup finance news with CFO commentary. Fundraising, SaaS metrics, tax, and fintech, curated for founders.
GlossaryMRR (Monthly Recurring Revenue)
Monthly equivalent of ARR, useful for month-over-month tracking.
InsightBookings vs. Billings vs. Revenue vs. ARR: The Four Numbers Founders Confuse
Bookings, billings, revenue, and ARR describe the same deal at four different moments, and mixing them up is the fastest way to lose credibility with a board or a diligence team. Here is what each one means, why they diverge, and which audience actually wants which.
