AI Vendor Evaluation Scorecard
Score AI vendors on the same axes, so the comparison survives contact with procurement.
Free, no account needed. This one makes no model call at all: everything is computed in code.
What it does
AI vendor evaluations tend to be won by whoever demoed most recently. A structured scorecard is how you compare vendors on the things that determine the cost of the decision two years from now.
This scores across security, capability, commercial terms and lock-in, and shows the weighting so nobody has to take the ranking on trust.
What it scores
- Security and data handling, including where inference actually runs
- Capability against your specific use cases rather than a feature list
- Commercial terms and the real cost at your volume
- Lock-in: what leaving costs, and whether you could
How it works
- Enter each vendor against the same criteria.
- Weighted scoring runs in code, with the weights visible.
- Take the comparison into procurement.
Related tools
AI Vendor RFP Generator
Builds an RFP that asks AI vendors the questions most RFPs forget to ask.
AI ROI and Business-Case Modeler
Builds the financial case for an AI initiative from your numbers, with the assumptions visible.
AI Cost and Usage Dashboard
Turns model spend and usage into the picture that shows where the money is going.
Model Bake-off Harness
Runs the same task set across several models and puts the outputs side by side.
Every tool here works with no API key configured. The scoring and the documents are produced in code; where a model is used at all it only polishes wording, and the tool falls back to its own output if the model is unavailable. Nothing you enter is used to train anything.
Start with a conversation, not a proposal
Thirty minutes. We will tell you what we would change first, and whether you need us at all.
Book a callThe firm behind the firm