1. A Real Deployment Portfolio, Not Just Demo Notebooks
Ask specifically what happened after the model was trained: was it deployed to a live camera feed, integrated into a production line, and monitored over weeks of real operating conditions? A candidate whose portfolio is entirely Jupyter notebooks and Kaggle competitions has not faced the problems that only show up in production, like lighting changes, camera drift, or edge-case objects the training data never saw. Computer Vision Consultant vs Freelancer: Which Should You Hire? covers exactly how to separate a demo-stage portfolio from a production-proven one.
2. Domain Match, Not Just Computer Vision Experience in General
A developer who has shipped facial recognition for access control has not automatically solved defect detection on a manufacturing line, medical imaging triage, or satellite crop analysis. Each domain has its own data characteristics, failure tolerances, and regulatory context. Custom Computer Vision Solutions for Enterprise Applications outlines how differently CV gets applied across healthcare, manufacturing, retail, and logistics, and the case study evidence to ask for should match your specific domain, not just the words "computer vision" on a resume.
3. Data Pipeline Experience, Not Just Model Architecture Knowledge
The hardest part of most CV projects is rarely the model; it's the pipeline feeding it: image collection, labelling consistency, augmentation strategy, and handling class imbalance when defects or anomalies are rare. Ask a candidate to walk through how they built and validated a labelled dataset from raw footage on a past project. If they can only describe the model they trained, not the data that fed it, expect that gap to surface mid-project.
4. Edge vs Cloud Familiarity, Matched to Your Actual Constraints
A model that runs beautifully on a cloud GPU can be unusable on a factory-floor edge device with no reliable internet connection and strict latency requirements. Confirm the consultant has shipped inference on whichever environment your use case actually needs, TensorRT and quantised models for edge deployment, or scalable cloud inference for high-throughput batch processing, since the engineering trade-offs are genuinely different.
5. Annotation Tooling Knowledge, Not Just Model Training Skill
Labelled data quality determines model quality more reliably than architecture choice does. A consultant who has only ever used pre-labelled public datasets may struggle when faced with your raw, unlabelled footage. Ask what annotation tools they've used (CVAT, Labelbox, or a custom pipeline), how they've handled annotator disagreement, and how many labelled examples they typically need per class before a model is production-viable.
6. A Real Model Benchmarking Approach
What a strong answer sounds like
A strong candidate defines precision, recall, and false-positive cost specific to your use case before training even begins, since a missed defect and a false alarm rarely carry the same business cost. They should describe how they validate against a held-out test set that reflects real operating conditions, not just a random split of the training data.
What a weak answer sounds like
A weak answer cites a single accuracy percentage with no context for what counts as a false positive versus a false negative, or benchmarks only against a clean academic dataset rather than your actual, messier production footage.
7. A Defined Post-Launch Support Model
Computer vision models degrade as camera angles shift, lighting changes seasonally, or new product variants appear that the training data never saw. Confirm upfront whether post-launch monitoring and retraining are included in the engagement or billed separately, and how the consultant proposes to detect model drift before it silently degrades accuracy in production.
What Comes Next
As vision-language models and foundation models trained on broader visual data continue to mature, some of the annotation burden covered above will shrink, but the fundamentals of domain match, deployment environment, and drift monitoring will matter just as much. The manufacturing-heavy growth driving this market isn't slowing down, which means the gap between consultants who can ship a production system and those who can only demo one will keep mattering more, not less. If you're ready to run this checklist against a real candidate, ai and ml freelance developers with verified computer vision deployment experience can walk through your specific use case before you commit.
