AI Product Analyst - AI Receptionist Team | MEDvidi

MEDvidi is a fast-growing US telehealth company building AI-powered systems across patient and operational workflows.
We’re looking for an AI Product Analyst to help us evaluate, monitor, and improve AI agents and LLM-powered workflows running in production.
This role is focused on understanding how AI systems actually behave in real environments - identifying failure patterns, measuring AI quality, and helping teams make product decisions under ambiguity.
What you’ll work on:
Analytics for AI agents and LLM-powered workflows
Investigation of hallucinations, inconsistencies, and AI failure modes
Analysis of logs, conversations, raw outputs, and operational datasets
AI quality evaluation and monitoring
Building dashboards and monitoring systems for AI performance
Measuring AI impact on product, operations, and user experience
Partnership with Product, Engineering, QA, and Operations teams
What we expect:
3+ years in Product / Data / AI Analytics
Strong Python and SQL skills
Understanding of LLM limitations, hallucinations, and AI evaluation challenges
Experience with complex production systems or automation platforms
Strong analytical and ownership mindset
Experience with conversational AI or AI agents is a plus
Fluent Russian and English B2+
CET-overlapping working hours
Why join MEDvidi:
Work on real AI systems in production
High ownership and direct product impact
Fast-moving startup environment
Fully remote long-term B2B collaboration
Personalized English lessons via Preply
Apply here: