InterviewXpert — AI-Powered Mock Interview Platform
Dynamic resume-to-question LLM orchestration paired with real-time OpenCV computer vision for candidate behavioral telemetry
AI/ML Engineer & GenAI Systems Architect • Savitribai Phule Pune University (SPPU)
The Problem Statement
Solution Architecture & Implementation
InterviewXpert links a dynamic React.js frontend with an asynchronous FastAPI microservice backend over duplex WebSockets. When a resume PDF is uploaded, a custom parsing pipeline extracts skills, projects, and work experience. The Gemini API dynamically designs a progressive 5-stage interview plan. As the candidate answers through their camera and microphone, an OpenCV pipeline calculates facial landmark alignment, eye gaze drift, and head motion stability while speech-to-text streams answers into a semantic evaluation engine.
Key Engineering Innovations
Dynamic Contextual Question Branching: If a candidate struggles with distributed systems, the system recursively prompts with diagnostic hints before pivoting to related architectural trade-offs.
Edge-Optimized Gaze Tracking: Built low-compute OpenCV landmark algorithms that track pupil position without requiring heavy GPU acceleration on client hardware.
Holistic Multi-Modal Scorecard: Synthesizes technical code accuracy, communication clarity (WPM and filler words), and emotional confidence into an actionable post-interview breakdown.
Performance Benchmarks & Empirical Impact
| Metric | Before / Baseline | Engineered | Net Impact |
|---|---|---|---|
| Resume-to-Interview Tailoring | Static Questions | 100% Dynamic | Zero Generic Questions |
| Audio-Video Processing Latency | 1,200ms | 380ms | 68% Latency Reduction |
| Behavioral Detection Accuracy | Manual Review | 91.4% Automated | Instant Objective Scoring |
Technology Stack Architecture
Frontend & Streaming
Backend Microservices
Computer Vision
Generative AI
Looking for an AI/ML Engineer or GenAI Consultant?
Yash Jondhale delivers production-ready RAG pipelines, FastAPI microservices, and computer vision systems. Available for machine learning roles and enterprise AI advisory.