Senior/Expert Data Scientist
ELEKS Artificial Intelligence Office is looking for a Senior/Expert Data Scientist in Ukraine, Poland, Croatia, Europe.
ABOUT CLIENT
The project focuses on a mission-critical emergency response platform that enables the secure transmission of real-time data to public safety agencies. It aggregates information from smartphones, connected vehicles, medical devices, IoT sensors, cameras, and enterprise systems, helping emergency responders receive critical context before or during an incident. The platform supports large-scale deployments and is widely adopted by emergency communication centers across the United States.
REQUIREMENTS
- 5+ years of experience in AI, Machine Learning, Data Science, or related engineering roles
- Proven experience designing and operating evaluation frameworks for conversational AI systems, preferably voice-based applications (or chatbot)
- Strong Python programming skills and experience building automated evaluation pipelines
- Solid background in statistics, data analysis, experiment design, and model benchmarking
- Experience designing high-quality evaluation datasets, including sampling strategies, labeling guidelines, ground-truth creation, and edge-case coverage
- Experience with both human evaluation and LLM-based evaluation methodologies
- Understanding of LLM judge calibration, evaluation consistency, and control of nondeterminism, latency, and evaluation cost
- Experience connecting offline evaluation metrics with production performance and business outcomes
- Experience building continuous evaluation frameworks, regression testing, and release validation pipelines
- Familiarity with conversational AI, NLP, speech recognition, or voice assistant technologies
- Understanding of AI safety, model quality assurance, bias detection, and evaluation best practices
- Strong analytical, problem-solving, and communication skills
- Upper-Intermediate or higher level of English
RESPONSIBILITIES
- Design, implement, and continuously improve evaluation frameworks for production conversational AI systems
- Develop automated evaluation pipelines, benchmarks, datasets, and quality metrics for AI model assessment
- Define evaluation methodologies for multi-turn conversations, dialogue flows, and voice interactions
- Build representative evaluation datasets covering real-world scenarios, edge cases, and safety-critical conversations
- Design and maintain regression testing frameworks for validating new model releases and platform updates
- Compare frontier AI models and assess their readiness for production deployment
- Analyze model failures, identify quality regressions, and recommend improvements based on evaluation results
- Collaborate with AI engineers, data scientists, and product teams to define quality standards and release criteria
- Improve evaluation processes using both human feedback and model-based assessment techniques
- Ensure AI systems meet quality, reliability, compliance, and safety requirements before production release
WHAT YOU WILL GET WITH ELEKS
- Close cooperation with a customer
- Challenging tasks
- Competence development
- Ability to influence project technologies
- Team of professionals
- Dynamic environment with low level of bureaucracy
ABOUT ELEKS
ELEKS is a custom software development company. We deliver value to our clients, thanks to our expertise and experience gained from working as a software innovation partner since 1991.
Our 2000+ professionals located in the Delivery Centers across Eastern Europe and sales offices in Europe and North America, provide our clients with a full range of software engineering services. These include product development, QA, R&D, design, technology consulting and dedicated teams.
Це ідеальний варіант для друга?
Отримай цінний бонус за рекомендацію