harri is the frontline employee experience platform built for companies who have service at the heart of their business. The solution is built on the notion that the customer experience will never exceed the employee experience. The Harri suite of talent attraction, workforce management and employee engagement technologies enable organizations to attract, manage, engage and retain the best talent for their business.

Hospitality is in our DNA, with most of our global team having front line and management restaurant experience - we are changing the landscape of our industry and frontline workers technology. We need the very best and brightest to join us on this mission to disrupt the market as it stands today. 

Based in NYC, Harri has global offices in the UK, Palestine and India and has been awarded: Top 50 Startup by LinkedIn, Best Enterprise Solution for HR/Workforce by HR Tech Awards & NYC Best Tech Startup for the Tech in Motion Events Timmy Awards.

Position Description

The Gen-AI QA Engineer role is focused on validating the Applications/Services, specifically the functionality, performance and accuracy of Generative AI models. You will also be responsible for ensuring their successful integration with other applications, both in house and 3rd Party. You will also be expected to maintain detailed documentation of test results to assist in debugging, model refinement, and ongoing monitoring of AI-driven functionalities. The role involves close collaboration with AI engineers, product managers and data scientists to ensure the quality and reliability of our AI models.

Role and Responsibilities 

Typical duties and responsibilities for a Gen-AI QA Engineer position may include but are not limited to:

• Review functional and design specifications, with a specific focus on AI/ML models and generative AI features, to ensure full understanding of individual deliverables.

• Execute manual and automated tests to evaluate the quality, accuracy, and performance of generative AI models, integrations and applications.

• Collaborate with cross-functional teams, including AI engineers and data scientists, to identify and report software defects and issues specific to AI models (e.g., bias, hallucination, performance).

• Stay up-to-date with the latest QA tools and trends in AI/ML, including model evaluation metrics and techniques.

• To quickly become an expert in our tech stack, specifically the systems relating to AI/ML and generative AI. Requesting training when required, especially in areas of AI/ML model evaluation and validation.

• Work closely with developers to ensure the timely resolution of defects, particularly those related to AI model behavior and output.

• Participate in all aspects of the software development lifecycle, including design, development, testing, and deployment of AI-powered applications. Hold and facilitate test plan/case reviews with cross-functional team members, with a strong emphasis on evaluating AI/ML components.

• Identify any potential quality issues related to AI models and data pipelines per defined processes and escalate potential quality issues as needed (e.g., model drift, data inconsistencies).

• Ensure that validated deliverables, including generative AI outputs and model performance, meet functional and design specifications and requirements.

• Contribute to automated testing frameworks specifically designed for evaluating AI/ML models.

• Continuously improve our QA processes and testing methodologies for generative AI systems.

• Knowledge sharing and culture building within the team structure, particularly in the area of AI/ML testing and best practices.

• Keep aligned with Harri's team(s) coding and design standards.

• Ability to communicate and work well with others, including those with specialized AI/ML expertise.

• Ability to deliver on time, maintaining a high quality of work, especially concerning the accuracy and reliability of AI model testing.

• Check in with your line manager and update on your progress, particularly regarding AI/ML model testing activities and results.

• To live and breathe the Harri Company values.

harri is the frontline employee experience platform built for companies who have service at the heart of their business. The solution is built on the notion that the customer experience will never exceed the employee experience. The Harri suite of talent attraction, workforce management and employee engagement technologies enable organizations to attract, manage, engage and retain the best talent for their business.

Hospitality is in our DNA, with most of our global team having front line and management restaurant experience - we are changing the landscape of our industry and frontline workers technology. We need the very best and brightest to join us on this mission to disrupt the market as it stands today. 

Based in NYC, Harri has global offices in the UK, Palestine and India and has been awarded: Top 50 Startup by LinkedIn, Best Enterprise Solution for HR/Workforce by HR Tech Awards & NYC Best Tech Startup for the Tech in Motion Events Timmy Awards.

Position Description

The Gen-AI QA Engineer role is focused on validating the Applications/Services, specifically the functionality, performance and accuracy of Generative AI models. You will also be responsible for ensuring their successful integration with other applications, both in house and 3rd Party. You will also be expected to maintain detailed documentation of test results to assist in debugging, model refinement, and ongoing monitoring of AI-driven functionalities. The role involves close collaboration with AI engineers, product managers and data scientists to ensure the quality and reliability of our AI models.

Role and Responsibilities 

Typical duties and responsibilities for a Gen-AI QA Engineer position may include but are not limited to:

• Review functional and design specifications, with a specific focus on AI/ML models and generative AI features, to ensure full understanding of individual deliverables.

• Execute manual and automated tests to evaluate the quality, accuracy, and performance of generative AI models, integrations and applications.

• Collaborate with cross-functional teams, including AI engineers and data scientists, to identify and report software defects and issues specific to AI models (e.g., bias, hallucination, performance).

• Stay up-to-date with the latest QA tools and trends in AI/ML, including model evaluation metrics and techniques.

• To quickly become an expert in our tech stack, specifically the systems relating to AI/ML and generative AI. Requesting training when required, especially in areas of AI/ML model evaluation and validation.

• Work closely with developers to ensure the timely resolution of defects, particularly those related to AI model behavior and output.

• Participate in all aspects of the software development lifecycle, including design, development, testing, and deployment of AI-powered applications. Hold and facilitate test plan/case reviews with cross-functional team members, with a strong emphasis on evaluating AI/ML components.

• Identify any potential quality issues related to AI models and data pipelines per defined processes and escalate potential quality issues as needed (e.g., model drift, data inconsistencies).

• Ensure that validated deliverables, including generative AI outputs and model performance, meet functional and design specifications and requirements.

• Contribute to automated testing frameworks specifically designed for evaluating AI/ML models.

• Continuously improve our QA processes and testing methodologies for generative AI systems.

• Knowledge sharing and culture building within the team structure, particularly in the area of AI/ML testing and best practices.

• Keep aligned with Harri's team(s) coding and design standards.

• Ability to communicate and work well with others, including those with specialized AI/ML expertise.

• Ability to deliver on time, maintaining a high quality of work, especially concerning the accuracy and reliability of AI model testing.

• Check in with your line manager and update on your progress, particularly regarding AI/ML model testing activities and results.

• To live and breathe the Harri Company values.