Sr. Quality Assurance Engineer - AI ML

The Senior Quality Assurance Engineer designs, builds, tests, and deploys effective test automation solutions across a portfolio of different development projects. They will manually test applications and automate the testing effort to meet the short- and long-term goals of the company’s systems development by applying appropriate automation technologies.   

The ideal candidate will have experience in designing, developing, validating, and executing automated testing for artificial intelligence, machine learning, LLMs and the applications including web-based applications that incorporate these technologies. Eagerness to quickly learn and understand an evolving field is required, as there will be many opportunities to apply new skills in emerging areas of AI/ML development.  

This position will report to the Manager of IT Quality Assurance in the Information Technology department.  

This position is required to report to the SHI Somerset NJ or Austin TX office location as determined by SHI management.    

Since 1989, SHI International Corp. has helped organizations change the world through technology. We’ve grown every year since, and today we’re proud to be a $14 billion global provider of IT solutions and services.

Over 17,000 organizations worldwide rely on SHI’s concierge approach to help them solve what’s next. But the heartbeat of SHI is our employees – all 6,000 of them. If you join our team, you’ll enjoy:

• Our commitment to diversity, as the largest minority- and woman-owned enterprise in the U.S.
• Continuous professional growth and leadership opportunities.
• Health, wellness, and financial benefits to offer peace of mind to you and your family.
• World-class facilities and the technology you need to thrive – in our offices or yours. 

Include but not limited to:  

• Define test strategy, create test plans, author test cases, perform test execution and capture and communicate test results to support ongoing AI/ML team product releases.  

• Conduct functional, performance, and exploratory testing.   

• Collaborate with engineers and product teams on quality strategies and success metrics.  

• Define and implement QA processes to optimize and scale testing.   

• Lead the improvement and implementation of best practices, methodologies, and tooling to meet quality coverage.  

• Integrate testing into the deployment pipeline.  

• Clearly and precisely articulate test results to application developers and management.  

• Debug and resolve complex QA issues, including AI/ML-related challenges.  

• Collaborate with software engineers and application users during the product development lifecycle.   

• Demonstrate compliance with team best practices and security requirements.  

• Create presentations and documentation for knowledge-sharing.  

• • Mentor and guide Quality Assurance Engineers and Software Engineers of all levels learning our applications, architecture, and QA processes.  

• BS in Computer Science (or related field) OR equivalent work experience.  

• At least 5 years professional programming experience (with 3 years of Python experience).  

• Proficiency applying GenAI/LLM and ML Testing Fundamentals.  

• In-depth knowledge of web applications and modern Hypertext Markup Language and Cascading Style Sheets (HTML)/(CSS)  

• Familiarity with majority of the following technologies:   

• APIs (REST and GraphQL), JavaScript, Angular, Typescript, SQL, JSON, C#  

• Ability to create and maintain automated tests using a Python testing framework and Selenium, Appium, Cypress, Playwright, or other test automation tools.  

• Strong problem solving, organizational, and time management skills.  

• Strong analytical skills.  

• Great verbal and communication skills with experience in communicating with technical and non-technical stakeholders across all levels of the organization.  

• Ability to design, develop, document, and maintain test plans for both manual test cases and automated tests scripts.  

• Ability to work independently and participate in collaboration with project teams.  

• A self-starter with attention to detail and a passion for learning and development.  

• Experience working with geographically distributed teams.  

• Experience with REST/OData APIs and GraphQL APIs.  

• Experience working in an Agile/Scrum environment.  

Preferred Skills/Qualifications: 

• Knowledge of QA automation architecture, methodologies, processes, and tools.  

• Experience with GitHub, Jira, Azure, Visual Studio, mabl, Selenium IDE, CI/CD (Jenkins, GitHub Actions), Selenium, Postman, Bootstrap, PyUnit, pytest.  

• The estimated annual pay range for this position is $80,000 - 120,000. The compensation for this position is dependent on job-related knowledge, skills, experience, and market location and, therefore, will vary from individual to individual. Benefits may include, but are not limited to, medical, vision, dental, 401K, and flexible spending. 
• Equal Employment Opportunity – M/F/Disability/Protected Veteran Status