QA Analyst

MaxSys Staffing & Consulting


_ At this time MaxSys Staffing & Consulting will not sponsor individuals for employment visas. Only Candidates authorized to work in Canada will be contacted. _

We are looking for a 2 QA Analyst to join the team.

We are focusing on the development of Machine Learning (ML) models that analyze and standardize product characteristics. QA Analyst’s role will include reviewing ML Model accuracy and assessing the accuracy of ground truth data labels.

This role demands meticulous attention to detail, critical thinking, and an understanding of retail product characteristics.



Responsibilities:
Review of Annotated Data: Review of annotated ground truth data which includes evaluating the accuracy of labels generated through Azure ChatGPT and Google Gemini LLMs. The accuracy of generated labels will be evaluated against the provided definitions for each label.
Manual Review of Model Outputs for Product Characteristics: Conduct thorough manual reviews using Excel to analyze ML model outputs using the provided documentation that outlines the criteria for model performance as well as detailed definitions for each product characteristic.
Test Case Design and Implementation: Design and implement comprehensive test cases and reports.

This includes reviewing user stories and requirements documents to ensure testability and communicating any gaps efficiently.
Documentation and Communication: Document edge cases, decisions, and test results meticulously. Communicate quantitative and qualitative findings from test results to the development team, highlighting defects, errors, and areas for improvement.
Collaboration and Problem-Solving: Work closely with the development team to understand model dataset requirements and ensure they are met.

Proactively raise blockers, ask critical questions, and navigate through challenging examples with a problem-solving mindset.
Quality Assurance and Enhancement: Monitor efforts to resolve issues and re-test bug fixes to ensure the final product satisfies the product requirements and meets end-user expectations. Suggest enhancements to improve product efficiency and effectiveness.

Qualifications:
1-3 years of experience in a QA role, preferably with exposure to ML model development or similar technical fields.
Excellent communication skills, both written and verbal, with the ability to convey complex information clearly and persuasively.
Strong analytical and critical thinking skills, with a keen eye for detail and a commitment to accuracy.
Proficiency in reviewing and annotating data, with a basic understanding of ML model development principles.
Strong collaboration skills, with the ability to work effectively with development teams and stakeholders.
A proactive approach to problem-solving, willing to challenge test scenarios and suggest improvements.
A strong foundation in English language proficiency, necessary for reviewing product information against business requirements and communicating effectively within the team.



Please share your resumes with us now!

For further inquiries, please call



_ MaxSys is committed to a diverse, equal, and inclusive workforce.

We are committed to meeting the needs of persons with disabilities. If you need to be accommodated during any phase of the hiring process, please advise our Recruitment team and we will make all reasonable efforts to accommodate your request. _


_ At this time MaxSys Staffing & Consulting will not sponsor individuals for employment visas.

Only Candidates authorized to work in Canada will be contacted. _



Job Types: Full-time, Fixed term contract



Pay: $40.00-$45.00 per hour

Schedule:
Monday to Friday

Experience:
QA role: 1 year (preferred)
ML Model development/or similar: 1 year (preferred)


Work Location: In person