Senior QA Engineer (Automation)

As a Senior QA Engineer, you will be a key member of our quality assurance team, responsible for ensuring the reliability, performance, and security.

While your primary focus will be on establishing robust software testing standards and automation, you will also work closely with security experts and AI engineers to validate the accuracy of our threat detection models. You will collaborate with developers and product managers to deliver a world-class inbox protection product that proactively detects, isolates, and remediates email compromises.

Core QA Responsibilities:

• Test Strategy: Design, develop, and execute comprehensive test plans and test cases for complex email processing pipelines, ensuring high coverage of user interfaces, API integrations (Gmail/Outlook), and backend AI analysis logic.
• Automation: Architect and maintain scalable automated test frameworks and scripts (using tools like Java, Python, Pytest, Selenium, or Cypress) to simulate email traffic and verify security actions, reducing manual effort.
• Defect Management: Identify, document, and track software defects using Jira; work closely with developers to reproduce complex edge cases (e.g., false positives/negatives in phishing detection) and verify fixes.
• Process Improvement: Lead code reviews for test scripts, advocate for Shift-Left testing, and contribute to the continuous improvement of our SDLC and CI/CD pipelines.

Domain-Specific Testing:

• AI & Threat Validation: Test of AI models for development including generation of test samples in an AI test environment.
• Performance Monitoring: Use instrumentation techniques for collecting performance for per customer/tenant in actual runs such as evals.
• Synthetic Data: Apply synthetic data techniques to generate good testing dataset.
• Compliance & Deliverability: Ensure the product adheres to email standards and security regulations without impacting legitimate email deliverability rates.
• Ad-hoc Duties: Perform the duties and tasks assigned by your direct report or asotherwise instructed by the Company.
  

Education: Bachelor's degree in Computer Science, Engineering, or a related field.

Experience:

• 5+ years of professional experience in software quality assurance or SDET roles.
• Automation Expertise: Strong proficiency in Java (preferred) or Python for writing automated test scripts. Experience with frameworks like Pytest, Robot Framework, Selenium, or Cypress.
• Testing Methodologies: Deep understanding of smoke, regression, integration, and performance testing types.
• Tools: Proficiency with bug tracking and project management systems (e.g., Jira, Confluence).
• Soft Skills: Excellent analytical mind, clear communication skills, and the ability to collaborate effectively in a fast-paced environment.
• Language: Professional proficiency in English

Preferred (Domain Specific Skills):

• AI Testing: Familiar with building techniques and testing of AI models for development including generation of test samples in an AI test environment
• Instrumentation: Familiar with building techniques and instrumentation for collecting performance for per customer/tenant in actual runs such as evals
• Synthetic Data: Able to work with environment and familiar with synthetic data techniques to be able to gather & generate enough data for AI model testing.
• Enterprise Email Security: Familiar with broad enterprise email security problems and email security standards such as SPF, DKIM, DMARC.
• Email Protocols: Deep understanding of email infrastructure and protocols (SMTP, IMAP, POP3, MIME types).
• Security Knowledge: Experience testing against Phishing, Spear Phishing, and Malware vectors. Understanding of how email headers are analyzed for forensics.
• Cloud & API: Experience testing integrations with Google Workspace (Gmail API) or Microsoft 365 (Graph API).