engineering
Posted 1 weeks agoQuality Engineer 3 - AI - SOC Automation
at Arctic Wolf
Bengaluru, IndiaRemote
Responsibilities
- Review testing strategies, approaches, and test plans and provide insight to development teams.
- Architect, design and build software to automate a variety of testing methods (e.g.
- Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability.
Requirements
- About the Role At Arctic Wolf, our AI-driven Security Operations Cloud ( AISOC ) processes hundreds of billions of security signals every day from a wide range of on-premises and cloud environments.
- Using advanced AI and automation, our platform turns complex data into meaningful insights that help detect and respond to threats faster and more effectively.
- Behind the scenes, our platform is powered by a scalable, distributed architecture built on microservices that enable real-time analysis and continuous improvement in threat detection.
- In this role, you’ll contribute to ensuring the reliability, performance, and quality of systems that are critical to delivering AI-powered security outcomes.
- API validation, performance/load testing, fuzzing, etc.) Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection, and regression testing for AI inference APIs.
- Our Technology Stack: Pytest, Robot, RestAPIs, Python, Playwright, Docker, Kubernetes, AWS (Bedrock, Lambda, SQS, S3, etc.), LangChain, LLM evaluation frameworks (e.g., Ragas), OpenAPI, Postgres, Linux.
- You: Are excited to work at the intersection of AI/ML, Big Data and the Cybersecurity problem space Have
- experience deploying services on cloud computing platforms (e.g, AWS, Azure, GCP) Continuously learn and expand your technical horizons Work as part of a team of highly skilled software professionals.
- If this applies, candidates are required to notify us in advance so we can explore appropriate accommodations.
- And we appreciate that—by protecting people’s and organizations’ sensitive data and seeking to end cyber risk— we get to work in an industry that is fundamental to the greater good.
- responsibilities in accordance with AWN’s Information Security policies, standards, processes, and controls to protect the confidentiality, integrity and availability of AWN business information (in accordance with our employee handbook and corporate policies) .