测试负责人 – 聚合人工智能（远程 - 美国）
Lead Software Engineer in Test – Agentic AI (Remote - US)
为什么加入Nextech？
我们是特种医疗技术解决方案的领导者。
我们致力于招聘和留住人才，因此通过具有竞争力的薪资、丰厚的奖金结构、完善的医疗保障、全面的健康计划以及众多其他福利来投资员工。
如果您是一名软件工程师、财务或会计专业人士、客户支持专家，或是对医疗技术充满热情的业务开发专家（仅举几例），我们期待您的加入。
我们是一家平等机会雇主，致力于多元化。无论个人特征如何，所有个体都鼓励申请。如果您在申请过程中需要协助或合理调整，请联系。
职位概述：
测试主管 – 代理AI负责领导跨下一代人工智能驱动的应用程序和分布式系统的质量工程策略和执行。该职位推动可扩展自动化框架的设计，验证复杂的AI代理行为，并确保UI、API、后端和AI编排层的高质量交付。
所有活动必须符合平等就业机会（EEO）法律、HIPAA、ERISA及所有适用法规。
主要职责
- 除了遵守Nextech的行为和道德标准外，职责包括：
- 设计、开发和维护跨UI、API、后端和AI驱动应用程序的可扩展自动化框架和回归测试套件。
- 领导代理AI系统的质量工程计划，包括大语言模型工作流、检索增强生成管道、自主代理和分布式编排平台。
- 验证复杂的AI代理行为，如多代理协调、工具调用、提示链式、记忆保留、对话流程和回退/重试机制。
- 在云原生和分布式环境中制定并执行功能、集成、回归、端到端和性能测试策略。
- 与软件工程师、产品经理和DevOps团队合作，将测试整合到软件开发生命周期中。
- 构建可重复使用的自动化解决方案，以验证API、编排层、异步工作流、企业集成和AI驱动的业务流程。
- 设计和维护强大的测试环境、CI/CD集成、云执行平台和自动化流程。
查看英文原文
Why join Nextech?
We are a leader in specialty healthcare technology solutions.
We’re committed to hiring and retaining talent, which is why we invest in our employees through competitive pay, a generous bonus structure, great healthcare, a comprehensive wellness program, and many other benefits.
If you are a software engineer, finance or accounting professional, customer support specialist, or a business development expert with a passion for healthcare technology (just to name a few), we want to hear from you.
We are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics are encouraged to apply. If you are a candidate in need of assistance or an accommodation in the application process, please contact .
Job Summary:
The Lead Software Engineer in Test – Agentic AI is responsible for leading quality engineering strategy and execution across next-generation AI-powered applications and distributed systems. This role drives the design of scalable automation frameworks, validates complex AI agent behaviors, and ensures high-quality delivery across UI, API, backend, and AI orchestration layers.
All activities must be performed in compliance with Equal Employment Opportunity (EEO) laws, HIPAA, ERISA, and all other applicable regulations.
Essential Functions
- In addition to adhering to Nextech’s conduct and behavioral standards, responsibilities include:
- Design, develop, and maintain scalable automation frameworks and regression test suites across UI, API, backend, and AI-driven applications.
- Lead quality engineering initiatives for Agentic AI systems, including LLM workflows, RAG pipelines, autonomous agents, and distributed orchestration platforms.
- Validate complex AI agent behaviors such as multi-agent coordination, tool calling, prompt chaining, memory retention, conversational workflows, and fallback/retry mechanisms.
- Develop and execute functional, integration, regression, end-to-end, and performance testing strategies across cloud-native and distributed environments.
- Collaborate with Software Engineers, Product Managers, and DevOps teams to integrate testing throughout the software development lifecycle.
- Build reusable automation solutions to validate APIs, orchestration layers, asynchronous workflows, enterprise integrations, and AI-driven business processes.
- Design and maintain robust test environments, CI/CD integrations, cloud execution platforms, and automation pipelines to improve efficiency and reliability.
- Establish and drive best practices related to code quality, maintainability, scalability, dependency injection, observability, and testability.
- Lead validation efforts for AI workflow resiliency, distributed system reliability, data consistency, and orchestration performance under failure and edge-case conditions.
- Mentor QA engineers and contribute to the development of scalable QA standards, automation strategies, reporting practices, and continuous improvement initiatives.
Minimum Requirements
- Bachelor’s degree in Computer Science, MIS, Engineering, or a related technical field.
- 8+ years of experience in Software Development or Software Engineer in Test (SDET/SET) roles.5+ years of hands-on experience developing automation frameworks using JavaScript/TypeScript or Java.
- Strong experience with automation tools such as Playwright, Cypress, Postman, K6, or equivalent frameworks.2+ years of experience testing AI-powered applications, LLM systems, Agentic AI platforms, orchestration frameworks, or autonomous workflows.
- Hands-on experience validating agent orchestration workflows, conversational AI applications, multi-step reasoning systems, and AI-driven business processes.
- Experience testing AI orchestration frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, or similar technologies.
- Strong expertise in API testing, backend integration testing, UI automation, and end-to-end workflow validation.
- Solid understanding of automation architecture, design patterns, anti-patterns, dependency injection, and inversion of control principles.
- Experience working in cloud-native and containerized environments (Azure, AWS, GCP, Docker, Kubernetes).Proven experience integrating automated test suites into CI/CD pipelines and distributed cloud environments.
- Experience validating asynchronous, event-driven, and distributed systems with a focus on resiliency and fault tolerance.
- Strong analytical, debugging, troubleshooting, and problem-solving skills.
- Excellent organizational, communication, and stakeholder collaboration skills in Agile environments.
- Experience with AI observability, telemetry, RAG pipeline validation, vector databases, or prompt evaluation frameworks (preferred).
Preferred Qualifications
- Experience with Azure DevOps, GitHub Actions, or similar CI/CD platforms.
- Experience with AI observability tools, telemetry platforms, and prompt evaluation frameworks.Experience validating RAG pipelines, vector databases, and AI response accuracy.
- Knowledge of healthcare systems, HIPAA compliance, and regulated enterprise environments.
- Experience with event-driven architectures, messaging systems, and distributed data platforms (including SQL Server).
- Prior experience leading QA teams, mentoring engineers, and implementing enterprise test reporting and quality metrics practices.
Work Environment/Physical Demands
- Remote work
- Activities require a significant amount of work in front of a computer monitor.
Total Rewards:
Generous annual bonus opportunity
401(k) with Employer Match
Flexible Time Off: take time off when you need it without worrying about available hours
11 paid holidays
Your Day Your Way - Celebrate a day of cultural or social significance to you
Access to Linkedin Learning courses for professional development
Insurance: Choice of Medical, Dental, and Vision plans
Health Savings Account with employer match
Flexible Spending Account
100% Company-Paid Parental leave (After 6 months with the company)
Company-Paid Life Insurance and Short/Long Term Disability Insurance
Nextech Luminary Peer Recognition Program
Employee Assistance Program with free counseling sessions available
Corporate Discounts on Retail, Travel, and Entertainment
Originally posted on Himalayas