QA分析师 - LOIS for Word
QA Analyst - LOIS for Word
Filevine是一家法律AI公司，为法律工作的未来提供法律运营智能。基于单一的真相系统，Filevine将数据、文档、工作流程和团队整合到一个统一的平台中——现代法律工作在此实现清晰和一致。
由LOIS（法律运营智能系统）驱动，Filevine在每个案件中连接上下文，将法律运营从被动转为主动。LOIS能够读取、理解并推理您的数据，揭示洞察、自动化复杂性，并为专业人士提供清晰和信心，让他们看得更多、知道更多、做得更多。由一群卓越的合作者和创新者推动，Filevine的快速增长获得了德勤和《Inc.》杂志的AI奖项和认可，成为国内最具创新性和增长最快的科技公司之一。
职位概述：
该职位负责Filevine的AI驱动法律起草产品Word中的LOIS质量。您将帮助建立并负责质量保证功能：测试策略、流程和自动化。您将在法律AI与产品质量的交叉点上工作，评估从AI输出准确性到产品中UI行为的各个方面。该职位的一大重点是将质量前置，使其从一开始就融入功能的规划和交付中。
理想的候选人拥有2年以上QA经验，对功能缺陷和AI质量问题都有敏锐的观察力，能够在模糊环境中从零开始构建，并且对未经过充分测试的产品感到真正不安。
薪资信息：105,000 - 150,000美元
该薪资范围代表该职位的最低和最高薪资。该职位的总薪酬包将根据个人的所在地、资格、教育、工作经验、技能和绩效来确定。
最终的薪资将根据主要工作地点和专业技能进行权衡。
工作地点期望：远程或可选择在以下地点之一混合办公/办公室：旧金山、纽约、芝加哥或盐湖城
酷炫的公司福利：
- 一家充满活力、迅速发展的公司，专注于帮助组织蓬勃发展
- 医疗、牙科和视力保险（适用于全职员工）
- 竞争力和公平的薪酬
- 产假和陪产假（适用于全职员工）
- 短期和长期残疾福利
- 有机会向专注的领导团队学习
- 最顶尖的
查看英文原文
Filevine is a Legal AI company delivering Legal Operating Intelligence for the future of legal work. Grounded in a singular system of truth, Filevine brings together data, documents, workflows, and teams into one unified platform—where modern legal work happens with clarity and consistency.
Powered by LOIS, the Legal Operating Intelligence System, Filevine connects context across every matter to transform legal operations from reactive to proactive. LOIS reads, understands, and reasons across your data to surface insight, automate complexity, and give professionals the clarity and confidence to see more, know more, and do more. Fueled by a team of exceptional collaborators and innovators, Filevine’s rapid growth has earned AI awards and recognition from Deloitte and Inc. as one of the most innovative and fastest-growing technology companies in the country.
Role Summary:
This role owns quality for LOIS for Word, Filevine's AI-powered legal drafting product. You'll help build and own the QA function: the test strategy, the process, and the automation. You'll work at the intersection of legal AI and product quality, evaluating everything from AI output accuracy to UI behavior across the product. A big part of this role is moving quality upstream, so it's built into how features are planned and shipped from the start.
The ideal candidate has 2+ years of QA experience, brings a sharp eye for both functional bugs and AI quality issues, is comfortable building from scratch in ambiguity, and gets genuinely uncomfortable shipping something they haven't tried to break.
Compensation Information: $105,000 - $150,000
The salary range represents the low and high end of the salary range for this position. The total compensation package for this position will be determined by each individual’s location, qualifications, education, work experience, skills and performance.
An individual’s final offer will be weighted by their primary work location and expertise.
Work Location Expectation: Remote or option to be hybrid/in-office in one the following locations: San Francisco, New York, Chicago, or Salt Lake City
Cool Company Benefits:
- A dynamic, rapidly growing company, focused on helping organizations thrive
- Medical, Dental, & Vision Insurance (for full-time employees)
- Competitive & Fair Pay
- Maternity & paternity leave (for full-time employees)
- Short & long-term disability
- Opportunity to learn from a dedicated leadership team
- Top-of-the-line company swag
Privacy Policy Notice
Filevine will handle your personal information according to what’s outlined in our Privacy Policy.
Communication about this opportunity, or any open role at Filevine, will only come from representatives with email addresses using "filevine.com". Other addresses reaching out are not affiliated with Filevine and should not be responded to.
What You'll Do:
- Define and own the test strategy, process, and QA playbook for the product
- Move QA upstream by partnering with product and engineering early, so test plans are ready before features ship
- Evaluate AI output quality across dimensions like accuracy, citation reliability, and appropriately scoped reasoning
- Design and maintain evaluation sets that account for non-deterministic output and catch regressions over time
- Test how AI-generated edits apply to documents, including accuracy and formatting fidelity across document structures
- Build automated guardrails integrated into CI/CD that cover critical flows
- Write structured, reproducible bug reports
- Partner with legal domain experts to understand how different customer types use the product, and translate that into test coverage
- Approach QA with a product and design mindset. If something works but could be better, we want to hear it
- Compare behavior across product surfaces and document discrepancies
What You'll Need:
- 2+ years of QA experience, including ownership of test strategy for a product or major feature area
- Track record of building QA process and automation from scratch in a fast-moving environment
- Comfort operating in high ambiguity, where features ship quickly and you figure out how to test them fast
- Strong analytical and problem-solving skills, with attention to both functional correctness and AI output quality
- Ability to reason about non-deterministic systems and define what "correct" means when there's no single right answer
- Excellent written communication, with the ability to write clear, concise, actionable bug reports backed by evidence
- Experience with bug tracking tools and test management workflows
Nice To Have:
- Experience testing AI or LLM-based products, especially for output accuracy and eval design
- CI/CD experience setting up pipelines and release gates for automated tests
- A design or UX sensibility, with an eye for where product workflows could be smoother
- Prior experience in legal technology or comfort reading legal contracts
- Programming experience beyond test automation