Prompt Engineer (LLM Systems, Evals & Safety)
你想爱上工作吗？你想要改变，影响和转变人们的生活吗？你希望与一个相信破坏正常，无聊和平均的团队合作吗？如果是的话，那么这是你正在寻找的工作.webook.com 是沙特第一场活动票售和体验预订平台，技术，功能，灵活性，营收服务于英国一些最大的大规模大型盛会超过20亿次销量。角色概览设计高质量的提示，系统说明和工具使我们的 LLM 功能准确，安全和经济效率。你将拥有评估，版本提示和持续改进。关键责任：· 作者，重构器和链接提示 （系统/工具/政策）为各种任务。·创建线下/在线评估套件 （标题，金组，指数）. ·建立即时库与版本化，A / B 测试和远程测量。·通过验证，限制解码和工具使用减少幻觉。·实施安全性：jailbreak/即时注射测试，内容政策检查，PII 处理。·与工程师合作将提示集成到生产功能中。要求。·多种任务类型和模型中的示范即时设计。·经历构建数据集和自动分数 （例如准确度，忠诚度，实用性，成本/可靠性）. ·熟悉提取增强生成概念和工具/功能调用。· 数据准备，评估和分析的强硬脚本 (Python/TypeScript). · 明确写作；将业务目标转化为可测量的快速规格。好处有能力。· 与兰克链/LLM 编排，向量商店和重新排序人员的经验。· 安全工具和红团技术知识。·实验平台 （特征旗，A / B 测试）,分析。最初发布在喜马拉雅山。
查看英文原文
Do you want to love what you do at work? Do you want to make a difference, an impact, and transform peoples lives? Do you want to work with a team that believes in disrupting the normal, boring, and average?
If yes, then this is the job you are looking for , webook.com is Saudi’s #1 event ticketing and experience booking platform in terms of technology, features, agility, revenue serving some of the largest mega events in the Kingdom surpassing over 2 billion in sales.
Role Overview
Design high-quality prompts, system instructions, and tooling that make our LLM features accurate, safe, and cost-effective. You’ll own evaluation, prompt versioning, and continuous improvement.
Key Responsibilities:
- Author, refactor, and chain prompts (system/tool/policy) for varied tasks.
- Create offline/online evaluation harnesses (rubrics, golden sets, metrics).
- Build prompt libraries with versioning, A/B testing, and telemetry.
- Reduce hallucinations via verification, constrained decoding, and tool use.
- Implement safety: jailbreak/prompt-injection tests, content policy checks, PII handling.
- Partner with engineers to integrate prompts into production features.
Requirements
- Demonstrated prompt design across multiple task types and models.
- Experience building eval datasets and automated scoring (e.g., accuracy, faithfulness, utility, cost/latency).
- Familiarity with retrieval-augmented generation concepts and tool/function calling.
- Strong scripting (Python/TypeScript) for data prep, evals, and analysis.
- Clear writing; ability to translate business goals into measurable prompt specs.
Nice-to-Haves
- Experience with LangChain/LLM orchestration, vector stores, and rerankers.
- Knowledge of safety tooling and red-teaming techniques.
- Experiment platforms (feature flags, A/B tests), analytics.
Originally posted on Himalayas