机器学习研究员/工程师（基础模型）
Machine Learning Researcher / Engineer (Foundational Models)
关于Pathway
在Pathway，我们正在颠覆人工智能的基础，推出世界上首个后Transformer模型，该模型的适应和思考方式与人类相似。我们的突破性架构优于Transformer，并为企业提供了对模型工作原理的全面可见性。将基础模型与市场上最快的数据显示处理引擎相结合，Pathway使企业能够超越渐进式优化，迈向真正情境化、以体验驱动的智能。NATO、La Poste和一级方程式赛车队等组织都信任我们。
Pathway由联合创始人兼首席执行官Zuzanna Stamirowska领导，她是一位复杂性科学家，组建了一支由AI先驱组成的团队，包括首席技术官Jan Chorowski，他是第一个将注意力机制应用于语音的人，并曾在Google Brain与诺贝尔奖得主Geoff Hinton合作，以及首席科学官Adrian Kosowski，他是一位领先的计算机科学家和量子物理学家，20岁便获得博士学位。
该公司得到了包括Lukasz Kaiser在内的领先投资者和顾问的支持，他是Transformer论文的合著者（ChatGPT中的“T”），也是OpenAI推理模型的关键研究人员。Pathway总部位于加利福尼亚州帕洛阿尔托。
职位机会
这是一项基于注意力机制模型的研发职位。
我们目前正在寻找1至2名在机器学习模型研究方面有出色成绩的研发工程师。
这是一个极具雄心的基础性项目。该项目配有灵活的GPU预算，最低保证在7位数以上。
你将
- 执行（分布式）模型训练。
- 根据实验结果帮助改进/调整模型架构。
- 设计新的任务和实验。
- 可选：监督参与数据准备的团队成员的工作。
你工作的成果将在项目的成功中发挥关键作用。
要求
简历信
我们总是很高兴收到你的消息！如果你能留给我们2-3句话，我们将非常感激。
你需满足以下至少一项条件：
- 你在NeurIPS、ICLR或ICML上发表过至少一篇论文——你是第一作者或做出了重要的概念和代码贡献。
- 你曾显著地为LLM训练工作做出贡献并引起新闻关注（如登上Huggingface基准榜首、成为行业最佳模型等），最好使用多块GPU。
- 你至少有6个月在领先机构从事相关工作的经验。
查看英文原文
About Pathway
At Pathway we are shaking the foundations of artificial intelligence by introducing the world’s first post-transformer model that adapts and thinks just like humans.
Our breakthrough architecture outperforms Transformer and provides the enterprise with full visibility into how the model works. Combining the foundational model with the fastest data processing engine on the market, Pathway enables enterprises to move beyond incremental optimization and toward truly contextualized, experience-driven intelligence. We are trusted by organizations such as NATO, La Poste, and Formula 1 racing teams.
Pathway is led by co-founder & CEO Zuzanna Stamirowska, a complexity scientist who created a team consisting of AI pioneers, including CTO Jan Chorowski who was the first person to apply Attention to speech and worked with Nobel laureate Geoff Hinton at Google Brain, as well as CSO Adrian Kosowski, a leading computer scientist and quantum physicist who obtained his PhD at the age of 20.
The company is backed by leading investors and advisors, including Lukasz Kaiser, co-author of the Transformer (“the T” in ChatGPT) and a key researcher behind OpenAI’s reasoning models. Pathway is headquartered in Palo Alto, California.
The Opportunity
This is an R&D position in attention-based models.
We are currently searching for 1 or 2 R&D Engineers with a strong track record in machine learning models research.
This is an extremely ambitious foundational project. There is a flexible GPU budget associated with this specific project, guaranteed to be in the 7-digit range minimum.
You Will
- perform (distributed) model training.
- help improve/adapt model architectures based on experiment results.
- design new tasks and experiments.
- optionally: oversee activities of team members involved in data preparation.
The results of your work will play a crucial role in the success of the project.
Requirements
Cover letter
It's always a pleasure to say hi! If you could leave us 2-3 lines, we'd really appreciate that.
You are expected to meet at least one of the following criteria:
- You have published at least one paper at NeurIPS, ICLR, or ICML - where you were the lead author or made significant conceptual & code contributions.
- You have significantly contributed to an LLM training effort which became newsworthy (topped a Huggingface benchmark, best in class model, etc.), preferably using multiple GPU's.
- You have spent at least 6 months working in a leading Machine Learning research center (e.g. at: Google Brain / Deepmind, Apple, Meta, Anthropic, Nvidia, MILA).
- You were an ICPC World Finalist, or an IOI, IMO, or IPhO medalist in High School.
You Are
- A deep learning researcher, with a track record in Language Models and/or RL (candidates with a Vision or Robotics ML background are also welcome to apply).
- Interested in improving foundational architectures and creating new benchmarks.
- Experienced at hands-on experiments and model training (PyTorch, Jax, or Tensorflow).
- Have a good understanding of GPU architecture, memory design, and communication.
- Have a good understanding of graph algorithms.
- Have some familiarity with model monitoring, git, build systems, and CI/CD.
- Respectful of others
- Fluent in English
Bonus Points
- Knowledge of approaches used in distributed training.
- Familiarity with Triton
- Successful track-record in algorithms & data science contests.
- Showing a code portfolio.
Why You Should Apply
- Join an intellectually stimulating work environment.
- Be a pioneer: you get to work with a new type of "Live AI" challenges around long sequences and changing data.
- Be part of one of an early-stage AI startup that believes in impactful research and foundational changes.
Benefits
- Type of contract: Full-time, permanent
- Preferable joining date: Immediate. The positions are open until filled – please apply immediately.
- Compensation: six-digit annual salary based on profile and location + Employee Stock Option Plan.
- Location: Remote work. Possibility to work or meet with other team members in one of our offices: Palo Alto, CA; Paris, France or Wroclaw, Poland. Candidates based anywhere in the EU, UK, United States, and Canada will be considered.
If you meet our broad requirements but are missing some experience, don’t hesitate to reach out to us.
Originally posted on Himalayas