高级数据工程师
Senior Data Engineer
多年以后，历史将回顾这个时刻，将其视为人类的一个里程碑——生成式人工智能开始改变一切的时刻。幸运的是，你正亲历这一时代。现在呢？
如果你是那些少数人之一，渴望将自己的才智投入到技术进步的持续浪潮中，那么Loka就是你最佳的杠杆点。
Loka是一家总部位于硅谷的全球分布式技术咨询公司，我们正在寻找一名高级数据工程师加入不断壮大的团队。在这个职位上，你将设计、实施并扩展从批处理到流处理的数据解决方案，处理从几兆字节到数拍字节的低延迟需求。你将成为良好实践的倡导者，并处于新技术和架构模式的最前沿。最终，我们期望你不仅能够融入我们的数据团队，还能将其提升到新的高度。
我们帮助客户推出创新方案，解决气候问题、战胜癌症、提高农业效率、教孩子阅读等。我们与各种类型的公司合作，从硅谷初创公司到知名大品牌，始终秉持我们根本的信念：使命至关重要。我们的同事中超过200名是经过认证的专业人士、技术专家和博士——这些致力于卓越的Lokals不仅为客户服务，还指导初级同事。我们完全远程办公，用内部孵化器测试新想法，每周五都放假（真的）。
作为结尾，2024年底，Loka被AWS评为年度创新合作伙伴，击败了超过15万名合作伙伴获得该称号。
我们对文化与项目一样自豪。你也会如此。加入我们的团队，与一个你引以为豪的团队一起，满足你成长和交付你相信的项目的需要。
**职位职责**
- 构建可扩展的生产级数据管道和实时数据流。
- 编写和设计可扩展、云就绪的应用程序。
- 领导技术项目，通过架构、设计和实现阶段。
- 与客户沟通以理解他们的业务和技术需求，评估潜在解决方案，并定义高层次的实施方案和估算。
- 与机器学习、数据科学、设计、软件工程和业务团队协作，处理数据或ETL问题。
- 构建测试和健康检查以维护代码和数据质量。
- 监控系统性能并优化数据处理流程。
查看英文原文
Years from now, history will look back at this moment as a landmark for the human race—the moment when generative artificial intelligence began to change _everything_. Luckily, you happen to be living through it. Now what?
If you’re one of those rare people driven to add their intellectual energy to the relentless momentum of technological advancement, consider Loka your optimal leverage point.
Loka is a globally distributed tech consultancy based in Silicon Valley, and we’re seeking a Senior Data Engineer to join our growing team. In this role you will design, implement and scale data solutions from batch to streaming, dealing with the low-latency requirements of a few megabytes up to several petabytes. You will be an evangelist of good practices and dwell at the cutting edge of new technologies and architectural patterns. Ultimately we expect that you will not just fit in with our Data crew but elevate it to new heights.
We help our clients launch innovations that fix the climate, defeat cancer, improve agricultural efficiencies, teach kids to read and more. We work with all kinds of companies, from Silicon Valley startups to major household brands, always guided by our fundamental belief that mission matters. We count more than 200 certified specialists, technical experts and PhDs among our colleagues—committed Lokals who contribute to their brilliance not only to serving our clients but to mentoring junior colleagues as well. We work entirely remotely, test new ideas with our in-house incubator and take every other Friday off (really).
To cap it off, at the end of 2024 Loka was recognized by AWS as Innovation Partner of the Year, beating more than 150,000 partners for the title.
We’re as proud of our culture as we are of our projects. You will be too. Join our team, feed your need to grow and ship projects you believe in with a team you’re proud to be a part of.
**The Role**
- Build scalable production-grade data pipelines and real-time data streams.
- Write and design scalable, cloud-ready applications.
- Lead technical projects through architecture, design and implementation phases.
- Engage with clients to understand their business and technical needs, evaluate potential solutions, and define high-level implementation approaches and estimates.
- Collaborate with Machine Learning, Data Science, Design, Software Engineering and Business teams to triage data or ETL issues.
- Build tests and health checks to maintain code and data quality.
- Monitor and analyze data flowing through various systems by adding appropriate visualizations and dashboards.
- Contribute to internal engineering initiatives and projects, helping identify opportunities for improvement, evaluate solutions, and drive their implementation.
- Provide updates and offer guidance to clients.
**Technical Requirements**
- Advanced Python and SQL
- Experience in ETL design, implementation, and maintenance.
- Experience in AWS (preferred), GCP, or Azure delivering data-centric product experiences
- 5+ years experience in related role
- Experience with in-memory and disk-based databases, relational and non-relational databases, full-text search engines, database design, development, and maintenance. (Such as MySQL, MongoDB, OpenSearch, and DynamoDB, with bonus for Graph Databases like Neo4j)
- Experience with data warehousing and multidimensional data models (columnar data modeling)
- Working knowledge in Data Lake, Data warehouse and massive parallel processing
- Strong problem-solving ability and ability to work through ambiguity and incomplete specifications
**Preferred but Not Required**
- Working knowledge in IAM, Federated Authentication, SSO, SAML, Encryption, Security, APIs, Disaster Recovery or Backup
- Strong ability in distributed systems for large-scale data processing
- Experience with Spark and Pandas
- Experience with Open Tables (Hudi, Delta Lake, DataBricks, Iceberg as related to Data Lakehouse)
- Experience with Infrastructure as Code and CI/CD Pipelines
- Experience with QuickSight and DataViz
**Additional Requirements**
- Excellent English - Being a global team, we work entirely in English for meetings, customer calls and business communications
- CV written in English
**Personality Profile**
- Curious: You strive to learn and grow into different industries with a modern tech stack.
- Autonomous: You thrive in a fully remote, globally distributed team.
- Collaborative: You enjoy working across departments.
- Adaptable: You operate with a startup mindset and move at startup speed.
**Benefits**
- Every other Friday off (26 extra days off a year)
- Remote-first culture
- Explore and Relocation programs (three months work abroad or full international relo)
- Paid sick days and local holidays
- Business English classes program
- Continuous Learning Support
- Fitness and/or Mental Health Subscriptions
- Access to LokaLabs™, our internal research and development program
- Defined career path
_Your achievements matter to us! Ensure your CV and LinkedIn and GitHub profiles are up to date and accurately reflect your experience._