资深工程师 - Databricks
Staff Engineer - Databricks
我们致力于让团队无缝管理任务并更智能地扩展解决方案。现在,在我们最具雄心的篇章中,我们将人类团队与AI代理结合起来。通过协调代理擅长的工作,自动化手动任务,并在大规模中发现洞察,我们为人们腾出空间,专注于真正重要的事情:判断力、创造力和大格局思考。这就是工作中的魔法,也是我们每天所追求的。
**你将:**
- 数据架构与设计:设计并监督可扩展且可靠的数据显示平台架构,包括数据管道、存储解决方案和处理系统
- 数据建模与管理:开发和实施数据模型,确保数据质量,并建立数据治理政策
- 数据管道开发:构建和优化数据管道,用于从各种来源摄取、处理和转换大型数据集
- 性能优化:识别并解决数据管道和系统中的性能瓶颈,确保高效的数据检索和处理
- 技术评估与创新:关注新兴数据技术,探索创新机会以提升组织的数据基础设施
- 故障排查与解决问题:诊断并解决复杂的数据相关问题,确保数据平台的稳定性和可靠性
- 数据安全与合规:实施数据安全措施,确保符合数据治理政策,保护敏感数据
- 完成其他指派的任务
**你需要具备:**
- 计算机科学、工程或相关领域的学士或硕士学位
- 10年以上数据工程或类似岗位经验
- 具备高可用性和可扩展性的企业SaaS软件解决方案经验
- 处理来自不同数据源的大规模结构化和非结构化数据的经验
- 在构建和维护数据平台系统方面有经验,如分布式计算、数据编排、分布式存储、流式基础设施,确保可扩展性、可靠性、效率和安全性
- 与产品工程团队合作,以数据、AI和分析用例为出发点影响设计
- 在涉及PB级数据的系统设计方面有深入经验,使用Databricks Lakehouse
- 在现代AI/数据基础设施模式方面有经验,包括为AI代理组织数据的语义层(元数据、上下文)
- AWS、G
查看英文原文
For over 20 years, Smartsheet has empowered teams to manage work seamlessly and scale solutions smarter. Now, in our most ambitious chapter yet, we are uniting human teams with AI agents. By orchestrating the work agents do best, automating manual tasks and uncovering insights at scale, we create the space for people to focus on what truly matters: judgment, creativity, and big thinking. That is magic at work, and it’s what we show up for every day.
**You Will:**
- Data Architecture and Design: Designing and overseeing the architecture of scalable and reliable data platforms, including data pipelines, storage solutions, and processing systems
- Data Modelling and Management:Developing and implementing data models, ensuring data quality, and establishing data governance policies
- Data Pipeline Development: Building and optimising data pipelines for ingesting, processing, and transforming large datasets from various sources
- Performance Optimisation: Identifying and resolving performance bottlenecks in data pipelines and systems, ensuring efficient data retrieval and processing
- Technology Evaluation and Innovation: Staying abreast of emerging data technologies and exploring opportunities for innovation to improve the organisation’s data infrastructure
- Troubleshooting and Problem Solving: Diagnosing and resolving complex data-related issues, ensuring the stability and reliability of the data platform
- Data Security and Compliance: Implementing data security measures, ensuring compliance with data governance policies, and protecting sensitive data
- Perform other duties as assigned
**You Have:**
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 10+ years of experience in data engineering or a similar role.
- Enterprise SaaS software solutions with high availability and scalability
- Solution handling large scale structured and unstructured data from varied data sources
- Experience in building and maintaining data platform systems such as distributed compute, data orchestration, distributed storage, streaming infrastructure ensuring scalability, reliability, efficiency and security
- Working with Product engineering team to influence designs with data, AI and analytics use cases in mind
- In depth experience in System design involving large Petabytes of data with Databricks Lakehouse
- Experience in modern AI/Data infrastructure patterns, Semantics layer Organizing data for AI agents (metadata, context)
- AWS, GCP, Snowflake and Data pipeline frameworks like Airbyte/Airflow
- Programming languages like Python, SQL, and potentially Java or Scala
- Modern software engineering practices like Kubernetes, CI/CD, IAC tools (Preferably Terraform), Observability, monitoring and alerting
- Solution Cost Optimisations and design to cost
- Driving engineering excellence initiative
- Legally eligible to work in India on an ongoing basis
- Fluency in English is required
**Get to Know Us:**
At Smartsheet, your ideas are heard, your potential is supported, and your contributions have real impact. You’ll have the freedom to explore, push boundaries, and grow beyond your role. We welcome diverse perspectives and nontraditional paths—because we know that impact comes from individuals who care deeply and challenge thoughtfully. When you’re doing work that stretches you, excites you, and connects you to something bigger, that’s magic at work. Let’s build what’s next, together.
**Equal Opportunity Employer:**
Smartsheet is an Equal Opportunity (EEO) employer committed to fostering an inclusive environment with the best employees. It is our policy to provide equal employment opportunities to all qualified applicants in accordance with applicable laws in the US, UK, Australia, Germany, Costa Rica, Japan, Bulgaria, India, and Singapore. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran or disabled status, or genetic information.
If there are preparations we can make to help ensure you have a comfortable and positive interview experience, please let us know.
#LI-Remote