数据工程师
Data Engineer
加入ProMach，发光发热。无论你富有创造力、战略思维、说服力，还是对机械有热情，这里都有你的位置。成为解决问题的人、促成交易的人、未来主义者——一切由你驱动。
在ProMach，你将接受挑战并获得回报，帮助提升包装性能并塑造自动化未来。我们很荣幸能与你一同踏上这段旅程。
是否引起了你的注意？继续阅读吧。
该职位负责在企业IT系统和ProMach数据湖之间设计、构建和维护数据流。利用Apache Spark和Delta Lake等工具，你将管理数据摄取和转换，与云服务集成，确保数据质量，并与分析师合作提供数据驱动的洞察。此职位的成功需要具备数据建模、SQL、Python和CI/CD流水线的专业知识。主要职责
- 数据管道开发：
- 使用Databricks、Apache Spark和Delta Lake设计、构建和维护可扩展的数据管道。
- ETL/ELT流程：
- 开发和管理用于从各种源系统中提取、转换和加载数据的稳健ETL/ELT工作流。
- 监控并解决移动数据的计划任务中的任何问题。
- 数据架构和建模：
- 参与设计和实现数据湖和数据仓库的数据模型和架构。
- 为支持报告和分析需求的架构和平台提供建议
- 云集成：
- 将数据解决方案与云平台（Azure、AWS或GCP）及相关服务集成。
- 数据质量和治理：
- 实施数据质量检查、监控和数据治理最佳实践，以确保一致性、准确性和可靠性。
- 自动化：
- 实施和维护CI/CD流水线，以自动化部署并优化工作流程。
- 协作：
- 与业务分析师和利益相关者密切合作，定义数据需求并交付可操作的洞察。
所需技能和资格
- 具有数据工程和基于云的开发的实际经验。
- 3-5年类似岗位经验
- 精通Databricks及其更广泛的生态系统（Databricks SQL、Delta Lake、Databricks Runtime）。
- 熟练掌握SQL、Python和Apache Spark。
- 具有Azure、AWS或GCP等云平台的经验。
- 对数据建模、ETL/ELT和数据仓库概念有深刻理解。
- 具有CI/CD工具和实践的经验。
- 出色的问题解决能力
查看英文原文
Join ProMach and shine. Whether you're creative, strategic, persuasive, or mechanically inclined, there’s a place for you here. Be a problem-solver, a closer, a futurist - whatever drives you.
At ProMach, you'll be challenged and rewarded as you help improve packaging performance and shape the future of automation. And we’ll be proud to have you on the journey.
Do we have your attention? Keep reading.
This role is responsible for designing, building, and maintaining data flows between corporate IT systems and ProMach’s data lake. Leveraging tools such as Apache Spark and Delta Lake, you will manage data ingestion and transformation, integrate with cloud services, ensure data quality, and collaborate with analysts to deliver data-driven insights. Success in this position requires expertise in data modeling, SQL, Python, and CI/CD pipelines.Key Responsibilities
- Data Pipeline Development:
- Design, build, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake.
- ETL/ELT Processes:
- Develop and manage robust ETL/ELT workflows for data extraction, transformation, and loading from diverse source systems.
- Monitor and resolve any issues with scheduled jobs that move data.
- Data Architecture and Modeling:
- Contribute to designing and implementing data models and architecture for data lakes and data warehouses.
- Provide guidance on architecture and platforms that facilitate reporting and analytics needs
- Cloud Integration:
- Integrate data solutions with cloud platforms (Azure, AWS, or GCP) and related services.
- Data Quality and Governance:
- Implement data quality checks, monitoring, and data governance best practices to ensure consistency, accuracy, and reliability.
- Automation:
- Implement and maintain CI/CD pipelines to automate deployment and streamline workflows.
- Collaboration:
- Work closely with business analysts and stakeholders to define data requirements and deliver actionable insights.
Required Skills and Qualifications
- Proven experience in data engineering and cloud-based development.
- 3-5 Years’ experience in a similar role
- Expertise in Databricks and the broader Databricks ecosystem (Databricks SQL, Delta Lake, Databricks Runtime).
- Proficiency in SQL, Python, and Apache Spark.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Strong understanding of data modeling, ETL/ELT, and data warehousing concepts.
- Experience with CI/CD tools and practices.
- Excellent problem-solving, analytical, and communication skills.
- Eager to learn new skills and step in to deliver where needed.
- Bachelor’s Degree in Information Systems, Computer Science, or related field, or equivalent work experience.
Preferred Experience
- Experience with ERP systems (SAP, Infor) and Salesforce CRM.
- Familiarity with BI tools such as Tableau.
- Manufacturing industry experience.
- Motivated, committed and energetic self-starter dedicated to providing high quality and responsive IT service
What’s in it for you?
There's no monopoly on innovative ideas or limits to how far you can advance with our team. We offer an open, communicative environment that fosters individual initiative. We pride ourselves in being a company where people are happy and choose to build a career.
In addition to growth opportunities, as a ProMach employee, you receive more than just a paycheck. Total compensation includes your salary, comprehensive medical/dental programs, as well as life insurance, a generous paid time off program, and a retirement savings plan with a company match. And because we understand the importance of feeling protected, there is no waiting period for benefits – you are eligible on your first day of employment!
Please note that the pay ranges listed on external job boards, outside our posting details, do not accurately reflect our internal compensation ranges.
Pro Mach, Inc. was named to the Inc. 5,000 list of the fastest growing private companies in the U.S. seven times. We continue to introduce innovative products, enter new markets, expand our global presence, and actively acquire new capabilities.
We have the rewards, opportunities, and the market strength of a large organization combined with the entrepreneurial culture of a small, fast-paced company. You will enjoy the benefits of working with a growing company that competes globally, with the personal touch and feel of a smaller company where you can make an impact every day.
ProMach is an Equal Opportunity Employer. Pro Mach uses E-Verify to verify employment eligibility of all new hires to work in the United States. Pro Mach is a drug-free workplace.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
Originally posted on Himalayas