数据工程师 III
Data Engineer III
职位概述:Data Engineer III 是一个注重实际技术的岗位,专注于企业数据部门内的全栈软件开发。该职位将在塑造未来的大数据和分析计划中发挥关键作用。
主要职责:
- 设计和开发代码及数据管道,从关系型数据库(Oracle、SQL Server、DB2、Aurora)、文件共享和网络服务中提取数据。
- 使用 Kinesis Streams、Kinesis Firehose、Kinesis Analytics 和 Kafka(MSK)进行流式数据摄入。
- 在 AWS S3 上构建数据湖,并通过数据分区和压缩来优化性能。
- 使用 AWS Glue、Informatica、EMR、Spark、Athena、Python 进行数据工程和分析。
- 使用 Snowflake 进行数据建模并构建数据仓库。
- 设计和开发代码及数据管道,从关系型数据库、文件共享和网络服务中提取数据。
- 设计 JavaScript 模块和 REST API,利用 MarkLogic 支持复杂搜索。
- 开发 MarkLogic 与现有企业平台的集成。
- 参与需求定义、系统架构设计和数据架构设计。
- 使用敏捷开发方法参与软件生命周期的所有方面。
任职要求:
- 需要 7 年以上企业信息解决方案架构、设计和开发经验。
- 需要 7 年以上集成架构经验,如 SOA、微服务、ETL 或其他集成技术。
- 需要 7 年以上使用内容或知识管理系统、搜索引擎、关系型数据库、NoSQL 数据库、ETL 工具、地理空间系统或语义技术的经验。
- 需要 5 年以上使用 MarkLogic 框架的实际经验,优先考虑 DynamoDB 经验。
- 需要 5 年以上使用 AWS 服务(S3、Kinesis、Lambda、Athena、Glue、EMR)的实际经验。
- 需要 5 年以上使用 SAS、R、Python 等分析工具的经验。
- 需要 5 年以上使用 Angular、JavaScript 和 Node.js 的 Web 开发经验。
- 需要具备 JSON 或 XML 数据建模经验。
- 需要具备 Git/GitHub、分支管理和其他现代源代码管理方法的经验。
- 需要具备 NoSQL 或关系型数据库领域的知识。
- 需要了解数据库架构和性能影响。
- 具备集成商业智能应用(如 Qlik Sense、Tableau 或 PowerBI)的经验。
- 具备机器学习和 A 的经验
查看英文原文
POSITION SUMMARY: The Data Engineer III is a hands-on technical role focused on full stack software development within the Enterprise Data organization. The role will play a critical part in shaping future big data and analytics initiatives.
PRINCIPAL RESPONSIBILITIES:
- Designs and develops code and data pipelines to ingest from relational databases (Oracle, SQL Server, DB2, Aurora), file shares, and web services.
- Streaming ingestion with Kinesis Streams, Kinesis Firehose, Kinesis Analytics and Kafka(MSK)
- Build Data Lake on AWS S3 with optimal performance considerations by partitioning and compressing data.
- Data Engineering and Analytics using AWS Glue, Informatica, EMR, Spark, Athena, Python.
- Data modeling and building Data Warehouse using Snowflake.
- Designs and develops code and data pipelines to ingest relational databases, file shares, and web services.
- Designs JavaScript modules and REST APIs utilizing MarkLogic to support complex searches.
- Develops MarkLogic integrations with existing enterprise platforms.
- Participates in requirements definition, system architecture design, and data architecture design.
- Participates in all aspects of the software life cycle using Agile development methodologies.
QUALIFICATIONS:
- 7+ years of experience in Enterprise Information Solution Architecture, Design, and development required.
- 7+ years of experience with integration architectures such as SOA, Microservices, ETL or other integration technologies.
- 7+ years of experience with working content or knowledge management systems, search engines, relational databases, NoSQL databases, ETL tools, geospatial systems, or semantic technology.
- 5+ years of hands-on experience with a MarkLogic framework , DynamoDB preferred.
- 5+ years of hands-on experience with AWS services ( S3, Kinesis, Lambda, Athena, Glue, EMR) required.
- 5+ years of analytics tools like SAS, R, Python, and other advanced statistical software.
- 5+ years of Web development experience with Angular, JavaScript, and Node.js.
- Experience with JSON or XML data modeling required.
- Experience with Git/GitHub, branching, and other modern source code management methodologies required.
- Domain knowledge of NoSQL or relational database required.
- Understanding of database architecture and performance implications required.
- Experience integrating Business Intelligence applications like Qlik Sense, Tableau, or PowerBI.
- Experience with Machine Learning and Artificial Intelligence.
- Ability to multi-task effectively.
- Ability to work collaboratively as part of an Agile Team.
- Extensive knowledge and experience with Python, JavaScript and Java.
- Excellent written and verbal communication skills, sense of ownership, urgency and drive.
MINIMUM QUALITIFICATIONS:
- Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Statistics or closely related field (willing to accept foreign education equivalent) (required).
- Experience in AWS services for data and analytics (required).
- 5 years of experience in Data Ingestion, Data Extraction, and Data Integration (required).
The statements used herein are intended to describe the general nature and level of the work being performed by an employee in this position and are not intended to be construed as an exhaustive list of responsibilities, duties and skills required by an incumbent so classified. Furthermore, they do not establish a contract for employment and are subject to change at the discretion of the Company.
Pay range: 109,500.00 - 150,600.00 DOE
Please note, this position is not sponsorship eligible.
Rewarding Compensation and Benefits
Eligible employees can elect to participate in:
• Comprehensive medical benefits coverage, dental plans and vision coverage.
• Health care and dependent care spending accounts.
• Short- and long-term disability.
• Life insurance and accidental death & dismemberment insurance.
• Employee and Family Assistance Program (EAP).
• Employee discount programs.
• Retirement plan with a generous company match.
• Employee Stock Purchase Plan (ESPP).
• Paid Time Off (PTO)
• Benefits
• Washington PTO:
The statements used herein are intended to describe the general nature and level of the work being performed by an employee in this position, and are not intended to be construed as an exhaustive list of responsibilities, duties and skills required by an incumbent so classified. Furthermore, they do not establish a contract for employment and are subject to change at the discretion of the Company.
EEO STATEMENT:Republic Services is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, protected veteran status, relationship or association with a protected veteran (spouses or other family members), genetic information, or any other characteristic protected by applicable law. For any concerns relating to Republic Services’ commitment to equal opportunity employment, you may contact the AWARE Line at 1-866-3-AWARE-4.ABOUT THE COMPANY
Republic Services, Inc. (NYSE: RSG) is a leader in the environmental services industry. We provide customers with the most complete set of products and services, including recycling, waste, special waste, hazardous waste and field services. Our industry-leading commitments to advance circularity and support decarbonization are helping deliver on our vision to partner with customers to create a more sustainable world.
In 2025, Republic’s total company revenue was $16.6 billion, and adjusted EBITDA was $5.3 billion. We serve 13 million customers and operate more than 1,000 locations, including collection and transfer stations, recycling and polymer centers, treatment facilities, and landfills.
Although we operate across North America, the collection, recycling, treatment, or disposal of materials is a local business, and the dynamics and opportunities differ in each market we serve. By combining local operational management with standardized business practices, we drive greater operating efficiencies across the company while maintaining day-to-day operational decisions at the local level, closest to the customer.
Our customers, including small businesses, major corporations and municipalities, want a partner with the expertise and capabilities to effectively manage their multiple recycling and waste streams. They choose Republic Services because we are committed to exceeding their expectations and helping them achieve their sustainability goals. Our 42,000 team members understand that it's not just what we do that matters, but how we do it.
Our company values guide our daily actions:
- Safe: We protect the livelihoods of our colleagues and communities.
- Committed to Serve: We go above and beyond to exceed our customers’ expectations.
- Environmentally Responsible: We take action to improve our environment.
- Driven: We deliver results in the right way.
- Human-Centered: We respect the dignity and unique potential of every person.
We are proud of our high employee engagement score of 86. We have an inclusive and diverse culture where every voice counts. In addition, our team positively impacted 5.1 million people in 2024 through the Republic Services Charitable Foundation and local community grants. These projects are designed to meet the specific needs of the communities we serve, with a focus on building sustainable neighborhoods.
STRATEGY
Republic Services’ strategy is designed to generate profitable growth. Through acquisitions and industry advancements, we safely and sustainably manage our customers’ multiple waste streams through a North American footprint of vertically integrated assets.
We focus on three areas of growth to meet the increasing needs of our customers: recycling and waste, environmental solutions and sustainability innovation.
With our integrated approach, strengthening our position in one area advances other areas of our business. For example, as we grow volume in recycling and waste, we collect additional material to bolster our circularity capabilities. And as we expand environmental solutions, we drive additional opportunities to provide these services to our existing recycling and waste customers.
Recycling and Waste
We continue to expand our recycling and waste business footprint throughout North America through organic growth and targeted acquisitions. The 13 million customers we serve and our more than 5 million pick-ups per day provide us with a distinct advantage. We aggregate materials at scale, unlocking new opportunities for advanced recycling. In addition, we are cross-selling new products and services to better meet our customers’ specific needs.
Environmental Solutions
Our comprehensive environmental solutions capabilities help customers safely manage their most technical waste streams. We are expanding both our capabilities and our geographic footprint. We see strong growth opportunities for our offerings, including PFAS remediation, an increasing customer need.
Sustainability Innovation
Republic’s recent innovations to advance circularity and decarbonization demonstrate our unique ability to leverage sustainability as a platform for growth.
The Republic Services Polymer Center is the nation’s first integrated plastics recycling facility. These innovative sites process rigid plastics from our recycling centers, producing recycled materials that promote true bottle-to-bottle circularity. We also formed Blue Polymers, a joint venture with Ravago, to develop facilities that will further process plastic material from our Polymer Centers to help meet the growing demand for sustainable packaging. We are building a network of Polymer Centers and Blue Polymer facilities across North America.
Our customers are increasingly looking for decarbonization solutions, and we are leveraging our network of landfills to meet that need. Republic is committed to harnessing landfill gas, a natural byproduct of decomposing waste, and converting it to energy. Republic has partnered with renewable gas developers to construct Renewable Natural Gas (RNG) plants at our landfills, expanding beyond the 77 projects we currently have to make progress towards our goal to beneficially reuse 50% more biogas by 2030 (2017 baseline year).
RECENT RECOGNITION
- Barron’s 100 Most Sustainable Companies
- CDP Discloser
- Dow Jones Best-In-Class Indices
- Ethisphere’s World’s Most Ethical Companies
- Fortune World’s Most Admired Companies
- Great Place to Work
- Sustainability Yearbook S&P Global
Job Posting End Date
10-09-2026The Company expects to accept applications for this position until the posting end date but encourages interested applicants to apply as soon as possible.
Originally posted on Himalayas