高级数据工程师
Senior Data Engineer
简介
寻找新的挑战吗?加入Guidewire成为数据工程师!我们正在组建一个新团队,利用我们在市场上的领先地位和数据资源,构建先进的预测模型和变量,推动财产与意外险市场的下一轮增长。这是一个早期加入的机会,可以塑造我们的方向,并对保险行业产生广泛影响。
职位描述
职责
- 参与多个同时进行的项目,专注于预测建模和机器学习的数据准备和管道开发。包括:
- 数据查询、探索性数据分析、数据概览和数据核对
- 根据产品经理和数据科学家/精算师的输入,创建、修订和监控数据管道
- 特征创建、初步测试和持续管理
- 与其他员工协作,包括产品经理、数据科学家、其他数据分析师、架构师,以解决问题、开发创新方法并提供项目状态
- 创建和管理数据资产、数据集、特征和代码,重点关注简洁性、可扩展性、可重用性和清晰的文档
- 其他不涉及具体项目的任务,如新功能开发、外部数据研究、对正在开发的新产品和工具提供用户反馈
- 在Guidewire,我们培养一种充满好奇心、创新精神和负责任使用AI的文化——赋能我们的团队不断利用新兴技术和数据驱动的洞察力,提高生产力和成果。
资格要求
- 本科或硕士学历或同等行业经验
- 对解决复杂数据问题充满热情
- 7-10年以上相关经验
- 在构建用于预测建模的建模数据集、管道和特征方面有丰富的实际经验
- 在使用DBT、Apache Iceberg和AWS数据功能(如Airflow、Glue、Redshift、EMR)构建ML数据管道方面有丰富经验,特别注重数据质量和治理
- 精通SQL,包括高级函数、表设计、视图创建、存储过程和脚本设计与编码,以及一般的性能调优
- 熟练使用Apache Spark进行数据处理和转换
- 了解Python
- 熟悉版本控制系统(如Git),用于管理数据管道和特征
- 了解与数据准备相关的MLOps原则和实践
查看英文原文
Summary
Ready for a new challenge? Join Guidewire as a Data Engineer! We are building a new team to take advantage of our market leading position and access to data to build advanced predictive models and variables to drive the next generation of growth in the P&C insurance market. This is an opportunity to come on board early and shape our direction and have a broad impact on the insurance industry.Job Description
Responsibilities
- Participate in multiple simultaneous projects with a focus on data preparation and pipeline development for predictive modeling and machine learning. Includes:
- Data interrogation, exploratory data analysis, profiling, and reconciliation
- Data pipeline creation, revision and monitoring based on product manager and data scientist/actuarial input
- Feature creation, initial testing, and ongoing management
- Work collaboratively with other staff including product managers, data scientists, other data analysts, architects to solve problems, develop innovative approaches, and provide project status
- Create and manage data assets, datasets, features, and code with a focus on simplicity, scalability, reusability, and clear documentation
- Additional work assignments not related to specific project work such as new feature development, external data research, providing user feedback on new products and tools under development
- At Guidewire, we foster a culture of curiosity, innovation, and responsible use of AI—empowering our teams to continuously leverage emerging technologies and data-driven insights to enhance productivity and outcomes.
Qualifications
- Bachelors or Masters degree or equivalent industry experience
- Passion for solving complex data problems
- 7-10+ years of relevant experience
- Advanced, hands on experience building modeling datasets, pipelines and features for predictive modeling
- Extensive experience using DBT, Apache Iceberg, and AWS data capabilities like Airflow, Glue, Redshift, EMR to build ML data pipelines, with a strong focus on data quality and governance.
- Expert SQL skills, including advanced functions, table design, view creation, stored procedure and script design and coding, general performance tuning
- Proficient in data processing and transformations using Apache Spark.
- Working knowledge of Python
- Experience with version control systems (e.g., Git) for managing data pipelines and features.
- Understanding of MLOps principles and practices related to data preparation and feature engineering; experience using Sagemaker and feature stores a plus
- Familiarity with common challenges in integrating RDBMS-sourced data into a data warehouse, including temporal data handling, Change Data Capture (CDC), Slowly Changing Dimensions (SCD), and data modeling methodologies like Kimball and Data Vault
- Experience within a regulated industry (finance, insurance, etc…); P&C policy administration and claims processing concepts as well as US/Canadian P&C standard lines of business experience a plus
- Self-motivated and detail-oriented with desire to solve problems
- Demonstrated ability to embrace AI and apply it to your role as well as use data-driven insights to drive innovation, productivity, and continuous improvement.
The US base salary range for this full-time position is $148,000 - $222,000 . Your base pay will depend on your experience, skills, education, training, and location among other factors. All full-time positions or part-time roles working 30 hours or more a week at Guidewire are eligible for benefits that support their health and well-being including health, dental, and vision insurance, paid time off, and a company sponsored retirement plan. In addition, some roles may be eligible for the annual company bonus plan, commissions, and/or long term incentive awards which are contingent on a variety of factors including, but not limited to, company and employee performance.Disability Accommodations and Guidewire’s Appeals Process. Guidewire provides accommodations to the hiring process to create a fair opportunity for candidates with disabilities to contend for open positions. Accommodation requests should be directed to . If things do not go as hoped, we invite you to use our appeals process. Guidewire promises to independently review any denied accommodation and any decision not to offer you the position. The appeals process is the same in either case. Within five business days of receiving a notice of denial of an accommodation, or receiving a notice of your non-selection for a vacancy, e-mail to make an appeal. Guidewire will assign a new decision-maker to review the request and/or hiring decision, who will then notify you in writing of a decision within 10 business days.
About Guidewire
Guidewire is the platform P&C insurers trust to engage, innovate, and grow efficiently. We combine digital, core, analytics, and AI to deliver our platform as a cloud service. More than 540+ insurers in 40 countries, from new ventures to the largest and most complex in the world, run on Guidewire.
As a partner to our customers, we continually evolve to enable their success. We are proud of our unparalleled implementation track record with 1600+ successful projects, supported by the largest R&D team and partner ecosystem in the industry. Our Marketplace provides hundreds of applications that accelerate integration, localization, and innovation.
For more information, please visit www.guidewire.com and follow us on Twitter: @Guidewire_PandC.
Guidewire Software, Inc. is proud to be an equal opportunity and affirmative action employer. We are committed to an inclusive workplace, and believe that a diversity of perspectives, abilities, and cultures is a key to our success. Qualified applicants will receive consideration without regard to race, color, ancestry, religion, sex, national origin, citizenship, marital status, age, sexual orientation, gender identity, gender expression, veteran status, or disability. All offers are contingent upon passing a criminal history and other background checks where it's applicable to the position.
Originally posted on Himalayas