Senior Data Engineer
我们正在寻找一个经验丰富的高级数据工程师，以在设计，构建和优化我们的核心数据平台中发挥实践作用。你将解决挑战性的技术问题，帮助塑造建筑决策，建立工程最佳做法，并建造可扩展性高质量的数据管道。你还将有机会为同事工程师提供辅导，做出代码审查，并在团队成长过程中提供技术指导。核心责任 · 数据管道开发：设计，构筑，优化和维护可扩展 ETL/ELT 管道，API 以及用于大量监管机构和健康数据集的微服务。· 数据可靠性与完整性：解决数据质量问题，并实施自动化测试，监控和验证以确保数据的准确性和可靠性。· 建筑设计：为技术设计和架构决策做出贡献，建立可扩展，可维护的解决方案来支持我们不断发展的数据平台。·系统集成：将数据管道与下游 NLP/ML 服务和搜索技术结合起来，包括 ELK 堆。·生产运营：支持生产部署，解决管道和数据库问题的故障，以及解决复杂的技术事件。·跨功能合作：与工程和产品团队密切合作，将要求转化为实用，设计良好的技术解决方案。· 科技熟练：你有效预测并采纳创新在企业建设技术解决方案中，保持与数据进步的最新状态，并将其纳入工作流程中。·管理复杂性：通过识别模式和开发有效的解决问题的策略来从复杂信息中积极合成解决方案。积极参与协作解决问题，利用各种观点和寻找创新解决方案来实现共享目标和数据工程倡议。·优化工作流程：你积极寻求改善和简化当前的数据管道管理，ETL （提取，转换，加载）过程以及数据仓库的工作流程的机会。·推动结果：你努力不断提高性能并超越预期，以促进总体成功和满足与数据相关的交付。
查看英文原文
We're looking for an experienced Senior Data Engineer to take a hands-on role in designing, building, and optimizing our core data platform. You'll work on challenging technical problems, help shape architectural decisions, establish engineering best practices, and build scalable, high-quality data pipelines. You'll also have opportunities to mentor fellow engineers, contribute to code reviews, and provide technical guidance as the team grows.
Core Responsibilities
- Data Pipeline Development: Design, build, optimize, and maintain scalable ETL/ELT pipelines, APIs, and microservices for high-volume regulatory and health agency datasets.
- Data Reliability & Integrity: Troubleshoot data quality issues and implement automated testing, monitoring, and validation to ensure data accuracy and reliability.
- Architecture & Design: Contribute to technical design and architectural decisions, building scalable, maintainable solutions that support our evolving data platform.
- System Integration: Integrate data pipelines with downstream NLP/ML services and search technologies, including the ELK stack.
- Production Operations: Support production deployments, troubleshoot pipeline and database issues, and resolve complex technical incidents.
- Cross-Functional Collaboration: Work closely with Engineering and Product teams to translate requirements into practical, well-designed technical solutions.
- Tech Savvy: You effectively anticipate and adopt innovations in business-building technology solutions, staying up-to-date with data advancements and incorporating them into work processes.
- Manages Complexity: You actively synthesize solutions from complex information by identifying patterns and developing effective problem-solving strategies to solve data-related problems effectively.
- Decision Quality: You consistently make good and timely decisions that propel organizational progress and maintain data integrity.
- Collaborates: You actively engage in collaborative problem-solving by leveraging diverse perspectives and finding innovative solutions to achieve shared goals and data engineering initiatives.
- Optimizes Work Processes: You actively seek opportunities to enhance and streamline current work processes for managing data pipelines, ETL (Extract, Transform, Load) processes, and data warehousing.
- Drives Results: You strive to continuously improve performance and exceed expectations to contribute to overall success and meet data-related deliverables.
- Strategic Mindset: You consistently demonstrate a strategic mindset by envisioning future possibilities and successfully translating them into breakthrough data strategies, contributing to the organization's long-term success.
- Engaged: You not only share our values but also possess the essential competencies needed to thrive at Redica, as outlined here.
Top Pharmaceutical Companies, Food Manufacturers, MedTech Companies, and Service Firms from around the globe rely on Redica Systems to mine and process government inspection, enforcement, and registration data. This enables them to quantify risk signals from their suppliers, identify market opportunities, benchmark against peers, and prepare for the latest inspection trends.
Our data and analytics have been cited by major media outlets, including MSNBC, The Wall Street Journal, and The Boston Globe.
Redica Systems is the Intelligence Cloud for life sciences, transforming regulatory complexity into connected, proactive intelligence. Redica's platform helps the world's leading Pharmaceutical and MedTech companies stay inspection-ready, manage supplier risk, and keep pace with evolving global regulations. Built on the Redica Catalyst Platform and powered by Redica ID, Redica unifies the industry's most complete regulatory and inspection datasets, sourced from hundreds of global health authorities, into trusted intelligence for quality and regulatory teams. The Redica Intelligence Cloud brings data together to anticipate risk, accelerate compliance, and enable smarter, faster decisions across the enterprise.
More information is available at redica.com.
Originally posted on Himalayas