中级数据 | 软件工程师
Mid Data | Software Engineer
我们寻找一名数据/软件工程师，设计、构建和演进可高度扩展且具备弹性的数据平台解决方案，以支持Experian Marketing Services的核心产品。在此职位中，您将参与大规模的云原生数据管道，优化分布式处理系统，并确保PB级工作负载的可靠性和性能。您将在敏捷价值流团队中运作，应用扎实的工程实践并与全球利益相关者协作，交付高质量的业务关键数据解决方案。
您的主要职责
- 使用Scala、Spark和云原生技术设计、开发和维护大规模数据管道，确保高性能、可扩展性和可靠性。
- 通过设计高效、有弹性的分布式系统和优化数据处理流程来解决复杂的数据工程挑战。
- 贡献于生产级别的数据平台，交付高质量、经过测试的代码并支持端到端功能开发。
- 通过编写干净、可测试和文档齐全的代码、代码审查以及遵循工程标准来确保软件质量。
- 在敏捷价值流团队中协作，与工程师、产品负责人和跨职能利益相关者紧密合作，交付对齐的技术解决方案。
- 为同事提供技术支持，参与架构讨论、代码审查并推动最佳工程实践。
- 支持发布和运维流程，包括部署、监控、警报以及系统可靠性的持续改进。
- 推动数据处理工作负载的性能、成本效率和可扩展性提升。
我们期望您具备
- 计算机科学、工程或相关技术领域的学士学位，或同等的实际工作经验。
- 软件或数据工程方面的扎实经验。
- 在使用Scala和Apache Spark构建和优化大规模数据管道方面有丰富经验。
- 具备云原生数据平台（AWS、GCP或Azure）的实际操作经验，包括S3、Glue、Athena等服务或类似服务。
- 对分布式系统、弹性模式、数据分区和高效数据访问策略有深入理解。
- 具备设计和运行高度并行化数据工作负载的经验。
- 熟练使用基于Git的版本控制系统（如GitHub、Bitbucket等）。
- 熟悉敏捷方法论和协作开发。
查看英文原文
We are looking for a Data | Software Engineer to design, build, and evolve highly scalable and resilient data platform solutions that power Experian Marketing Services’ core products. In this role, you will work on large-scale, cloud-native data pipelines, optimize distributed processing systems, and ensure the reliability and performance of petabyte-scale workloads. You will operate within agile value stream teams, applying strong engineering practices and collaborating with global stakeholders to deliver high-quality, business-critical data solutions.
Your key responsibilities
- Design, develop, and maintain large-scale data pipelines using Scala, Spark, and cloud-native technologies, ensuring high performance, scalability, and reliability.
- Solve complex data engineering challenges by designing efficient, resilient distributed systems and optimizing data processing workflows.
- Contribute to production-grade data platforms, delivering high-quality, tested code and supporting end-to-end feature development.
- Ensure software quality through clean, testable, and well-documented code, code reviews, and adherence to engineering standards.
- Collaborate within agile value stream teams, working closely with engineers, product owners, and cross-functional stakeholders to deliver aligned technical solutions.
- Provide technical guidance to peers, contributing to architecture discussions, code reviews, and promoting best engineering practices.
- Support release and operational processes, including deployments, monitoring, alerting, and continuous improvement of system reliability.
- Drive improvements in performance, cost efficiency, and scalability of data processing workloads.
What we expect from you
- Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
- Solid experience in software or data engineering.
- Strong expertise in building and optimizing large-scale data pipelines using Scala and Apache Spark.
- Hands-on experience with cloud-native data platforms (AWS, GCP, or Azure), including services such as S3, Glue, Athena, or equivalent.
- Strong understanding of distributed systems, resiliency patterns, data partitioning, and efficient data access strategies.
- Experience designing and operating highly parallelized data workloads.
- Proficiency with Git-based version control systems (GitHub, Bitbucket, etc.).
- Familiarity with agile methodologies and collaborative development in multi-team environments.
- Strong communication skills, with the ability to contribute in technical discussions and support peer development.
- Advanced English proficiency and availability to travel to São Carlos/SP when needed.
Nice to have
- Experience with DBT or other data transformation frameworks.
- Knowledge of concurrent and parallel programming patterns.
- Experience with functional programming (Scala) or languages such as Java, Python, or Rust.
- Familiarity with modern data platform architectures and large-scale data ecosystems.
At Serasa Experian, we believe that diversity is essential for a healthier and more innovative work environment, where everyone can share experiences and express their ideas. That’s why we promote several initiatives to support inclusive recruitment and the professional development of our people.
We also have our affinity groups, created to empower and support individuals from underrepresented groups: ExperianPride (LGBTQIAPN+ community), Ubuntu (racial equity), Women in Experian (gender equity), Aspire (people with disabilities), and Connecting Generations (generations).
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Experian is a global data and technology company that powers opportunities for people and businesses around the world. We operate across a wide range of markets, including financial services, healthcare, automotive, agribusiness, insurance, among others. Experian invests in people and in advanced new technologies to unlock the power of data. We have an incredible team of 25,200 employees across 32 countries.
Our uniqueness is valuing yours. Experian’s people-centric, inclusive, and purpose-driven culture has been recognized with several awards — including World’s Best Workplaces™ 2025 (Fortune Global Top 25) and Great Place To Work™ in 26 countries, among others. Check out Experian Life on social media or explore our careers site to understand why. Experian is also proud to be an equal opportunity and affirmative action employer.
Originally posted on Himalayas