大数据开发工程师
Big Data Developer
加入我们!
为什么选择Talan?
连续第四年,Talan西班牙被认定为“最佳工作场所”!🎉 今年,我们还庆祝了在波兰的第二次认证,自我们在那里开设办公室以来,这是一个重要的里程碑。
Talan是一家国际咨询集团,专注于通过技术进行创新和转型,拥有5,000名员工,年营业额达6亿欧元。
我们为客户提供建设性的服务,以支持他们在组织转型的关键阶段,主要业务包括:
· 管理与创新咨询:支持企业、管理、文化和技术转型。
· 数据与技术:实施重大转型项目。
· 云与应用服务:构建或集成软件解决方案。
· 卓越服务中心:提供技术、创新、敏捷性、技能可持续性和成本优化。
Talan通过创新和技术加速客户的转型。通过理解他们的挑战,并通过技术、创新和数据加以支持,我们使他们更加高效和有韧性。
职位简介
我们正在寻找一名中级大数据开发人员加入客户贡献平台团队。在此职位中,您将负责开发、维护和优化大规模数据处理解决方案,确保平台上的高性能、可扩展性和数据质量。
您将在敏捷环境中与技术和业务利益相关者密切合作,参与现代数据工程解决方案的设计和实现,同时持续改进现有流程。
主要职责
· 设计、开发和维护ETL和数据转换流程。
· 构建、优化和支持基于Spark的数据管道。
· 在大数据环境中开发可扩展的数据处理解决方案。
· 从多个来源集成数据,同时确保数据质量和一致性。
· 分析、排查并解决数据相关问题。
· 优化数据性能和处理效率。
· 与跨职能团队合作,收集和细化业务需求。
· 参与敏捷仪式并为持续改进计划做出贡献。
· 在整个开发生命周期中遵循DevOps和CI/CD最佳实践。
所需技能与经验
· 3年以上软件开发和数据工程经验。
· 精通SQL(ANSI SQL,Hi
查看英文原文
Join Us!
Why Talan?
For the 4th consecutive year, Talan Spain has been recognized as a Great Place to Work! 🎉 This year, we’re also celebrating our 2nd certification in Poland, a significant milestone since opening our office there.
Talan is an international advisory group specializing in innovation and transformation through technology, with 5,000 employees and an annual turnover of 600M€.
We offer our customers a continuum of services to support them at each key stage of their organization's transformation, with four main activities:
· CONSULTING in Management and Innovation: Supporting business, managerial, cultural, and technological transformations.
· DATA & TECHNOLOGY: Implementing major transformation projects.
· CLOUD & APPLICATION SERVICES: Building or integrating software solutions.
· SERVICE CENTERS of EXCELLENCE: Providing technology, innovation, agility, sustainability of skills, and cost optimization.
Talan accelerates its clients' transformation through innovation and technology. By understanding their challenges and supporting them with technology, innovation, and data, we enable them to be more efficient and resilient.
About the Role
We are looking for a Mid-Level Big Data Developer to join the Client Contribution Platform team. In this role, you will be responsible for developing, maintaining, and optimizing large-scale data processing solutions, ensuring high performance, scalability, and data quality across the platform.
You will work closely with both technical and business stakeholders in an Agile environment, contributing to the design and implementation of modern data engineering solutions while continuously improving existing processes.
Key Responsibilities
· Design, develop, and maintain ETL and data transformation processes.
· Build, optimize, and support Spark-based data pipelines.
· Develop scalable data processing solutions in a Big Data environment.
· Integrate data from multiple sources while ensuring data quality and consistency.
· Analyze, troubleshoot, and resolve data-related issues.
· Optimize data performance and processing efficiency.
· Collaborate with cross-functional teams to gather and refine business requirements.
· Participate in Agile ceremonies and contribute to continuous improvement initiatives.
· Follow DevOps and CI/CD best practices throughout the development lifecycle.
Required Skills & Experience
· 3+ years of experience in software development and data engineering.
· Strong SQL knowledge (ANSI SQL, Hive SQL, Spark SQL, or equivalent).
· Hands-on experience with Apache Spark and at least one of the following programming languages:· Scala
· Python
· Java
- Experience working with Spark-based platforms such as:· Azure Databricks
- Amazon EMR
- Cloudera
- Apache Hive
- or similar Big Data environments.
- Experience with Qlik Sense reporting and dashboard development.
- Familiarity with Agile methodologies and DevOps practices.
- Experience with version control and CI/CD tools such as:· Git
- GitHub
- SonarQube
- Nexus
- Strong analytical and problem-solving skills.
- Ability to work collaboratively within a multidisciplinary team.
- Ability to understand, analyze, and improve business and technical requirements.
- English level B2+ or above.
Nice to Have
· Interest or experience in using AI-assisted development tools.
· Knowledge of AI-driven approaches for data engineering, automation, and analytics.
· Experience with process optimization through AI technologies.
- Permanent, full-time contract with career development opportunities.
- Chance to work in a challenging, multicultural environment with international projects.
- Exposure to large-scale financial IT systems and cross-country operations.
- Training opportunities to develop new skills in finance, technology, and data management.
- If you are passionate about development & tech, we want to meet you!
- Talan Spain’s commitment to non-discrimination based on gender, race, ideology, or any other reason, in accordance with the company’s "Equality Plan" and the current regulations on gender equality between women and men (Royal Decree-Law 6/2019).