Senior Data Engineer
关于我们，Coderio 为全球公司设计和提供可扩展的数字解决方案。我们结合强大的技术专业知识与产品思维方式来领导复杂的软件倡议端到端。我们与国际客户合作，重视自主性和清晰沟通，并通过技术卓越建立长期伙伴关系。更多信息：我们正在寻找一名高级数据工程师来设计，构建和优化可扩展，高性能数据平台支持大量金融和交易数据。理想的候选人拥有在 Python,SQL,Apache Spark,AWS 和现代数据工程架构方面的强大的专业知识，具有经验证明的工作经验。你能期望什么 （责任）·设计，建造和维护高吞吐量，低延迟批量和流媒体数据管道以摄入和处理来自各种全球来源的金融交易。·设计，扩展和优化云数据仓库和湖泊建筑物能够处理大量结构化和非结构化的数据。· 与数据科学家，软件工程师和产品管理人员合作，了解业务需求并将其转化为可扩展的可靠数据解决方案。· 实施和执行数据质量框架，自动测试，监控和警报以确保数据完整性，可靠性，高可用性和遵守 SLA. ·推动采用 DataOps 实践，包括 CI/CD,工作流程自动化以及基础设施作为数据系统代码 (IaC). · 维护数据治理，隐私和安全标准跨数据存储和计算层，包括 GDPR/LGPD 合规。· 导师和指导初级及中等数据工程师，促进工程卓越性，最佳实践和现代建筑模式。要求 · 5年以上数据工程，大数据或相关软件工程职业经验，在快速发展环境中管理高量产品级数据系统的经验记录证明。· 对复杂数据处理，优化和软件开发的 Python 和 SQL 有强大的熟练；Scala 或 Java 体验是个好处。·与 Apache Spark/PySpark,Delta Lake 以及包括 Data Mesh 原则在内的现代湖泊架构的实践经验。· 强大的 AWS 数据服务专业知识，特别是 S3,Glue,Athena,EventBridge,FireHose 和 Lambda. ·与数据编程的丰富经验
查看英文原文
About Us
Coderio designs and delivers scalable digital solutions for global companies. We combine strong technical expertise with a product mindset to lead complex software initiatives end-to-end. We work with international clients, value autonomy and clear communication, and build long-term partnerships through technical excellence.
🌍 More information:
We are looking for a Senior Data Engineer to design, build, and optimize scalable, high-performance data platforms supporting large volumes of financial and transactional data. The ideal candidate has strong expertise in Python, SQL, Apache Spark, AWS, and modern data engineering architectures, with proven experience working with production-grade systems in fast-paced environments.
What You Can Expect (Responsibilities)
- Design, build, and maintain high-throughput, low-latency batch and streaming data pipelines to ingest and process financial transactions from diverse global sources.
- Design, scale, and optimize cloud data warehouse and lakehouse architectures capable of handling massive volumes of structured and unstructured data.
- Collaborate with Data Scientists, Software Engineers, and Product Managers to understand business needs and translate them into scalable, reliable data solutions.
- Implement and enforce data quality frameworks, automated testing, monitoring, and alerting to ensure data integrity, reliability, high availability, and compliance with SLAs.
- Drive the adoption of DataOps practices, including CI/CD, workflow automation, and Infrastructure as Code (IaC) for data systems.
- Champion data governance, privacy, and security standards across data storage and compute layers, including GDPR/LGPD compliance.
- Mentor and guide junior and mid-level Data Engineers, promoting engineering excellence, best practices, and modern architectural patterns.
Requirements
- 5+ years of experience in Data Engineering, Big Data, or related Software Engineering roles, with a proven track record managing high-volume, production-grade data systems in fast-paced environments.
- Strong proficiency in Python and SQL for complex data processing, optimization, and software development; Scala or Java experience is a plus.
- Hands-on experience with Apache Spark/PySpark, Delta Lake, and modern lakehouse architectures, including Data Mesh principles.
- Strong expertise in AWS data services, particularly S3, Glue, Athena, EventBridge, Firehose, and Lambda.
- Solid experience with data orchestration and warehousing technologies, including Apache Airflow or similar DAG-based tools and platforms such as Snowflake, AWS Redshift, or Google BigQuery.
- Experience designing real-time streaming architectures using technologies such as Apache Kafka or AWS Kinesis, as well as familiarity with modern data transformation and modeling tools such as dbt.
- Strong knowledge of DevOps/DataOps practices, including Git, Docker, CI/CD pipelines (GitHub Actions, GitLab CI, or similar), Infrastructure as Code, and cloud platforms such as AWS or GCP.
- Advanced English proficiency is required, with the ability to communicate effectively in English in both technical and non-technical contexts.
Nice to Have
- Previous experience in Fintech, Payments, E-commerce, or other high-growth technology environments, particularly working with financial transactions or highly regulated data.
- Experience with Databricks and advanced cloud lakehouse architectures.
- Knowledge of data privacy, governance, and security frameworks, including GDPR/LGPD, as well as experience implementing secure data platforms.
- Experience with Infrastructure as Code tools such as Terraform, advanced DataOps automation, and mentoring Data Engineers or contributing to technical architecture decisions.
Benefits
- 100% remote
- Long-term commitment, with autonomy and meaningful impact
- Strategic, high-visibility role within a modern engineering culture
- Collaborative international team with strong technical leadership
- Career development and growth opportunities within Coderio
Why join Coderio?
At Coderio, we value talent and excellence. While we are primarily a remote-first company, this specific strategic role offers the opportunity to work directly on-site to drive high-stakes initiatives. We are passionate about technology, collaboration, and fair compensation. We offer an inclusive and challenging environment with real growth opportunities. If you are motivated to design solutions that make a difference, we are waiting for you. Apply now.
Originally posted on Himalayas