数据工程师
Data Engineer
我们正在寻找一位有才华且经验丰富的数据工程师加入我们的团队。作为数据工程师，你将在设计、构建和维护我们的数据基础设施方面发挥关键作用，以支持我们不断增长的业务需求。你的工作将包括与数据团队一起构建新的数据仓库，构建数据管道为内部和外部客户提供数据，并维护和确保数据质量。
- 计算机科学、工程或相关领域的学士或硕士学位。
- 4年以上数据工程师或类似职位的经验，具备设计和构建数据管道、ETL流程和数据仓库的扎实背景。
- 具有基于云的数据平台和服务的实际经验，特别是AWS（Amazon Web Services），包括但不限于S3、Redshift、Lambda和Glue。
- 精通编程语言如Python、SQL，并具有使用数据处理框架/库如Apache Spark、Pandas或其他类似工具的经验。
- 具有管理计算工作负载和使用工具如Kubernetes进行扩展的经验。
- 对数据库概念、数据建模和关系型数据库（例如PostgreSQL、MySQL）有扎实的理解。
- 具备出色的分析、解决问题和沟通能力，能够在快节奏和协作的环境中高效工作。
- 在金融科技或金融服务行业的工作经验是加分项。
- 优秀的沟通和协作能力，能够与技术和非技术利益相关者有效互动
- 与数据团队一起设计和构建数据仓库
- 设计、开发和维护数据管道和ETL流程，从各种来源摄取、处理和转换大量数据到我们的数据仓库中。
- 构建数据管道至第三方报告和自动化工具
- 与客户合作，在安全环境中提供干净可靠的数据
- 构建和优化数据模型、模式和数据库，以支持分析和报告需求。
- 实现数据质量检查、监控和错误处理机制，以确保数据的完整性和可靠性。
- 与数据团队和业务部门合作，了解数据需求并交付满足业务需求的数据解决方案。
- 持续优化和改进数据基础设施、性能和可扩展性，以支持不断增长的数据量和不断变化的业务需求
查看英文原文
We are seeking a talented and experienced Data Engineer to join our dynamic
team. As a Data Engineer, you will play a crucial role in designing, building, and
maintaining our data infrastructure to support our growing business needs.
Your role will include building a new data warehouse alongside the data team,
building data pipelines to provide data to both internal and external clients and
maintaining and ensuring data quality for the business.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 4+ years experience as a Data Engineer or similar role, with a strong background in designing and building data pipelines, ETL processes, and data warehouses.
- Hands-on experience with cloud-based data platforms and services, particularly AWS (Amazon Web Services) including but not limited to S3, Redshift, Lambda and Glue
- Proficiency in programming languages such as Python, SQL, and experience with data processing frameworks/libraries such as Apache Spark, Pandas, or similar.
- Experienced in managing compute workloads and scaling with tools such as kubernetes
- Solid understanding of database concepts, data modelling, and relational databases (e.g., PostgreSQL, MySQL).
- Strong analytical, problem-solving, and communication skills, with the ability to work effectively in a fast-paced and collaborative environment.
- Experience working in the fintech or financial services industry is a plus.
- Excellent communication and collaboration skills, with the ability to interact effectively with technical and non-technical stakeholders
- Design and build data warehouse alongside the data team
- Design, develop, and maintain data pipelines and ETL processes to ingest, process, and transform large volumes of data from various sources into our data warehouse.
- Build data pipeline to third party reporting and automation tools
- Work with clients to provide clean and reliable data in a safe environment
- Build and optimize data models, schemas, and databases to support analytical and reporting requirements.
- Implement data quality checks, monitoring, and error handling mechanisms to ensure the integrity and reliability of our data.
- Collaborate with the data team and business departments to understand data requirements and deliver data solutions that meet business needs.
- Continuously optimize and improve data infrastructure, performance, and scalability to support growing data volumes and evolving business requirements.
- Stay up-to-date with emerging technologies and best practices in data engineering, cloud computing, and data management.
Baanx is building digital assets services for every business. Top crypto businesses partner with Baanx for 20% of the world's cryptocurrency. We provide our services in the United States and Europe to many millions of customers.
Baanx is working on Crypto-as-a-Service Digital Banking and Digital Asset Lending services for our clients. We deliver full platforms for some of the world's biggest / leading firms in the crypto space - cards / lending / remittance / wallets / exchange.
As a Senior Backend Developer, you will be responsible for the architecture and development of BAANX applications and services, and integration with 3rd party services.
Originally posted on Himalayas