数据工程师负责人
Lead Data Engineer
我们是谁:LUMIQ 是金融服务和保险 (FSI) 行业的领先数据与分析公司。我们受全球最大的 FSIs,包括保险公司,银行,AMC 和 NBFC 所信任,以应对其数据挑战。我们的客户包括40多家企业,存款/AUM 超过10亿美元,共同代表全球约1十亿客户。我们的专业知识在于创建下一代数据技术产品来帮助 FSI 企业组织,管理和有效地使用数据。我们一直挑战现状,引入许多行业首位机构,如亚洲第一个企业数据平台在云中为监管实体。成立于2013年,LUMIQ 现在完成了十年的创新,由 Info Edge Ventures (新加坡泰马塞克控股和 Naukri 之间的合资公司)和美国第二季企业支持。我们的文化:在 LUMI Q,我们努力创造一个热情数据专业人士的社区,他们旨在超越普通的企业动态。我们为你提供以自己的步伐构想,承诺和导航职业轨迹的自由。拥有权力政策的文化推动结果。我们的文化鼓励'技术诗歌',结合创造性和技术来创造革命性的解决方案。我们相信我们的人员能够以最小限制管理他们的责任。我们的团队由行业最聪明的人组成,从博士和工程师到银行,保险,NBFC,AMC 等行业专家,他们将挑战并激励你达到新的高度。工作描述:我们正在寻找一名高技能的领先数据工程师加入我们的动态团队。在这个角色中,你不仅会设计和开发我们的云计算数据基础设施,还将领导一个数据工程师团队为我们的 BFSI 客户提供强大可扩展的数据解决方案。作为技术负责人,你将在云技术,数据工程和 BFSI 领域交叉点上工作,同时指导团队确保项目成功。关键责任:· 领导,指导和管理数据工程师团队提供高质量的数据解决方案。· 使用 AWS 平台设计,开发和实施基于云的数据管道,ETL 流程和数据集成解决方案。• 与跨功能团队合作了解数据需求并设计可扩展的数据模型和架构,符合 BFSI 行业需要。·优化数据存储,处理和检索以实现云环境中最大的性能和成本效率。
查看英文原文
Who we are:
LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry. We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, to address their data challenges. Our clients include 40+ enterprises with over $10B in deposits/AUM, collectively representing about 1B customers globally.
Our expertise lies in creating next-gen data technology products to help FSI enterprises organize, manage, and effectively use data. We have consistently challenged the status quo, introducing many industry-firsts like the first enterprise data platform in Asia on cloud for a regulated entity.
Founded in 2013, LUMIQ has now completed a decade of innovation, backed by Info Edge Ventures (a JV between Temasek Holdings of Singapore and Naukri) and US-based Season 2 Ventures.
Our Culture:
At LUMIQ, we strive to create a community of passionate data professionals who aim to transcend the usual corporate dynamics. We offer you the freedom to ideate, commit, and navigate your career trajectory at your own pace.
Culture of ownership empowerment to drive outcomes.
Our culture encourages 'Tech Poetry' combining creativity and technology to create solutions that revolutionize industry. We trust our people to manage their responsibilities with minimal policy constraints. Our team is composed of the industry's brightest minds, from PhDs and engineers to industry specialists from Banking, Insurance, NBFCs, AMCs, who will challenge and inspire you to reach new heights.
Job Description:
We are seeking a highly skilled Lead Data Engineer to join our dynamic team. In this role, you will not only design and develop our cloud-based data infrastructure but also lead a team of Data Engineers to deliver robust and scalable data solutions for our BFSI customers. As a Tech Lead, you will work at the intersection of cloud technologies, data engineering, and the BFSI domain, while guiding the team to ensure project success.
Key Responsibilities:
- Lead, mentor, and manage a team of Data Engineers to deliver high-quality data solutions.
- Design, develop, and implement cloud-based data pipelines, ETL processes, and data integration solutions using platforms AWS.
- Collaborate with cross-functional teams to understand data requirements and design scalable data models and architectures that align with BFSI industry needs.
- Optimize data storage, processing, and retrieval for maximum performance and cost-efficiency in cloud environments.
- Implement data security and compliance measures to ensure the protection and integrity of sensitive BFSI data.
- Work closely with data scientists and analysts to enable seamless access to high-quality data for analytical purposes.
- Troubleshoot and resolve data-related issues, ensuring data availability and reliability for BFSI customers.
- Stay updated on industry best practices, emerging cloud technologies, and trends in the BFSI sector to drive continuous improvement and innovation.
- Manage project timelines, delegate tasks, and ensure the successful delivery of data engineering projects.
Qualifications:
- Minimum 6 years experience with good Hands on Pyspark, Airflow, AWS.
- Advanced SQL and PySpark expertise; strong understanding of Data Engineering concepts (DW, Data Lake, OLTP vs OLAP, etc.)
- API development experience (preferably in Python)
- Familiarity with Docker and Kubernetes
- Experience with Airflow
- Exposure to Hudi, Iceberg, or Delta Lake
- Strong AWS project experience(should also be adaptable to other cloud platforms if required)
- Proven experience in leading and managing a team of Data Engineers in previous roles.
- Bachelors degree in computer science, Engineering, or a related field. Master's degree preferred.
- Proficiency in programming languages like Python, Java, or spark for data processing and ETL operations.
- Experience with big data technologies (e.g., Hadoop, Spark) and data processing frameworks.
- Familiarity with BFSI industry data standards, compliance requirements, and security protocols.
- Excellent problem-solving skills and the ability to work in a collaborative, cross-functional team environment.
What do you get:
- Opportunity to contribute to an entrepreneurial culture and exposure to the startup hustler culture.
- Competitive Salary Packages.
- Group Medical Policies.
- Equal Employment Opportunity.
- Maternity Leave.
- Opportunities for upskilling and exposure to the latest technologies.
- 100% Sponsorship for certification.
- Flexible work hours.
Originally posted on Himalayas