大数据顾问

Big Data Consultant
Singapore
Must Have

• Experience: Min 5 Years

• Must have good technical experience and should be able to understand and develop the modules and bring the task to closure on time.

• At least 4+ years of development work experience in Hadoop programming (HDFS) using PySpark/Scala/Java with Hive-based Data warehouse projects. And, with good Shell Scripting experience.

• Able to Understand the requirements and ingest the data into the Bigdata platform using Spark with HIVE.

• Should be able to write the SQL scripts and write few complex SQL Scripts to process the data with SCD handling exposure.

• Responsible for meeting the quality, and scope as per the project plans must be able to meet the stringent timelines.

• Flexible to work as per the regional timing.

• Excellent communication and documentation skills

• Very good at team playing and flexibility to work with the Offshore team in different time zones based on project needs.

• Willingness to do Certification in Databricks Certified Developer: Apache Spark 3. X

Nice to Have

• Autosys, Bit bucket, Jenkin, etc.

• Proactive, and have good communication skills to articulate technical issues.

• Exposure to is Confluence/JIRA

• Should be able to work independently Prior Experience to any Databases like Oracle/SQL Server/ETL will be an added advantage.

• At least 1+ years of Module Lead Experience

• Hands-on experience in data analysis and debugging the issues in SQL.

• Performance tuning the Hive QLs and the Cluster nodes Functional Testing Functional Test plan and execution experience.

Originally posted on Himalayas