高级数据工程师 – Hadoop
Senior Data Engineer – Hadoop
Bright Vision Technologies 是一家技术咨询和软件开发公司，为美国各地提供云、AI、数据和企业解决方案。
这是一个加入一家知名且受人尊敬的组织的绝佳机会，提供巨大的职业发展潜能。
职位名称：高级数据工程师 - Hadoop
地点：100% 远程（美国）
职位类型：全职，直接 W2
薪资范围：每年 145,000 至 165,000 美元
经验要求：6 年以上
赞助：美国公民、绿卡持有者、EAD 持有者以及可转 H-1B 的候选人欢迎申请。我们无法为该职位的新 H-1B 签证申请提供赞助。
职位简介：
我们正在寻找一位经验丰富的高级数据工程师 - Hadoop，负责在 Hadoop 及相关大数据生态系统上设计、构建和运营大规模数据处理管道和分析平台。在此职位中，您将负责摄取、转换和分析大量结构化和非结构化数据，以支持企业分析、机器学习和报告工作负载。理想的候选人应具备 Hadoop 生态系统中的深厚技术专长，同时具备扎实的软件工程基础，并清楚了解如何在生产环境中交付可靠、高性能且成本效益高的数据平台。
所需资格
· 计算机科学、工程或相关技术领域的学士学位。
- 五年以上在 Hadoop 上设计和运营大数据管道的专业经验。
- 在生产环境中具有使用 Apache Spark（Scala、Python 或 Java）的扎实实践经验。
- 具有 Hive、HDFS、Sqoop、HBase 和更广泛的 Hadoop 生态系统的丰富经验。
- 具有流数据平台（如 Kafka、Spark Streaming 或 Flink）的实际操作经验。
- 强大的 SQL 技能，以及在关系型和 NoSQL 数据存储中工作的经验。
- 具有使用工作流编排工具（如 Airflow 或 Oozie）的经验。
- 对分布式系统概念有扎实的理解，包括分区、复制和容错。
- 熟练掌握 Python 或 Shell 脚本。
- 优秀的故障排除、调试和文档编写技能。
优先考虑的资格
· 在 AWS EMR、Azure HDInsight 或 Databricks 等云平台上运行 Hadoop 的经验。
- 熟悉现代湖仓格式（Delta、Iceberg、Hudi）。
- 接触过数据治理工具（如 Apache Atlas 或 Collibra）。
- 有使用 Kubernetes 或 Docker 进行容器化部署的经验。
- 有在 CI/CD 流水线中集成自动化测试和部署的经验。
查看英文原文
Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.
Job Title: Senior Data Engineer - Hadoop
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $145,000–$165,000 Annually
Experience Required: 6+ years
Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.
Job Summary:
We are seeking an experienced Senior Data Engineer - Hadoop to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads. The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software engineering fundamentals and a clear understanding of how to deliver reliable, performant, and cost-effective data platforms in production environments.
Required Qualifications
· Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
- Five or more years of professional experience designing and operating big-data pipelines on Hadoop.
- Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.
- Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
- Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.
- Strong SQL skills and experience working with both relational and NoSQL data stores.
- Experience with workflow orchestration tools such as Airflow or Oozie.
- Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance.
- Strong scripting skills in Python or Shell.
- Excellent troubleshooting, debugging, and documentation skills.
Preferred Qualifications
· Experience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks.
- Familiarity with modern lakehouse formats (Delta, Iceberg, Hudi).
- Exposure to data governance tooling such as Apache Atlas or Collibra.
- Experience with Kubernetes-based data platforms (Spark-on-K8s, Trino).
- Hands-on experience with CI/CD and infrastructure-as-code in data engineering workflows.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to or contact us at (908)676-4399. Learn more about Bright Vision Technologies at .
Bright Vision Technologies is an Equal Opportunity Employer.Equal Employment Opportunity (EEO) Statement
Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.
BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
Originally posted on Himalayas