Big Data Application Developer
大数据应用程序开发商 - 远程亮视觉技术是一家提供云，人工智能，数据和企业解决方案的科技咨询和软件开发公司。这是一个非常好的机会加入一家既定且受尊敬的组织，提供巨大的职业增长潜力。工作标题：大数据应用程序发明者位置：100%远程 （美国）职位类型：全日制，直接 W2工资范围：100,000~150,000美元年经验：6年以上赞助：美国公民，绿卡持有人，EAD 持有人以及 H-1B 转让申请人鼓励申请。我们无法赞助新的 H-1B 签证申请该职位。工作总结 我们正在寻找一个经验丰富的大数据应用程序开发人员，以设计，构建和运营 Hadoop 及相关的大数据生态系统上的大型数据处理管道和分析平台。在这个角色中，你将负责摄入，转换和分析大量结构化和非结构化的数据来支持企业分析，机器学习和报告工作负载。理想的候选人将在 Hadoop 生态系统中的深层技术专业知识与强大的软件工程基础以及如何提供可靠，高性能和成本效率的数据平台在生产环境中进行清晰理解。·计算机科学，工程或相关技术学科的士学位。· 在 Hadoop 设计和运行大数据管道的五年或以上专业经验。·在生产环境中与 Apache Spark （Scala,Python 或 Java）进行强大的实践经验。• 与 Hive,HDFS,Sqoop,HBase 以及更广泛的 Hadoop 生态系统进行丰富的经验。· 强大的脚本编写能力在 Python 或 Shell 中。·优秀的故障解决，调试和文档化技能。优先资格 · 在 AWS EMR,Azure HDInsight 或 Databricks 等云平台上使用 Hadoop 经验。·熟悉现代湖泊格式 (Delta,Iceberg,Hudi). ·接触数据治理工具。
查看英文原文
Big Data Application Developer - Remote
Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.
Job Title: Big Data Application Developer
Location: 100% Remote (United States)
Position Type: Full-time, Direct W2
Salary Range: $100,000–$150,000 Annually
Experience: 6+ years
Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.
Job Summary
We are seeking an experienced Big Data Application Developer to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads. The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software engineering fundamentals and a clear understanding of how to deliver reliable, performant, and cost-effective data platforms in production environments.
Required Qualifications
· Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
- Five or more years of professional experience designing and operating big-data pipelines on Hadoop.
- Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.
- Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
- Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.
- Strong SQL skills and experience working with both relational and NoSQL data stores.
- Experience with workflow orchestration tools such as Airflow or Oozie.
- Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance.
- Strong scripting skills in Python or Shell.
- Excellent troubleshooting, debugging, and documentation skills.
Preferred Qualifications
· Experience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks.
- Familiarity with modern lakehouse formats (Delta, Iceberg, Hudi).
- Exposure to data governance tooling such as Apache Atlas or Collibra.
- Experience with Kubernetes-based data platforms (Spark-on-K8s, Trino).
- Hands-on experience with CI/CD and infrastructure-as-code in data engineering workflows.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to or contact us at (908) 505-3544. Learn more about Bright Vision Technologies at .
Bright Vision Technologies is an Equal Opportunity Employer.
Equal Employment Opportunity (EEO) Statement
Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.
BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
Originally posted on Himalayas