Kafka 平台工程师
Kafka Platform Engineer
Bright Vision Technologies 是一家技术咨询和软件开发公司,为美国各地提供云、AI、数据和企业解决方案。加入一家知名且备受尊敬的组织,这是一个绝佳的机会,提供巨大的职业发展机会。
职位名称:Kafka 平台工程师
地点:100% 远程(美国)
职位类型:全职,直接 W2
薪资范围:每年 13 万美元至 18 万美元(根据经验而定)
所需经验:10 年以上
签证支持:美国公民、绿卡持有者、EAD 持有者以及 H-1B 转移候选人欢迎申请。我们无法为该职位提供新的 H-1B 签证申请。
职位简介
Bright Vision Technologies 正在寻找一位经验丰富的 Kafka 平台工程师,要求具备 10 年以上分布式系统、事件流和平台工程经验,包括对 Apache Kafka 和 Confluent 平台的深入专业知识。理想的候选人将设计、部署和管理企业级流媒体平台,为组织内的关键任务实时数据处理提供支持。该职位需要深入的技术能力,包括 Kafka 内部机制、平台自动化、安全、可观测性和云原生基础设施,同时还需具备指导工程团队和制定企业事件流标准的能力。
主要职责
- 设计、部署和管理高可用的 Apache Kafka 和 Confluent 平台环境,支持企业级事件驱动的应用程序。
- 设计 Kafka 集群拓扑、代理配置、分区策略、复制、容量规划和高性能工作负载的性能优化。
- 使用 SASL、SSL/mTLS、ACL、RBAC、加密和认证机制实现企业级安全。
- 设计和管理 Kafka Connect、Schema Registry、Kafka Streams、ksqlDB 和事件流管道,用于实时数据集成。
- 使用 Terraform、Ansible 或类似自动化框架开发和维护基础设施即代码,以配置和管理 Kafka 基础设施。
- 设计和实现高可用性(HA)、灾难恢复(DR)、备份、故障转移和跨区域复制策略。
- 构建全面的监控、警报、日志和可观测性解决方案,使用 Prometheus、Grafana、OpenTelemetry、ELK 和 Confluent 监控工具。
- 优化集群性能,排查生产问题,进行根本原因分析,并
查看英文原文
Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.
Job Title: Kafka Platform Engineer
Location: 100% Remote (U.S.)Position Type: Full-time, Direct W2
Salary Range: $130,000–$180,000 Annually (based on experience)
Experience Required:10+ Years
Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.
Job Summary
Bright Vision Technologies is seeking a highly experienced Kafka Platform Engineer with 10+ years of experience in distributed systems, event streaming, and platform engineering, including extensive expertise with Apache Kafka and the Confluent Platform. The ideal candidate will architect, deploy, and manage enterprise-scale streaming platforms that power mission-critical, real-time data processing across the organization. This role requires deep technical expertise in Kafka internals, platform automation, security, observability, and cloud-native infrastructure, along with the ability to mentor engineering teams and define enterprise event-streaming standards.
Key Responsibilities
- Architect, deploy, and manage highly available Apache Kafka and Confluent Platform environments supporting enterprise-scale event-driven applications.
- Design Kafka cluster topology, broker configuration, partitioning strategies, replication, capacity planning, and performance optimization for high-throughput workloads.
- Implement enterprise-grade security using SASL, SSL/mTLS, ACLs, RBAC, encryption, and authentication mechanisms.
- Design and manage Kafka Connect, Schema Registry, Kafka Streams, ksqlDB, and event streaming pipelines for real-time data integration.
- Develop and maintain Infrastructure as Code using Terraform, Ansible, or similar automation frameworks to provision and manage Kafka infrastructure.
- Design and implement High Availability (HA), Disaster Recovery (DR), backup, failover, and cross-region replication strategies.
- Build comprehensive monitoring, alerting, logging, and observability solutions using Prometheus, Grafana, OpenTelemetry, ELK, and Confluent monitoring tools.
- Optimize cluster performance, troubleshoot production issues, conduct root cause analysis, and implement long-term platform improvements.
- Support Kafka deployments on Kubernetes using Strimzi, Confluent Operator, or managed cloud services including AWS MSK, Azure Event Hubs (Kafka API), and Confluent Cloud.
- Collaborate with application developers, data engineers, DevOps, SRE, and enterprise architects to establish event-driven architecture standards and best practices.
- Conduct architecture reviews, establish platform governance, perform code reviews, and mentor engineers on Kafka development and operations.
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related technical discipline.
- 10+ years of professional experience in distributed systems, platform engineering, or infrastructure engineering, including 5+ years of hands-on Apache Kafka or Confluent Platform experience.
- Expert-level knowledge of Kafka internals, including partitions, replication, brokers, ISR, consumer groups, offset management, and performance tuning.
- Extensive experience implementing Kafka security using SASL, SSL/mTLS, ACLs, RBAC, and enterprise authentication mechanisms.
- Strong hands-on experience with Kafka Connect, Schema Registry, Kafka Streams, ksqlDB, and real-time event streaming architectures.
- Experience implementing High Availability (HA), Disaster Recovery (DR), multi-cluster replication, and cross-region failover strategies.
- Advanced scripting skills using Python, Bash, or Go, along with Infrastructure as Code experience using Terraform, Ansible, or similar tools.
- Strong experience with observability platforms including Prometheus, Grafana, OpenTelemetry, ELK, and distributed tracing solutions.
- Excellent troubleshooting, communication, documentation, stakeholder management, and technical leadership skills.
Preferred Qualifications
- Confluent Certified Administrator or Confluent Certified Developer certification.
- Experience operating Kafka on Kubernetes using Strimzi, Confluent Operator, or similar operators.
- Hands-on experience with managed Kafka services including AWS MSK, Confluent Cloud, Azure Event Hubs (Kafka API), or Google Cloud Managed Kafka.
- Experience with stream processing technologies such as Apache Flink, Apache Spark Structured Streaming, or Apache Beam.
- Knowledge of data governance, schema evolution, metadata management, and data lineage for streaming platforms.
How to Apply
Would you like to know more about this opportunity?
For immediate consideration, please send your resume to or contact us at (908) 505-3545. Learn more about Bright Vision Technologies at www.bvteck.com.
Bright Vision Technologies is an Equal Opportunity Employer.Equal Employment Opportunity (EEO) Statement
Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.
BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
Originally posted on Himalayas