Data Platform Engineer

Data Platform Engineer (Kafka / Event Streaming)

We're hiring a senior Data Platform Engineer to own and evolve our enterprise Kafka event-streaming platform built on Red Hat AMQ Streams running on OpenShift. This is a hands-on role for an engineer who thrives at the intersection of platform engineering, DevOps/GitOps, and event-driven architecture, and who can deliver a secure, scalable, and developer-friendly streaming ecosystem at enterprise scale.

You'll partner with application teams, architects, and SREs to define integration standards, automate platform delivery with GitLab CI/CD and Argo CD, and drive adoption of Kafka-based architectures across the organization.

What You'll Do

Kafka & AMQ Streams

• Design, deploy, and operate AMQ Streams (Kafka) clusters on Red Hat OpenShift
• Manage Kafka brokers, KRaft, MirrorMaker 2, and explore Kafka Connect and Schema Registry
• Ensure high availability, performance, scalability, and reliability
• Handle capacity planning, partitioning, retention policies, and tuning
• Implement monitoring, logging, and alerting using Prometheus, Grafana, and Splunk

Event-Driven Architecture

• Define and standardize patterns including event sourcing, CQRS, pub/sub, CDC, stream processing & enrichment, and request-reply over Kafka
• Guide teams on schema design, topic governance, data contracts, and message lifecycle management

Security & Governance

• Implement Kafka security using RBAC, TLS, ACLs, SSO, and OAuth
• Enforce naming standards, schema evolution, retention policies, and compliance
• Ensure encryption in transit and at rest, auditing, and data protection

Automation & GitOps

• Build GitOps workflows with Argo CD for declarative Kafka deployments
• Develop GitLab CI/CD pipelines for automated builds and environment promotion
• Maintain Infrastructure as Code using Terraform and Ansible

Collaboration

• Support and troubleshoot for development and integration teams
• Work closely with architects and SREs
• Create documentation, runbooks, and internal enablement materials

What You Bring

• Bachelor's degree in Computer Science, Engineering, or equivalent experience
• Proven Kafka administration experience in production
• Strong OpenShift and container orchestration expertise
• Scripting skills in Python or Bash
• Experience with Prometheus, Grafana, Splunk
• Familiarity with Kafka Streams, ksqlDB, or Flink
• Knowledge of Istio / OpenShift Service Mesh
• Experience operating in regulated, enterprise-scale environments
• Strong grasp of DevOps and SRE practices

Job Type: Full-time

Pay: $111, $150,000.00 per year

Benefits:

• 401(k)
• Health insurance
• Paid time off

Work Location: Hybrid remote in New York, NY 10020