Senior Data Engineer
The Value Maximizer
- Columbia, South Carolina, United States
- Columbia, South Carolina, United States
About
Key Responsibilities
Design, develop, and maintain real-time data pipelines using Apache Kafka
Build scalable stream processing solutions using Kafka Streams, Spark Streaming, or Flink
Develop and optimize ETL/ELT pipelines for large-scale data processing
Integrate streaming pipelines with data lakes, data warehouses, and analytics platforms
Work with cross-functional teams including Data Scientists, Product Managers, and Analysts
Ensure data reliability, scalability, and performance optimization
Implement data governance, monitoring, and alerting for streaming systems
Troubleshoot production issues and optimize streaming architecture
Required Skills
8+ years of experience in Data Engineering
Strong hands‑on experience with Apache Kafka / Kafka Streaming
Experience with Python, Java, or Scala
Strong knowledge of real-time streaming architectures
Experience with Spark, Flink, or Kafka Streams
Strong SQL and data modeling skills
Experience working with cloud platforms (AWS, GCP, or Azure)
Familiarity with data lake technologies (S3, Delta Lake, Snowflake, etc.)
Preferred Skills
Experience with Databricks or Snowflake
Experience with containerization (Docker, Kubernetes)
Knowledge of CI/CD pipelines and DevOps practices
Experience with monitoring tools like Prometheus, Grafana, or Splunk
Nice to Have
Experience with event-driven architecture
Experience building high-throughput, low-latency data systems
#J-18808-Ljbffr
Languages
- English
Notice for Users
This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.