Data Engineer

Job Description

Roles and Responsibilities

• Design, implement, and manage MongoDB architectures including schema design, indexing, replication, sharding, and scaling.
• Optimize MongoDB performance for large-scale, high-availability environments.
• Build and maintain ETL/ELT pipelines to ingest, transform, and load structured and unstructured data from multiple sources into MongoDB and other data platforms.
• Implement automation and ensure reliable data flows.
• Optimize MongoDB queries and aggregation pipelines for efficiency and speed.
• Conduct regular performance tuning and capacity planning.
• Ensure data quality, consistency, and integrity through validation and monitoring frameworks.
• Implement security controls, access management, and encryption across MongoDB and associated systems.
• Work with developers, data scientists, analysts, and DevOps teams to understand data needs and deliver scalable solutions.
• Integrate MongoDB with cloud services (AWS, GCP, Azure) and application environments.
• Monitor data pipelines and database performance using appropriate tools.
• Diagnose and resolve pipeline failures, data integrity issues, and database performance problems
• Develop and maintain documentation for data pipelines, system architecture, schemas, and engineering workflows.

Required Skills & Qualifications

• Deep knowledge of document modeling, aggregation framework, indexing strategies, replication, sharding, and overall database administration.
• Strong skills in Python, Java, or with experience using MongoDB drivers and libraries.
• Hands-on experience with technologies like Apache Spark, Kafka, Airflow, and cloud-native data services.
• Experience working with GCP, AWS, or Azure data ecosystems.
• Ability to design scalable and efficient NoSQL data models.
• Proven capability in diagnosing performance issues and improving data systems.
• Strong interpersonal skills for working with cross-functional stakeholders.

Requirements

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field; Master's degree preferred.
• Minimum 8 years of experience in data engineering, with strong expertise in MongoDB.