Big- Data Engineer(AWS

Job Title: Big- Data Engineer(AWS & Data Brick)

Location- Toronto ON-Onsite

Contract

Key Skills:-

• Databricks
• Apache Spark
• SQL
• Python
• Data Warehousing
• ETL
• Hadoop
• Kafka

Responsibilities

• Design, develop, and maintain scalable and robust data pipelines on Databricks.
• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
• Optimize and troubleshoot existing data pipelines for performance and reliability.
• Ensure data quality and integrity across various data sources.
• Implement data security and compliance best practices.
• Monitor data pipeline performance and conduct necessary maintenance and updates.
• Document data pipeline processes and technical specifications.

Qualifications

• Bachelor's degree in computer science, Engineering, or a related field.
• 5+ years of experience in data engineering.
• Proficiency with Databricks and Spark.
• Strong SQL skills and experience with relational databases.
• Experience with big data technologies (e.g., Hadoop, Kafka).
• Knowledge of data warehousing concepts and ETL processes.
• Excellent problem-solving and analytical skills.