Data Engineer

Job Title: Sr Data Engineer

Location: Atlanta, GA-Onsite from

Day 1

Duration: Contract-Only

Role name: Engineer

Role Description:

1. Design, develop, and maintain scalable data pipelines on Azure platform.

2. Implement data storage solutions using Azure Data Lake Storage, Azure SQL Database, and Azure Cosmos DB.

. Develop ETL processes to extract, transform, and load data from various sources into Azure data services.

4. Collaborate with data scientists and analysts to ensure efficient data flow and support their analytics needs.

5. Monitor and optimize data pipelines for performance, reliability, and cost-effectiveness.6. Manage and maintain data security, access controls, and compliance standards within Azure services.

7. Troubleshoot and resolve data-related issues, ensuring data integrity and accuracy.

8. Work with DevOps teams to automate deployment, monitoring, and management of data solutions.

9. Keep up-to-date with industry trends and best practices in Azure data engineering.10. Document data pipelines, processes, and procedures for knowledge sharing and team collaboration.

Competencies: Digital : Microsoft Azure, Digital : Azure Machine Learning (ML)

Experience (Years): 8-10

Essential Skills: 1. Proficiency in designing, implementing, and managing data pipelines and ETL processes using Azure Data factory.2. Strong experience with Azure Databricks for data processing, transformation, and analysis.3. Expertise in working with Azure SQL database, Azure Synapse analytics and other Azure data storage solutions.4. Knowledge on data modelling concepts and Hands-on-experience with tools like Azure Data lake storage.5. Ability to write efficient SQL queries for data extraction, transformation and loading.6. Familiarity with Azure Cosmos DB for NoSQL data storage and management.7. Skills in scripting languages like python or power shell for automating data workflows and tasks.8. Proficient in data quality and data governance practices within Azure ecosystem.9. Familiarity with Azure DevOps for CI/CD processes and deployment of data solutions.10. Understanding of data security and compliance standards within Azure, including data encryption and access controls.11. Knowledge of Azure monitoring and logging tools to ensure the health and performance of data solutions

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.