This job offer is no longer available
About
Azure Data engineer
Location
Grand rapids, MI (Onsite)
Exp need
10+ years
Job Description
Role Description:
1. Azure Data Integration Services
* Azure Data Factory (ADF) Troubleshoot pipeline failures, debug triggers, resolve integration runtime issues, optimize data flows, and support ETLELT workloads.
* Azure Databricks Investigate cluster performance issues, job failures, notebook errors, library conflicts, and assist with Spark optimization basics.
* Azure Function Apps Diagnose runtime failures, configuration issues, scaling problems, and integration errors with other Azure services.
2. Monitoring, Diagnostics Observability
* Use Azure Log Analytics, Kusto queries (KQL), and Azure Monitor too
* Investigate incidents
* Identify root causes
* Build dashboards and alerts
* Interpret logs from ADF, Databricks, Function Apps, App Insights, and DevOps pipelines.
3. DevOps Deployment Support
* Support CICD pipelines in Azure DevOps including build failures, release issues, YAML pipeline debugging, and artifact management.
* Assist teams with environment configuration, variable groups, service connections, and deployment best practices.
4. Data Engineering ETL Troubleshooting
* Apply basic data science and ETL knowledge to understand data quality issues, schema mismatches, transformation failures, and performance bottlenecks.
* Support ingestion pipelines from various sources (databases, APIs, files, etc.).
* Validate data integrity and troubleshoot data drift or pipeline regressions.
5. Incident Problem Management
* Triage incoming tickets, classify severity, and drive timely resolution.
* Reproduce issues, document findings, and provide clear communication to stakeholders.
* Create root cause analysis (RCA) reports and preventive recommendations.
6. Collaboration Escalation
* Work with product engineering teams for complex issues requiring deeper investigation.
* Collaborate with data engineers, developers, DevOps engineers, and architects to resolve cross service problems.
7
. Documentation Knowledge Sharing
* Create troubleshooting guides, runbooks, KB articles, and best practice documentation.
* Contribute to internal knowledge bases and team learning sessions.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.