SIGNUP

Job Opportunities

Find jobs near you, whether onsite, hybrid, or remote.
  • Similar Jobs to: Data Engineer Lead
XX
Data Engineer - LeadDiverse Lynx • United States
Apply Now
XX

Data Engineer - Lead

Diverse Lynx
  • US
    United States
  • US
    United States
Apply Now

About

Data Engineer - Lead
Location: Irvine, CA - onsite Duration: 6 months Rate- $85/hr C2C Data engineering delivery- POD level; Skills- pipeline design, performance tuning (Databricks, Spark, PySpark, SQL, pipeline development, performance tuning) Databricks, Spark, PySpark, SQL, pipeline development, performance tuning Role Descriptions: Data Engineer - Lead - Data engineering delivery oversight; Skills- pipeline design| performance tuning (Databricks| Spark| PySpark| SQL| pipeline development| performance tuning) Tower Lead - with Data engineering L3 Support Experience: Asset Management Domain experience; Skills- pipeline design| performance tuning (Databricks| Spark| PySpark| SQL| pipeline development| performance tuning) Data Engineer - L3 Support Engineer (Sr) - Strong L3 Technical Capability| expert in support processes; Senior DevOps Specialist Deerfield, IL - Onsite Fulltime Aditi Rai $155K Job Description Must Have Technical/Functional Skills 5+ years of DevOps, platform engineering, or build/release engineering experience in large enterprise environments. 3+ years of deep, hands-on experience with Azure DevOps and/or GitHub Enterprise in an enterprise multi-team context. Expert-level proficiency in infrastructure-as-code: Terraform required; Bicep strongly preferred. Strong experience with containerization and AKS: Helm chart development, Kustomize, namespace management, and workload identity. Proficiency in scripting: PowerShell and/or Python; experience with Azure CLI and REST APIs. Proven experience implementing DevSecOps toolchains in regulated enterprise environments. Working knowledge of enterprise Azure networking as it pertains to deployment pipelines: Private Endpoints, self-hosted agents in VNets, ExpressRoute-connected environments Required/Preferred Certifications: AZ-400 (Highly Desirable) | AZ-104 | AZ-305 | CKA (Beneficial) | GitHub Actions Certification Roles & Responsibilities CI/CD Pipeline Engineering Design, build, and operate enterprise CI/CD pipelines using Azure DevOps Pipelines (YAML-based, multi-stage) and GitHub Actions, supporting 50+ development teams across the organization. Implement and enforce DevSecOps gates: SAST/DAST scanning (Microsoft Defender for DevOps, Snyk), dependency auditing, secrets detection, and container image scanning via Microsoft Defender for Containers. Develop reusable pipeline templates, task groups, and shared library components to standardize delivery across all Azure DevOps organizations. Champion shift-left quality practices: automated unit/integration/performance testing integrated into deployment pipelines with quality gates Infrastructure Automation & Cloud Engineering Own and extend the organization's Azure infrastructure-as-code estate using Terraform and Bicep; manage state backends in Azure Storage with Terraform Cloud/Atlantis. Design and maintain Azure Landing Zone configurations including Management Group hierarchy, Azure Policy initiatives, RBAC assignments, and Subscription vending automation. Automate provisioning and lifecycle management of Azure PaaS services: AKS, Azure SQL, Azure Service Bus Storage Accounts, Key Vault, and App Services. Integrate infrastructure pipelines with enterprise CMDB (ServiceNow) for automated asset registration and compliance reporting. Release Management & GitOps Define and govern enterprise release management processes, branching strategies (trunk-based development), and GitOps workflows using ArgoCD or Flux on AKS. Manage Azure Artifacts feeds for NuGet, npm, Maven, and container image artefacts across the enterprise; implement retention and promotion policies. Platform Reliability & Operational Excellence Define and monitor DevOps DORA metrics (Deployment Frequency, Lead Time, MTTR, Change Failure Rate) and publish dashboards to engineering leadership. Collaborate with the SRE team to implement progressive delivery patterns: blue/green deployments, canary releases, and feature flag management using Azure App Configuration. Manage Azure cost efficiency for CI/CD infrastructure: Microsoft-hosted and self-hosted agent pools, ephemeral build agents, and pipeline optimization for build minutes. Governance, Security & Compliance Ensure all pipelines and infrastructure comply with enterprise security standards, including CIS Benchmarks for Azure, Microsoft Cloud Security Benchmark (MCSB), and internal control frameworks. Maintain pipeline audit trails and artefact provenance in alignment with SOC 2, ISO 2700 1, and regulatory requirements. Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
  • United States

Languages

  • English
Notice for Users

This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.