S'INSCRIRE

Offres d'emploi

Trouvez des postes près de chez vous, sur site, hybrides ou à distance.
  • Emplois similaires à : Data Engineer 2
XX
Data EngineerCybermedia Technologies • New York, New York, United States
Postuler Maintenant
XX

Data Engineer

Cybermedia Technologies
  • US
    New York, New York, United States
  • US
    New York, New York, United States
Postuler Maintenant

À propos

CTEC is a leading technology firm that provides modernization, digital transformation, and application development services to the U.S. Federal Government. Headquartered in McLean, VA, CTEC has over 300 team members working on mission-critical systems and projects for agencies such as the Department of Homeland Security, Internal Revenue Service, and the Office of Personnel Management. The Company has experienced rapid growth and is increasing its capabilities in cloud development for national-security focused agencies. We are seeking to hire a Data Engineer to join our team. Client: CTEC develops and delivers innovative, customer-centric technologies and solutions for the Office of Personnel Management’s Health and Insurance business unit and OCIO. Responsibilities Data Pipeline & ETL Development: Design, develop, and maintain scalable ETL pipelines and data workflows to ingest, transform, and integrate data from legacy systems and external sources into modern cloud-based data platforms. Cloud Data Platform & Databricks Implementation: Build, optimize, and maintain data processing solutions using Azure Databricks and lakehouse architectures to support analytical, operational, and reporting use cases. Data Migration Support: Support phased data migration from legacy databases and ETL tools to Azure Databricks environments, including transformation documentation and data mapping. Lakehouse & Data Layer Design: Implement layered lakehouse data architectures (bronze, silver, gold) in Databricks to support data quality, performance, and downstream reporting needs. Python & PySpark Development: Develop data processing notebooks, workflows, and distributed data transformations using Python and PySpark within Databricks environments. Data Quality & Validation: Develop data validation, reconciliation, and testing processes to ensure data accuracy, completeness, and consistency across data domains. Data Integration & Interoperability: Integrate Databricks data platforms with analytics and reporting tools to enable business intelligence and operational dashboards. Data Governance & Security Implementation: Support metadata management, data catalog integration, encryption, access controls, and compliance with federal data protection requirements. DevOps & CI/CD Support: Maintain source control and CI/CD pipelines for Databricks and data engineering workflows, supporting automated promotion across environments. Technical Collaboration: Work with data architects, solution architects, business analysts, and reporting teams to implement approved data solutions. Operational Support & Troubleshooting: Provide ongoing support for Databricks workflows, resolve pipeline failures, and troubleshoot complex data processing issues. Mentorship & Knowledge Sharing: Guide junior data engineers and contribute to documentation and team enablement. Works under minimal supervision with minor guidance from senior personnel. Qualifications & Experience At least seven (7–9+) years of experience in data engineering, ETL development, or large-scale data integration environments. Strong experience designing and developing ETL pipelines and data transformations in Azure Databricks. Strong proficiency in SQL and Python, with hands-on PySpark experience. Experience with cloud-based data platforms, data lakes, and lakehouse environments, preferably on Microsoft Azure. Experience implementing layered lakehouse architectures (bronze, silver, gold) for enterprise analytics. Familiarity with Spark-based big data processing frameworks. Experience migrating data from legacy databases/ETL tools to Databricks platforms. Experience integrating Databricks with BI/reporting tools such as Power BI. Familiarity with data governance, metadata management, and data security best practices. Experience with source control and CI/CD for data engineering and Databricks workflows. Working knowledge of SDLC and Agile delivery methodologies. Excellent organizational, communication, and collaboration skills. Preferred Hands-on experience with Azure Databricks workflows, Delta tables, and Databricks job orchestration. Experience with Azure Data Lake, Azure Data Factory, or similar Azure data services. Experience supporting federal IT modernization or large-scale enterprise data transformation initiatives. Familiarity with healthcare, insurance, or benefits administration data environments. Experience implementing data governance or data catalog platforms. Education Bachelor’s degree in Computer Science, Engineering, Information Systems, or related technical discipline. Equivalent education or professional experience will be considered in lieu of a degree. Clearance Must be a U.S. citizen and be able to obtain a Public Trust clearance. Benefits CTEC offers a competitive benefits package including paid vacation and sick leave, health insurance, performance bonus programs, and 401(k) matching. EEO and Compliance Voluntary Self-Identification and related EEO statements are included as part of the standard government-compliant process. Completion is voluntary and confidential. For more details, refer to the organization’s Equal Employment Opportunity policy.
#J-18808-Ljbffr
  • New York, New York, United States

Compétences linguistiques

  • English
Avis aux utilisateurs

Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.