À propos
The Data Engineer II is responsible for designing, building, and maintaining data architecture and pipelines to support advanced analytics and AI/ML initiatives. This role requires moderate technical proficiency, strong problem-solving skills, and the ability to work independently while collaborating with engineers, data scientists, analysts, and product teams. The position includes troubleshooting complex issues and mentoring junior team members. Required Knowledge, Skills, and Abilities
Knowledge Principles of data architecture and engineering best practices. Moderate understanding of programming languages and relational databases. Familiarity with cloud-based data platforms and governance frameworks. Skills Ability to design and maintain complex data architectures and pipelines. Skill in troubleshooting and optimizing workflows. Proficiency in Microsoft Fabric and Power BI tools. Strong analytical and problem-solving skills. Effective written and verbal communication skills. Abilities Ability to build pipelines independently and document processes thoroughly. Ability to mentor junior team members. Ability to collaborate across technical and non-technical teams. Ability to support AI/ML initiatives and follow governance policies. Key Responsibilities
Data Architecture & Engineering Design and implement scalable, extensible data architectures and pipelines using Microsoft Fabric components (OneLake, Data Factory, Synapse Data Engineering, Synapse Data Warehouse). Build pipelines independently and optimize for performance and reliability. Troubleshoot and resolve complex data workflow issues. Document architecture, processes, and data lineage for compliance and transparency. Analytics & Visualization Develop Power BI semantic models, dataflows, and paginated reports. Partner with analysts and product teams to deliver actionable insights. Data Governance Enforce data governance policies and ensure compliance. Maintain accurate lineage documentation in Microsoft Purview for all assigned pipelines. AI/ML Support Design and Optimize Data for AI/ML: Architect and implement data pipelines specifically tailored for machine learning workflows, ensuring scalability and performance. Feature Engineering & Data Quality: Collaborate with data scientists to prepare high-quality datasets, perform feature engineering, and validate data integrity for model training. Model Deployment Support: Assist in operationalizing AI/ML models by integrating them into production environments and monitoring performance. Experiment Tracking & Documentation: Establish structured documentation for experiments, including versioning and reproducibility standards. Advanced Integration: Work with Azure OpenAI and Copilot Studio to enable intelligent automation and conversational AI solutions. Collaboration & Communication Work closely with engineers, data scientists, and analysts to meet evolving data needs. Begin mentoring junior engineers and share best practices. Tools & Technologies Microsoft Fabric (OneLake, Data Factory, Synapse Data Engineering, Synapse Data Warehouse) Power BI (semantic models, dataflows, paginated reports) Microsoft Purview (data governance, lineage, cataloging) Azure OpenAI Copilot Studio Required Dallas College Professional Development Hours per Academic Year. All employees are required to complete a minimum of 19 hours. Perform other duties not listed as assigned. Normal physical job functions performed within a standard office environment. Reasonable accommodation(s) may be made to individuals with physical challenges to perform the essential duties and responsibilities. Minimum Requirements for Position Bachelor's degree in Computer Science, Data Engineering, or related field. Two (2) plus years of relevant experience in data engineering or related field. Skills: Moderate proficiency in data processing frameworks, programming languages (e.g., SQL, Python), and databases. Strong analytical and problem-solving abilities. Other Preferred Qualifications for Role (not mandatory, but advantageous) Bilingual or multilingual preferred. Effective communication skills. Ability to maintain the security or integrity of the critical infrastructure of Dallas College.
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.