JR Data Engineer- Expert
Probity Inc.
- Chantilly, Virginia, United States
- Chantilly, Virginia, United States
À propos
Position Code: 20-SO0312-2
Position Description:
Seeking a highly motivated, self-directed professional for a Data Engineering role. In this role, you will design and maintain data pipelines, collaborate closely with development teams, and help deliver reliable data solutions that enable teams to transform data into actionable insights.
Required Qualifications:
Active TS/SCI with Polygraph clearance.
A Master’s degree in Computer Science, Information Systems, Engineering, or additional years of specialized experience in a scientific or technical discipline.
Build and maintain reliable data pipelines that support ingestion, transformation, and delivery of large datasets
Partner with software developers and engineering teams to integrate data solutions into existing systems and applications
Develop and optimize SQL queries to support data retrieval, transformation, and analysis
Work with relational databases such as PostgreSQL, Oracle, and MySQL to store, manage, and access data
Develop scripts and automation using Python, Linux, and shell scripting to support data processing tasks
Operate within AWS environments to support cloud-based data infrastructure and workflows
Prepare and structure data outputs in usable formats for analysis and downstream systems, including JSON
8+ years of experience developing or maintaining data pipelines in collaboration with development teams
4+ years of hands‑on experience with Python
Experience working with AWS cloud services
Familiarity with SPARC environments and relational databases including PostgreSQL, Oracle, or MySQL
Demonstrated experience writing and maintaining SQL queries
4+ years of experience working in Linux environments, including shell scripting
Experience preparing and managing structured and unstructured datasets, including JSON formats
Desired Qualifications:
Excellent communication and collaboration skills.
Experience with workflow orchestration tools such as Apache NiFi or Apache Airflow
4+ years of development experience with Java or Scala
Experience managing or supporting EMR or SPARC clusters
Background in performance tuning and optimization of data pipelines or large data systems
4+ years of experience working with Hive or Iceberg
Familiarity with implementing cloud-based security practices
#J-18808-Ljbffr
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.