This job offer is no longer available
Data Engineer Software Developer
Leidos Inc
- Shiloh, Illinois, United States
- Shiloh, Illinois, United States
About
The Leidos Digital Modernization Group seeks a Data Engineer Software Developer for the Global Solution Management - Operations II (GSM-O II) contract, under the Global Automations & Intelligent Network Solutions (GAINS) Team. This role is a Back‑End Developer on the Real‑Time Visibility (RTV) team, focused on designing, building, and maintaining the infrastructure and systems that collect, store, process, and analyze large volumes of network operations data for the DISN network. The existing platform is built on Elastic Stack and Confluent Kafka. The ideal candidate will have a strong background in data engineering, platform operations, and integration, with experience in large‑scale, mission‑critical environments. As a key team member, you will design and implement scalable data integration solutions that capture data from diverse sources such as logs, performance metrics, events, ticketing, ordering, and CMDB systems. You will adhere to the program’s CI/CD processes and data governance practices, participate in Agile development cycles, and support user experience via a unified interface on the Elastic platform. Collaboration with operational end users, support teams, and data analysts will be essential to analyze requirements, design solutions, and deliver actionable insights. Primary Responsibilities
Design, build, and maintain scalable, reliable data systems and pipelines to ingest, process, and transform large, complex, and disparate data sources for analytics and reporting. Unify and integrate data from multiple network operations systems into a consistent, accessible platform, ensuring data quality, accuracy, security, and compliance with DoD and DISA requirements. Implement solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), creating pipelines and supporting Kibana visualizations and dashboards with React, JavaScript, and HTML. Develop and manage data warehouses and data lakes to support analytics, reporting, and operational dashboards, optimizing infrastructure for performance, scalability, and cost‑effectiveness through automation and best practices. Analyze and optimize ingestion throughput, query performance, indexing strategies, and storage efficiency across Elastic and Kafka platforms. Automate data‑related tasks such as ETL/ELT processes, data validation, cleansing, monitoring, and support CI/CD pipelines for automated build, test, and deployment. Collaborate with data analysts, visualization engineers, and other stakeholders to deliver integrated, actionable data solutions, and document data architecture, integration patterns, and operational procedures. Troubleshoot and resolve issues related to data ingestion, processing, and platform performance, storage, memory, partitioning, and cluster performance. Basic Qualifications
Bachelor’s degree in Computer Science, Engineering, or a related technical discipline and 4+ years of relevant experience. Hands‑on experience designing, building, and maintaining data pipelines (ETL/ELT) and integrating multiple, disparate data sources. Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar). Proficiency with data engineering tools and languages such as Python, Java, SQL, and shell scripting. Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing. Familiarity with network operations data (logs, metrics, events, ticketing, CMDB) and related data models. Experience with Linux/UNIX system administration and automation. Knowledge of data security, access controls, and compliance frameworks (DoD, DISA, RMF, STIGs). Experience with CI/CD pipelines, containerized pipelines, version control (Git, Bitbucket), and DevOps practices. Strong communication and documentation skills for collaboration and knowledge sharing. Must be able to commute to Scott AFB, IL for full‑time onsite support. Ability to obtain an interim Secret DoD Security clearance before the start date. Ability to obtain Security+ certification or equivalent DoD 8570 IAT II certification within 14 days of the start date. Preferred Qualifications
Experience with DISA, DISN, or other DoD network environments, including developing and deploying software applications that meet DoD security standards (e.g., STIGs), and knowledge of network security, encryption, and access controls in classified environments. Experience with big data technologies and platforms such as Kafka, Spark, NiFi, Hadoop, Elasticsearch, Logstash, Databricks, and ELK Stack for text mining, summarization, search, and entity extraction. Experience with cloud‑based data platforms (AWS, Azure, GCP, AWS GovCloud), cloud‑integrated platforms, and infrastructure as code, including networking and security policies. Familiarity with Kubernetes deployment, platform upgrades, patching, configuration management tools (Ansible, Puppet, Chef), and monitoring, alerting, and observability tools (Prometheus, Grafana, Elastic). Experience with BI tools like Kibana and developing and maintaining technical documentation and runbooks. Strong understanding and practical experience with Agile methodologies (Scrum, SAFe), and related tools such as Atlassian JIRA and Confluence. Certified Confluent Developer and Certified Elastic Engineer. Excellent communication and collaboration skills, with experience working remotely with geographically dispersed teams and within a matrixed organization to combine software, integration, and data engineering practices. Apply knowledge of system architecture, networks, and centralized logging (ELK) to support data transformation initiatives. Pay Range: $87,100.00 – $157,450.00 Commitment to Non‑Discrimination
All qualified applicants will receive consideration for employment without regard to sex, race, ethnicity, age, national origin, citizenship, religion, physical or mental disability, medical condition, genetic information, pregnancy, family structure, marital status, ancestry, domestic partner status, sexual orientation, gender identity or expression, veteran or military status, or any other basis prohibited by law. Leidos will also consider for employment qualified applicants with criminal histories consistent with relevant laws.
#J-18808-Ljbffr
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.