Über
Job Location: Reston, VA(100% Remote)(Non-Locals also will work)
Position Type: Long Term Contract
Job Description:
We are looking for an experienced Data Engineer who will be responsible for standardizing our data ingestion pipelines and improving the performance of data storage and retrieval. Our projects ingest structured and unstructured data from multiple sources, which eventually ends up in a unified Data Lake. This data is available for reporting and analytics by various other teams. This candidate should be comfortable working with SQL as well as NoSQL databases. Cloud experience is a bonus. Your primary focus will be the continuous development/improvement of our data ingestion pipeline, and data parsing. Major technologies involved include Python, AWS Glue, SQL, MongoDB, ElasticSearch, and NiFi.
kills and Responsibilities Design and develop stream and batch processing data pipelines for ingesting healthcare data (CSVs, JSON, Common Data Formats like OMOP, ACT, etc.,) into MongoDB and ElasticSearch. Ability to write intermediate to advanced SQL/Python for data ingestion and processing. Support existing and develop new data flows as needed by developing processes that verify, standardize, and scale data input, transformation, and storage. Collaborate with product managers and other engineers to implement and document complex and evolving requirements Research and implement cutting edge solutions to solve challenges related to ETL, data processing, and analytics. Support efforts by the Data Science and Data Analytics teams. Ability to debug complex data issues without frequent guidance from senior team members. Occasional Linux server management including the review or management of log files, crontab, security configuration, etc. Developing techniques to work with both tabular and hierarchical data. Strong attention to detail, good work ethic, ability to work on multiple projects simultaneously, and good communication skills Required Skills
Must have strong programming & ETL skills in Python & SQL. Experience working with Healthcare Common Data formats. 3 to 6 years of experience working in Data Engineering or related roles. A degree in Computer Science or an equivalent major. Experience working with various database systems: MongoDB/SQL Server/PostgreSQL etc. Experience with agile methodologies and short release cycles Enjoys collaborating with other engineers on architecture and sharing designs with the team Desired Experience
Experience working with NiFi. Experience with cloud technologies (AWS) Experience working with PHI/Healthcare data. AI / Client experience.
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klicken Sie auf „Jetzt Bewerben“, um Ihre Bewerbung direkt auf deren Website einzureichen.