Data Engineer

About The Company

C the Signs is a leading innovator in the healthcare technology sector, dedicated to harnessing the power of artificial intelligence and machine learning to transform patient care and health outcomes. Committed to advancing the frontiers of medical data analysis, we develop cutting-edge solutions that support healthcare providers, researchers, and policymakers. Our mission is to improve health equity, enhance clinical decision-making, and facilitate personalized medicine through the integration of advanced data engineering and AI capabilities. With a focus on ethical data practices and compliance with healthcare regulations, we strive to build trustworthy and scalable platforms that make a tangible difference in people's lives.

About The Role

The Data Engineer will play a crucial role in developing and fine-tuning data specifically for our large language models (LLMs) and machine learning applications within the healthcare domain. This individual will oversee the entire data lifecycle—from sourcing and cleaning to structuring and optimizing large, complex healthcare datasets. The ideal candidate will possess a strong foundation in data engineering principles, extensive experience with big data technologies, and a comprehensive understanding of the unique challenges associated with healthcare data management. You will be responsible for designing, building, and maintaining scalable data pipelines that facilitate the ingestion, processing, and storage of high-volume, diverse datasets, ensuring data quality and integrity at every step. Your work will directly impact the effectiveness of our AI models, enabling more accurate and reliable healthcare solutions.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field
• Proven experience as a Data Engineer with a focus on big data technologies
• Strong proficiency in programming languages such as Python, Scala, or Java
• Extensive experience with data warehousing, ETL processes, and data modeling
• Hands-on experience with cloud platforms like AWS, GCP, or Azure and their data processing services
• Experience with big data frameworks such as Apache Spark for distributed processing
• Excellent problem-solving skills and the ability to work independently and collaboratively
• Strong communication and interpersonal skills

Preferred qualifications include a Master's degree in a related field, experience with healthcare data standards such as FHIR and HL7, familiarity with machine learning concepts and LLM fine-tuning, and experience with data orchestration tools like Apache Airflow.

Responsibilities

• Collaborate with data scientists and machine learning engineers to understand data requirements for LLM and model fine-tuning projects
• Design, build, and maintain scalable data pipelines to ingest, process, and store diverse healthcare datasets
• Implement robust data validation, cleaning, and transformation processes to ensure high data quality and consistency
• Develop and optimize data structures, schemas, and models for efficient access and utilization by AI models
• Identify, acquire, and integrate new data sources while ensuring compliance with healthcare regulations such as HIPAA
• Monitor, troubleshoot, and optimize data pipeline performance for reliability and efficiency
• Document data engineering processes, data models, and data dictionaries for transparency and reproducibility
• Stay current with advancements in data engineering, big data technologies, and machine learning to continuously improve practices

Benefits

• Competitive salary and comprehensive benefits package
• Flexible working arrangements, including remote and hybrid options
• Opportunity to work on innovative AI technology with the potential to save lives and improve health outcomes
• Collaborate with a passionate team dedicated to healthcare innovation and health equity
• Continuous learning opportunities with access to the latest tools, technologies, and research in AI and healthcare
• Engage in meaningful work that has a tangible impact on patient care globally

Equal Opportunity

C the Signs is an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, gender, sexual orientation, age, disability, or any other protected characteristic. We are committed to creating an inclusive environment where all employees can thrive and contribute to our mission of transforming healthcare through innovative AI solutions.