- +2
- +19
- Texas, United States
About
About the job Sr. Data Engineer
Role: Senior Data Engineer
Required Qualifications:
Strong in Python with 3+ years hands-on coding experience
3+ years experience in designing and building Microservices
3+ years experience with REST API design and development using Python
3+ years experience with deployment/scaling of apps on containerized environment (i.e., Kubernetes, AKS)
3+ years experience with real-time and streaming technology (i.e., Azure Event Hubs, Azure Functions Kafka, Spark Streaming)
3+ years experience with cloud-based platforms (i.e., Azure, GPC, AWS)
Experience building automated big data pipelines
Experience performing data analysis and data exploration
Experience working in an agile delivery environment
Experience with Snowflake
Experience with RDBMS and NoSQL Databases and hands-on query tuning/optimization
Experience working in multi-developer environment, using version control (i.e., Git)
Experience with orchestrating pipelines using tools (i.e., Airflow, Azure Data Factory)
Experience with data modeling and system architecture design
Experience partnering cross-functionally with other technical teams (i.e., data ingestion, data science, operational systems) to align priorities and achieve deliverable outcomes
Experience with setting coding standards, performing code reviews, and mentoring junior developers
Exposure/understanding DevOps best practice and CICD (i.e., Jenkins)
Ability to understand complex systems and solve challenging analytical problems
Strong critical thinking, communication, and problem-solving skills and a quick learner
Must have:
Strong experience with deployment/scaling of apps on containerized environment (i.e., Kubernetes, AKS)
Strong experience with NoSQL Databases and hands-on query tuning/optimization
Strong experience with real-time and streaming technology (i.e., Azure Event Hubs, Azure Functions Kafka, Spark Streaming)
Preferred Qualifications:
Experience in Azure/GCP.
Solid understanding of Kafka architecture and building consumers for high volume data streams.
Experience with bash shell scripts, UNIX utilities & UNIX Commands
Previous healthcare experience and domain knowledge
Education:
Bachelors degree in computer science, Engineering, Statistics, Physics, Math, or related field or equivalent experience
Preferred: masters degree with coursework focused on advanced algorithms, mathematics in computing, data structures, etc.
Nice-to-have skills
- Python
- Microservices
- REST API
- Kubernetes
- Kafka
- Azure
- Google Cloud Platform
- AWS
- Big Data
- Data Analysis
- RDBMS
- Git
- Azure Data Factory
- Data Modeling
- System Architecture
- DevOps
- Jenkins
- Bash
- Unix
Work experience
- Data Engineer
- Data Infrastructure
Languages
- English