SIGNUP
Back to Jobs
XX
Python Data EngineerVirtusa • Tampa, Florida, United States
Find similar jobs

This job offer is no longer available

XX

Python Data Engineer

Virtusa
  • US
    Tampa, Florida, United States
  • US
    Tampa, Florida, United States
Find similar jobs

About

We are seeking a highly experienced and motivated Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and optimizing highly scalable and robust ETL/ELT pipelines. This role will be critical in shaping our data architecture, implementing Lakehouse solutions, and working with cutting-edge technologies like LLMs and Vector Search.
Key Responsibilities
Design, develop, and maintain robust and scalable data pipelines using PySpark and Python.
Implement and manage data solutions within the Databricks platform.
Define and enforce data modeling standards, specifically utilizing the Medallion architecture (Bronze, Silver, Gold layers).
Architect and implement Lakehouse capabilities, including AI/Machine Learning features and Vector Search for advanced data retrieval.
Evaluate, integrate, and work with Large Language Model (LLM) frameworks.
Collaborate with data scientists and business stakeholders to understand data requirements and translate them into technical solutions.
Ensure data quality, reliability, and security throughout the data lifecycle.
Mentor junior engineers and contribute to best practices in data engineering.
#J-18808-Ljbffr
  • Tampa, Florida, United States

Languages

  • English
Notice for Users

This job was posted by one of our partners. You can view the original job source here.

Find similar jobs