Sr Databricks Engineer with Python

Job Title : Sr Databricks Engineer with Python Experience

Location: Wilmington, DE/ Columbus, OH 5 days onsite role

Duration: Long Term

Type: Contract W2

Local candidates will be prefered.

Job Description:

We are looking for a Senior Data Engineer with strong experience in Databricks, Pyspark, and modern Data Warehouse systems. The ideal candidate can design, build, and optimize scalable data pipelines and work closely with analytics, product, and engineering teams.

Key Responsibilities:

• Design and build ETL/ELT pipelines using Databricks and Pyspark
• Develop and maintain data models and data warehouse structures (dimensional modeling, star/snowflake schemas)
• Optimize data workflows for performance, scalability, and cost
• Work with cloud platforms (Azure/AWS/GCP) for storage, compute, and orchestration
• Ensure data quality, reliability, and security across pipelines
• Collaborate with cross-functional teams (Data Science, BI, Product)
• Write clean, reusable code and follow engineering best practices
• Troubleshoot issues in production data pipelines

Required Skills:

• Strong hands-on skills in Databricks, Pyspark, and SQL
• Experience with data warehouse concepts, ETL frameworks, batch/streaming pipelines
• Solid understanding of Delta Lake and Lakehouse architecture
• Experience with at least one cloud platform (Azure preferred)
• Experience with workflow orchestration tools (Airflow, ADF, Prefect, etc.)

Nice to Have:

• Experience with CI/CD for data pipelines
• Knowledge of data governance tools (Unity Catalog or similar)
• Exposure to ML data preparation pipelines

Soft Skills:

• Strong communication and documentation skills
• Ability to work independently and mentor others
• Problem-solver with a focus on delivering business value

About Next Gen Software Solutions LLC:

Next Gen Software Solutions is a trusted provider of IT Staffing and consulting services dedicated to empowering businesses with cutting-edge technology solutions and exceptional talent. We specialize in delivering tailored IT consulting services, innovative software solutions, and connecting businesses with highly skilled IT professionals. Founded and led by a dedicated U.S. Army solider, Next Gen Software Solutions is deeply rooted in the core values of integrity, discipline, commitment, and experience-principles that guide every aspect of our operations.

Equal Employment Opportunity Statement:

Next Gen Software Solutions LLC is an Equal Opportunity Employer. We are committed to fostering an inclusive and diverse workplace where all employees and applicants are treated respect and dignity. We do not discriminate based on race, colour, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, genetic information, veteran status, or any other legally protected characteristic under applicable federal, state, or local laws.