Jobbörse
Finde Jobs in deiner Nähe – ob vor Ort, hybrid oder remote.- Ähnliche Jobs zu: Senior EPC Engineer – Value Engineering & QA/QC Lead
Senior Lead Data Engineer
BrillioSt LouisAbout Brillio Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage
Senior Embedded Systems Engineer - Firmware & Hardware Lead
Radiance TechnologiesBrooklynRadiance Technologies, Inc. is seeking a highly skilled Senior Embedded Systems Engineer to lead the architecture and development of next-generation electronic devices. This role involves ownership of
Senior Data Engineer Azure Fabric & AI Pipelines Lead
K&L Gates LLPKansas CityK&L Gates is seeking a Senior Data Engineer in Kansas City. This role focuses on designing scalable Microsoft Fabric data platforms and establishing engineering standards while mentoring staff. Ideal
Remote Senior Data Engineer - Lead End-to-End Pipelines
Crate and BarrelNorthbrookCrate and Barrel is seeking a Senior Data Engineer to lead technical implementations within their Google Cloud-native data ecosystem. The role emphasizes the engineering of high-performance data pipel
Occupational Therapist( Sign on Bonus!)
Fox RehabilitationBrooklynOur team is growing, and we‘re looking for top-caliber Occupational Therapists to join us in Brooklyn and surrounding locations in New York. UBER CAN BE INCLUDED! Why FOX Rehabilitation?• Pioneer of G
Primary Care Physician [Spanish Required]
Oak Street HealthBrooklynWe’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who
Mobile Pressure Washer Operator - Travel to Job Sites
Kokosing Materials IncBrooklynKokosing Materials, Inc. is seeking a full-time Wash Truck Operator to maintain and clean various mobile and heavy equipment. This position requires travel to multiple job sites within the region and
Retail Sales Consultant - 401k and Tuition Reimbursement
AT&TBrooklynDo you speak Russian and English? If you do, we’re looking for you! Our Retail Careers come with awesome perks and may include additional starting pay if you are bilingual. Great things are in store!
L1 Systems Administrator
BelcanBrooklynA Tier L1 IT Systems Administrator job is currently available at Belcan in Evendale, OH 45215. This is a full‑time, direct hire position with full benefits. To be considered for this role, you must be
Social Media & Content Specialist
W.A. Smith Financial GroupBrooklynWe are seeking a Social Media & Content Specialist to lead and execute the firm's organic social media efforts across all major platforms including Facebook, Instagram, LinkedIn, TikTok, X, and YouTub
Regional Surveillance Systems Administrator
Bally's InteractiveBrooklynBally's Interactive is seeking a Surveillance System Technician I to install, maintain, and repair surveillance and security hardware. This role includes troubleshooting alarm systems and supervising
Business Intelligence Analyst
W. R. BerkleyBrooklynCompany Details Company URL: www.berkleyaspire.comBerkley Aspire is an excess & surplus lines insurer of commercial risks unable to find a home in the standard markets. We are an operating unit of WR
Senior Business Analyst, Regulatory Reporting Solutions (Remote)
Hispanic Alliance for Career EnhancementBrooklynPosition Summary The Senior Business Analyst supports execution and coordination of PBM, Medicaid, and Licensure regulatory and state reporting requirements. This role supports the Sr. Manager by coor
Business Analyst II
AFA American Fidelity Assurance CompanyBrooklynThe Business Analyst II is accountable for ensuring that project solution(s) to relevant opportunities and/or problems meet the Customer’s true needs. In working on medium-sized technology-related pro
Field Sales Technical Associate - Lexington, KY (Remote in Lexington Area)
KonecranesBrooklynAt Konecranes, we believe that great customer experience is built on the people behind the Konecranes name. Everything we do, we do with passion and drive. We believe diversity drives business success
Remote Global Sales Ops & Data Insights Specialist
LexisNexis Risk SolutionsBrooklynLexisNexis Risk Solutions is seeking a Sales Operations Specialist to manage systems and reporting frameworks that enhance operational efficiency across regions. The candidate will design CRM dashboar
Systems/Network Engineer for local IT Managed Services Provider
6AM CityBrooklynJob Description Interested in an exceptional technical growth opportunity? How about advancement/promotion opportunities in a dynamic and growing technical services business. We have an environment an
Enterprise Cisco Network Engineer - CUCM & WAN Specialist
Norman Regional Health SystemBrooklynNorman Regional Health System is seeking a Network Engineer responsible for providing enterprise-level support, design, and maintenance of the network infrastructure. This role involves working closel
Entry-Level Lab Technician: Precision Analyses & QA
Darling InternationalBrooklynDarling Ingredients Inc. in Kentucky is seeking an entry-level lab technician to conduct precise analyses in support of quality control and regulatory activities. Candidates should possess a B.S. in C
Tier 1 IT Systems Administrator Onsite, Secret Clearance
BelcanBrooklynBelcan Corporation is seeking a Tier L1 IT Systems Administrator to provide technical assistance in Evendale, OH. This full-time position supports users with Windows and Linux issues and requires a Co
CAD-Driven Dairy Facility Design & Estimating
OhioagconnectionBrooklynHansen Agri-PLACEMENT is seeking a Dairy Design Specialist responsible for assisting with the planning, layout, and cost estimating of new dairy facilities. This role involves creating accurate design
Sales Engineer (Gemlock)
Core & MainBrooklynBased in St. Louis, Core & Main is a leader in advancing reliable infrastructure™ with local service, nationwide®. As a specialty distributor with a focus on water, wastewater, storm drainage and fire
Route Sales Representative - Kentucky
Arrow InternationalBrooklynRoute Sales Representative – Kentucky Atlantic Bingo Supply is a leader in the multi-billion-dollar charitable gaming industry. We distribute a wide array of products including consumables (pull tab t
Wireless Sales Lead & Team Coach - Unlimited Commission
Acosta GroupBrooklynAcosta Group in Fulton, KY, is hiring a Sales Lead to drive sales performance and mentor sales associates. The role requires strong communication skills and a proactive approach to customer engagement
Technical Lead (Microgrid & BESS Design)
6AM CityBrooklynDescription Join ENTRUST as a Technical Lead focused on Microgrid & BESS Design Engineering. This position is responsible for providing comprehensive IFC Design documents and project engineering suppo
Senior Lead Data Engineer
- St Louis, Missouri, United States
- St Louis, Missouri, United States
Über
Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.
Senior Lead Data Engineer Salary: $125,000 - $130,000 a year
Key Responsibilities
Design, develop, and maintain ETL/ELT pipelines using PySpark and Python in Databricks (notebooks, jobs, Delta Lake tables, Unity Catalog for governance).
Implement medallion architecture (bronze/silver/gold layers) and optimize Spark jobs for performance, cost, scalability, and reliability.
Write efficient SQL queries for data transformation, validation, and analytics within Databricks.
Provision and manage cloud infrastructure using Terraform (IaC) for Databricks workspaces, clusters, jobs, storage (ADLS/S3), networking, IAM roles/permissions, and related resources on Azure and/or AWS.
Implement and maintain CI/CD pipelines using Jenkins, GitHub (Actions/Repositories), and branching strategies for automated testing, deployment of notebooks, jobs, Delta Live Tables, and Terraform configurations.
Integrate data from diverse sources (databases, APIs, streaming, files) into cloud storage and processing layers.
Ensure data quality, lineage, security, and compliance (Delta Lake ACID transactions, schema evolution, time travel, and access controls).
Monitor pipeline performance, troubleshoot failures, and implement alerting/observability (Databricks tools, cloud monitoring services, or third‑party solutions).
Optimize cloud costs through auto‑scaling clusters, spot instances, job scheduling, and efficient resource usage.
Collaborate in agile teams, participate in code reviews, and contribute to best practices for data engineering.
Required Skills & Experience
Strong proficiency in Python and PySpark for distributed data processing and ETL.
Advanced SQL skills with experience in complex querying, window functions, and optimization.
Hands‑on experience with Databricks (clusters, notebooks, Delta Lake, Unity Catalog, Delta Live Tables, workflows/jobs).
Proficiency in Terraform for infrastructure provisioning and management (Databricks resources, cloud storage, IAM, networking).
Experience with GitHub for version control and collaboration (branching, pull requests, code reviews).
Solid knowledge of CI/CD practices and tools, particularly Jenkins (pipelines, plugins for Databricks/GitHub/Terraform).
Working experience on Azure (Data Lake, Data Factory, Synapse, Key Vault, etc.) and/or AWS (S3, Glue, EMR, IAM, Lambda, etc.).
Understanding of big data concepts, data modeling (star/snowflake, dimensional), and lakehouse principles.
Familiarity with performance tuning in Spark/Databricks environments.
Equal Employment Opportunity Declaration Brillio is an equal opportunity employer to all, regardless of age, ancestry, colour, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding, and related medical conditions), and sexual orientation.
#J-18808-Ljbffr
Sprachkenntnisse
- English
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.