Data Engineer

Orion Innovation

Montvale, New Jersey, United States

Montvale, New Jersey, United States

Über

Summary We seek an experienced Applications Lead (Technical Lead) to own technical support leadership for a Data Analytics solution—supporting a global user base across multiple Azure-based production environments. This is a hands‑on technical leadership role focused on complex incident resolution, data‑intensive troubleshooting, and performance/scalability in large datasets and pipelines.
The role requires deep strength in PySpark, T‑SQL, data engineering, and analytics platform troubleshooting across Databricks, SQL Server/DWH, and Azure data services. You will serve as the escalation support technical lead for the most challenging cases (e.g., large datasets, heavy transformations, performance bottlenecks, configuration issues across data platforms), guiding support analysts and partnering with engineering/product to drive root‑cause closure and durable fixes.
Qualifications
8+ years of experience in application support / technical lead / data platform troubleshooting roles, with demonstrated ownership of complex incident/problem resolution in production‑like environments. Hands‑on Azure Data Engineering and Python experience.
Databricks + PySpark familiarity, including:
Building/navigating workspaces and notebooks
PySpark read/write operations and basic transformation logic
Strong T SQL / DWH background, including:
SQL database design and development
Stored procedures, table & scalar functions, performance tuning via execution plans and indexing
Advanced querying (CTEs, temp tables, correlated subqueries; cursors where appropriate)
Experience with large‑scale data wrangling, including scenarios with very large row counts (e.g., 100M+), and ability to reason about data complexity and performance bottlenecks.
Strong understanding of RDBMS concepts and (preferred) MSBI stack fundamentals.
Hands‑on ETL and reporting experience, including troubleshooting of pipelines and data flows end‑to‑end.
Strong communication skills: ability to explain complex data/platform issues clearly to engineers, support teams, and stakeholders.
Preferred Experience
Hands‑on SQL Diagnostics & Performance Tuning: Writing and optimizing advanced T SQL to diagnose and resolve issues (SPs, scalar/table functions, CTEs/temp tables, correlated subqueries; use execution plans, indexing strategy, and query refactoring for performance).
Azure Data Factory (ADF): building pipelines and troubleshooting orchestration patterns; ability to map concepts between SSIS and ADF.
ADLS file‑format expertise: Parquet/Delta vs CSV/Excel tradeoffs for volume, performance, and operational supportability.
Power BI workspace concepts (nice to have), plus data management/data analysis tools like Alteryx (nice to have).
Basic accounting concepts to better interpret audit/financial datasets.
Advanced Excel (Pivot, formulas, lookups, VBA macros) as a nice to have.
SAP/Oracle ERP technical profile:
Understanding ERP architecture
Support implementation/customization/performance tuning of extraction code
Basic ABAP/UNIX familiarity as a nice to have
EEO Statement Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.
#J-18808-Ljbffr

Montvale, New Jersey, United States

Sprachkenntnisse

English

Hinweis für Nutzer

Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.

Ähnliche Jobs finden