Software Engineering Query Planner Professional Multiple CitiesIBM • Granite Heights, Wisconsin, United States
Software Engineering Query Planner Professional Multiple Cities
IBM
- Granite Heights, Wisconsin, United States
- Granite Heights, Wisconsin, United States
Über
Your role and responsibilities As a Software Engineer focused on query engine planning, optimization, and scheduling, you will design, develop, test, and deliver the planning pipelines, cost-based optimization logic, and scheduling strategies that power watsonx.data's analytical engine. You will work in an Agile, collaborative environment to understand stakeholder requirements and directly influence query latency, resource efficiency, and high-concurrency performance at petabyte scale. Your primary responsibilities will include:
Build Planning & Logical Optimization: Design logical plan generation and cost-based optimization—cardinality estimation, predicate pushdown, join reordering, partition and projection pruning, and subquery decorrelation—for complex query patterns.
Design Physical Execution & Scheduling: Translate logical plans into physical plans accounting for data locality, storage format, and CPU/GPU capabilities; implement adaptive execution and scheduling that balances throughput, latency, and fairness.
Contribute to CI/CD & Tooling: Contribute to the automated CI/CD pipeline and build tooling for plan visualization, cost-model inspection, and optimizer decision tracing.
Debug & Tune: Profile execution plans, unit-test fixes for planning regressions in production and CI, and optimize memory management (spill-to-disk, buffer pools, operator budgeting).
Collaborate in Agile Environment: Partner with storage, GPU acceleration, catalog, and AI/ML teams, contribute to design reviews and RFCs with measurable acceptance criteria, and document optimization rules and cost-model assumptions.
Required education None
Preferred education Bachelor's Degree
Required technical and professional expertise
Query Engine Experience: 6+ years of professional software engineering, including at least 2 years in query engine development, database internals, or distributed query processing.
Systems Programming Proficiency: Strong skills in Java, Scala, C++, or a comparable systems language, comfortable with performance-critical, production-grade code.
Optimization Depth: Hands-on experience with plan generation, logical optimization (predicate pushdown, join reordering, partition pruning), and cost-based optimization, plus the optimizer internals of a modern engine (Presto/Trino, Spark, DuckDB, ClickHouse).
Execution Models & AQE: Solid grasp of relational algebra, query rewriting, execution-model trade-offs (volcano, vectorized, compiled), adaptive query execution, and profiling tools (async-profiler, perf, flamegraphs).
Communication & Education: Clear written communication—able to document optimizer design decisions and explain trade-offs to engineers and leadership; Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
Preferred technical and professional experience
Optimizer & GPU Planning: Experience maintaining a production query optimizer, GPU‑aware planning or hardware-accelerated execution (RAPIDS/cuDF, Velox), and statistics infrastructure (histograms, NDV estimation) integrated into cost models.
Learned Optimization & OSS: Exposure to ML-guided optimization or learned cardinality estimation, contributions to open source (Trino, Spark, Calcite, Arrow, Velox, DuckDB), and familiarity with open table formats and their impact on partition pruning and scan optimization.
Benefits
Healthcare benefits including medical & prescription drug coverage, dental, vision, and mental health & well being
Financial programs such as 401(k), cash balance pension plan, the IBM Employee Stock Purchase Plan, financial counseling, life insurance, short & long‑term disability coverage, and opportunities for performance‑based salary incentive programs
Generous paid time off including 12 holidays, minimum 56 hours sick time, 120 hours vacation, 12 weeks parental bonding leave in accordance with IBM Policy, and other Paid Care Leave programs. IBM also offers paid family leave benefits to eligible employees where required by applicable law
Training and educational resources on our personalized, AI‑driven learning platform where IBMers can grow skills and obtain industry‑recognized certifications to achieve their career goals
Diverse and inclusive employee resource groups, giving & volunteer opportunities, and discounts on retail products, services & experiences
We consider qualified applicants with criminal histories, consistent with applicable law.
IBM is proud to be an equal‑opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.