À propos
Work Location Irving TX
Job Description
Seeking a Senior professional with 3 to 5 years of experience in Python Scala and Spark SQL to design and optimize big scalable data processing solutions within the Databricks Spark SQL Scala Python Java ecosystem
Develop and maintain scalable data processing pipelines using Apache Spark with Python and Scala
Utilize Spark SQL to analyze large datasets and extract meaningful insights supporting data driven decision making
Collaborate with cross functional teams to integrate big data solutions into existing systems
Optimize Spark jobs for performance and efficiency in distributed computing environments
Ensure data quality and consistency across various data sources
Stay updated with the latest advancements in Spark Scala Python and related big data technologies to continuously improve processing capabilities
Roles and Responsibilities
Design develop and deploy complex data processing workflows leveraging Apache Spark Scala Python and SparkSQL
Write efficient reusable and maintainable code for Spark applications
Troubleshoot and resolve performance bottlenecks in Spark jobs and data pipelines
Collaborate with data engineers’ data scientists and stakeholders to translate business requirements into technical solutions
Conduct code reviews and provide mentorship to junior team members on best practices and coding standards
Participate in architectural discussions and contribute to the evolution of big data platforms
Monitor and maintain the health availability and reliability of Spark clusters and data services Karat Interview mandate
Skills Mandatory Skills: Python, Scala, Spark SQL
Benefits and Perks
Comprehensive Medical Plan Covering Medical, Dental, Vision
Short Term and Long-Term Disability Coverage
401(k) Plan with Company match
Life Insurance
Paid Paternity and Maternity Leave
The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.
Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.
LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.
#J-18808-Ljbffr
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.