Cette offre d'emploi n'est plus disponible
Big Data Engineer
Throtle Inc.
- Red Bank, New Jersey, United States
- Red Bank, New Jersey, United States
À propos
401(k)
401(k) matching
Company parties
Competitive salary
Dental insurance
Flexible schedule
Free food & snacks
Health insurance
Paid time off
Parental leave
Training & development
Vision insurance
Competitive compensation
Comprehensive benefits including Medical, Dental, and Vision
Life insurance
Long‑Term Disability
Generous PTO program
Hybrid schedule (Mondays and Fridays WFH)
Half‑day Summer Fridays (closes at 1 p.m. Memorial Day to Labor Day)
Early Fridays (office closes at 3 p.m.)
The office is closed between Christmas and New Year
Company‑sponsored lunch at least one time a month
Professional Development Policy
Job Summary Please consider joining our technology team at Throtle as a Big Data Developer. In this role, you will be part of the team responsible for transforming and maintaining several billion records that make Throtle’s data onboarding solution work. You’ll need to evaluate incoming data, perform specialized hygiene, and standardize it for consumption by multiple processes. You’ll work in a fast‑paced, high‑volume processing environment where quality and attention to detail are paramount.
Duties/Responsibilities
Design and implement data pipelines and transformations using big data technologies such as Spark, Hadoop, and related ecosystems.
Develop and maintain complex SQL queries for data extraction and reporting, and optimize query performance and scalability.
Design and develop software components that integrate with our identity graphs, client data, and keying processes.
Participate in capacity monitoring and planning.
Develop and maintain technical documentation.
Ensure data integrity and quality in the development process, including conducting data research and analysis to identify trends and patterns.
Work with cross‑functional teams to ensure software systems meet business requirements and are scalable for future growth, including developing predictive models and enhancing data quality.
Ensure compliance with all regulations and laws applicable to assigned roles and responsibilities, and implement and maintain policies and procedures governing the work of assigned roles, including ePHI security requirements.
Required Skills and Abilities
Experience with large‑scale data processing and analytics platforms, including Hadoop, Spark, or related ecosystems.
Knowledge of distributed computing concepts and experience with cloud‑based infrastructure.
Experience with fuzzy logic matching and tools.
Experience with AWS infrastructure.
Education and Experience
4+ years of experience working with Big Data technologies, including Spark and SQL databases.
Proficiency in programming languages such as Scala, Java, Python, Shell, or a combination thereof.
Expertise in data modeling, database design, and development.
Experience in building and maintaining data transformations (ETL) using SQL, Python, Scala, or Java.
Ability to analyze, troubleshoot, and performance‑tune queries.
Ability to identify problems and effectively communicate solutions to peers and management.
Strong analytical and problem‑solving skills to address complex software and data challenges.
Ability to work effectively with cross‑functional teams and communicate technical designs and solutions to non‑technical stakeholders.
Throtle is an equal‑opportunity employer that is committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws.
Flexible work from home options available.
#J-18808-Ljbffr
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.