Senior Data Engineer
Windfall Data Inc
- San Francisco, California, United States
- San Francisco, California, United States
Über
We’re on a mission to change how organizations perceive and use people data. And we hold true to our core values of: (1) Be an excellent communicator; (2) Operate with transparency; (3) Provide leverage, not optimization; (4) Win When Our Customers Win; and (5) Act with integrity and trust.
Responsibilities
Construct data pipelines to ingest and merge billions of individual entities into Windfall’s core data asset
Work closely with our data science team to run ML models on top of billions of data points
Build supporting data services and applications to orchestrate and monitor our data systems
Technology you will use
Cloud platform - GCP
Programming languages - Java, Python, and Kotlin
Data warehouse & databases - BigQuery, Postgres, Scylla/Cassandra
Distributed processing frameworks - Dataflow (Apache Beam) and Apache Spark
Orchestration - Airflow
Requirements
4-8 years of professional data engineering experience
Significant experience working with Apache Beam/Spark/Flink or MapReduce
Strong Object-oriented programming ability in a JVM language
Expert knowledge of distributed data processingFamiliarity with different datastores, their differences, and appropriate usages
Experience at a sub-200 person company
You communicate as well as you code
You can simplify complex problems into simple solutions
You balance a strong sense of ownership and responsibility in your work with collaboration and team alignment
You are comfortable making trade-offs between quality, complexity, and speed-of-delivery
Preferred Qualifications
Proven experience taking a large project from ideation to production
Experience leading greenfield projects
Working knowledge of cloud-native data engineering infrastructure
Additional Information The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across California and Colorado. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. We also offer a comprehensive benefits package, which you can explore on our careers site.
Compensation range: $170,000 - $220,000 a year
Windfall is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
We may use AI tools to assist parts of the hiring process, such as reviewing applications or analyzing resumes. These tools assist our team and do not replace human judgment. Final hiring decisions are made by people.
We comply with CCPA. For more information on how we comply, review our privacy notice.
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.