Senior Data Engineer
Flywheel Digital
- New York, New York, United States
- New York, New York, United States
About
Omni Platform Group (OPG) is currently seeking a senior data engineer to join our technology team. In this role you will build Omni products which sit atop cloud‑based data infrastructure. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will work on one or more software and data products in the Omni Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions.
This position is based out of our Jersey City Office.
What you'll do:
Steward data and compute environments to facilitate usage of data assets.
Design, build, test and deploy scalable and reusable systems that handle large amounts of data.
Lead and mentor a small team of developers.
Perform code reviews and provide leadership and guidance to junior developers.
Learn and teach new technologies to the team.
Who you are:
Experience designing and managing data flows.
Experience designing systems and APIs to integrate data into applications.
8+ years of Linux, Bash, Python, and SQL experience.
4+ years using Spark and other Hadoop ecosystem software.
4+ years using AWS cloud services, esp. EMR, Glue, Athena, and Redshift.
Passion for Technology: Excitement for new technology, bleeding edge applications, and a positive attitude towards solving real world challenges.
Additional Skills:
BS, MS or PhD in Computer Science, Engineering, or equivalent real‑world experience (You've learned something to be able to claim you are an engineer).
Significant experience with Python, C++, or other popular language.
Experience with big data and/or infrastructure. Bonus for having experience in setting up Petabytes of data so they can be easily accessed. Understanding of data organization, i.e., partitioning, clustering, file sizes, file formats. Data cataloging with Hive/Hive metastore or Glue or similar.
Experience working with relational databases.
Experience with Hadoop, Hive, Spark, or other data processing tools.
Experience in any of the modern data stack technologies like
dbt ,
airbyte
is desired.
Significant experience working with AWS and/or GCP.
Proven ability to independently execute projects from concept to implementation to launch and to maintain a live product.
Flywheel Commerce Network is committed to fair and equitable compensation practices. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to skill set, depth of experience, certifications, and specific work location.
Salary Range $120,000 - $140,000 USD
Working at Flywheel We are proud to offer all Flywheelers a competitive rewards package and unparalleled career growth opportunities and a supportive, fun and engaging culture.
We have office hubs across the globe where team members can go to feel productive, inspired, and connected to others - team members go into Hub Offices 3x a week.
Competitive paid time off, including annual leave plus paid public holidays.
Great learning and development opportunities.
Benefits that help you live your best life.
Parental leave and benefits.
Volunteering opportunities.
For inclusion and identity, there are ERGs available.
The hired candidate will be required to complete a background check.
Flywheel Commerce Network is an Equal Opportunity Employer and participates in E-Verify. All applicants will receive fair consideration for employment. We do not discriminate based upon race, color, religion, sex, sexual orientation, age, marital status, gender identity, national origin, disability, or any other legally protected characteristics in the location in which the candidate is applying.
#J-18808-Ljbffr
Languages
- English
Notice for Users
This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.