- +2
- +10
- Michigan, United States
About
Below are the details for the direct hire role I mentioned earlier. The max salary is 130k. This is remote but candidates are required to fly out to Troy, MI for meetings a couple times a month at their expense if not able to relocate to Troy, MI.
Data Engineer
End Client: Motor Information Systems
Sponsorship offered
MOTOR Information Systems, an owned subsidiary of Hearst, is actively seeking a Data Engineer who possesses a strong passion for designing, optimizing, refactoring, and upgrading complex data solutions. MOTOR's Insights team is a new team with an exponential growth opportunity - both in terms of technology and personnel, and we are looking for someone to share our mission that will transform our company's future. With this position, you will have a rare opportunity to use your talents, passions, and expertise to help drive this massive change in how we build, organize, and optimize our backend systems and processes across all MOTOR Insights product line. This position offers excellent career growth and promotional opportunities, stellar compensation, and an opportunity to work with the world's premier provider of aftermarket automotive data. Hearst and MOTOR Information Systems could very well be your best and last position in a rewarding and fulfilling career!
Required Experience (must have)
Minimum 5+ years' data engineering experience working with designing data models in both column store and relational databases, incorporating disparate data to solve complex business needs.
Minimum Bachelor's degree or Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
Experience building and optimizing data pipelines, architectures, database modeling and data sets that meet business requirements.
Experience in building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources in 'big data' technologies or similar. Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
Experience in building processes supporting data transformation, analytics tools, data structures, metadata, dependency, and workload management. Assist Data Science team that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and optimizing our product into an innovative industry leader.
Experience in using Azure DevOps, or Jira project management/requirements management.
Experience with big data tools: Hadoop, Spark, Kafka, or a related technology.
Proficient in programming languages such as SQL, Python, R, Shell Scripting
Experience with NoSQL databases, including Postgres and Cassandra is a plus - (Nice to have)
Strong working experience with technologies like AWS/Databricks and (minimum 3+ years' experience) working with big data, including expertise designing data models in both column store and relational databases, incorporating disparate data to solve complex business needs - (Nice to have)
AWS lambda functions (Python preferred)
AWS databases (Aurora, DynamoDB, or Redshift preferred)
AWS storage services (EC2, S3 preferred)
Data Lake experience or similar (AWS preferred)
Primary Responsibilities
Developing and implementing an overall organizational data strategy that is in line with business processes. The strategy includes data model designs, database development, implementation and management of data warehouses and data analytics systems.
Identifying data sources, both internal and external and work out a plan for data management that is aligned with organizational data strategy.
Coordinating and collaborating with cross-functional teams, stakeholders, and vendors for the smooth functioning of the enterprise data system.
Managing end-to-end data architecture, from selecting the platform, designing the technical architecture, and developing the application to finally testing and implementing the proposed solution.
Identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition.
Being MOTOR Driven is Being Diversity Driven
We are MOTOR driven. At MOTOR, we are driven by diversity and creating an inclusive and welcoming workplace that celebrates our differences. Being MOTOR driven is celebrating your uniqueness. #MOTORDriven
Nice-to-have skills
- SQL
- Python
- R
- Shell Scripting
- JIRA
- Hadoop
- Spark
- Kafka
- AWS
- AWS Lambda
Work experience
- Data Engineer
- Data Infrastructure
Languages
- English