Senior Data Engineer: Scalable Pipelines & AnalyticsAmerica First Credit Union • Riverdale, Georgia, United States
This job offer is no longer available
Senior Data Engineer: Scalable Pipelines & Analytics
America First Credit Union
- Riverdale, Georgia, United States
- Riverdale, Georgia, United States
About
Collaborates with data science teams, software developers, business analysts, and data engineers to extract transactional, historical, analytical, behavioral, and predictive data sets by building data pipelines from ever‑increasing data resources. Understands progressive statistical, programmatic, and analytical approaches to business hypotheses as they apply to available data, and aids business owners and the data science team in the interpretation of source data and the associated business data pipelines. Requires a solid understanding of both the technical and business aspects of Data Science and business analytics, as well as full software‑development life‑cycle experience within various analytical architectures, including piloting models and processes, architecting underlying data design, and model/process operationalization.
Will be required to explore internal and external data sources to identify useful structures within the data that were or are previously unknown to the business. Should have a strong understanding of relational and dimensional modeling to facilitate data wrangling, model operationalization, and exploration of data. Responsible for adhering to corporate data‑governance policies and controls to ensure the accuracy, timeliness, and confidentiality of resources under management. Must be able to work with users at all levels of management in developing and implementing operational and strategic analytics. The Data Engineer’s primary focus will be on operationalization of data pipelines to facilitate use of novel and optimized data‑set products by a variety of end users using a variety of data‑transformation tools.
Responsibilities
Manage installation, patching, upgrading, and administration of software systems that support data pipelines. This includes ETL platforms (Airflow, SSIS), data‑quality platforms (Great Expectations), distributed data‑processing systems (Hopsworks, Polar), and streaming platforms (Kafka, RabbitMQ).
Develop data pipelines to support the operational implementation of Data Science and analytical models.
Ensure all security, documentation, governance, and compliance standards are met.
Oversee the development of a small reporting layer on top of analytical models to ensure accountability and insight into models’ performance and impact.
Perform DevOps and orchestration around supporting data marts and analytical processes.
Mentor Data Engineer I, II, III levels to train them on best practices and optimal technology usage.
Work with management regarding forecasting, planning, and implementation of used and future technologies leveraged to support data engineering processes.
Related Duties
Engineer each solution with appropriate kinds of technology, with optimized performance.
Execute analytics solution engineering strategy, requirements, and adapt processes as needed.
Monitor and secure usage of data while tracking platform product performance.
Advise and collaborate in internal partnerships to deliver accurate, available, and accessible API services.
Identify potential concerns based on projections of current trends.
Contribute to Credit Union culture by keeping a positive attitude and growing relationships.
Qualifications EDUCATION:
Bachelor of Science degree in information technology, computer science, statistics, or related business degree with equivalent experience of 10+ years.
Master of Science in information technology, computer science, statistics, or related degree with equivalent experience of 5+ years.
EXPERIENCE:
Minimum of 7 years experience in designing, developing, and implementing data solutions.
QUALIFICATIONS:
Must have advanced SQL abilities, experience with both Oracle and Microsoft desired.
Must have advanced programming experience with Python.
Must have experience with Linux.
Experience with a variety of ETL tools is desired: Airflow, SSIS, Informatica, dbt, etc.
Experience with Anaconda, Kafka, RabbitMQ, Jupyter Notebook, Tableau desired.
Experience developing business analytical solutions in large or midsize companies.
Must be able to manage multiple tasks simultaneously and react to problems quickly.
Understanding of the financial services industry desired.
Experience with dashboard design and delivery desired.
Must be able to translate concepts and directions into practical solutions.
Must have development experience with various data‑management technologies; NoSQL, relational database, message broker, multi-dimensional database, and database architecture.
Understand data collection, streaming, preparation, analysis, visualization, modeling, algorithm integration, evaluation, optimization within an implementation context.
#J-18808-Ljbffr
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.