Senior Data Engineer - Tech Lead
- +2
- +12
- Massachusetts, United States
- +2
- +12
- Massachusetts, United States
Über
Job Summary:
We seek an experienced and innovative, hands on Senior Data Engineer to design, optimize, and implement a cutting-edge data architecture in collaboration with our Business and Client teams. As a technical leader, you will leverage your expertise in developing, enhancing, and managing large-scale data systems to drive strategic initiatives and elevate the capabilities of our data platforms.
Your primary responsibility will be to create an enterprise-wide data strategy and architecture that streamlines the entire data lifecycle - from ingestion to retrieval - ensuring seamless integration, scalability, and high-quality data throughout. You will maintain rigorous standards for security, governance, and data quality to ensure trustworthiness and compliance.
As a key member of our team, you will partner with cross-functional groups to transform our existing data infrastructure into a modern, cloud-native solution that fuels business insights and drives value. Your focus will include migrating core business processes across diverse systems and locations to a unified data layer, enabling technical teams to publish data and end-users to access it seamlessly.
To achieve these goals, you will be asked to develop tooling and services that connect data sources to consumers, guaranteeing accessible, reliable, and trustworthy data delivery that meets business needs. If you're passionate about crafting robust data architectures and driving innovation through technology, we encourage you to apply for this exciting opportunity.
Responsibilities:
Design, develop, and maintain data systems, analytics, and reporting applications
Engage with our multiple business teams to understand their needs and requirements and develop cohesive strategies to address them in a cost-effective and efficient manner
Assess current environment and make recommendation specific to data and reporting technologies
Collaborate with development teams to ensure the functionality being developed is implemented in a platform-centric manner, while setting data for publishing new data sources
Build reporting capabilities that allow for self-service analysis based on a multiple "what if" scenarios leveraging AI technologies
Optimize existing data systems and analytics applications
Analyze data to identify trends and develop insights
Prioritize appropriately so our existing data estate continues to work flawlessly as the target architecture is developed
Implement processes to ensure the quality and availability of data and build functionality to improve the overall robustness of our data platform
Develop accurate metrics to identify performance improvement opportunities
Design verification plans and implement unit tests to validate the correctness and performance of the solutions
Design a reliable production support process and, when required, assist in supporting and troubleshooting production issues
Qualifications:
At least 5 years of experience working with modern, large-scale data systems in a technical leadership role
Possess extensive expertise in working with diverse data storage technologies, including databases, data warehouses data lakes and data lakehouses
Demonstrated expertise in SQL, Spark, Pandas, or similar technologies
At least 3 years building complex or scalable systems using Python or other object-oriented languages (e.g., C++, Rust, Java, C#)
Extensive experience designing schemas, optimizing queries, and manipulating/aggregating data, particularly with point-in-time semantics
Excellent software architecture design skills
Exceptional communication skills and the ability to build strong relationships as well as credibility
Thorough knowledge of with CI/CD (Jenkins, Gitlab, Github) and testing (e.g., pytest) methodologies
At least 3 years of experience using AWS services oriented towards data and compute functions
Bachelor's degree in Computer Science, Computer Engineering or a related discipline
Experience with containerized deployments and elastic environments
Arrowstreet Capital is a Boston-based systematic investment firm that manages global equity portfolios for institutional investors around the world.
Arrowstreet Capital is an equal opportunity employment firm that values diversity and inclusion. All qualified applicants will receive consideration for employment without regard to sex, race, color, religion, national origin, ancestry, gender identity, genetic information, age, sexual orientation, pregnancy, medical condition, disability, veteran or military status, marital status or any other characteristic protected by federal, state, or local law. For more information, please refer to the Know Your Rights poster, as well as the following Pay Transparency statement.
Arrowstreet Capital is committed to working with and providing reasonable accommodations for qualified individuals with disabilities and disabled veterans. If you need a reasonable accommodation for any part of the employment process due to a disability, contact us to discuss the nature of your request and contact information.
Wünschenswerte Fähigkeiten
- SQL
- Spark
- Pandas
- Python
- C++
- Rust
- Java
- C#
- Jenkins
- Gitlab
- Github
- AWS
Berufserfahrung
- Data Engineer
- Data Infrastructure
Sprachkenntnisse
- English