Senior Data Engineer
New York City | Technology, Data & Innovation
- United States
- United States
Über
The New York City Employees' Retirement System (NYCERS) is seeking an experienced Senior Data Engineer to join our IT Data Management unit in the Information Technology division. The Senior Data Engineer will design, develop, and maintain enterprise systems and data architectures supporting NYCERS pension administration system as part of ongoing Legacy Modernization and Replacement initiative. The Data Engineer will operationalize business rules, metadata, and data quality requirements into scalable ETL applications using IBM DataStage, orchestrated via Control-M, and supported by advanced SQL engineering. The Senior Data Engineer will also assist in database design of NYCERS mission critical applications and inventory of its components. In this capacity, Data Engineer will: Design and implement end-to-end ETL pipelines using IBM DataStage for legacy and modern data sources. Develop and maintain source-to-target mappings (STTM) and translate them into DataStage jobs and SQL transformations. Write and optimize advanced SQL queries, stored procedures, and data validation frameworks. Build and maintain Control-M workflows for batch processing, dependency management, and SLA compliance. Perform data profiling, metadata analysis, and field-level mapping to support data migration and integration. Create and maintain enterprise data dictionary, including business definitions, valid values, and lineage. Participate in data inventory, classification, and governance initiatives for NYCERS critical data assets. Collaborate with SMEs and technical teams to identify and remediate data quality gaps and inconsistencies. Support NYCERS Reporting platform, FOILs and Office of Actuary valuations requirements. Troubleshoot and resolve data defects, ETL failures, and performance issues. Key deliverables: Participate in identification, inventory, and classification of NYCERS critical data. Perform data analysis and document data quality rules and definitions. Actively participate in development, optimization and performance tuning of ETL and SQL processes. Extract business rules from the existing Legacy code and create Source-to-Target mappings. Transform business rules and data quality rules into ETL and/or SQL solutions. Develop complex SQL data validations based on STTMs and target Data Models. Support NYCERS Data Warehouse development and implementation. Defect handling and problem resolution. Mandatory Skills and Experience: Minimum 5+ years of source-to-target data mapping in mixed mainframe and distributed environments. Proven experience in VSAM data conversion to relational/dimensional SQL databases. Minimum 3+ years of hands-on IBM DataStage ETL development. Experience extracting field references and calculated data from COBOL programs. Experience with BMC Control-M workload automation. Experience with GIT version control systems. Experience creating and maintaining data dictionaries and metadata repositories. Strong analytical skills for data profiling, mapping, and transformation logic design. Ability to develop advanced complex SQL data validations based on STTMs and target Data Models. Deep understanding of data structures and their relationship to ETL applications. Excellent analytical and problem solving skills along with fundamental technique troubleshooting abilities. Ability to work in multiple environments: IBM Mainframe, Windows Server, and SQL Server. ETL architecture and data lifecycle management in mixed environments (IBM Mainframe, Windows Server, SQL Server). Public Service Loan Forgiveness As a prospective employee of the City of New York, you may be eligible for federal loan forgiveness programs and state repayment assistance programs. For more information, please visit the U.S. Department of Education's website at https://studentaid.gov/pslf/. Residency Requirement New York City Residency is not required for this position Additional Information The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.