Data EngineerDepartment of City Planning • New York, New York, United States
Cette offre d'emploi n'est plus disponible
Data Engineer
Department of City Planning
- New York, New York, United States
- New York, New York, United States
À propos
Designing, deploying, and scaling of current infrastructure to ensure that Data Engineering maintains and improves existing processes, and expands its abilities and offerings.
Understanding the technologies used by the team and recommending new technologies. Ideating, designing, and implementing improvements to products and processes to ensure that the team is using the best tools for the job.
Building Data Engineering data products, which involves:
operating data ingestion pipelines and managing data storage,
running scripts that transform input data by standardizing, geocoding, merging, aggregating, and performing basic spatial manipulations, and
reviewing outputs by writing custom scripts and/or using established QAQC tools to identify errors, inconsistencies, and edge cases in datasets.
Designing new data products from concept to completion, working on specifications with product owners, creating technical designs with team members, helping to plan sprints, contributing to documentation, and delivering a finished product.
Collaborating with other data engineers in sprint planning, design, code review, and pair programming.
Learning and wrangling complex legacy data systems and bringing the infrastructure into a modern development stack.
Sharing your accomplishments and lessons learned with NYC Planning, other city agencies, and the world via talks, presentations, blogs, or other mediums.
Minimum Qualifications
A baccalaureate degree in computer science, engineering or a related field from an accredited college and four years of satisfactory full‑time experience related to IT automation engineering, monitoring engineering, management of infrastructure.
Eight years of satisfactory full‑time experience related to IT automation engineering, monitoring engineering, management of infrastructure.
Education and/or experience which is equivalent to ‘1’ or ‘2’ above.
Preferred Skills
Four or more years of experience in data engineering, analytics, or related technical field.
Two or more years of experience in data engineering, analytics, or related technical field.
Experience with SQL (PostgreSQL/DuckDB/MySQL/SQL-Server).
Experience with Python or similar scripting language.
Working knowledge of:
Data Warehousing/Data Lakes
ETL/ELT frameworks (dbt or other)
Working in cloud environments (AWS/GCP/Azure) and infrastructure as code principles
Containerization technologies
CI/CD-Git or other version control systems and collaborative development practices
Working knowledge of spatial data tools like PostGIS, GeoPandas, etc.
Understanding of data governance and metadata management principles.
Strong analytical and problem‑solving mindset with attention to detail.
Strong communication skills and ability to work in a collaborative development environment.
Nice to have: Experience with orchestration tools (Airflow/Prefect/Dagster).
Nice to have: Experience with big data platforms/technologies (BigQuery/Snowflake/Redshift/Apache Spark).
Public Service Loan Forgiveness As a prospective employee of the City of New York, you may be eligible for federal loan forgiveness programs and state repayment assistance programs. For more information, please visit the U.S. Department of Education’s website at https://studentaid.gov/pslf/.
Residency Requirement New York City Residency is not required for this position.
Additional Information The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.
#J-18808-Ljbffr
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.