Senior Data Engineer (1043) - DataSFCity and County of San Francisco • United States
Dieses Stellenangebot ist nicht mehr verfügbar
Senior Data Engineer (1043) - DataSF
City and County of San Francisco
- United States
- United States
Über
Salary range: $153,686/year - $193,388/year. Application process is via SmartRecruiters.
Essential duties
Platform Administration : Manage the central Snowflake data warehouse, including access control, security policies, resource monitoring, performance tuning, and cost optimization. Administer the platform with a focus on data democratization and accessibility while protecting privacy and security.
Pipeline Development : Build and maintain scalable and resilient pipelines to ingest and structure data from diverse sources. Design infrastructure to support both streaming and batch processes, and both structured and unstructured data sources.
Infrastructure as Code (IaC) : Use Terraform to define, deploy, and manage data infrastructure, ensuring pipelines are reproducible, version-controlled, and production-ready.
Best Practices & Innovation : Champion and implement best practices for documentation, data modeling, warehouse architecture, SQL optimization, and testing. Provide guidance to department partners on data engineering best practices.
Collaboration : Work closely with data scientists, analysts, product managers, software engineers, and nontechnical stakeholders to understand data requirements and build solutions that meet their needs.
Monitoring & Support : Proactively monitor the health of the data platform and pipelines, troubleshoot issues, and ensure high standards of data quality and availability.
Desirable Qualifications
Technical Knowledge
Hands-on experience administering and developing on managed cloud data platforms such as Snowflake, BigQuery, or Databricks.
Advanced SQL development and data transformation/modeling using tools like dbt.
Strong Python programming (e.g., pandas, PySpark) for data processing and automation.
Proficiency with Infrastructure as Code, preferably Terraform.
Experience building data pipelines with orchestration tools (e.g., Azure Data Factory, Airflow, Dagster).
Deep understanding of data warehousing, data modeling, and ELT principles.
Knowledge of data governance, security, and privacy.
Experience with real-time streaming technologies (e.g., Kafka, Kinesis, Snowpipe).
Experience deploying pipelines for machine learning models.
Collaboration & Communication
Strong problem-solving skills and ability to design practical data solutions.
Excellent verbal and written communication, including explaining technical concepts to non-technical stakeholders.
A collaborative mindset and enthusiasm to work across diverse, cross-functional teams.
Mission Alignment
Commitment to equity, transparency, and ethical data use.
Passion for public service and using data to improve government services.
Empathy for San Francisco’s diverse communities and a drive to make data and services more accessible for residents.
Interest or experience in public sector data or social impact work.
How to qualify Education : An associate degree in computer science, computer engineering, information systems, or a closely related field from an accredited college or university, or equivalent total course credits/units (e.g., at least 60 semester or 90 quarter credits with specified amounts in the field).
Experience : Three (3) years of experience analyzing, installing, configuring, enhancing, and/or maintaining components of an enterprise network.
Substitution : Additional experience may be substituted for the required degree on a year-for-year basis (up to two years). One year equals 30 semester units / 45 quarter units in the specified field. Completion of related programs may substitute for the degree.
Completion of related programs may be substituted for the required degree.
Verification:
Applicants must clearly indicate how they meet the minimum qualifications in their application. Verification of education and/or experience may be required during recruitment and selection. For details, see the verification information guidance.
Note:
Falsifying education, training, or work experience or attempting deception may disqualify an applicant from this and future City opportunities.
Applicants must meet the minimum qualification requirement by the final application deadline unless otherwise noted.
What else should I know? Selection Procedures : The process includes evaluation of applications against minimum requirements and assessment of job-related knowledge, skills and abilities. Depending on applicants, additional screening may include an oral interview or a written/performance exercise. Only those whose qualifications most closely meet the Department needs may be invited to continue. Meeting minimum requirements does not guarantee advancement.
For reference, see the position counts document at the SF HR site.
Additional Information Regarding Employment Applications for City and County of San Francisco jobs are accepted online at the official careers site. Eligible candidates should apply as soon as possible; the posting may close at any time but not before Friday, January 9, 2026 (11:59 PM, PST).
Selected candidates may be contacted by email; ensure your contact information is up-to-date and that CCSF emails are not blocked by spam filters.
All information will be kept confidential according to EEO guidelines.
HR Analyst Information:
For recruitment questions, contact Debbie Yung at Debbie.Yung@SFGov.org
Condition of Employment:
The City and County of San Francisco encourages applicants from women, minorities, and persons with disabilities. Applicants will be considered regardless of sex, race, age, religion, color, national origin, disability, sexual orientation, gender identity, or other protected status as defined by law.
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.