City and County of San Francisco
Senior Data Engineer (1043) - DataSF
City and County of San Francisco, San Francisco, California, United States, 94199
Senior Data Engineer (1043) - DataSF
City and County of San Francisco – City Administrator’s Office – DataSF Team
About DataSF DataSF is transforming how San Francisco works with data. We build robust, scalable data infrastructure to power data‑driven city services, increase transparency, and improve government performance.
Role Overview Senior Data Engineer with 3+ years of experience building scalable data pipelines, managing Snowflake, and implementing IaC. Reporting to the Principal Data Engineer.
Responsibilities
Administer and secure the central Snowflake warehouse, including access control, performance tuning, and cost optimization.
Design, build, and maintain scalable, resilient data pipelines for both batch and streaming ingestion.
Define, deploy, and manage data infrastructure using Terraform and other IaC tools.
Champion best practices for data modeling, warehouse architecture, SQL optimization, and testing.
Collaborate with data scientists, analysts, product managers, and software engineers across domains.
Proactively monitor platform health, troubleshoot issues, and ensure high data quality and availability.
Qualifications
Hands‑on experience with managed cloud data platforms such as Snowflake, BigQuery, or Databricks.
Advanced, performant SQL writing and proficiency with dbt for data transformation.
Strong programming skills in Python, pandas, or PySpark.
Experience with Terraform and orchestration tools such as Airflow or Dagster.
Deep understanding of data warehousing concepts and modern ELT principles.
Excellent communication skills, both technical and non‑technical.
Commitment to equity, transparency, and ethical data use.
Education & Experience
Associate degree in computer science, information systems, or related field OR equivalent coursework.
Three (3) years of relevant networking or data engineering experience.
Equal Employment Opportunity City and County of San Francisco encourages women, minorities and persons with disabilities to apply. Applicants will be considered regardless of protected category under the law.
How to Apply
Complete the online application at https://careers.sf.gov.
Include a cover letter.
Submit the Supplemental Questionnaire by January 9, 2026 at 11:59pm PST.
#J-18808-Ljbffr
About DataSF DataSF is transforming how San Francisco works with data. We build robust, scalable data infrastructure to power data‑driven city services, increase transparency, and improve government performance.
Role Overview Senior Data Engineer with 3+ years of experience building scalable data pipelines, managing Snowflake, and implementing IaC. Reporting to the Principal Data Engineer.
Responsibilities
Administer and secure the central Snowflake warehouse, including access control, performance tuning, and cost optimization.
Design, build, and maintain scalable, resilient data pipelines for both batch and streaming ingestion.
Define, deploy, and manage data infrastructure using Terraform and other IaC tools.
Champion best practices for data modeling, warehouse architecture, SQL optimization, and testing.
Collaborate with data scientists, analysts, product managers, and software engineers across domains.
Proactively monitor platform health, troubleshoot issues, and ensure high data quality and availability.
Qualifications
Hands‑on experience with managed cloud data platforms such as Snowflake, BigQuery, or Databricks.
Advanced, performant SQL writing and proficiency with dbt for data transformation.
Strong programming skills in Python, pandas, or PySpark.
Experience with Terraform and orchestration tools such as Airflow or Dagster.
Deep understanding of data warehousing concepts and modern ELT principles.
Excellent communication skills, both technical and non‑technical.
Commitment to equity, transparency, and ethical data use.
Education & Experience
Associate degree in computer science, information systems, or related field OR equivalent coursework.
Three (3) years of relevant networking or data engineering experience.
Equal Employment Opportunity City and County of San Francisco encourages women, minorities and persons with disabilities to apply. Applicants will be considered regardless of protected category under the law.
How to Apply
Complete the online application at https://careers.sf.gov.
Include a cover letter.
Submit the Supplemental Questionnaire by January 9, 2026 at 11:59pm PST.
#J-18808-Ljbffr