City of Columbus
Data Engineer (Technology Solutions Analyst IV) (Vacancy)
City of Columbus, Frankfort, Kentucky, United States
Key Responsibilities
Data Integration & ETL Development: Design, build, and maintain ETL/ELT pipelines using tools like Talend, Informatica, ADF, SSIS, or similar.
SQL & Data Querying: Strong SQL skills for data validation, profiling, troubleshooting, and optimizing large datasets.
Database Systems: Experience with relational databases (SQL Server, PostgreSQL, Oracle), including schemas, normalization, indexing, and performance.
API & File-Based Integration: Knowledge of REST/SOAP APIs, JSON, XML, flat files, and batch transfers; able to integrate with external systems securely.
Data Mapping & Transformation Logic: Develop source-to-target mappings, define transformation rules, and implement business logic in pipelines.
Data Modeling: Familiarity with dimensional, relational, and operational models to support analytics and operations.
Data Quality & Validation: Implement validation rules, quality checks, error handling, auditing, and reconciliation in data pipelines.
Programming & Scripting: Proficiency in Python, Java, or Scala to write, optimize, and debug code for data processing and ETL workflows.
Automation & Scheduling: Use job scheduling and orchestration tools like Airflow, Control‑M, Cron, or platform‑native schedulers.
Cloud & Storage Concepts: Understanding of cloud storage, compute, and integration on Azure, AWS, or GCP (optional but valuable).
Version Control & SDLC: Familiarity with Git and structured development processes, including code reviews, deployments, and documentation.
Technical Requirement Gathering: Translate business requirements into technical specifications for data pipelines and integrations.
Testing & Troubleshooting: Validate ETL processes, analyze outputs, resolve issues, and support repeatable UAT procedures.
Documentation: Produce design documents, data flows, dictionaries, integration specs, and operational procedures.
Analytical Problem‑Solving: Analyze data flows and system behaviors to identify root causes and recommend fixes.
Performance Optimization: Optimize queries, transformations, pipeline logic, and system configurations for throughput and reliability.
Collaboration & Communication: Work with BAs, analysts, SMEs, application leads, and engineers to deliver accurate integrations.
Tooling & Productivity: Use Smartsheet, Jira, SharePoint, or similar tools for task tracking and documentation.
Under direction, responsible for researching, designing, developing, and improving enterprise data and/or application solutions; performs related duties as required.
Develop data and/or application solutions, which may include utilization of supportive software, data management platforms, database management systems, server applications, and/or web‑based development systems.
Confers with departmental or divisional personnel to analyze current operational procedures, document potential problems, and identify specific data input and output requirements for software system development.
Analyzes requirements of data and/or application solutions, such as licensing requirements, data requirements, peripheral equipment, maintenance support, server requirements, access on mobile devices, or other system interfaces and requirements to determine feasibility of system designs within time and budget constraints.
Reviews the outline of the new or revised business system process(es) and makes recommendations for improvements by defining the hardware and software requirements of the proposed system(s) or process(es); evaluates integration requirements for data and applications and supportive databases; develops solutions for integration and/or extraction of data for cross‑platform dependencies among application systems; prepares cost estimates and project timelines for implementation.
Consults with technical staff to evaluate business processes, needs, expectations, and functional requirements and translates into technical requirements; designs and proposes solutions to streamline or enhance business functions/processes.
Develops solutions for citywide data integration and management; creates synthesized data models, transformations and visualizations for deployment of analytics to meet the business or operational needs of the City.
Researches third‑party software systems for feasibility of design and compatibility and adaptability with existing architecture and business processes; reviews proposed hardware and software solutions and recommends selection to management for approval.
Formulates, designs, configures, and/or modifies software systems using scientific analysis to predict and measure outcome and consequences of design.
Develops and directs software system testing procedures, programming, and documentation.
Serves as senior consultant for database design, implementation, and administration, including security, backup, recovery, and maintenance; utilizes administrative rights within software applications to mass import updates to an application system.
Advises departmental or divisional personnel in their technology needs with regard to data corruption, security issues, computer viruses, and hardware and software redundancy.
Consults with staff members to evaluate interface between hardware and software and operational and performance requirements of software system; analyzes system growth and evaluates processing efficiency.
Plans and prepares technical reports, memoranda, and instructional manuals as documentation of system development.
Makes recommendations to management regarding the planning, development, and coordination of software system development projects.
Performs engineering cost/benefit analysis to verify potential effectiveness of new products; conducts technical research for building new designs, developing business cases, selling ideas to management, and gaining commitment for new system enhancements.
Mentors business systems analysts and senior programmer analysts in their work and individual projects as requested by management.
Participates in appropriate professional activities to stay abreast of existing and emerging technologies.
Qualifications
Possession of a bachelor's degree and four (4) years of experience in systems analysis, database management, applications development, or software design.
Valid possession of one (1) of the following certifications may be substituted for the required education: Microsoft Certified Solutions Developer (all tracks), Microsoft Certified Solutions Expert (Data Platform or Business Intelligence), or Geographic Information Systems Professional (GISP).
Additional experience may substitute for the educational requirement on a year‑for‑year basis.
Possession of a master's degree may be substituted for one (1) year of the required experience.
Recruitment Information Recruitment #: 25-0585-V7
Employment Type: Full‑Time (Regular)
Contact Information Kimberly Hetterscheidt
Department of Technology
Division of Information Services
1111 E. Broad St.
Columbus, Ohio 43205
P: (614) 645-0367
E: khetterscheidt@columbus.gov
The City of Columbus is an Equal Opportunity Employer
#J-18808-Ljbffr
Data Integration & ETL Development: Design, build, and maintain ETL/ELT pipelines using tools like Talend, Informatica, ADF, SSIS, or similar.
SQL & Data Querying: Strong SQL skills for data validation, profiling, troubleshooting, and optimizing large datasets.
Database Systems: Experience with relational databases (SQL Server, PostgreSQL, Oracle), including schemas, normalization, indexing, and performance.
API & File-Based Integration: Knowledge of REST/SOAP APIs, JSON, XML, flat files, and batch transfers; able to integrate with external systems securely.
Data Mapping & Transformation Logic: Develop source-to-target mappings, define transformation rules, and implement business logic in pipelines.
Data Modeling: Familiarity with dimensional, relational, and operational models to support analytics and operations.
Data Quality & Validation: Implement validation rules, quality checks, error handling, auditing, and reconciliation in data pipelines.
Programming & Scripting: Proficiency in Python, Java, or Scala to write, optimize, and debug code for data processing and ETL workflows.
Automation & Scheduling: Use job scheduling and orchestration tools like Airflow, Control‑M, Cron, or platform‑native schedulers.
Cloud & Storage Concepts: Understanding of cloud storage, compute, and integration on Azure, AWS, or GCP (optional but valuable).
Version Control & SDLC: Familiarity with Git and structured development processes, including code reviews, deployments, and documentation.
Technical Requirement Gathering: Translate business requirements into technical specifications for data pipelines and integrations.
Testing & Troubleshooting: Validate ETL processes, analyze outputs, resolve issues, and support repeatable UAT procedures.
Documentation: Produce design documents, data flows, dictionaries, integration specs, and operational procedures.
Analytical Problem‑Solving: Analyze data flows and system behaviors to identify root causes and recommend fixes.
Performance Optimization: Optimize queries, transformations, pipeline logic, and system configurations for throughput and reliability.
Collaboration & Communication: Work with BAs, analysts, SMEs, application leads, and engineers to deliver accurate integrations.
Tooling & Productivity: Use Smartsheet, Jira, SharePoint, or similar tools for task tracking and documentation.
Under direction, responsible for researching, designing, developing, and improving enterprise data and/or application solutions; performs related duties as required.
Develop data and/or application solutions, which may include utilization of supportive software, data management platforms, database management systems, server applications, and/or web‑based development systems.
Confers with departmental or divisional personnel to analyze current operational procedures, document potential problems, and identify specific data input and output requirements for software system development.
Analyzes requirements of data and/or application solutions, such as licensing requirements, data requirements, peripheral equipment, maintenance support, server requirements, access on mobile devices, or other system interfaces and requirements to determine feasibility of system designs within time and budget constraints.
Reviews the outline of the new or revised business system process(es) and makes recommendations for improvements by defining the hardware and software requirements of the proposed system(s) or process(es); evaluates integration requirements for data and applications and supportive databases; develops solutions for integration and/or extraction of data for cross‑platform dependencies among application systems; prepares cost estimates and project timelines for implementation.
Consults with technical staff to evaluate business processes, needs, expectations, and functional requirements and translates into technical requirements; designs and proposes solutions to streamline or enhance business functions/processes.
Develops solutions for citywide data integration and management; creates synthesized data models, transformations and visualizations for deployment of analytics to meet the business or operational needs of the City.
Researches third‑party software systems for feasibility of design and compatibility and adaptability with existing architecture and business processes; reviews proposed hardware and software solutions and recommends selection to management for approval.
Formulates, designs, configures, and/or modifies software systems using scientific analysis to predict and measure outcome and consequences of design.
Develops and directs software system testing procedures, programming, and documentation.
Serves as senior consultant for database design, implementation, and administration, including security, backup, recovery, and maintenance; utilizes administrative rights within software applications to mass import updates to an application system.
Advises departmental or divisional personnel in their technology needs with regard to data corruption, security issues, computer viruses, and hardware and software redundancy.
Consults with staff members to evaluate interface between hardware and software and operational and performance requirements of software system; analyzes system growth and evaluates processing efficiency.
Plans and prepares technical reports, memoranda, and instructional manuals as documentation of system development.
Makes recommendations to management regarding the planning, development, and coordination of software system development projects.
Performs engineering cost/benefit analysis to verify potential effectiveness of new products; conducts technical research for building new designs, developing business cases, selling ideas to management, and gaining commitment for new system enhancements.
Mentors business systems analysts and senior programmer analysts in their work and individual projects as requested by management.
Participates in appropriate professional activities to stay abreast of existing and emerging technologies.
Qualifications
Possession of a bachelor's degree and four (4) years of experience in systems analysis, database management, applications development, or software design.
Valid possession of one (1) of the following certifications may be substituted for the required education: Microsoft Certified Solutions Developer (all tracks), Microsoft Certified Solutions Expert (Data Platform or Business Intelligence), or Geographic Information Systems Professional (GISP).
Additional experience may substitute for the educational requirement on a year‑for‑year basis.
Possession of a master's degree may be substituted for one (1) year of the required experience.
Recruitment Information Recruitment #: 25-0585-V7
Employment Type: Full‑Time (Regular)
Contact Information Kimberly Hetterscheidt
Department of Technology
Division of Information Services
1111 E. Broad St.
Columbus, Ohio 43205
P: (614) 645-0367
E: khetterscheidt@columbus.gov
The City of Columbus is an Equal Opportunity Employer
#J-18808-Ljbffr