FastTek Global
Overview
Location: Dearborn, Michigan Data Engineer #1037316 Job Description
Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately Key Responsibilities
Collaborate with business and technology stakeholders to understand current and future data requirements Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks Ensure optimum performance and identify improvement opportunities Skills Required
Google Cloud Platform ETL Apache Spark Data Architecture Python SQL KAFKA Skills Preferred
Java Powershell Data Acquisition Data Analysis Data Collection Data Conversion Data Integrity Data/Analytics dashboards Experience
Experience Required: Engineer 2 Exp: 4+ years Data Engineering work experience Experience Preferred
Data Pipeline Architecture & Development: Design, build, and maintain highly scalable, fault-tolerant, and performant data pipelines to ingest and process data from 10+ siloed sources, including both structured and unstructured formats. ML-Driven ETL Implementation: Operationalize ETL pipelines for intelligent data ingestion, automated cataloging, and sophisticated normalization of diverse datasets. Unified Data Model Creation: Architect and implement a unified data model capable of connecting all relevant data elements across various sources, optimized for efficient querying and insight generation by AI agents and chatbot interfaces. Big Data Processing: Utilize advanced distributed processing frameworks (Apache Beam, Apache Spark, Google Cloud Dataflow) to handle large-scale data transformations and data flow. Cloud-Native Data Infrastructure: Leverage GCP services to build and manage robust data storage, processing, and orchestration layers. Data Quality, Governance & Security: Implement rigorous data quality gates, validation rules, bad record handling, and comprehensive logging. Ensure strict adherence to data security policies, IAM role management, and GCP perimeter security. Automation & Orchestration: Develop shell scripts, Cloud Build YAMLs, and utilize Cloud Scheduler/PubSub for E2E automation of data pipelines and infrastructure provisioning. Collaboration with AI/ML Teams: Work closely with AI/ML engineers, data scientists, and product managers to understand data reqts, integrate data solutions with multi-agentic systems, and optimize data delivery for chatbot functionalities. Testing & CI/CD: Implement robust testing strategies, maintain high code quality through active participation in Git/GitHub, perform code reviews, and manage CI/CD pipelines via Cloud Build. Tuning & Optimization: Continuously monitor, optimize, and troubleshoot data pipelines and BQ performance using techniques like table partitioning, clustering, and sharding. Education
Education Required: Bachelor\'s Degree Education Preferred: Certification Program Additional Info
At FastTek Global, Our Purpose is Our People and Our Planet. We come to work each day and are reminded we are helping people find their success stories. Doing the right thing is our mantra. We act responsibly, give back to the communities we serve and have a little fun along the way. FastTek Global is financially strong, privately held, 100% consultant and client focused. We differentiate ourselves by being fast, flexible, creative and honest. Our benefits include Medical and Dental, Vision, PTO, Long Term Disability, Life Insurance, and 401(k) with immediate vesting and 3% match. We also offer an employee referral program and an employee recognition culture. We have been named one of the Top Work Places in Michigan by the Detroit Free Press in 2013–2019 and 2020–2023. For more open positions, visit: https://www.fasttek.com/fastswitch/findwork AI & Hiring Disclosure: We use AI tools to support parts of our hiring process under human oversight. Personal data collected is used for recruitment purposes, with rights to access or request deletion. If AI is used in a video interview, you will be informed in advance and asked for consent. Our tools are regularly reviewed to detect bias and ensure compliance. Contact info@fasttek.com for rights inquiries.
#J-18808-Ljbffr
Location: Dearborn, Michigan Data Engineer #1037316 Job Description
Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately Key Responsibilities
Collaborate with business and technology stakeholders to understand current and future data requirements Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks Ensure optimum performance and identify improvement opportunities Skills Required
Google Cloud Platform ETL Apache Spark Data Architecture Python SQL KAFKA Skills Preferred
Java Powershell Data Acquisition Data Analysis Data Collection Data Conversion Data Integrity Data/Analytics dashboards Experience
Experience Required: Engineer 2 Exp: 4+ years Data Engineering work experience Experience Preferred
Data Pipeline Architecture & Development: Design, build, and maintain highly scalable, fault-tolerant, and performant data pipelines to ingest and process data from 10+ siloed sources, including both structured and unstructured formats. ML-Driven ETL Implementation: Operationalize ETL pipelines for intelligent data ingestion, automated cataloging, and sophisticated normalization of diverse datasets. Unified Data Model Creation: Architect and implement a unified data model capable of connecting all relevant data elements across various sources, optimized for efficient querying and insight generation by AI agents and chatbot interfaces. Big Data Processing: Utilize advanced distributed processing frameworks (Apache Beam, Apache Spark, Google Cloud Dataflow) to handle large-scale data transformations and data flow. Cloud-Native Data Infrastructure: Leverage GCP services to build and manage robust data storage, processing, and orchestration layers. Data Quality, Governance & Security: Implement rigorous data quality gates, validation rules, bad record handling, and comprehensive logging. Ensure strict adherence to data security policies, IAM role management, and GCP perimeter security. Automation & Orchestration: Develop shell scripts, Cloud Build YAMLs, and utilize Cloud Scheduler/PubSub for E2E automation of data pipelines and infrastructure provisioning. Collaboration with AI/ML Teams: Work closely with AI/ML engineers, data scientists, and product managers to understand data reqts, integrate data solutions with multi-agentic systems, and optimize data delivery for chatbot functionalities. Testing & CI/CD: Implement robust testing strategies, maintain high code quality through active participation in Git/GitHub, perform code reviews, and manage CI/CD pipelines via Cloud Build. Tuning & Optimization: Continuously monitor, optimize, and troubleshoot data pipelines and BQ performance using techniques like table partitioning, clustering, and sharding. Education
Education Required: Bachelor\'s Degree Education Preferred: Certification Program Additional Info
At FastTek Global, Our Purpose is Our People and Our Planet. We come to work each day and are reminded we are helping people find their success stories. Doing the right thing is our mantra. We act responsibly, give back to the communities we serve and have a little fun along the way. FastTek Global is financially strong, privately held, 100% consultant and client focused. We differentiate ourselves by being fast, flexible, creative and honest. Our benefits include Medical and Dental, Vision, PTO, Long Term Disability, Life Insurance, and 401(k) with immediate vesting and 3% match. We also offer an employee referral program and an employee recognition culture. We have been named one of the Top Work Places in Michigan by the Detroit Free Press in 2013–2019 and 2020–2023. For more open positions, visit: https://www.fasttek.com/fastswitch/findwork AI & Hiring Disclosure: We use AI tools to support parts of our hiring process under human oversight. Personal data collected is used for recruitment purposes, with rights to access or request deletion. If AI is used in a video interview, you will be informed in advance and asked for consent. Our tools are regularly reviewed to detect bias and ensure compliance. Contact info@fasttek.com for rights inquiries.
#J-18808-Ljbffr