Stefanini Group
Join to apply for the GCP Data Engineer role at Stefanini Group
Stefanini Group is hiring!
Stefanini is looking for a Data Engineer, Dearborn, MI
For quick apply, please reach out Pawan Rawat at 248-213-3605 / pawansingh.rawat@stefanini.com
We are looking for the candidate who will be responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately
Responsibilities
Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis
Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow
Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data
Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks
Experience Required
Required 4+ years of Data Engineering work experience
Google Cloud Platform, ETL, Apache Spark, Data Architecture, Python, SQL, KAFKA
Data Pipeline Architecture & Development : Design, build, and maintain highly scalable, fault-tolerant, and performant data pipelines to ingest and process data from 10+ siloed sources, including both structured and unstructured formats.
ML-Driven ETL Implementation : Operationalize ETL pipelines for intelligent data ingestion, automated cataloging, and sophisticated normalization of diverse datasets.
Unified Data Model Creation : Architect and implement a unified data model capable of connecting all relevant data elements across various sources, optimized for efficient querying and insight generation by AI agents and chatbot interfaces.
Big Data Processing : Utilize advanced distributed processing frameworks (Apache Beam, Apache Spark, Google Cloud Dataflow) to handle large-scale data transformations and data flow.
Cloud-Native Data Infrastructure : Leverage GCP services to build and manage robust data storage, processing, and orchestration layers.
Data Quality, Governance & Security : Implement rigorous data quality gates, validation rules, bad record handling, and comprehensive logging. Ensure strict adherence to data security policies, IAM role management, and GCP perimeter security.
Automation & Orchestration : Develop shell scripts, Cloud Build YAMLs and utilize Cloud Scheduler / PubSub for E2E automation of data pipelines and infrastructure provisioning.
Collaboration with AI / ML Teams : Work closely with AI / ML engineers, data scientists, and product managers to understand data reqts, integrate data solutions with multi-agentic systems, and optimize data delivery for chatbot functionalities.
Testing & CI / CD : Implement robust testing strategies, maintain high code quality through active participation in Git / GitHub, perform code reviews, and manage CI / CD pipelines via Cloud Build.
Perf. Tuning & Optimization : Continuously monitor, optimize, and troubleshoot data pipelines and BQ performance using techniques like table partitioning, clustering, and sharding.
Experience Preferred
Java, PowerShell, Data Acquisition, Data Analysis, Data Collection, Data Conversion, Data Integrity, Data / Analytics dashboards
Education Required
Bachelor's Degree
Listed salary ranges may vary based on experience, qualifications, and local market. Also, some positions may include bonuses or other incentives
About Stefanini Group The Stefanini Group is a global provider of offshore, onshore and near shore outsourcing, IT digital consulting, systems integration, application, and strategic staffing services to Fortune 1000 enterprises around the world.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology
Industries
IT Services and IT Consulting
Stefanini takes pride in hiring top talent and developing relationships with our future employees. Our talent acquisition teams will never make an offer of employment without having a phone conversation with you.
J-18808-Ljbffr
#J-18808-Ljbffr
Stefanini Group is hiring!
Stefanini is looking for a Data Engineer, Dearborn, MI
For quick apply, please reach out Pawan Rawat at 248-213-3605 / pawansingh.rawat@stefanini.com
We are looking for the candidate who will be responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately
Responsibilities
Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis
Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow
Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data
Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks
Experience Required
Required 4+ years of Data Engineering work experience
Google Cloud Platform, ETL, Apache Spark, Data Architecture, Python, SQL, KAFKA
Data Pipeline Architecture & Development : Design, build, and maintain highly scalable, fault-tolerant, and performant data pipelines to ingest and process data from 10+ siloed sources, including both structured and unstructured formats.
ML-Driven ETL Implementation : Operationalize ETL pipelines for intelligent data ingestion, automated cataloging, and sophisticated normalization of diverse datasets.
Unified Data Model Creation : Architect and implement a unified data model capable of connecting all relevant data elements across various sources, optimized for efficient querying and insight generation by AI agents and chatbot interfaces.
Big Data Processing : Utilize advanced distributed processing frameworks (Apache Beam, Apache Spark, Google Cloud Dataflow) to handle large-scale data transformations and data flow.
Cloud-Native Data Infrastructure : Leverage GCP services to build and manage robust data storage, processing, and orchestration layers.
Data Quality, Governance & Security : Implement rigorous data quality gates, validation rules, bad record handling, and comprehensive logging. Ensure strict adherence to data security policies, IAM role management, and GCP perimeter security.
Automation & Orchestration : Develop shell scripts, Cloud Build YAMLs and utilize Cloud Scheduler / PubSub for E2E automation of data pipelines and infrastructure provisioning.
Collaboration with AI / ML Teams : Work closely with AI / ML engineers, data scientists, and product managers to understand data reqts, integrate data solutions with multi-agentic systems, and optimize data delivery for chatbot functionalities.
Testing & CI / CD : Implement robust testing strategies, maintain high code quality through active participation in Git / GitHub, perform code reviews, and manage CI / CD pipelines via Cloud Build.
Perf. Tuning & Optimization : Continuously monitor, optimize, and troubleshoot data pipelines and BQ performance using techniques like table partitioning, clustering, and sharding.
Experience Preferred
Java, PowerShell, Data Acquisition, Data Analysis, Data Collection, Data Conversion, Data Integrity, Data / Analytics dashboards
Education Required
Bachelor's Degree
Listed salary ranges may vary based on experience, qualifications, and local market. Also, some positions may include bonuses or other incentives
About Stefanini Group The Stefanini Group is a global provider of offshore, onshore and near shore outsourcing, IT digital consulting, systems integration, application, and strategic staffing services to Fortune 1000 enterprises around the world.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology
Industries
IT Services and IT Consulting
Stefanini takes pride in hiring top talent and developing relationships with our future employees. Our talent acquisition teams will never make an offer of employment without having a phone conversation with you.
J-18808-Ljbffr
#J-18808-Ljbffr