VetJobs
Senior Data Engineer - Alpharetta GA
Join to apply for the Senior Data Engineer - Alpharetta GA role at VetJobs.
Get AI-powered advice on this job and more exclusive features.
Job Description
We are looking for a highly skilled and experienced Senior Data Engineer to join our team. You'll be instrumental in designing, building, and maintaining our next-generation Data Ingestion platform and its infrastructure. This role requires a deep understanding of distributed systems and hands‑on expertise with cutting‑edge big data technologies in a cloud‑native environment.
You will be responsible for creating robust, scalable, and fault‑tolerant data pipelines that process massive datasets for both real‑time and batch‑based analytics. Your work will directly enable our data scientists, analysts, and business teams to derive critical insights and make data‑driven decisions.
Eligibility for Military Affiliated Job Seekers
The following position is available to Veterans, Transitioning Military, National Guard and Reserve Members, Military Spouses, Wounded Warriors, and their Caregivers. If you have the required skill set, education requirements, and experience, please click the submit button and follow the next steps.
Responsibilities
Apply the knowledge of data characteristics and data supply pattern, develop rules and tracking process to support data quality model.
Prepare data for analytical use by building data pipelines to gather data from multiple sources and systems.
Integrate, consolidate, cleanse and structure data for use by our clients in our solutions.
Perform design, creation, and interpretation of large and highly complex datasets.
Stay up‑to‑date with the latest trends and advancements in GCP and related technologies, actively proposing and evaluating new solutions.
Understand best practices for data management, maintenance, reporting and security and use that knowledge to implement improvements in our solutions.
Implement security best practices in pipelines and infrastructure.
Develop and implement data quality checks and troubleshoot data anomalies.
Provide guidance and mentorship to junior data engineers.
Review dataset implementations performed by junior data engineers.
Qualifications
Bachelor’s degree in a STEM major or equivalent discipline; Master’s Degree strongly preferred.
5+ years of experience as a data engineer or related role.
5+ years of software engineering experience.
Advanced skills using programming languages such as Python or SQL and intermediate level experience with scripting languages.
5+ years experience with Cloud technology: GCP, AWS, or Azure.
5+ years experience designing and developing cloud‑native solutions.
Experience building and maintaining moderately‑complex data pipelines, troubleshooting issues, transforming and entering data into a data pipeline in order for the content to be digested and usable for future projects.
Demonstrates advanced Git usage and CI/CD integration skills.
Expert‑level proficiency in SQL, Python or relevant programming languages.
Demonstrated experience designing and implementing distributed data processing solutions at scale.
In‑depth, hands‑on experience with BigData tools such as Apache Spark or Apache Beam.
Proven experience with Google Cloud Platform (GCP) services for data engineering, including Dataflow, Dataproc, BigQuery, and Pub/Sub.
Experience with workflow orchestration tools like Apache Airflow (or GCP's Cloud Composer).
Solid understanding of data modeling, data warehousing, and ETL/ELT best practices.
Background of Large Data Analysis and building AI ML Models would be a huge plus.
Excellent problem‑solving skills and the ability to troubleshoot complex distributed systems.
Effective communication and collaboration skills, with the ability to articulate technical concepts to both technical and non‑technical stakeholders.
Benefits We offer comprehensive compensation and healthcare packages, 401(k) matching, paid time off, and organizational growth potential through our online learning platform with guided career tracks.
Are you ready to power your possible? Apply today, and get started on a path toward an exciting new career at Equifax, where you can make a difference!
Auto req ID:
461648BR
Minimum Education Required:
Bachelors
Job Category:
Administrative and Support Services
Location:
Alpharetta, Georgia, USA
Employment Type:
Full‑time
Seniority Level:
Mid‑ to Senior‑level
Job Code:
Operations_ Specialist
Affiliate Sponsor:
Equifax
#J-18808-Ljbffr
Get AI-powered advice on this job and more exclusive features.
Job Description
We are looking for a highly skilled and experienced Senior Data Engineer to join our team. You'll be instrumental in designing, building, and maintaining our next-generation Data Ingestion platform and its infrastructure. This role requires a deep understanding of distributed systems and hands‑on expertise with cutting‑edge big data technologies in a cloud‑native environment.
You will be responsible for creating robust, scalable, and fault‑tolerant data pipelines that process massive datasets for both real‑time and batch‑based analytics. Your work will directly enable our data scientists, analysts, and business teams to derive critical insights and make data‑driven decisions.
Eligibility for Military Affiliated Job Seekers
The following position is available to Veterans, Transitioning Military, National Guard and Reserve Members, Military Spouses, Wounded Warriors, and their Caregivers. If you have the required skill set, education requirements, and experience, please click the submit button and follow the next steps.
Responsibilities
Apply the knowledge of data characteristics and data supply pattern, develop rules and tracking process to support data quality model.
Prepare data for analytical use by building data pipelines to gather data from multiple sources and systems.
Integrate, consolidate, cleanse and structure data for use by our clients in our solutions.
Perform design, creation, and interpretation of large and highly complex datasets.
Stay up‑to‑date with the latest trends and advancements in GCP and related technologies, actively proposing and evaluating new solutions.
Understand best practices for data management, maintenance, reporting and security and use that knowledge to implement improvements in our solutions.
Implement security best practices in pipelines and infrastructure.
Develop and implement data quality checks and troubleshoot data anomalies.
Provide guidance and mentorship to junior data engineers.
Review dataset implementations performed by junior data engineers.
Qualifications
Bachelor’s degree in a STEM major or equivalent discipline; Master’s Degree strongly preferred.
5+ years of experience as a data engineer or related role.
5+ years of software engineering experience.
Advanced skills using programming languages such as Python or SQL and intermediate level experience with scripting languages.
5+ years experience with Cloud technology: GCP, AWS, or Azure.
5+ years experience designing and developing cloud‑native solutions.
Experience building and maintaining moderately‑complex data pipelines, troubleshooting issues, transforming and entering data into a data pipeline in order for the content to be digested and usable for future projects.
Demonstrates advanced Git usage and CI/CD integration skills.
Expert‑level proficiency in SQL, Python or relevant programming languages.
Demonstrated experience designing and implementing distributed data processing solutions at scale.
In‑depth, hands‑on experience with BigData tools such as Apache Spark or Apache Beam.
Proven experience with Google Cloud Platform (GCP) services for data engineering, including Dataflow, Dataproc, BigQuery, and Pub/Sub.
Experience with workflow orchestration tools like Apache Airflow (or GCP's Cloud Composer).
Solid understanding of data modeling, data warehousing, and ETL/ELT best practices.
Background of Large Data Analysis and building AI ML Models would be a huge plus.
Excellent problem‑solving skills and the ability to troubleshoot complex distributed systems.
Effective communication and collaboration skills, with the ability to articulate technical concepts to both technical and non‑technical stakeholders.
Benefits We offer comprehensive compensation and healthcare packages, 401(k) matching, paid time off, and organizational growth potential through our online learning platform with guided career tracks.
Are you ready to power your possible? Apply today, and get started on a path toward an exciting new career at Equifax, where you can make a difference!
Auto req ID:
461648BR
Minimum Education Required:
Bachelors
Job Category:
Administrative and Support Services
Location:
Alpharetta, Georgia, USA
Employment Type:
Full‑time
Seniority Level:
Mid‑ to Senior‑level
Job Code:
Operations_ Specialist
Affiliate Sponsor:
Equifax
#J-18808-Ljbffr