Software Guidance and Assistance, Inc.
Data Engineer
Software Guidance and Assistance, Inc., San Jose, California, United States, 95199
Software Guidance & Assistance, Inc., (SGA), is searching for a
Data Engineer
for a
CONTRACT
assignment with one of our premier
SaaS
clients in
San Jose, CA.
This role is hybrid with 3 days onsite per week.
Responsibilities
: Design, develop, and maintain scalable and reliable data pipelines to support large-scale data processing. Build and optimize data workflows using orchestration tools like Apache Airflow and Spark to support scheduled and event-driven ETL/ELT processes. Implement complex parsing, cleansing, and transformation logic to normalize data from a variety of structured and unstructured sources. Collaborate with data scientists, analysts, and application teams to integrate, test, and validate data products and pipelines. Operate and maintain pipelines running on cloud platforms (AWS) and distributed compute environments (e.g., Databricks). Monitor pipeline performance, perform root cause analysis, and troubleshoot failures to ensure high data quality and uptime. Ensure proper security, compliance, and governance of data across systems and environments. Contribute to the automation and standardization of data engineering processes to improve development velocity and operational efficiency. Required
Skills
:
Proficient in Python and PySpark for data processing and scripting. Strong experience with SQL for data manipulation and performance tuning. Deep understanding of distributed data processing with Apache Spark. Hands-on experience with Airflow or similar orchestration tools. Experience with cloud services and data tools in AWS (e.g., S3, Lambda, SQS, Gateway, Networking). Expertise with Databricks for collaborative data engineering and analytics. Solid understanding of data modeling, data warehousing, and best practices in data pipeline architecture. Strong problem-solving skills with the ability to work independently on complex tasks. Familiarity with CI/CD practices and version control (e.g., Git) in data engineering workflows.
SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at https://sgainc.com/ .
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.
Data Engineer
for a
CONTRACT
assignment with one of our premier
SaaS
clients in
San Jose, CA.
This role is hybrid with 3 days onsite per week.
Responsibilities
: Design, develop, and maintain scalable and reliable data pipelines to support large-scale data processing. Build and optimize data workflows using orchestration tools like Apache Airflow and Spark to support scheduled and event-driven ETL/ELT processes. Implement complex parsing, cleansing, and transformation logic to normalize data from a variety of structured and unstructured sources. Collaborate with data scientists, analysts, and application teams to integrate, test, and validate data products and pipelines. Operate and maintain pipelines running on cloud platforms (AWS) and distributed compute environments (e.g., Databricks). Monitor pipeline performance, perform root cause analysis, and troubleshoot failures to ensure high data quality and uptime. Ensure proper security, compliance, and governance of data across systems and environments. Contribute to the automation and standardization of data engineering processes to improve development velocity and operational efficiency. Required
Skills
:
Proficient in Python and PySpark for data processing and scripting. Strong experience with SQL for data manipulation and performance tuning. Deep understanding of distributed data processing with Apache Spark. Hands-on experience with Airflow or similar orchestration tools. Experience with cloud services and data tools in AWS (e.g., S3, Lambda, SQS, Gateway, Networking). Expertise with Databricks for collaborative data engineering and analytics. Solid understanding of data modeling, data warehousing, and best practices in data pipeline architecture. Strong problem-solving skills with the ability to work independently on complex tasks. Familiarity with CI/CD practices and version control (e.g., Git) in data engineering workflows.
SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at https://sgainc.com/ .
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.