Software Guidance & Assistance
Software Guidance & Assistance, Inc. (SGA) is searching for a
Big Data Engineer
for a contract assignment with one of our premier financial services clients in
Alpharetta, GA or New York, NY
.
This position is for Big data engineer for the Wealth Management Framework CoE team. CoE team is responsible to define and govern the data platforms. We are looking for colleagues with strong sense of ownership and ability to drive solutions. The role is primarily responsible to automate the existing process and bring new ideas and innovation. The candidate is expected to code, conduct code reviews, and test framework as needed, along with participating in application architecture and design and other phases of the automation. The ideal candidate will be a self-motivated team player committed to delivering on time and should be able to work with or without minimal supervision.
Responsibilities
Design & Develop new automation framework for ETL processing
Support existing framework and become technical point of contact for all related teams
Enhance existing ETL automation framework as per user requirements
Performance tuning of spark, snowflake ETL jobs
New technology POC and suitability analysis for Cloud migration
Process optimization with the help of automation and new utility development
Work in collaboration for any issues and new features
Support any batch issue
Support application team teams with any queries
Required Skills
7 years of Data engineering experience
Must be strong in UNIX Shell, Python scripting knowledge
Must be strong in Spark
Must have strong knowledge of SQL
Hands-on knowledge on how HDFS/Hive/Impala/Spark works
Strong in logical reasoning capabilities
Should have working knowledge of Github, DevOps, CICD/ Enterprise code management tools
Strong collaboration and communication skills
Must possess strong team-player skills and should have excellent written and verbal communication skills
Ability to create and maintain a positive environment of shared success
Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor
Good to have working experience on snowflake & any data integration tool i.e. Informatica cloud
Preferred Skills
Snowflake/Azure/AWS any cloud
IDMC/any ETL tool
SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let’s work better together, we mean it. You’ll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work.
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.
#J-18808-Ljbffr
Big Data Engineer
for a contract assignment with one of our premier financial services clients in
Alpharetta, GA or New York, NY
.
This position is for Big data engineer for the Wealth Management Framework CoE team. CoE team is responsible to define and govern the data platforms. We are looking for colleagues with strong sense of ownership and ability to drive solutions. The role is primarily responsible to automate the existing process and bring new ideas and innovation. The candidate is expected to code, conduct code reviews, and test framework as needed, along with participating in application architecture and design and other phases of the automation. The ideal candidate will be a self-motivated team player committed to delivering on time and should be able to work with or without minimal supervision.
Responsibilities
Design & Develop new automation framework for ETL processing
Support existing framework and become technical point of contact for all related teams
Enhance existing ETL automation framework as per user requirements
Performance tuning of spark, snowflake ETL jobs
New technology POC and suitability analysis for Cloud migration
Process optimization with the help of automation and new utility development
Work in collaboration for any issues and new features
Support any batch issue
Support application team teams with any queries
Required Skills
7 years of Data engineering experience
Must be strong in UNIX Shell, Python scripting knowledge
Must be strong in Spark
Must have strong knowledge of SQL
Hands-on knowledge on how HDFS/Hive/Impala/Spark works
Strong in logical reasoning capabilities
Should have working knowledge of Github, DevOps, CICD/ Enterprise code management tools
Strong collaboration and communication skills
Must possess strong team-player skills and should have excellent written and verbal communication skills
Ability to create and maintain a positive environment of shared success
Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor
Good to have working experience on snowflake & any data integration tool i.e. Informatica cloud
Preferred Skills
Snowflake/Azure/AWS any cloud
IDMC/any ETL tool
SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let’s work better together, we mean it. You’ll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work.
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.
#J-18808-Ljbffr