JPS Tech Solutions
Job Description
Get AI-powered advice on this job and more exclusive features.
Job Category & Type Job Category:
Data Architect
Job Type:
Onsite
Job Location:
Arizona Scottsdale
Compensation:
Depends on Experience
W2:
W2-Contract Only; applications on a C2C basis will not be considered for this role.
Job ID Job Id:
JPS-4671
Mandatory Requirements
Must have minimum 7-10 years of handson experience on building data ingestion highly robust and scalable pipelines using AWS native services Cloud Formation AWS Glue Crawlers Catalog Step Functions Event Bridge Lambda S3 SNS Kinesis other data related services
Must be proficient in Python Java
Must be proficient with SQL and HQL
Must have handled structured and unstructured data ingestion from different file formats TXT CSV JSON XML Parquet etc
Must have handled data streaming from Kafka topics using Apache Flink etc
Must have prior experience with open table formats like Apache Iceberg Hudi etc
Must have exposure to Cloudera data lake environment should have exposure to Snowflake environment
Must be proficient with Github versioning activities
Prior experience on CICD using Jenkins would be an added advantage
Should be able to envision the ingestion end to end while keeping up with all the data privacy lineage the cost optimization requirements
Must possess clear written verbal communication skills along with interpersonal skill to collaborate with the team is very important
Should be willing to coordinate own the delivery with the team located in India
Must have a positive attitude should be open for discussions stay hungry to learn try out something new
Must have prior handson working experience in Cloudera Hadoop implementation Should be able to reverse engineer the current processes running on it
Prior Apache Flink experience would be ideal
Skills Mandatory Skills:
AWS Cloud Architecture, AWS Well Architected Tools, Cloud Architecture, Cloud Solution Architecture, Enterprise Cloud Architecture
#J-18808-Ljbffr
Job Category & Type Job Category:
Data Architect
Job Type:
Onsite
Job Location:
Arizona Scottsdale
Compensation:
Depends on Experience
W2:
W2-Contract Only; applications on a C2C basis will not be considered for this role.
Job ID Job Id:
JPS-4671
Mandatory Requirements
Must have minimum 7-10 years of handson experience on building data ingestion highly robust and scalable pipelines using AWS native services Cloud Formation AWS Glue Crawlers Catalog Step Functions Event Bridge Lambda S3 SNS Kinesis other data related services
Must be proficient in Python Java
Must be proficient with SQL and HQL
Must have handled structured and unstructured data ingestion from different file formats TXT CSV JSON XML Parquet etc
Must have handled data streaming from Kafka topics using Apache Flink etc
Must have prior experience with open table formats like Apache Iceberg Hudi etc
Must have exposure to Cloudera data lake environment should have exposure to Snowflake environment
Must be proficient with Github versioning activities
Prior experience on CICD using Jenkins would be an added advantage
Should be able to envision the ingestion end to end while keeping up with all the data privacy lineage the cost optimization requirements
Must possess clear written verbal communication skills along with interpersonal skill to collaborate with the team is very important
Should be willing to coordinate own the delivery with the team located in India
Must have a positive attitude should be open for discussions stay hungry to learn try out something new
Must have prior handson working experience in Cloudera Hadoop implementation Should be able to reverse engineer the current processes running on it
Prior Apache Flink experience would be ideal
Skills Mandatory Skills:
AWS Cloud Architecture, AWS Well Architected Tools, Cloud Architecture, Cloud Solution Architecture, Enterprise Cloud Architecture
#J-18808-Ljbffr