Calance
Senior Cloud Data Engineer (AWS / PySpark / Serverless)
Calance, Torrance, California, United States, 90504
Overview
JOB DETAILS: Position: Senior Cloud Data Engineer (AWS / PySpark / Serverless) JOB REF#:43883 – JIH5JP00003893 Duration:12 Months (On-Going Contract) Location:HYBRID – Torrance, CA 90501 Pay Rate:$70.00 – $74.00 per hour (W2 Only) HYBRID: Must be able to work ONSITE 4 days a week (LOCAL CANDIDATE ONLY) Responsibilities
Design, develop, and maintain robust ETL/ELT pipelines using AWS Glue for large-scale data processing Build serverless applications and microservices using AWS Lambda for real-time and batch data processing Implement data transformation logic using PySpark for distributed computing on large datasets Develop and optimize SQL queries for data extraction, transformation, and loading processes Implement Infrastructure as Code (IaC) using AWS CloudFormation, CDK, or Terraform Design event-driven architectures using AWS services, such as EventBridge, SQS, and SNS Develop RESTful APIs and web services using Node.js for data access and integration Mentor junior developers and provide technical guidance to the team Collaborate with data scientists, analysts, and stakeholders to understand requirements Participate in code reviews and maintain high coding standards Document technical designs, processes, and best practices Develop and maintain web applications using Node.js, Java, and Python. Design and implement RESTful APIs and microservices. Experience with AWS services (EC2, S3, Lambda, RDS, etc.). Write clean, maintainable, and efficient code while adhering to best practices. Troubleshoot and debug applications to ensure optimal performance. Participate in code reviews and contribute to team knowledge sharing. Proficiency in Node.js, Java, and Python. Required Experience / Skills
5 years of Software Development experience with 3 years in Cloud environments Strong proficiency in Python with extensive experience in PySpark for big data processing Hands-on experience with AWS Glue for ETL pipeline development and management Proven expertise in AWS Lambda for serverless application development Solid understanding of Node.js for API development and backend services Experience with SQL and NoSQL databases (PostgreSQL, MySQL, MongoDB, DynamoDB) Proficiency in AWS services including S3, IAM, CloudWatch, and VPC Experience with CI/CD pipelines and DevOps practices Understanding of Infrastructure as Code tools (CloudFormation, CDK, Terraform) Familiarity with version control systems (Git) and agile development methodologies Strong understanding of data warehousing concepts and dimensional modeling Experience with data formats (JSON, Parquet, Avro, ORC) and data serialization Understanding of data security, privacy, and compliance requirements Strong understanding of front-end technologies (HTML, CSS, JavaScript, frameworks like React or Angular). Desired Skills
Knowledge of data streaming technologies (Kinesis, Kafka) is a plus Benefits
EPO/PPO Medical Plans HMO/PPO Dental programs Vision – VSP (Vision Plan Summary) 401K Retirement vesting program (VOYA) Paid Bi-Weekly/Direct Deposit Flex Spending Plan Voluntary Life, AD&D, STD or LTD plans
#J-18808-Ljbffr
JOB DETAILS: Position: Senior Cloud Data Engineer (AWS / PySpark / Serverless) JOB REF#:43883 – JIH5JP00003893 Duration:12 Months (On-Going Contract) Location:HYBRID – Torrance, CA 90501 Pay Rate:$70.00 – $74.00 per hour (W2 Only) HYBRID: Must be able to work ONSITE 4 days a week (LOCAL CANDIDATE ONLY) Responsibilities
Design, develop, and maintain robust ETL/ELT pipelines using AWS Glue for large-scale data processing Build serverless applications and microservices using AWS Lambda for real-time and batch data processing Implement data transformation logic using PySpark for distributed computing on large datasets Develop and optimize SQL queries for data extraction, transformation, and loading processes Implement Infrastructure as Code (IaC) using AWS CloudFormation, CDK, or Terraform Design event-driven architectures using AWS services, such as EventBridge, SQS, and SNS Develop RESTful APIs and web services using Node.js for data access and integration Mentor junior developers and provide technical guidance to the team Collaborate with data scientists, analysts, and stakeholders to understand requirements Participate in code reviews and maintain high coding standards Document technical designs, processes, and best practices Develop and maintain web applications using Node.js, Java, and Python. Design and implement RESTful APIs and microservices. Experience with AWS services (EC2, S3, Lambda, RDS, etc.). Write clean, maintainable, and efficient code while adhering to best practices. Troubleshoot and debug applications to ensure optimal performance. Participate in code reviews and contribute to team knowledge sharing. Proficiency in Node.js, Java, and Python. Required Experience / Skills
5 years of Software Development experience with 3 years in Cloud environments Strong proficiency in Python with extensive experience in PySpark for big data processing Hands-on experience with AWS Glue for ETL pipeline development and management Proven expertise in AWS Lambda for serverless application development Solid understanding of Node.js for API development and backend services Experience with SQL and NoSQL databases (PostgreSQL, MySQL, MongoDB, DynamoDB) Proficiency in AWS services including S3, IAM, CloudWatch, and VPC Experience with CI/CD pipelines and DevOps practices Understanding of Infrastructure as Code tools (CloudFormation, CDK, Terraform) Familiarity with version control systems (Git) and agile development methodologies Strong understanding of data warehousing concepts and dimensional modeling Experience with data formats (JSON, Parquet, Avro, ORC) and data serialization Understanding of data security, privacy, and compliance requirements Strong understanding of front-end technologies (HTML, CSS, JavaScript, frameworks like React or Angular). Desired Skills
Knowledge of data streaming technologies (Kinesis, Kafka) is a plus Benefits
EPO/PPO Medical Plans HMO/PPO Dental programs Vision – VSP (Vision Plan Summary) 401K Retirement vesting program (VOYA) Paid Bi-Weekly/Direct Deposit Flex Spending Plan Voluntary Life, AD&D, STD or LTD plans
#J-18808-Ljbffr