Tata Consultancy Services
Join to apply for the
AWS Cloud Engineer
role at
Tata Consultancy Services
This position focuses on building scalable data pipelines and data infrastructure using AWS services such as S3, Glue, Redshift, Athena, Lambda, Step Functions, Kinesis, etc. The engineer will develop ETL/ELT pipelines, integrate data from relational databases, APIs, and streaming sources, design data models, optimize performance, implement security and compliance, automate tasks, and build CI/CD pipelines.
Responsibilities
Design, develop, and optimize ETL/ELT pipelines using AWS and Databricks services such as Unity Catalog, PySpark, AWS Glue, Lambda, Step Functions, and Apache Airflow.
Integrate data from various sources, including relational databases, APIs, and streaming data, ensuring high data quality and consistency.
Build and manage scalable, secure, and cost-efficient data infrastructure using AWS services like S3, Redshift, Athena, and RDS.
Create and maintain data models to support analytics and reporting requirements.
Monitor and optimize the performance of data pipelines, databases, and queries to meet SLAs and reduce costs.
Work closely with data scientists, analysts, and software engineers to understand data needs and deliver solutions that enable business insights.
Implement best practices for data security, encryption, and compliance with regulations such as GDPR, CCPA, or ITAR.
Automate repetitive tasks and processes using scripting (Python, Bash) and Infrastructure as Code (Terraform, AWS CloudFormation).
Build and optimize continuous integration and continuous deployment (CI/CD) pipelines to enable rapid and reliable software releases using GitLab in an Agile environment.
Set up monitoring and alerting for data pipelines and infrastructure, and troubleshoot issues to ensure high availability.
Qualifications
Bachelor of Computer Science.
Programming skills in Python, Scala, or PySpark for data processing and automation.
Expertise in SQL and experience with relational and NoSQL databases (e.g., RDS, DynamoDB).
Experience with AWS data services such as S3, Glue, Redshift, Athena, Lambda, Step Functions, Kinesis, and Azure Databricks.
Experience with data integration, data modeling, performance optimization, security, compliance, automation, CI/CD, monitoring, and troubleshooting.
Strong communication and collaboration skills.
Base Salary Range: $100,000 - $120,000 per annum
TCS Employee Benefits Summary: Discretionary Annual Incentive; Comprehensive Medical Coverage; Family Support; Insurance Options; Convenienes & Professional Growth; Time Off; Legal & Financial Assistance.
#J-18808-Ljbffr
AWS Cloud Engineer
role at
Tata Consultancy Services
This position focuses on building scalable data pipelines and data infrastructure using AWS services such as S3, Glue, Redshift, Athena, Lambda, Step Functions, Kinesis, etc. The engineer will develop ETL/ELT pipelines, integrate data from relational databases, APIs, and streaming sources, design data models, optimize performance, implement security and compliance, automate tasks, and build CI/CD pipelines.
Responsibilities
Design, develop, and optimize ETL/ELT pipelines using AWS and Databricks services such as Unity Catalog, PySpark, AWS Glue, Lambda, Step Functions, and Apache Airflow.
Integrate data from various sources, including relational databases, APIs, and streaming data, ensuring high data quality and consistency.
Build and manage scalable, secure, and cost-efficient data infrastructure using AWS services like S3, Redshift, Athena, and RDS.
Create and maintain data models to support analytics and reporting requirements.
Monitor and optimize the performance of data pipelines, databases, and queries to meet SLAs and reduce costs.
Work closely with data scientists, analysts, and software engineers to understand data needs and deliver solutions that enable business insights.
Implement best practices for data security, encryption, and compliance with regulations such as GDPR, CCPA, or ITAR.
Automate repetitive tasks and processes using scripting (Python, Bash) and Infrastructure as Code (Terraform, AWS CloudFormation).
Build and optimize continuous integration and continuous deployment (CI/CD) pipelines to enable rapid and reliable software releases using GitLab in an Agile environment.
Set up monitoring and alerting for data pipelines and infrastructure, and troubleshoot issues to ensure high availability.
Qualifications
Bachelor of Computer Science.
Programming skills in Python, Scala, or PySpark for data processing and automation.
Expertise in SQL and experience with relational and NoSQL databases (e.g., RDS, DynamoDB).
Experience with AWS data services such as S3, Glue, Redshift, Athena, Lambda, Step Functions, Kinesis, and Azure Databricks.
Experience with data integration, data modeling, performance optimization, security, compliance, automation, CI/CD, monitoring, and troubleshooting.
Strong communication and collaboration skills.
Base Salary Range: $100,000 - $120,000 per annum
TCS Employee Benefits Summary: Discretionary Annual Incentive; Comprehensive Medical Coverage; Family Support; Insurance Options; Convenienes & Professional Growth; Time Off; Legal & Financial Assistance.
#J-18808-Ljbffr