Tata Consultancy Services
Job Description
A cloud-focused data engineering role centered on AWS and Databricks services. The position requires building robust, scalable data pipelines, ensuring high data quality, and delivering analytics-ready data to business stakeholders. Responsibilities
Design, develop, and optimize ETL/ELT pipelines using AWS services (S3, Glue, Redshift, Athena, Lambda, Step Functions, Kinesis) and Databricks (Unity Catalog, PySpark). Integrate data from relational databases, APIs, and streaming sources, ensuring high data quality and consistency. Build and manage secure, cost‑efficient data infrastructure on AWS (S3, Redshift, Athena, RDS). Create and maintain data models to enable efficient querying and reporting. Monitor and optimize performance of pipelines, databases, and queries to meet SLAs and reduce costs. Collaborate with data scientists, analysts, and software engineers to understand data needs and deliver solutions that enable business insights. Implement best practices for data security, encryption, and compliance with regulations such as GDPR, CCPA, or ITAR. Automate repetitive tasks and processes using scripting (Python, Bash) and Infrastructure as Code (Terraform, AWS CloudFormation). Build and maintain CI/CD pipelines using GitLab in an Agile environment. Set up monitoring and alerting for data pipelines and infrastructure, and troubleshoot issues to ensure high availability. Qualifications
Bachelor’s degree in Computer Science, Engineering, or related field. Strong programming skills in Python, Scala, or PySpark. Proficient in SQL and experience with relational and NoSQL databases (e.g., RDS, DynamoDB). Hands‑on experience with AWS data services and Databricks platform. Experience with IaC tools (Terraform, CloudFormation) and CI/CD practices. Knowledge of security and compliance standards (GDPR, CCPA, ITAR). Base Salary
$100,000 – $120,000 per annum. Benefits Summary
Discretionary annual incentive. Comprehensive medical coverage – health, dental, vision, disability, pet insurance. Family support – maternity and parental leaves. Auto and home insurance, identity theft protection. Commuter benefits, certification and training reimbursement, and 401(k) plan. Legal assistance and financial assistance – college fund, student loan refinancing.
#J-18808-Ljbffr
A cloud-focused data engineering role centered on AWS and Databricks services. The position requires building robust, scalable data pipelines, ensuring high data quality, and delivering analytics-ready data to business stakeholders. Responsibilities
Design, develop, and optimize ETL/ELT pipelines using AWS services (S3, Glue, Redshift, Athena, Lambda, Step Functions, Kinesis) and Databricks (Unity Catalog, PySpark). Integrate data from relational databases, APIs, and streaming sources, ensuring high data quality and consistency. Build and manage secure, cost‑efficient data infrastructure on AWS (S3, Redshift, Athena, RDS). Create and maintain data models to enable efficient querying and reporting. Monitor and optimize performance of pipelines, databases, and queries to meet SLAs and reduce costs. Collaborate with data scientists, analysts, and software engineers to understand data needs and deliver solutions that enable business insights. Implement best practices for data security, encryption, and compliance with regulations such as GDPR, CCPA, or ITAR. Automate repetitive tasks and processes using scripting (Python, Bash) and Infrastructure as Code (Terraform, AWS CloudFormation). Build and maintain CI/CD pipelines using GitLab in an Agile environment. Set up monitoring and alerting for data pipelines and infrastructure, and troubleshoot issues to ensure high availability. Qualifications
Bachelor’s degree in Computer Science, Engineering, or related field. Strong programming skills in Python, Scala, or PySpark. Proficient in SQL and experience with relational and NoSQL databases (e.g., RDS, DynamoDB). Hands‑on experience with AWS data services and Databricks platform. Experience with IaC tools (Terraform, CloudFormation) and CI/CD practices. Knowledge of security and compliance standards (GDPR, CCPA, ITAR). Base Salary
$100,000 – $120,000 per annum. Benefits Summary
Discretionary annual incentive. Comprehensive medical coverage – health, dental, vision, disability, pet insurance. Family support – maternity and parental leaves. Auto and home insurance, identity theft protection. Commuter benefits, certification and training reimbursement, and 401(k) plan. Legal assistance and financial assistance – college fund, student loan refinancing.
#J-18808-Ljbffr