Tata Consultancy Services
Data Engineer ( Bigdata with AWS & Snowflake)
Tata Consultancy Services, Bethesda, Maryland, us, 20811
Data Engineer (Bigdata with AWS & Snowflake)
Get AI-powered advice on this job and more exclusive features.
Pay Base pay range: $100,000.00/yr - $130,000.00/yr
Job Description
Involved in the Study of the business logic and coordinate with the client to gather the requirements.
Experience with Hive, Nifi, Airflow, Snowflake and Kafka
Experience in Cloud environments, particularly AWS - EC2, S3, Lambda
Experience in Unit testing, integration testing for Spark scripts
Scripting with Bash, CSH, Shell, or Python
Designing and implementing large-scale ingest systems in a Big Data environment
Optimizing all stages of the data life cycle, from initial planning, to ingest, through final display and beyond
Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution capabilities
Developing custom solutions/code to ingest and exploit new and existing data sources
Working with Sponsor development teams to improve application performance
Providing support to maintain, optimize, troubleshoot, and configure the AWS/spark/Hadoop environment as needed
Collaborating with team‑mates, other service providers, vendors, and users to develop new and more efficient method
Experience with CI/CD pipelines, unit tests, integration, and regression testing
Significant experience with Airflow
Strong ability to manage competing priorities and communication to multiple stakeholders
Bachelor’s degree in computer science, Computer Engineering, or a related discipline with experience in software design and development.
TCS Employee Benefits Summary
Discretionary Annual Incentive
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans
Family Support: Maternal & Parental Leaves
Insurance Options: Auto & Home Insurance, Identity Theft Protection
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement
Time Off: Vacation, Time Off, Sick Leave & Holidays
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing
Seniority Level Entry level
Employment Type Full-time
Job Function Information Technology
Industries IT Services and IT Consulting
Referrals increase your chances of interviewing at Tata Consultancy Services by 2x
Locations: Annapolis Junction, MD ($150,000 - $170,000, 1 week ago); Washington, DC ($145,000 - $204,000, 2 weeks ago); Washington, DC ($112,597.33 - $152,810.66, 3 months ago); Rockville, MD ($112,597.33 - $152,810.66, 3 months ago).
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Pay Base pay range: $100,000.00/yr - $130,000.00/yr
Job Description
Involved in the Study of the business logic and coordinate with the client to gather the requirements.
Experience with Hive, Nifi, Airflow, Snowflake and Kafka
Experience in Cloud environments, particularly AWS - EC2, S3, Lambda
Experience in Unit testing, integration testing for Spark scripts
Scripting with Bash, CSH, Shell, or Python
Designing and implementing large-scale ingest systems in a Big Data environment
Optimizing all stages of the data life cycle, from initial planning, to ingest, through final display and beyond
Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution capabilities
Developing custom solutions/code to ingest and exploit new and existing data sources
Working with Sponsor development teams to improve application performance
Providing support to maintain, optimize, troubleshoot, and configure the AWS/spark/Hadoop environment as needed
Collaborating with team‑mates, other service providers, vendors, and users to develop new and more efficient method
Experience with CI/CD pipelines, unit tests, integration, and regression testing
Significant experience with Airflow
Strong ability to manage competing priorities and communication to multiple stakeholders
Bachelor’s degree in computer science, Computer Engineering, or a related discipline with experience in software design and development.
TCS Employee Benefits Summary
Discretionary Annual Incentive
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans
Family Support: Maternal & Parental Leaves
Insurance Options: Auto & Home Insurance, Identity Theft Protection
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement
Time Off: Vacation, Time Off, Sick Leave & Holidays
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing
Seniority Level Entry level
Employment Type Full-time
Job Function Information Technology
Industries IT Services and IT Consulting
Referrals increase your chances of interviewing at Tata Consultancy Services by 2x
Locations: Annapolis Junction, MD ($150,000 - $170,000, 1 week ago); Washington, DC ($145,000 - $204,000, 2 weeks ago); Washington, DC ($112,597.33 - $152,810.66, 3 months ago); Rockville, MD ($112,597.33 - $152,810.66, 3 months ago).
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr