Tata Consultancy Services
Databricks, PySpark, Scala - Developer in DC or NY
Tata Consultancy Services, Washington, District of Columbia, us, 20022
Databricks, PySpark, Scala - Developer in DC or NY
Databricks, PySpark, Scala - Developer in DC or NY
Direct message the job poster from Tata Consultancy Services Sr. Technical Recruiter at Tata Consultancy Services (TCS)
Databricks, PySpark, Scala - Developer in DC or NY Must Have Technical/Functional Skills • 8–10 years of total experience in data engineering, with at least 3–4 years in Databricks and PySpark. • Strong programming skills in Scala and Python (PySpark). • Deep experience with Databricks platform, including job orchestration, Delta Lake, and cluster management. • Proficient in distributed data processing, performance tuning, and handling large datasets. • Experience with cloud platforms (e.g., Azure, AWS, or GCP) and cloud-native data engineering tools. • Strong knowledge of data modeling, data warehousing, and data integration techniques. • Hands-on experience with version control (Git), CI/CD tools, and Agile development practices. • Excellent problem-solving, communication, and collaboration skills. • Design, develop, and optimize scalable ETL/ELT pipelines using Databricks and Apache Spark (PySpark and Scala). • Build data ingestion workflows from various sources (structured, semi-structured, and unstructured). • Develop reusable components and frameworks for efficient data processing. • Implement best practices for data quality, validation, and governance. • Collaborate with data architects, analysts, and business stakeholders to understand data requirements. • Tune Spark jobs for performance and scalability in a cloud-based environment. • Maintain robust data lake or lakehouse architectures. • Ensure high availability, security, and integrity of data pipelines and platforms. • Support troubleshooting, debugging, and performance optimization in production workloads. • Create and maintain technical documentation for pipelines and data models. Generic Managerial Skills, If any Working with multiple stakeholders and architecture review Education Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Information Technology Industries IT Services and IT Consulting Referrals increase your chances of interviewing at Tata Consultancy Services by 2x Inferred from the description for this job
Medical insurance Vision insurance 401(k) Get notified about new Scala Developer jobs in
Washington, DC . Software Engineer 1 - C++/Java/Python/Linux/Circuit
Annapolis Junction, MD $130,000.00-$270,000.00 2 months ago Software Engineer 0 - DevOps/C++/Java/Python/React/Circuits/SQL/AI/RF
Annapolis Junction, MD $130,000.00-$270,000.00 2 months ago Software Engineer 2 - C++/Java/Python/Linux/Circuit
Annapolis Junction, MD $130,000.00-$270,000.00 2 months ago Software Engineer 3 - C++/Java/Python/Linux/Circuit
Annapolis Junction, MD $130,000.00-$270,000.00 2 months ago Annapolis Junction, MD $150,000.00-$200,000.00 1 month ago Washington, DC $140,000.00-$220,000.00 2 weeks ago Fairfax, VA $140,000.00-$220,000.00 2 weeks ago Hanover, MD $78,000.00-$250,000.00 1 day ago Chantilly, VA $140,000.00-$220,000.00 2 weeks ago Software Engineer 1 - Python/Docker/Kubernetes/AWS/Kotlin/Java/Golang/Kafka
Fort Meade, MD $110,000.00-$140,000.00 1 month ago HDPA - Software Engineer - Linux, Python, Java
Washington, DC $102,000.00-$138,000.00 2 weeks ago Reston, VA $70,000.00-$80,000.00 1 week ago Software Engineer - 3 (Bash/Python/Java/RESTful APIs)
Annapolis Junction, MD $162,000.00-$294,000.00 4 days ago Software Engineer - 2 (Java/Python/Containers/Graph Databases)
Annapolis Junction, MD $144,000.00-$266,000.00 3 days ago Washington, DC $55,666.00-$777,777.00 2 months ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Databricks, PySpark, Scala - Developer in DC or NY
Direct message the job poster from Tata Consultancy Services Sr. Technical Recruiter at Tata Consultancy Services (TCS)
Databricks, PySpark, Scala - Developer in DC or NY Must Have Technical/Functional Skills • 8–10 years of total experience in data engineering, with at least 3–4 years in Databricks and PySpark. • Strong programming skills in Scala and Python (PySpark). • Deep experience with Databricks platform, including job orchestration, Delta Lake, and cluster management. • Proficient in distributed data processing, performance tuning, and handling large datasets. • Experience with cloud platforms (e.g., Azure, AWS, or GCP) and cloud-native data engineering tools. • Strong knowledge of data modeling, data warehousing, and data integration techniques. • Hands-on experience with version control (Git), CI/CD tools, and Agile development practices. • Excellent problem-solving, communication, and collaboration skills. • Design, develop, and optimize scalable ETL/ELT pipelines using Databricks and Apache Spark (PySpark and Scala). • Build data ingestion workflows from various sources (structured, semi-structured, and unstructured). • Develop reusable components and frameworks for efficient data processing. • Implement best practices for data quality, validation, and governance. • Collaborate with data architects, analysts, and business stakeholders to understand data requirements. • Tune Spark jobs for performance and scalability in a cloud-based environment. • Maintain robust data lake or lakehouse architectures. • Ensure high availability, security, and integrity of data pipelines and platforms. • Support troubleshooting, debugging, and performance optimization in production workloads. • Create and maintain technical documentation for pipelines and data models. Generic Managerial Skills, If any Working with multiple stakeholders and architecture review Education Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Information Technology Industries IT Services and IT Consulting Referrals increase your chances of interviewing at Tata Consultancy Services by 2x Inferred from the description for this job
Medical insurance Vision insurance 401(k) Get notified about new Scala Developer jobs in
Washington, DC . Software Engineer 1 - C++/Java/Python/Linux/Circuit
Annapolis Junction, MD $130,000.00-$270,000.00 2 months ago Software Engineer 0 - DevOps/C++/Java/Python/React/Circuits/SQL/AI/RF
Annapolis Junction, MD $130,000.00-$270,000.00 2 months ago Software Engineer 2 - C++/Java/Python/Linux/Circuit
Annapolis Junction, MD $130,000.00-$270,000.00 2 months ago Software Engineer 3 - C++/Java/Python/Linux/Circuit
Annapolis Junction, MD $130,000.00-$270,000.00 2 months ago Annapolis Junction, MD $150,000.00-$200,000.00 1 month ago Washington, DC $140,000.00-$220,000.00 2 weeks ago Fairfax, VA $140,000.00-$220,000.00 2 weeks ago Hanover, MD $78,000.00-$250,000.00 1 day ago Chantilly, VA $140,000.00-$220,000.00 2 weeks ago Software Engineer 1 - Python/Docker/Kubernetes/AWS/Kotlin/Java/Golang/Kafka
Fort Meade, MD $110,000.00-$140,000.00 1 month ago HDPA - Software Engineer - Linux, Python, Java
Washington, DC $102,000.00-$138,000.00 2 weeks ago Reston, VA $70,000.00-$80,000.00 1 week ago Software Engineer - 3 (Bash/Python/Java/RESTful APIs)
Annapolis Junction, MD $162,000.00-$294,000.00 4 days ago Software Engineer - 2 (Java/Python/Containers/Graph Databases)
Annapolis Junction, MD $144,000.00-$266,000.00 3 days ago Washington, DC $55,666.00-$777,777.00 2 months ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr