Info Way Solutions
Job Title:
Data Engineer - Python & Databricks Location:
State Street - NJ / Boston, MA
Job Description: Infosys is seeking a skilled
Data Engineer
with expertise in
Python
and
Databricks
to support data platform development and transformation initiatives for our client at State Street. The ideal candidate will have a strong background in data engineering, cloud platforms (preferably Azure), and experience with large-scale data pipelines.
Key Responsibilities: Develop and optimize scalable data pipelines using Python and Databricks. Work with large datasets to build ETL/ELT processes. Integrate data from various sources into cloud-based data lakes or warehouses. Collaborate with data scientists, architects, and business stakeholders to ensure data quality and usability. Monitor and troubleshoot data workflows to ensure high availability and performance. Required Skills:
4+ years of experience in Data Engineering. Strong hands-on experience with
Python
and
Databricks . Proficient in SQL and data manipulation techniques. Experience with cloud platforms, preferably
Azure . Familiarity with Delta Lake, Spark, and distributed computing. Preferred:
Prior experience working with financial clients or in regulated environments. Knowledge of CI/CD and version control tools (e.g., Git).
Data Engineer - Python & Databricks Location:
State Street - NJ / Boston, MA
Job Description: Infosys is seeking a skilled
Data Engineer
with expertise in
Python
and
Databricks
to support data platform development and transformation initiatives for our client at State Street. The ideal candidate will have a strong background in data engineering, cloud platforms (preferably Azure), and experience with large-scale data pipelines.
Key Responsibilities: Develop and optimize scalable data pipelines using Python and Databricks. Work with large datasets to build ETL/ELT processes. Integrate data from various sources into cloud-based data lakes or warehouses. Collaborate with data scientists, architects, and business stakeholders to ensure data quality and usability. Monitor and troubleshoot data workflows to ensure high availability and performance. Required Skills:
4+ years of experience in Data Engineering. Strong hands-on experience with
Python
and
Databricks . Proficient in SQL and data manipulation techniques. Experience with cloud platforms, preferably
Azure . Familiarity with Delta Lake, Spark, and distributed computing. Preferred:
Prior experience working with financial clients or in regulated environments. Knowledge of CI/CD and version control tools (e.g., Git).