Damco Solutions
Role Description:
Position: Azure Databricks Engineer
Client: Client/Telecommunication
Location:
tlanta / Alpharetta - Onsite Duration- 6 Month
Responsibilities: Design, build, and maintain scalable and robust ETL or ELT pipelines using Databricks. Ingest data from various sources (databases, APIs, streaming services, cloud storage) into the Databricks environment. Implement data transformations and cleansing processes to ensure data quality and consistency. Utilize Databricks features like Delta Live Tables (DLT) for declarative pipeline development and efficient data processing. Manage and optimize data storage within Databricks Translate business needs into technical specifications for data solutions.
Skills:
Deep understanding and hands-on experience with the Databricks platform, including Databricks notebooks, clusters, jobs, Delta Lake, Unity Catalog, and Databricks Programming languages. Experience with major cloud provider such as Azure, as Databricks runs on these infrastructures Working Experience with streaming data technologies Solid understanding of data warehousing principles, dimensional modeling, and various ETL/ELT methodologies. Familiarity with Git or other version control systems for collaborative code development.
tlanta / Alpharetta - Onsite Duration- 6 Month
Responsibilities: Design, build, and maintain scalable and robust ETL or ELT pipelines using Databricks. Ingest data from various sources (databases, APIs, streaming services, cloud storage) into the Databricks environment. Implement data transformations and cleansing processes to ensure data quality and consistency. Utilize Databricks features like Delta Live Tables (DLT) for declarative pipeline development and efficient data processing. Manage and optimize data storage within Databricks Translate business needs into technical specifications for data solutions.
Skills:
Deep understanding and hands-on experience with the Databricks platform, including Databricks notebooks, clusters, jobs, Delta Lake, Unity Catalog, and Databricks Programming languages. Experience with major cloud provider such as Azure, as Databricks runs on these infrastructures Working Experience with streaming data technologies Solid understanding of data warehousing principles, dimensional modeling, and various ETL/ELT methodologies. Familiarity with Git or other version control systems for collaborative code development.