Direct Recruit Agency
Data Catalog Developer (7190-A)
NYC, New York, United States – Engineering Department – Full‑time, on‑site
$100.00 – $105.00 per hour (W2)
We are seeking a highly skilled and experienced Data Catalog Developer to join our team at Direct Recruit Agency. As a Data Catalog Developer, you will be responsible for designing, developing, and maintaining data catalogs for our clients.
Key Responsibilities
Design and develop data catalogs using Collibra Data Catalog.
Build Collibra workflows and integrate Edge Server with various data sources, authentication, and access controls.
Perform metadata synchronization, lineage harvesting, and metadata synchronization.
Migrate applications from on‑premises locations to cloud service providers.
Develop, modify, and extend code for building cloud infrastructure, automate CI/CD pipelines, and implement best practices for data quality, validation, and governance.
Collaborate with data architects, analysts, and business stakeholders to understand data requirements and make data‑driven decisions.
Qualifications
Bachelor’s degree in Computer Science, Information Systems, or a related field.
Minimum of 3 years of experience as a Data Catalog Developer or in a similar role.
Hands‑on experience building ETL pipelines using Databricks SaaS infrastructure.
Expertise in Collibra Data Management, Data Asset, Data Governance, and BAU support of Collibra Data Catalog.
Edge Server experience and Collibra Ranger certification preferred.
Proficiency in AWS (S3, Glue, Aurora PostgreSQL, Athena), SQL, Python, Scala, and Databricks.
Experience with Container Orchestration services (Docker, Kubernetes) and CI/CD deployment automation using GitLab or similar.
Strong problem‑solving, communication, collaboration, and attention‑to‑detail skills.
Desired Skills (Nice to Have)
Databricks, AWS (S3, Glue, Aurora PostgreSQL, Athena), SQL.
Knowledge of Lakehouse architecture and federated query engines such as Starburst or Trino.
Experience with Terraform and infrastructure‑as‑code practices.
Interview Process
Two virtual interviews followed by one on‑site interview.
Interviewers will assess technical expertise, problem‑solving ability, and fit with the team culture.
Citizen requirement: United States citizen only.
Benefits Competitive salary of $100.00 – $105.00 per hour (W2) with a comprehensive benefits package. The role requires 100% on‑site presence, five days a week, with a second‑round on‑site interview.
How to Apply If you are a highly motivated and skilled Data Catalog Developer looking for a challenging and rewarding opportunity, we encourage you to apply for this position.
#J-18808-Ljbffr
$100.00 – $105.00 per hour (W2)
We are seeking a highly skilled and experienced Data Catalog Developer to join our team at Direct Recruit Agency. As a Data Catalog Developer, you will be responsible for designing, developing, and maintaining data catalogs for our clients.
Key Responsibilities
Design and develop data catalogs using Collibra Data Catalog.
Build Collibra workflows and integrate Edge Server with various data sources, authentication, and access controls.
Perform metadata synchronization, lineage harvesting, and metadata synchronization.
Migrate applications from on‑premises locations to cloud service providers.
Develop, modify, and extend code for building cloud infrastructure, automate CI/CD pipelines, and implement best practices for data quality, validation, and governance.
Collaborate with data architects, analysts, and business stakeholders to understand data requirements and make data‑driven decisions.
Qualifications
Bachelor’s degree in Computer Science, Information Systems, or a related field.
Minimum of 3 years of experience as a Data Catalog Developer or in a similar role.
Hands‑on experience building ETL pipelines using Databricks SaaS infrastructure.
Expertise in Collibra Data Management, Data Asset, Data Governance, and BAU support of Collibra Data Catalog.
Edge Server experience and Collibra Ranger certification preferred.
Proficiency in AWS (S3, Glue, Aurora PostgreSQL, Athena), SQL, Python, Scala, and Databricks.
Experience with Container Orchestration services (Docker, Kubernetes) and CI/CD deployment automation using GitLab or similar.
Strong problem‑solving, communication, collaboration, and attention‑to‑detail skills.
Desired Skills (Nice to Have)
Databricks, AWS (S3, Glue, Aurora PostgreSQL, Athena), SQL.
Knowledge of Lakehouse architecture and federated query engines such as Starburst or Trino.
Experience with Terraform and infrastructure‑as‑code practices.
Interview Process
Two virtual interviews followed by one on‑site interview.
Interviewers will assess technical expertise, problem‑solving ability, and fit with the team culture.
Citizen requirement: United States citizen only.
Benefits Competitive salary of $100.00 – $105.00 per hour (W2) with a comprehensive benefits package. The role requires 100% on‑site presence, five days a week, with a second‑round on‑site interview.
How to Apply If you are a highly motivated and skilled Data Catalog Developer looking for a challenging and rewarding opportunity, we encourage you to apply for this position.
#J-18808-Ljbffr