Largeton Group
Collibra Data Lineage Automation Engineer
Job Summary – Collibra Data Lineage Automation Engineer McLean, VA Lead the design and implementation of automated, end-to-end data lineage solutions across a diverse enterprise data environment. Deliver and maintain lineage frameworks (Spline, OpenLineage, Marquez, or similar) for hybrid (cloud and legacy) data architectures. Capture, trace, and map metadata, ETL processes, and query executions to ensure comprehensive data traceability. Apply AI/ML techniques—such as metadata intelligence, NLP for code parsing, and pattern detection—to enhance lineage automation and coverage. Integrate automated lineage solutions with data governance platforms (e.g., Collibra, Alation). Develop custom connectors, extractors, or agents to enable lineage capture across various data systems (cloud, relational, NoSQL, BI/reporting tools). Extend and publish lineage metadata in consumable formats for governance and analytics teams. Develop reusable lineage components and promote automation-first processes and design patterns. Advise and collaborate with architects and governance leaders on best practices for lineage standardization, storage, and operational reuse. Support regulated environments and enterprise-scale data ecosystems with advanced data lineage and metadata management solutions. Seniority level
Entry level Employment type
Contract Job function
Engineering and Information Technology Information Services
#J-18808-Ljbffr
Job Summary – Collibra Data Lineage Automation Engineer McLean, VA Lead the design and implementation of automated, end-to-end data lineage solutions across a diverse enterprise data environment. Deliver and maintain lineage frameworks (Spline, OpenLineage, Marquez, or similar) for hybrid (cloud and legacy) data architectures. Capture, trace, and map metadata, ETL processes, and query executions to ensure comprehensive data traceability. Apply AI/ML techniques—such as metadata intelligence, NLP for code parsing, and pattern detection—to enhance lineage automation and coverage. Integrate automated lineage solutions with data governance platforms (e.g., Collibra, Alation). Develop custom connectors, extractors, or agents to enable lineage capture across various data systems (cloud, relational, NoSQL, BI/reporting tools). Extend and publish lineage metadata in consumable formats for governance and analytics teams. Develop reusable lineage components and promote automation-first processes and design patterns. Advise and collaborate with architects and governance leaders on best practices for lineage standardization, storage, and operational reuse. Support regulated environments and enterprise-scale data ecosystems with advanced data lineage and metadata management solutions. Seniority level
Entry level Employment type
Contract Job function
Engineering and Information Technology Information Services
#J-18808-Ljbffr