Omni Inclusive
JD:
• Review and validate the **Azure Data Explorer (ADX)** architecture to ensure scalability, resiliency, and performance. Recommend and implement approved changes to cluster sizing, partitioning strategies, and cache policies.
• Ensure integration of data pipelines such as Vector, Event Hubs, Azure Blob, Cribl, NiFI ensuring high throughput and fault tolerance.
• Develop and maintain "Kusto Query Language (KQL)" functions, materialized views, and time-series optimizations to support advanced querying and SIEM use cases.
• Ensure all data ingestion flows are monitored end-to-end, with alerting and logging for failures, latency issues, or schema mismatches.
• Build and maintain data quality monitoring dashboards to identify missing, delayed, malformed, or duplicate events, and proactively address anomalies.
• Implement and document data normalization practices, including alignment with schema standards like OCSF when applicable.
• Configure and maintain role-based access control (RBAC) and ensure compliance with corporate data governance and security standards.
• Provide cost visibility and optimization strategies, including usage tracking, retention tuning, and query performance analysis.