Logo
OKAYA INFOCOM

Foundry Data Engineer / Architect

OKAYA INFOCOM, Oakland, California, United States, 94616

Save Job

We are seeking a Palantir Foundry Data Engineer to design, build, and maintain data pipelines and workflows that power advanced analytics and operational insights for the utility industry. This role focuses on leveraging Palantir Foundry to integrate diverse data sources, ensure data quality, and enable real‑time decision‑making for grid reliability, asset management, and regulatory compliance.

Technical Expertise

Hands‑on experience with Palantir Foundry development and data integration.

Strong proficiency in Python, SQL, and Foundry‑specific frameworks.

Knowledge of utility data systems (SCADA, AMI, GIS, OMS).

Experience

3+ years in data engineering or related roles, preferably in utilities or energy sector.

Familiarity with cloud platforms (AWS, Azure) and containerization (Docker, Kubernetes).

Soft Skills

Strong problem‑solving and analytical skills.

Ability to work in cross‑functional teams and communicate effectively.

Preferred Qualifications

Experience with real‑time data streaming technologies (Kafka, Spark).

Knowledge of grid modernization, DER integration, and renewable forecasting.

Certifications in Palantir Foundry or data engineering.

Build and optimize ETL workflows in Palantir Foundry for ingesting data from SCADA, AMI, GIS, OMS, and ERP systems.

Develop scalable pipelines for real‑time sensor data and IoT streams.

Implement data transformations and enrichment to support analytics and reporting.

Integration & Automation

Integrate structured and unstructured data sources into Foundry.

Automate data ingestion and validation processes to ensure accuracy and timeliness.

Collaborate with IT and OT teams to bridge operational and enterprise data systems.

Data Quality & Governance

Monitor and maintain data integrity across all pipelines.

Apply data governance standards and ensure compliance with NERC CIP, FERC, and state regulations.

Implement robust security and access controls within Foundry.

Work closely with data scientists, analysts, and business teams to deliver reliable datasets for predictive analytics and reporting.

Provide technical support and documentation for Foundry workflows.

Performance Optimization

Optimize workflows for high‑volume, high‑velocity data.

Troubleshoot and resolve pipeline failures and performance bottlenecks.

Architect Responsibilities

Proven experience with Palantir Foundry architecture and development.

Strong understanding of data modeling, ETL processes, and distributed systems.

Proficiency in Python, SQL, and Foundry‑specific frameworks.

5+ years in data architecture or related roles.

Hands‑on experience with cloud platforms (AWS, Azure, GCP) and containerization (Docker, Kubernetes).

Excellent problem‑solving and analytical skills.

Strong communication and stakeholder management abilities.

Experience with data governance frameworks and security best practices.

Familiarity with machine learning workflows and data science integration in Foundry.

Certifications in Palantir Foundry or related technologies.

Architect scalable data platforms in Palantir Foundry to support grid operations, outage management, asset health monitoring, and energy forecasting.

Design workflows and pipelines for real‑time and batch data ingestion from SCADA, AMI, GIS, and ERP systems.

Ensure compliance with NERC, FERC, and state regulatory standards.

Develop custom applications and workflows using Foundry’s APIs and frameworks.

Collaborate with engineering teams to implement best practices for data ingestion and transformation.

Establish data governance standards, access controls, and compliance frameworks.

Ensure adherence to regulatory requirements (GDPR, CCPA, etc.) and internal policies.

Work closely with business analysts, data scientists, and operations teams to translate requirements into technical solutions.

Provide technical guidance and mentorship to junior team members.

Monitor and optimize data pipelines for efficiency and reliability.

Troubleshoot and resolve issues related to data quality, latency, and system performance.

Optimize data pipelines for high‑volume sensor data and IoT streams.

Oakland, CA

Full Time

Contact:

Anmol Rathor

Senior Talent Acquisition Specialist

418 Broadway #7195, Albany, NY 12207

Direct Cell: 631 705 9048

Email: Anmol.r@okayainc.com

LinkedIn: linkedin.com/in/anmol-rathor-21785b1b2

#J-18808-Ljbffr