Logo
Spectraforce Technologies

Data Engineer

Spectraforce Technologies, North Chicago, Illinois, us, 60086

Save Job

Title:

Data Engineer

Duration: 3 Months

Location: Chicago, IL (Remote)

About the Project

We're launching a focused 3-month initiative to: Bulk-ingest over 50,000 supplier contracts into SAP Ariba, with metadata extraction powered by OCR. Design and implement the database architecture and data flows that will feed our Negotiation AI-including contract detail extraction and supplier spend analytics.

This work currently runs separately from the Negotiation AI MVP, but must be future-ready for seamless integration.

Role Overview

As our Data Engineer, you will own the end-to-end data pipelines. This includes designing scalable databases, developing ingestion workflows, collaborating with our internal Machine Learning Engineering team, and structuring supplier spend data. You'll work closely with the Full Stack Developer to co-design the database schema for the Negotiation AI and ensure future compatibility with the ingestion pipeline.

Key Deliverables Ingestion Pipeline : Build and deploy a robust ETL/ELT pipeline using Azure to ingest 50,000+ contracts. Metadata Extraction : Configure and run OCR workflows (e.g., OlmOCR/Azure Document Intelligence) to extract key contract fields such as dates, parties, terms etc. Scalable Database Schema : Design and implement a schema in Azure PostgreSQL to store contract metadata, OCR outputs, and supplier spend data. Collaborate with the Software Developer to design a future-ready schema for AI consumption.

Required Skills & Experience

Data Engineering & ETL/ELT

Experience with Azure PostgreSQL or similar relational databases Skilled in building scalable ETL/ELT pipelines (preferably using Azure) Proficient in Python for scripting and automation

OCR Collaboration

Ability to work with internal Machine Learning Engineering teams to validate and structure extracted data Familiarity with OCR tools (e.g., Azure Document Intelligence, Tesseract) is a plus

SAP Ariba Integration

Exposure to cXML, ARBCI, SOAP/REST protocols is a plus

Comfortable with API authentication (OAuth, tokens) and enterprise-grade security

Agile Collaboration & Documentation

Comfortable working in sprints and cross-functional teams Able to use Github Copilot to document practices for handover

Preferred Qualifications

Experience with large-scale contract ingestion projects Familiarity with procurement systems and contract lifecycle management Background in integrating data pipelines with AI or analytics platforms