Logo
Jobs via Dice

Principal Big Data Engineer

Jobs via Dice, Durham, North Carolina, United States, 27703

Save Job

Principal Big Data Engineer Location: Durham, NC (Onsite). Contract: 12+ months with potential for long‑term. Pay: $63 – $73 per hour. Benefits: health insurance, 401(k), paid sick leave (depending on location).

Key Responsibilities

We are seeking a highly motivated Data Engineer to join the Data Aggregation team.

Data Aggregation is a growing area and we are looking for a skilled engineer to drive design and development of industry‑leading external‑facing API solutions.

The comprehensive API / data solutions will bring together retail, clearing and custody capabilities to help external fintech partners with financial goal planning, investment advice and financial projections to better serve our clients and efficiently partner with them to accomplish their financial objectives.

Key Requirements and Technology Experience

Bachelor's or Master's Degree in a technology‑related field (e.g., Engineering, Computer Science, etc.) required with 10 years of working experience.

Big Data Processing: Apache Spark (EMR), Scala, distributed computing, performance optimization.

Cloud & Infrastructure: AWS (S3, EMR, EC2, Lambda, Step Functions), multi‑region DR strategy.

Databases: Cassandra/YugaByte (NoSQL), Oracle, PostgreSQL.

Snowflake Data Pipeline: ETL design, API integration, batch processing.

DevOps & CI/CD: Jenkins, Docker, Kubernetes, Terraform, Git.

Monitoring & Observability: Splunk, Datadog APM, Grafana, CloudWatch.

Orchestration: Control‑M job scheduling, workflow automation.

Financial domain experience.

Seniority level Mid‑Senior level

Employment type Full‑time

Job function Engineering and Information Technology

Industries Software Development

EEO Statement Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Contact By applying to our jobs you agree to receive calls, AI‑generated calls, text messages or emails from Pyramid Consulting, Inc. and its affiliates and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy.

#J-18808-Ljbffr