Logo
Crusoe Energy Systems LLC

Senior+ Software Engineer - Cloud Availability Platform Engineering (Observabili

Crusoe Energy Systems LLC, San Francisco, California, United States, 94199

Save Job

About the Role

We are looking for a highly skilled engineer with deep expertise in building and operating observability platforms at scale. You will design, develop, and run Crusoe’s next-generation observability stack, enabling engineers to understand the internal state of distributed systems through metrics, logs, and traces. Your work will ensure reliability, performance, and actionable insights across Crusoe’s global infrastructure and cloud platform. What You’ll Be Working On

Designing and operating scalable observability systems (metrics, logging, tracing) across multi-datacenter Kubernetes environments

Architecting end-to-end telemetry pipelines, including ingestion, storage, querying, and visualization

Extending monitoring and alerting with Prometheus, Alertmanager, Thanos/Cortex, Grafana, and OpenTelemetry

Building scalable log collection and processing pipelines with Fluent Bit, Vector, Loki, or ELK/Opensearch stacks

Implementing distributed tracing platforms (Tempo, Jaeger, OpenTelemetry) and integrating with service meshes, load balancers, and APIs

Defining and driving adoption of SLOs, SLIs, and error budgets across services and teams

Automating provisioning and scaling of observability infrastructure with Kubernetes, Terraform, and custom tooling (Go, Python)

Ensuring reliability and cost efficiency of telemetry pipelines while supporting high-volume workloads (AI/ML, HPC clusters, GPU infrastructure)

Embedding security best practices into observability platforms, including RBAC, TLS, secret management, and multi-tenant access controls

Partnering with engineering teams to embed observability into applications, services, and infrastructure

Mentoring engineers and shaping Crusoe’s observability strategy and technical roadmap

What You’ll Bring to the Team

7+ years of experience in infrastructure or platform engineering, with a focus on observability and monitoring systems

Deep expertise with metrics systems (Prometheus, Thanos, Mimir, Cortex), logging pipelines (Fluent Bit, Vector, Loki, ELK/Opensearch), and tracing platforms (Jaeger, Tempo, OpenTelemetry)

Strong programming skills in Go or Python for automation, operators, and custom integrations

Experience running observability platforms on Kubernetes and operating them at scale across multi-datacenter environments

Proven ability to design, optimize, and scale telemetry pipelines handling high cardinality and high throughput data

Solid understanding of distributed systems, performance engineering, and debugging complex workloads

Familiarity with service meshes, networking, and workload instrumentation (Envoy, Istio, OpenTelemetry SDKs)

Strong collaboration skills and the ability to influence engineering teams to adopt observability best practices

Bonus Points

Contributions to open source observability projects (Prometheus, OpenTelemetry, Grafana, Loki, etc.)

Experience supporting AI/ML or GPU-heavy environments with high observability demands

Knowledge of event-driven or streaming systems (Kafka, NATS, Pulsar) used in telemetry pipelines

Experience implementing cost optimization strategies for large-scale observability platforms

Background in incident response, chaos engineering, and reliability practices

Benefits

Industry competitive pay

Restricted Stock Units in a fast growing, well-funded technology company

Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents

Employer contributions to HSA accounts

Paid Parental Leave

Paid life insurance, short-term and long-term disability

Teladoc

401(k) with a 100% match up to 4% of salary

Generous paid time off and holiday schedule

Cell phone reimbursement

Tuition reimbursement

Subscription to the Calm app

MetLife Legal

Company paid commuter benefit; $300 per month

Compensation

Compensation will be paid in the range of $166,000 - $201,000 + Bonus. Restricted Stock Units are included in all offers. Compensation to be determined by the applicant’s education, experience, knowledge, skills, and abilities, as well as internal equity and alignment with market data. Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.

#J-18808-Ljbffr