Logo
FriendliAI

Software Engineer - Developer Tools

FriendliAI, San Francisco

Save Job

Overview

FriendliAI is hiring a Python Engineer to build developer tools for our users and internal engineers. The software developed by the engineer will be the primary way developers integrate with our inference and agent platform. Your work will remove friction for internal teams and external users. You’ll design ergonomic & stable APIs, reliable releases to PyPI, and drive top-tier developer experience across documentation, examples, and tooling. You’ll collaborate with frontend engineers on end-to-end workflows and partner with product & engineering teams.

Responsibilities

  • Own the Python SDK lifecycle. You will design APIs and implement the client side in the SDK.
  • Build and maintain a cross-platform CLI with a modern interface, including helpful error messages and good UX.
  • Manage packaging and distribution pipelines.
  • Develop and maintain internal developer tools related to DevOps.
  • Create examples, templates, and guides that help developers effectively utilize our software bundles.

Qualifications

  • 3+ years of professional Python engineering building libraries, SDKs, or developer tools used in production.
  • Demonstrated SDK/CLI ownership. Familiarity with API ergonomics and versioning, deprecation policies, telemetry, and debugging customer issues.
  • Strong Python fundamentals, including asyncio, typing, packaging, and testing.
  • Web API fluency in REST and gRPC.
  • Experience working with Python monorepos.
  • Clear written communication skills and capable of turning complex features into clean APIs and concise docs.

Preferred Experience

  • Maintainer or significant OSS contributor in Python libraries (tooling, SDK, CLI, etc.).
  • Experience with Python AST and Meta-programming, Packaging
  • Performance work (profiling, streaming, backpressure) or multi-platform build experience.
  • Containers & local dev tooling (Docker); familiarity with Kubernetes basics.
  • Experience with LLM/agent SDKs or inference workflows.
  • A front-row seat to the AI infrastructure revolution.
  • Opportunity to work cross-functionally with top-tier engineers, product leaders, and go-to-market teams.
  • Competitive compensation.
  • Premium hardware and health support benefits.
  • A highly collaborative, fast-moving team where your impact is immediate and visible .

About us

FriendliAI, a San Mateo, CA-based startup, is building the next-generation AI inference platform that accelerates the deployment of large language and multimodal models with unmatched performance and efficiency. Our infrastructure supports high-throughput, low-latency AI workloads for organizations worldwide. We are also integrated with the Hugging Face platform, allowing instant access to over 430,000 open-source models. We are on a mission to deliver the world’s best platform for generative and agentic AI.

#J-18808-Ljbffr