Senior Software Engineer, ML Focus

Please Note: We are not accepting outreach from external recruiters or agencies for this role. About North The public cloud is home to $200B+ in annual technology spend, yet 95% of it is still managed with credit cards and spreadsheets. With AI accelerating cloud growth toward $1T by 2030, businesses need better tools to manage, optimize, and scale their cloud investments. At North, were building the next-generation cloud spend management platformgiving companies clarity, control, and automation over their cloud finances. Our mission is to help organizations take charge of their cloud costs and maximize efficiency in the AI-driven era. Backed by top-tier investors and trusted by leading customers like Brave, StayNTouch, and DataBiologics, were assembling a world-class team to redefine how businesses manage cloud spend. If youre looking for impact, growth, and the opportunity to shape the future of cloud finance, North is the place to be. About the Role Were looking for a Senior Software Engineer with strong ML experience to join our core team. This is a high-impact, hands-on role where you'll build both traditional software systems and ML-powered features that drive real customer value. Youll work directly with our CTO to shape product architecture, deploy intelligent automation across the stack, and bring features like Agent North, our customer-facing AI assistant, to life. This role is perfect for engineers whove shipped production systems (ML and non-ML), enjoy operating across the stack, and thrive in the fast, scrappy pace of an early-stage startup. Youll touch everything from infrastructure and APIs to model tuning and deployment. What Youll Do Design, build, and deploy systemssome ML-powered, some notthat help customers automate and optimize cloud usage Integrate and fine-tune large language models (LLMs) for use in product features like AI assistants, forecasting, and anomaly detection Own projects end-to-end: architecture decisions, implementation, deployment, and monitoring Contribute across the stack, from backend services to data pipelines and ML infrastructure Collaborate with product, design, and engineering to build features that customers love and actually use Help build and maintain secure, reliable infrastructure across GCP, AWS, and Azure Experiment with cutting-edge techniques in ML deployment, prompt engineering, and model monitoring Influence the direction of our engineering culture, tools, and team practices What Were Looking For 5+ years of hands-on software engineering experience, ideally spanning application logic, infrastructure, and data/ML systems Solid experience deploying production ML systems (bonus if youve worked with LLMs, PyTorch, Hugging Face, or LangChain) Strong Python skills; bonus points for familiarity with Go and SQL Experience deploying and scaling software on cloud platforms (AWS, GCP, Azure) Comfort working in Terraform and Git for infrastructure and version control A build-first mindsetyou enjoy solving problems through code and arent afraid to learn new tools Clear communicator who can explain technical ideas to peers, leadership, and sometimes customers Proactive, thoughtful, and excited to wear multiple hats in a startup environment Nice to Have Experience in a startup or fast-paced environment Prior experience working with cloud cost data, FinOps, or infra tooling Familiarity with Amazon Bedrock, Llama, or vertex databases Background in AI security, prompt engineering, or fine-tuning AWS or cloud certification Youve built AI or automation tools that solved real user pain points Work Setup This is a hybrid role based in New York City. Our office is in the West Village, and we typically spend part of the week in-office and part remote. Benefits Unlimited PTO Office access in West Village 16-week fully paid parental leave (mothers can extend to 20 weeks at 50% pay) Company-wide breaks: Last week of August and Dec 23Jan 3 Healthcare: Anthem BlueCross Gold PPO, 75% employer-covered 30-day sabbatical every 4 years Ramp card for approved expenses Compensation Base salary range: $160,000$220,000, depending on experience and location. Join Us If youre a senior engineer who loves building intelligent systems, thrives on ownership, and wants to help shape the future of cloud financewed love to meet you. #J-18808-Ljbffr