This range is provided by The Cypress Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $160,000.00/yr - $220,000.00/yr Direct message the job poster from The Cypress Group Technical Recruiter at The Cypress Group My Client is a fast-moving startup based in NYC building cutting-edge AI-powered solutions to solve real-world problems in the building industry. Our mission is to harness the latest advances in large language models (LLMs) to build intuitive, human-centric tools. We believe small teams can make a big impact—and we’re looking for people who thrive in dynamic, high-ownership environments. Role Overview We’re seeking a Machine Learning Engineer with a strong focus on prompt engineering to help us develop, fine-tune, and deploy LLM-driven applications. You’ll work closely with our product, engineering, and design teams to iterate quickly on new features, prototypes, and research-backed implementations that bring language models to life in production. What You’ll Do Design, test, and optimize prompts for large language models (e.g., GPT-4, Claude, Gemini) across a range of tasks. Fine-tune open-source or proprietary language models using instruction tuning, RLHF, or LoRA-based approaches. Develop robust evaluation pipelines to assess model performance, safety, and reliability. Collaborate with product and UX teams to integrate LLM functionality into real-world user flows. Research and experiment with new prompting techniques (e.g., chain-of-thought, self-reflection, retrieval-augmented generation). Write reusable components and tools to streamline LLM integration and testing. Monitor model behavior in production and iterate on prompts/models based on user feedback and performance data. What We’re Looking For 2–5+ years of experience in machine learning, NLP, or applied AI. Experience working with large language models (OpenAI, Anthropic, Hugging Face, Cohere, etc.). Strong Python skills and familiarity with ML frameworks like PyTorch or TensorFlow. Deep understanding of prompt engineering techniques and LLM behavior. Experience with tools for LLMOps (e.g., LangChain, Weights & Biases, MLflow, etc.) is a plus. Ability to balance research exploration with practical product needs. Excellent communication skills and a collaborative, startup-minded attitude. Nice to Have Experience with vector databases (e.g., Pinecone, Weaviate, FAISS). Familiarity with API-based LLM deployments and serverless infrastructure. Published research or blog posts in the NLP/LLM space. Previous startup experience or working on small, agile teams. What We Offer Competitive salary and early-stage equity Flexible hybrid schedule with a beautiful workspace in NYC Opportunity to work on cutting-edge AI applications with real user impact A small, ambitious, and collaborative team Generous vacation, healthcare, and wellness benefits Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Job function Information Technology Industries Software Development Referrals increase your chances of interviewing at The Cypress Group by 2x Inferred from the description for this job Medical insurance 401(k) Get notified about new Machine Learning Engineer jobs in New York, NY . Brooklyn, NY $119,000.00-$155,000.00 3 days ago New York, NY $120,700.00-$228,600.00 3 days ago Software Engineer, Machine Learning (Multiple Levels) - Slack New York, NY $167,300.00-$334,600.00 2 days ago New York, NY $120,000.00-$180,000.00 1 week ago New York, NY $100,000.00-$250,000.00 1 month ago New York, NY $93,144.00-$133,063.00 4 days ago New York, NY $181,875.00-$200,645.00 1 week ago New York, NY $180,000.00-$290,000.00 3 months ago New York, NY $150,000.00-$260,000.00 4 months ago Machine Learning Engineer, Personalization New York, NY $136,878.00-$195,540.00 1 week ago New York, NY $160,000.00-$280,000.00 1 year ago New York, NY $141,000.00-$202,000.00 4 days ago New York, NY $150,000.00-$220,000.00 4 weeks ago New York, NY $112,664.00-$160,948.00 1 week ago New York, NY $220,000.00-$260,000.00 1 week ago New York, NY $128,000.00-$240,000.00 4 days ago New York, NY $187,000.00-$270,000.00 1 month ago New York, NY $70,000.00-$100,000.00 1 week ago New York, NY $138,250.00-$197,500.00 1 week ago New York, NY $150,000.00-$200,000.00 2 months ago New York, NY $150,000.00-$210,000.00 1 month ago New York, NY $167,000.00-$185,500.00 5 days ago Machine Learning Engineer, GenRecs, Personalization New York, NY $138,250.00-$197,500.00 1 week ago New York, NY $138,250.00-$197,500.00 4 days ago New York, NY $180,000.00-$240,000.00 3 months ago New York, NY $110,000.00-$250,000.00 3 months ago New York, NY $175,000.00-$250,000.00 3 weeks ago New York, NY $100,000.00-$300,000.00 2 weeks ago New York, NY $164,000.00-$198,000.00 6 days ago New York, NY $180,000.00-$280,000.00 7 months ago New York, NY $185,000.00-$195,000.00 1 month ago New York, NY $130,000.00-$180,000.00 6 months ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr
The Cypress Group