Join to apply for the Research Engineer -- Vision role at Zyphra
Join to apply for the Research Engineer -- Vision role at Zyphra
About This Role
You will be a core contributor on Zyphra’s Vision Team building the next generation of vision-language models which can understand natural scenes with a focus on web, desktop, and mobile UIs. You will be deeply involved in the entire model training process from data gathering and processing to designing novel architectures and training methodologies. You will work across:
- Large-scale vision encoder and vision language training runs
- Performance optimization of our training stack
- Image and video dataset collection, processing, and evaluation
- Architecture and training methodology ablations and improvements
You will be a core contributor on Zyphra’s Vision Team building the next generation of vision-language models which can understand natural scenes with a focus on web, desktop, and mobile UIs. You will be deeply involved in the entire model training process from data gathering and processing to designing novel architectures and training methodologies. You will work across:
- Large-scale vision encoder and vision language training runs
- Performance optimization of our training stack
- Image and video dataset collection, processing, and evaluation
- Architecture and training methodology ablations and improvements
Requirements
- Strong research taste and intuition. The ability to work through a research project from conception to execution to write-up.
- Strong implementation and prototyping ability – can take an idea from conception to experimentation extremely quickly.
- The ability to work well and cooperate with others in a high-paced research setting.
- Experience with training and evaluating vision language models
- Experience with creating and collecting large scale machine learning datasets, especially in the visual modality
- Experience with training vision encoders using contrastive learning or other methods
- Experience with supervised finetuning and preference learning methods as well as reinforcement learning methods
- A good intuitive ability to understand model behaviours and correct them through iterative finetuning.
- Interest in grappling in detail with data and spending significant time involved in data engineering and synthetic data generation
- Postgraduate degree in scientific subject (Computer Science, Mathematics, Physics, Machine Learning, etc)
- Previously published machine learning research in well-respected venues
- Highly proficient with Pytorch and Python
- Are excited and able to rapidly learn new fields and implement new ideas
- Excellent communication and collaboration skills and can work effectively on both research and engineering implementation at scale.
- Our research methodology is to make grounded, methodical steps toward ambitious goals. Both deep research and engineering excellence are equally valued
- We strongly value new and crazy ideas and are very willing to bet big on new ideas
- We move as quickly as we can; we aim to make the bar to impact as low as possible
- We all enjoy what we do and love discussing AI
- Medical, dental, vision and FSA plans
- Competitive salary, equity and 401(k)
- Relocation and immigration support on a case-by-case basis
- On-site meals prepared by a dedicated culinary team; Thursday Happy Hours
- Willing to be in-person in our office in Palo Alto
- US authorization to work. We will consider O1 visa sponsorship for the right candidate
Seniority level
Seniority level
Entry level
Employment type
Employment type
Full-time
Job function
Job function
Engineering and Information TechnologyIndustries
Technology, Information and Internet
Referrals increase your chances of interviewing at Zyphra by 2x
Sign in to set job alerts for “Research Engineer” roles.
Mountain View, CA $145,000.00-$170,000.00 2 weeks ago
Mountain View, CA $138,225.00-$207,575.00 2 weeks ago
Software Engineer, AI Platform - New Grad
Mountain View, CA $145,000.00-$170,000.00 2 weeks ago
Mountain View, CA $141,000.00-$202,000.00 1 week ago
Mountain View, CA $141,000.00-$202,000.00 1 week ago
San Jose, CA $100,500.00-$173,250.00 4 days ago
Software Engineer (L4), Content & Business Products
New Grads 2025 - Software Engineer, Algorithm
San Jose, CA $120,000.00-$165,000.00 10 months ago
Palo Alto, CA $96,000.00-$200,000.00 6 hours ago
New Grads 2025 - General Software Engineer
San Jose, CA $120,000.00-$165,000.00 5 months ago
Mountain View, CA $130,000.00-$176,000.00 1 week ago
San Jose, CA $113,400.00-$206,300.00 2 weeks ago
Sunnyvale, CA $167,000.00-$185,500.00 5 days ago
Palo Alto, CA $119,000.00-$179,000.00 2 weeks ago
Alameda, CA $130,000.00-$160,000.00 1 month ago
Software Engineer(s) - New Grad (Fall 2025 Graduation)
UI Software Engineer (L4/L5), Partner Payments Lifecycle Apps
Software Engineer, Research Infrastructure (University Grad)
San Jose, CA $100,500.00-$173,250.00 1 week ago
Software Engineer(s) - New Grad (Fall 2025 Graduation)
Santa Clara, CA $150,000.00-$175,000.00 8 months ago
San Jose, CA $113,400.00-$206,300.00 2 weeks ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr