LanceDB
Join to apply for the
AI Infrastructure Engineer
role at
LanceDB 2 days ago Be among the first 25 applicants Join to apply for the
AI Infrastructure Engineer
role at
LanceDB Get AI-powered advice on this job and more exclusive features. About LanceDB
LanceDB is a developer-friendly, open-source data lake for multimodal AI. From hyper-scalable vector search to advanced retrieval for RAG, from streaming training data to interactive exploration of large-scale AI datasets, LanceDB is the best foundation for your AI application, and powers some of the most groundbreaking applications and challenging requirements today. About LanceDB
LanceDB is a developer-friendly, open-source data lake for multimodal AI. From hyper-scalable vector search to advanced retrieval for RAG, from streaming training data to interactive exploration of large-scale AI datasets, LanceDB is the best foundation for your AI application, and powers some of the most groundbreaking applications and challenging requirements today.
About The Role
We are seeking an engineer who brings both hands-on model training, model fine-tuning, feature engineering expertise and a strong background in data/AI/ML infrastructure to join our world-class team, pushing the frontiers of multimodal data infrastructure.
Your Responsibilities Will Include
Resident expert on AI engineering bringing familiarity with frameworks such as PyTorch or JAX. Experienced with compute systems such as Kubernetes, Ray, or Spark to support distributed training and inference workloads. Champion a superior Developer Experience, maximizing productivity for AI engineers. Drive the end-to-end design and development of a high-performance and large-scale feature engineering infrastructure for leading multimodal AI companies. Collaborate closely with the customers, design partners, and the Lance/LanceDB community
Requirements
You like working with a small, high-caliber team with a lot of autonomy and drive, and you can iterate fast. You have 3+ years of experience building and deploying ML/DL models in production environments or supporting infrastructure for AI researchers and AI engineers performing these tasks, using Python and libraries such as PyTorch or Tensorflow. You have a proven ability to deliver projects end-to-end, from scoping and resourcing to implementation and delivery. You have experience with large scale data processing systems such as Spark, Flink, Ray, KubeFlow or Dataflow. You have a working knowledge of cloud platforms (AWS, GCP, Azure) including managed storage (S3, GCS) and compute (EC2, GKE, AKS). You have knowledge of monitoring/logging stacks (Prometheus, Grafana, ELK/EFK) for alerting on data pipeline failures, resource saturation, or model skew.
It would be even better if you are someone who:
Has a deep understanding of training architecture, from PyTorch or Jax experience to CUDA kernel fusion or TPU programming. Has experience designing or operating a feature store (e.g., Feast, Tecton) or building a custom feature registry. Has understand Docker layered file system, K8s scheduling algorithms, orchestration services. Loves python wizardry or Rust Has experience directly working with external customers Has built sophisticated monitoring and observability features Has hands on knowledge of Kubernetes, Terraform, Docker, CI/CD. Or experience operating Kubernetes services in production environments. Is familiar with one of Apache Spark, Apache Flink, Delta Lake, Ray, Google Dataflow, Kafka, Airflow, Kubeflow or other similar systems.
About The LanceDB Team
LanceDB was created by experts with decades of experience building tools for data science and machine learning. From co-authors of pandas to Apache PMC of HDFS, Arrow, Iceberg and HBase, the LanceDB team has created open source tools used by millions world-wide.
Compensation & Benefits
LanceDB is committed to equitable and competitive compensation. Actual compensation is determined based on factors such as skills, experience, location, and the interview process.
In addition to base salary, new hires receive compelling equity grants and access to a comprehensive benefits package including:
Medical, dental, vision, and life insurance 401(k) retirement plan Flexible Spending Accounts (FSA) and Health Savings Accounts (HSA) Commuter benefits Generous paid time off
Join us to build the AI infrastructure the future depends on. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Information Technology Industries Information Services Referrals increase your chances of interviewing at LanceDB by 2x Sign in to set job alerts for “Infrastructure Engineer” roles.
San Francisco, CA $180,000.00-$250,000.00 5 days ago San Francisco, CA $150.00-$175.00 5 months ago San Francisco, CA $150,000.00-$250,000.00 1 year ago San Francisco, CA $135,000.00-$185,000.00 3 weeks ago San Francisco, CA $175,000.00-$250,000.00 4 weeks ago San Francisco, CA $150,000.00-$250,000.00 6 months ago Hayward, CA $100,000.00-$150,000.00 6 months ago San Francisco, CA $100,949.33-$137,002.66 6 days ago San Francisco, CA $110,000.00-$170,000.00 2 months ago San Francisco, CA $180,000.00-$250,000.00 1 month ago San Francisco, CA $140,000.00-$300,000.00 3 weeks ago San Francisco, CA $150,000.00-$249,998.00 1 year ago San Francisco, CA $187,000.00-$227,000.00 1 month ago San Francisco, CA $107,600.00-$134,500.00 4 days ago San Francisco, CA $184,000.00-$229,000.00 2 weeks ago San Francisco, CA $100,000.00-$220,000.00 2 months ago Infrastructure Engineer - eero, eero Foundations - Cloud Systems and Infrastructure
San Francisco, CA $116,300.00-$201,200.00 4 hours ago Infrastructure Engineer (All levels Entry through Senior)
Walnut Creek, CA $60,000.00-$190,000.00 2 days ago San Francisco, CA $116,300.00-$201,200.00 2 weeks ago San Francisco, CA $180,000.00-$240,000.00 9 months ago San Francisco, CA $270,000.00-$310,000.00 2 weeks ago San Francisco, CA $99,008.00-$134,368.00 6 days ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
AI Infrastructure Engineer
role at
LanceDB 2 days ago Be among the first 25 applicants Join to apply for the
AI Infrastructure Engineer
role at
LanceDB Get AI-powered advice on this job and more exclusive features. About LanceDB
LanceDB is a developer-friendly, open-source data lake for multimodal AI. From hyper-scalable vector search to advanced retrieval for RAG, from streaming training data to interactive exploration of large-scale AI datasets, LanceDB is the best foundation for your AI application, and powers some of the most groundbreaking applications and challenging requirements today. About LanceDB
LanceDB is a developer-friendly, open-source data lake for multimodal AI. From hyper-scalable vector search to advanced retrieval for RAG, from streaming training data to interactive exploration of large-scale AI datasets, LanceDB is the best foundation for your AI application, and powers some of the most groundbreaking applications and challenging requirements today.
About The Role
We are seeking an engineer who brings both hands-on model training, model fine-tuning, feature engineering expertise and a strong background in data/AI/ML infrastructure to join our world-class team, pushing the frontiers of multimodal data infrastructure.
Your Responsibilities Will Include
Resident expert on AI engineering bringing familiarity with frameworks such as PyTorch or JAX. Experienced with compute systems such as Kubernetes, Ray, or Spark to support distributed training and inference workloads. Champion a superior Developer Experience, maximizing productivity for AI engineers. Drive the end-to-end design and development of a high-performance and large-scale feature engineering infrastructure for leading multimodal AI companies. Collaborate closely with the customers, design partners, and the Lance/LanceDB community
Requirements
You like working with a small, high-caliber team with a lot of autonomy and drive, and you can iterate fast. You have 3+ years of experience building and deploying ML/DL models in production environments or supporting infrastructure for AI researchers and AI engineers performing these tasks, using Python and libraries such as PyTorch or Tensorflow. You have a proven ability to deliver projects end-to-end, from scoping and resourcing to implementation and delivery. You have experience with large scale data processing systems such as Spark, Flink, Ray, KubeFlow or Dataflow. You have a working knowledge of cloud platforms (AWS, GCP, Azure) including managed storage (S3, GCS) and compute (EC2, GKE, AKS). You have knowledge of monitoring/logging stacks (Prometheus, Grafana, ELK/EFK) for alerting on data pipeline failures, resource saturation, or model skew.
It would be even better if you are someone who:
Has a deep understanding of training architecture, from PyTorch or Jax experience to CUDA kernel fusion or TPU programming. Has experience designing or operating a feature store (e.g., Feast, Tecton) or building a custom feature registry. Has understand Docker layered file system, K8s scheduling algorithms, orchestration services. Loves python wizardry or Rust Has experience directly working with external customers Has built sophisticated monitoring and observability features Has hands on knowledge of Kubernetes, Terraform, Docker, CI/CD. Or experience operating Kubernetes services in production environments. Is familiar with one of Apache Spark, Apache Flink, Delta Lake, Ray, Google Dataflow, Kafka, Airflow, Kubeflow or other similar systems.
About The LanceDB Team
LanceDB was created by experts with decades of experience building tools for data science and machine learning. From co-authors of pandas to Apache PMC of HDFS, Arrow, Iceberg and HBase, the LanceDB team has created open source tools used by millions world-wide.
Compensation & Benefits
LanceDB is committed to equitable and competitive compensation. Actual compensation is determined based on factors such as skills, experience, location, and the interview process.
In addition to base salary, new hires receive compelling equity grants and access to a comprehensive benefits package including:
Medical, dental, vision, and life insurance 401(k) retirement plan Flexible Spending Accounts (FSA) and Health Savings Accounts (HSA) Commuter benefits Generous paid time off
Join us to build the AI infrastructure the future depends on. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Information Technology Industries Information Services Referrals increase your chances of interviewing at LanceDB by 2x Sign in to set job alerts for “Infrastructure Engineer” roles.
San Francisco, CA $180,000.00-$250,000.00 5 days ago San Francisco, CA $150.00-$175.00 5 months ago San Francisco, CA $150,000.00-$250,000.00 1 year ago San Francisco, CA $135,000.00-$185,000.00 3 weeks ago San Francisco, CA $175,000.00-$250,000.00 4 weeks ago San Francisco, CA $150,000.00-$250,000.00 6 months ago Hayward, CA $100,000.00-$150,000.00 6 months ago San Francisco, CA $100,949.33-$137,002.66 6 days ago San Francisco, CA $110,000.00-$170,000.00 2 months ago San Francisco, CA $180,000.00-$250,000.00 1 month ago San Francisco, CA $140,000.00-$300,000.00 3 weeks ago San Francisco, CA $150,000.00-$249,998.00 1 year ago San Francisco, CA $187,000.00-$227,000.00 1 month ago San Francisco, CA $107,600.00-$134,500.00 4 days ago San Francisco, CA $184,000.00-$229,000.00 2 weeks ago San Francisco, CA $100,000.00-$220,000.00 2 months ago Infrastructure Engineer - eero, eero Foundations - Cloud Systems and Infrastructure
San Francisco, CA $116,300.00-$201,200.00 4 hours ago Infrastructure Engineer (All levels Entry through Senior)
Walnut Creek, CA $60,000.00-$190,000.00 2 days ago San Francisco, CA $116,300.00-$201,200.00 2 weeks ago San Francisco, CA $180,000.00-$240,000.00 9 months ago San Francisco, CA $270,000.00-$310,000.00 2 weeks ago San Francisco, CA $99,008.00-$134,368.00 6 days ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr