Bloomberg
Senior LLM Infrastructure Engineer - Artificial Intelligence
Bloomberg, New York, New York, us, 10261
Join to apply for the
Senior LLM Infrastructure Engineer - Artificial Intelligence
role at
Bloomberg 14 hours ago Be among the first 25 applicants Join to apply for the
Senior LLM Infrastructure Engineer - Artificial Intelligence
role at
Bloomberg Get AI-powered advice on this job and more exclusive features. This range is provided by Bloomberg. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range
$165,000.00/yr - $260,000.00/yr Location
New York
Business Area
Engineering and CTO
Ref #
10043279
Description & Requirements
Bloomberg’s Engineering AI department has 300+ AI practitioners building highly sought after products and features that often require novel innovations. We are investing in AI to build better search, discovery, and workflow solutions using technologies such as transformers, gradient boosted decision trees, large language models, and dense vector databases. We are expanding our group and seeking highly skilled individuals who will be responsible for contributing to the team (or teams) of Machine Learning (ML) and Software Engineers that are bringing innovative solutions to AI-driven customer-facing products.
At Bloomberg, we believe in fostering a transparent and efficient financial marketplace. Our business is built on technology that makes news, research, financial data, and analytics on over 35 million financial instruments searchable, discoverable, and actionable across the global capital markets.
Bloomberg has been building Artificial Intelligence applications that offer solutions to these problems with high accuracy and low latency since 2009. We build AI systems to help process and organize the ever-increasing volume of structured and unstructured information needed to make informed decisions. Our use of AI uncovers signals, helps us produce analytics about financial instruments in all asset classes, and delivers clarity when our clients need it most.
The Advent Of Large Language Models (LLMs) Presents New Opportunities For Expanding Our NLP Capabilities In Our Products. As a Senior LLM Engineer In The AI Department, You Will Have The Opportunity To Make Key Technical Decisions Which Help Define The Future Of Infrastructure For LLM Training And Inference At Bloomberg! Join The AI Department As a Senior LLM Engineer And You Will Have The Opportunity To
Build production LLM systems to power business functions in the Bloomberg Terminal Optimize and support LLM workloads in on-prem HPC and cloud environments Contribute to internal initiatives related to LLM research and development Work with specialized hardware for tensor computations
You'll Need To Have
4+ years of programming experience with an object-oriented programming language A degree in Computer Science, Engineering or similar field of study or equivalent work experience Experience in designing, developing, and supporting ML applications Understanding of ML model architectures, specifically, transformers, and underlying computations Experience in profiling, benchmarking and optimizing ML applications
We’d Love To See
Deep working proficiency in Python Experience in using HPC compute platforms and understanding anatomy of distributed computations Proficiency with various ML accelerators (NVIDIA GPUs, TPUs, other vendor ASICs) and building efficient workloads for them Solid understanding of networking (Infiniband, AWS EFA, RoCE) Experience managing infrastructure in Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP).
We give back to the technology community and you can read more about our outreach at:
Salary Range = 165000 - 260000 USD Annually + Benefits + Bonus
The referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level.
We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation (exempt roles only), paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Information Technology Referrals increase your chances of interviewing at Bloomberg by 2x Sign in to set job alerts for “Senior Infrastructure Engineer” roles.
New York, NY $206,195.00-$309,235.00 2 days ago IT Infrastructure Architect M365 (Remote)
Parsippany, NJ $84,400.00-$121,799.00 4 days ago New York City Metropolitan Area 5 days ago New York City Metropolitan Area $90,000.00-$105,000.00 4 days ago New York, NY $120,300.00-$161,300.00 2 weeks ago Manhattan, NY $90,000.00-$110,000.00 4 days ago IT Systems Administrator - MSP Experience Required
New York City Metropolitan Area $75,000.00-$85,000.00 1 week ago Manhattan, NY $75,000.00-$79,000.00 1 week ago New York, NY $75,000.00-$85,000.00 3 weeks ago New York, NY $80,000.00-$100,000.00 1 month ago Systems Engineer (Linux/Virtualization) - Hybrid
New York City Metropolitan Area 2 days ago New York City Metropolitan Area $100,000.00-$110,000.00 3 days ago Jersey City, NJ $110,000.00-$145,000.00 2 weeks ago New York, NY $115,000.00-$125,000.00 1 week ago New York, NY $47,000.00-$52,000.00 4 days ago Manhattan, NY $70,000.00-$80,000.00 1 week ago Digital Data Systems and Applications Sr. Manager, Engineering
East Hanover, NJ $114,900.00-$211,900.00 1 day ago Edison, NJ $70,000.00-$130,000.00 1 week ago New York, NY $120,000.00-$150,000.00 2 weeks ago Woodbridge, NJ $82,200.00-$117,400.00 2 months ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Senior LLM Infrastructure Engineer - Artificial Intelligence
role at
Bloomberg 14 hours ago Be among the first 25 applicants Join to apply for the
Senior LLM Infrastructure Engineer - Artificial Intelligence
role at
Bloomberg Get AI-powered advice on this job and more exclusive features. This range is provided by Bloomberg. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range
$165,000.00/yr - $260,000.00/yr Location
New York
Business Area
Engineering and CTO
Ref #
10043279
Description & Requirements
Bloomberg’s Engineering AI department has 300+ AI practitioners building highly sought after products and features that often require novel innovations. We are investing in AI to build better search, discovery, and workflow solutions using technologies such as transformers, gradient boosted decision trees, large language models, and dense vector databases. We are expanding our group and seeking highly skilled individuals who will be responsible for contributing to the team (or teams) of Machine Learning (ML) and Software Engineers that are bringing innovative solutions to AI-driven customer-facing products.
At Bloomberg, we believe in fostering a transparent and efficient financial marketplace. Our business is built on technology that makes news, research, financial data, and analytics on over 35 million financial instruments searchable, discoverable, and actionable across the global capital markets.
Bloomberg has been building Artificial Intelligence applications that offer solutions to these problems with high accuracy and low latency since 2009. We build AI systems to help process and organize the ever-increasing volume of structured and unstructured information needed to make informed decisions. Our use of AI uncovers signals, helps us produce analytics about financial instruments in all asset classes, and delivers clarity when our clients need it most.
The Advent Of Large Language Models (LLMs) Presents New Opportunities For Expanding Our NLP Capabilities In Our Products. As a Senior LLM Engineer In The AI Department, You Will Have The Opportunity To Make Key Technical Decisions Which Help Define The Future Of Infrastructure For LLM Training And Inference At Bloomberg! Join The AI Department As a Senior LLM Engineer And You Will Have The Opportunity To
Build production LLM systems to power business functions in the Bloomberg Terminal Optimize and support LLM workloads in on-prem HPC and cloud environments Contribute to internal initiatives related to LLM research and development Work with specialized hardware for tensor computations
You'll Need To Have
4+ years of programming experience with an object-oriented programming language A degree in Computer Science, Engineering or similar field of study or equivalent work experience Experience in designing, developing, and supporting ML applications Understanding of ML model architectures, specifically, transformers, and underlying computations Experience in profiling, benchmarking and optimizing ML applications
We’d Love To See
Deep working proficiency in Python Experience in using HPC compute platforms and understanding anatomy of distributed computations Proficiency with various ML accelerators (NVIDIA GPUs, TPUs, other vendor ASICs) and building efficient workloads for them Solid understanding of networking (Infiniband, AWS EFA, RoCE) Experience managing infrastructure in Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP).
We give back to the technology community and you can read more about our outreach at:
Salary Range = 165000 - 260000 USD Annually + Benefits + Bonus
The referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level.
We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation (exempt roles only), paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Information Technology Referrals increase your chances of interviewing at Bloomberg by 2x Sign in to set job alerts for “Senior Infrastructure Engineer” roles.
New York, NY $206,195.00-$309,235.00 2 days ago IT Infrastructure Architect M365 (Remote)
Parsippany, NJ $84,400.00-$121,799.00 4 days ago New York City Metropolitan Area 5 days ago New York City Metropolitan Area $90,000.00-$105,000.00 4 days ago New York, NY $120,300.00-$161,300.00 2 weeks ago Manhattan, NY $90,000.00-$110,000.00 4 days ago IT Systems Administrator - MSP Experience Required
New York City Metropolitan Area $75,000.00-$85,000.00 1 week ago Manhattan, NY $75,000.00-$79,000.00 1 week ago New York, NY $75,000.00-$85,000.00 3 weeks ago New York, NY $80,000.00-$100,000.00 1 month ago Systems Engineer (Linux/Virtualization) - Hybrid
New York City Metropolitan Area 2 days ago New York City Metropolitan Area $100,000.00-$110,000.00 3 days ago Jersey City, NJ $110,000.00-$145,000.00 2 weeks ago New York, NY $115,000.00-$125,000.00 1 week ago New York, NY $47,000.00-$52,000.00 4 days ago Manhattan, NY $70,000.00-$80,000.00 1 week ago Digital Data Systems and Applications Sr. Manager, Engineering
East Hanover, NJ $114,900.00-$211,900.00 1 day ago Edison, NJ $70,000.00-$130,000.00 1 week ago New York, NY $120,000.00-$150,000.00 2 weeks ago Woodbridge, NJ $82,200.00-$117,400.00 2 months ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr