Careers
Careers

job details

Back to jobs search

Jobs search results

3,836 jobs matched
Showing 21 to 40 of 3836 rows
Back to jobs search

Senior Software Engineer, Performance Optimizations for LLM

GoogleSunnyvale, CA, USA; Kirkland, WA, USA
In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include:

Health, dental, vision, life, disability insurance
Retirement Benefits: 401(k) with company match
Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
Sick Time: 40 hours/year (increased to 69 hours/year for Seattle) including 5 discretionary sick days per instance
Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
Baby Bonding Leave: 18 weeks
Holidays: 13 paid days per year
Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Sunnyvale, CA, USA; Kirkland, WA, USA.

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience programming in Python or C++.
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • 3 years of experience with large language model (LLM) concepts, algorithms, and experience designing NLP solutions.
  • 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, and debugging).

Preferred qualifications:

  • Experience with modern deep learning toolkits (e.g., JAX).
  • Experience developing and optimizing LLMs.
  • Experience working on GPUs or TPUs.
  • Experience with latency, memory, compute, and quality tradeoffs as they apply to ML model architectures.
  • Experience with low-level ML model optimization, new architectures, and tools.

About the job

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems. In this role you will be a key engineer contributing towards feature development and performance optimizations for LLM inference on TPUs.The Google Cloud AI Research team addresses AI challenges motivated by Google Cloud’s mission of bringing AI to tech, healthcare, finance, retail and many other industries. We work on a range of unique problems focused on research topics that maximize scientific and real-world impact, aiming to push the state-of-the-art in AI and share findings with the broader research community. We also collaborate with product teams to bring innovations to real-world impact that benefits our customers.

The US base salary range for this full-time position is $174,000-$252,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.

Responsibilities

  • Optimize large-scale models for single- and multi-host inference.
  • Explore optimizations such as quantization and shardings.
  • Add features to process long contexts in large language models (LLMs).
  • Collaborate with the machine learning (ML) research, ML performance, model optimization tooling, and other optimization teams.
  • Maintain the open-sourced vLLM-based inference stack for Tensor Processing Units (TPUs).

Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.

If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.

Google apps
Main menu