Summer 2024 Research Co-Op/ Intern: PhD Tech

Advanced Micro Devices (AMD)

Feb 8

Applications are closed

Internship
Full-time
Starts on May 19
Summer Internship
Research & Development
Data
$91.5K - $137.3K
Seattle

Requirements

Experience developing and debugging in Python
Experience in ML frameworks such as PyTorch, JAX, TensorFlow
Experience with distributed training
Solid understanding of transformer architecture
Experience on LLMs/LMMs finetuning, distillation, and/or RLHF
Research experience and publications in ML, NLP, Vision and Language, or related fields
WHAT WOULD SET YOU APART:
Expertise on LLM/LMM pretraining
Expertise on distributed training frameworks
Strong publication record
WHO WE’RE LOOKING FOR:
We are looking for students who are passionate about generative AI and enjoying the design and implementation of novel research ideas to improve the quality of LLMs/LMMs and other generative models, accelerate the training and inference speed, and influence future hardware and software directions.The ideal candidate will have expertise and hands-on experience on training LLMs/LMMs, familiar with hyper-parameter tuning, data processing, and latest training techniques for LLMs/LMMs. A PhD or MS degree in ML, NLP, Vision, or related fields is preferred.

Responsibilities

You will work with world renowned scientists and engineers to advance the state of the art on large language models (LLMs), large multimodality models (LMMs), and other generative models. You will develop novel large scale distributed training algorithms and model architectures to improve the quality of models and accelerate the model training and inference speed of LLMs/LMMs. You are expected to work on the algorithm and model design, implementation, and evaluation. You will write paper submissions based on the internship work and release the code to the public.

Advanced Micro Devices (AMD)

together we advance_

Manufacturing & Electronics

Industry

10,001+

Employees

1969

Founded Year

Mission & Purpose

We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our mission is the AMD culture. We push the limits of innovation to solve the world’s most important challenges. We strive for execution excellence while being direct, humble, collaborative, and inclusive of diverse perspectives. AMD together we advance