Research Engineer Intern - Doubao (Seed) - Machine Learning System - 2025 Summer (MS)

ByteDance

Jun 12, 2024

Applications are closed

Internship
Full-time
Summer Internship
Software Engineering
San Jose

Requirements

Currently pursuing a MS in Software Development, Computer Science, Computer Engineering, or a related technical discipline.
Familiar with machine learning algorithms and platforms
Published papers at top conferences
Familiar with the C/C++ and Python development in Linux environments
Familiar with at least one deep learning framework (TensorFlow, PyTorch, MXNet, or other)
Ability to work independently and complete projects from beginning to end and in a timely manner.
Good communication and teamwork skills to clearly communicate technical concepts with other teammates.
Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment.
Preferred Qualifications:
The following experiences will be a big plus:
GPU based high performance computing, RDMA high performance network (MPI, NCCL, ibverbs).
Distributed training framework optimizations such as DeepSpeed, FSDP, Megatron, GSPMD.
AI compiler stacks such as torch.fx, XLA and MLIR.
Large scale data processing and parallel computing.
Experiences in designing and operating large scale systems in cloud computing or machine learning.
Experiences in in-depth CUDA programming and performance tuning (cutlass, triton).

Responsibilities

Research and develop our efficient machine learning systems, including efficient optimizers, parameters, and gradient efficient training with rank reduction and communication compression.
Develop a state-of-the-art asynchronous training framework ensuring convergence.
Implement both general purpose training framework features and model specific optimizations (e.g. LLM, diffusions).
Improve efficiency and stability for extremely large scale distributed training jobs.

FAQs

What is the job title for this internship?

The job title for this internship is Research Engineer Intern - Doubao (Seed) - Machine Learning System - 2025 Summer (MS).

What is the primary purpose of the internship at ByteDance?

The primary purpose of the internship at ByteDance is to offer students industry exposure and hands-on experience, allowing them to turn their ambitions into reality while exploring infinite opportunities.

How long will the internship program last?

The internship program will last for 12 weeks, beginning in May/June 2025.

What kind of experiences can interns expect during their time at ByteDance?

Interns can expect hands-on experience in developing fundamental skills, exposure to real-world scenarios, and access to a vibrant blend of social events and enriching development workshops.

What kind of skills will interns have the opportunity to develop during this internship?

Interns will have the opportunity to develop fundamental skills related to research engineering and machine learning systems while gaining practical experience.

Is this internship program specifically for MS students?

Yes, this internship is designed for MS (Master's) students.

What benefits can interns expect from participating in this internship?

Interns can expect personal and professional growth, enrichment through workshops, hands-on experience, and the chance to explore potential career paths in a dynamic industry environment.

ByteDance

Technology

Industry

10,001+

Employees

2012

Founded Year

Mission & Purpose

ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. We are committed to building a safe, healthy and positive online environment for all our users.