Applied Research Scientist

THE ROLE:

We are looking for Applied Research Scientist experienced with large multimodal foundation models. In this role, you will explore novel foundation models for visual/audio understanding with advanced LLMs and large-scale training techniques to advance the state-of-the-arts. You will be part of a world-class research team working on pre-training, fine-tuning, and aligning large multimodal models, in addition to keeping up-to-date to the latest progress and trends in large multi-modal model, unified visual foundation model and other foundation models.

THE PERSON:

Do you like to design and implement novel research ideas, improve the quality of the large multimodal models, accelerate the training and inference speed, and influence future hardware and software direction? If so, this role is for you.

The ideal candidate will have expertise and hands-on experience on training LMMs, familiar with hyper-parameter tuning techniques, data preprocessing, tokenization methods and latest training approaches.A successful candidate needs to be knowledgeable with the latest transformer architectures.

KEY RESPONSIBILITIES:

• Pre-train and post-train large multi-modality models.

• Improve visual/audio understanding, modality fusion and reasoning of multi-modality models

• Improve the state-of-the-art large multi-modality models.

• Accelerate the training and inference speed of LMMs

• Research novel ML techniques and model architectures.

• Influence the direction of AMD AI platform.

• Publish your work at top-tier venues.

• Engage with academia and open-source ML communities.

PREFERRED EXPERIENCE:

• Experience in developing and debugging in Python.

• Experience in ML frameworks such as PyTorch, JAX or TensorFlow.

• Experience with distributed training.

• Expertise on LMM pretraining, finetuning, and/or RLHF.

• Familiar with transformer architecture.

• Strong communication and problem-solving skills.

• Publication at top-tier venues is a huge plus.

ACADEMIC CREDENTIALS:

• A PhD or master's degree or equivalent in machine learning, computer science, artificial intelligence, or a related field.