Skip to content
← Back to job listings

Research Scientist, HCI-Multimodality - Interaction Perception, PICO

ByteDance · San Jose, California, United States of America

External listingfull-timeRecently

About The Role

About the Team

The team at PICO is dedicated to leverage technologies such as computer vision, deep learning, SLAM, 3D reconstruction, and multi-sensor fusion, we continuously expand the ways humans interact with the virtual world through handheld controllers, bare-hand tracking, eye-tracking, and XR interactive accessories, enhancing the overall interaction experience.

We focus on computer vision + NLP + LLM for next-generation VR intelligent interaction.

Responsibilities

  • Develop computer vision-driven VR interaction algorithms centered on intelligent input method systems.
  • Build LLM & NLP algorithms for prediction, error correction and completion.
  • Research lightweight LLM/NLP and vision-language multimodal fusion for VR.
  • Deliver technical innovations, patents and research translation.
  • Provide technical leadership for the algorithm team.

Minimum Qualifications

  • Master’s/PhD in CS, AI or related field.
  • 5+ years NLP/LLM R&D experience, 2+ years leading core algorithms.
  • Expertise in Transformers, LLMs and sequence modeling.
  • Proficiency in PyTorch/TensorFlow.
  • Basic computer vision or multimodal background.

Preferred Qualifications

  • Experience in intelligent input methods, especially Chinese input methods.
  • LLM fine-tuning and optimization for interactive systems.
  • Vision-language multimodal fusion for VR.
  • Lightweight model deployment on VR/edge devices.
  • VR interaction and scenario understanding.

This is an external listing. JobSpring does not represent or verify the employer. Report this listing