Research Scientist - 3D/4D Reconstruction/Generation, PICO

Location:
San Jose

Team:
Technology

Employment Type:
Regular

Job Code:
A243243

Responsibilities

About the Team

The PICO MR team is dedicated to developing core environmental perception algorithms for the PICO system. The team focuses on three main areas: visual localization, scene perception, and 3D reconstruction. Its work in MR scenarios includes research, exploration, and deployment of technologies such as multimodal scene perception, AIGC scene generation, depth estimation (Mono/Stereo/MVS), 3D scene reconstruction (3DGS, NeRF, etc.), and lighting estimation.

The team boasts strong technical capabilities, with most members holding master’s or doctoral degrees from renowned universities (e.g., Tsinghua University, Peking University, Zhejiang University, Nanyang Technological University, Hong Kong University of Science and Technology). It has published numerous papers in top conferences/journals like CVPR, ECCV, ICCV, SIGGRAPH, and TPAMI. The team has won multiple awards: CVPR 2025 OpenSUN3D Double Track Champion, CVPR 2025 Cross-device Localization Challenge Champion, CVPR 2024 Monocular Depth Estimation Challenge Champion, CVPR 2024 OpenSUN3D 3D Functionality Grounding Track Champion, and ICCV 2023 OpenSUN3D 3D Object Instance Search Track Champion.

Responsibilities

1. Participate in R&D for 3D/4D algorithms and foundation models, and promote their deployment in MR application scenarios.

2. Develop and optimize large 3D/4D generative models (e.g., data curation, pre-training, post-training, evaluation, acceleration and deployment).

Qualifications

Minimum Qualifications

• Master’s degree or above in computer science or related fields; 3+ years of algorithm research or industry experience.
• Excellent programming skills; proficient in Python/C/C++ and common deep learning frameworks.
• Solid foundation in AIGC/3DV/CG; project experience in reconstruction or generation.
• Proficiency in 3D representation/rendering (Gaussian Splatting, NeRF, meshes, point clouds);

Preferred Qualifications

• Thorough understanding of the latest advances in reconstruction and generation. Preferred experience in any of:
• 3D/4D reconstruction (feed-forward GS/optimization-based)
• 3D/4D generation (human/scene/novel view synthesis)
• Image/video generation & understanding (video depth estimation/tracking/understanding)
• Publications in CV/CG/ML/AI conferences or journals (e.g., CVPR, ICCV, ECCV, SIGGRAPH, TOG, TVCG, NeurIPS, ICML, ICLR) focusing on computer vision/computer graphics.
• Hands-on experience in building large model training pipelines and curating datasets.
• Familiarity with MR/AR/VR technologies is a strong plus.
• Award winners of competitions such as ACM-ICPC, NOI/IOI, TopCoder, or AI/CV contests are preferred.

Job Information

【For Pay Transparency】Compensation Description (Annually)

The base salary range for this position in the selected city is $212800 - $450000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

About Pico

Founded in April 2015, Pico is a VR company committed to developing immersive and interactive VR experiences for people around the world. Pico also provides tailor-made solutions for our enterprise clients in the fields of education and healthcare.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request