HackerTube.dev

Facebook's Prototype VR Face Tracking Got Even Better

UploadVR · 69.6K views · 2019-06-28 · 3:57

Open on YouTube ↗

If playback is restricted in your region, try opening the original video. Use Mark watched to add it to your marked videos.

Overview

UploadVR covers a Facebook Reality Labs prototype that tracks facial expressions using cameras mounted in a VR headset. The updated version captures subtle micro-expressions for realistic avatars.

On Hacker News

Pointed to in metaverse and VR threads as proof that realtime photorealistic face tracking from headset cameras is coming.

Recommended by 1 HN people across 1 months · HN mentions 2020–2022

Topics

VR, AR & spatial computingComputer vision, speech & NLP
Search by tags
virtual realityfacebook reality labsface trackingavatarsheadset cameras

What people said

josephg · 2021-09 · Strong recommendation

> The author mentions lip syncing and hand tracking. That goes a long way, but it doesn't recreate the video experience to me. The oculus team put together a seriously jawdropping demo of facial tracking using a few cameras in a headset, combined with a lot of AI. The prototype was from a couple years ago. I can't wait until it makes it into commercial headsets. I wonder what the hold up is? Well worth a look if you haven't seen it: [VIDEO]

Read the original HN comment ↗
microjim · 2022-03 · Reference

Title should be amended to something like 'Face-to-face, rather than shoulder-to-shoulder, enhances learning, innovation.' For a high quality face-to-face remote experience, I expect we'll start to see really impressive consumer ready technology announced soon. See what Facebook have been doing with cameras mounted in VR headsets [1] or Google's Project Starline [2]. That said, when we're doing this much transformation and synthesis of the raw data to achieve high-fidelity telepresence, are we going to have issues trusting it? [1] [VIDEO] [2] [LINK]

Read the original HN comment ↗
roveo · 2021-11 · Reference

There are algos that reconstruct photorealistic 3D facial expressions from headset cameras in realtime. [VIDEO]

Read the original HN comment ↗

Sources

Video by UploadVR, played through YouTube.

Data and selection notes

HN summaries and labels may contain AI errors. HN dates refer to discussions, not video publication.

HN Library: HackerTube export (2026-10-31) and open-index/hacker-news. Upstream summaries and classifications may contain AI errors.

Views, duration and playback status refresh separately from the published catalog. When an update fails, existing data remains visible.

Selection checks
  • SaaS & AI candidates: Topic keywords do not match
  • Editor-approved picks: Editorial review is required

Rule matches identify candidates. They do not guarantee video quality or financial results.

About the library and its sources