Face mesh

A face mesh is a 3D surface of connected points that face AR fits over a person's face in real time, matching its shape and expression. Masks, makeup and 3D objects attached to the mesh stay on the face as it turns, talks and blinks.

Also known as: face geometry, 3D face mesh, face landmarks, face tracking mesh

How it works

Face tracking finds landmarks such as the eyes, nose, lips and jawline in every camera frame and fits a mesh of a few hundred points over them, so the mesh bends with each expression. Effects use it in two ways: 3D pieces such as a headpiece, horns or glasses are anchored to points on the mesh, and a face texture is painted across its surface. The mesh can also stay invisible and hide the parts of a 3D object that should sit behind the head, so a crown looks like it wraps around it instead of floating in front.

How it works in illust

illust can set up the face mesh for your project, fitting your 3D mask, headpiece or accessories to the face so they follow each visitor's expressions in the phone's browser. Add a face texture for paint or makeup, then share the effect by link or QR code.

Explore AR StudioSee it in action: MASK at ICANN87 in Bali →

Key facts

  • Google's MediaPipe Face Mesh estimates 468 3D face landmarks in real time, even on mobile devices, from a single camera with no depth sensor (Google MediaPipe).
  • Apple's ARKit fits a mesh that matches the size, shape and current expression of the user's face, and can use it as invisible occlusion geometry so the face hides parts of virtual objects, such as the frames of virtual glasses (Apple ARKit documentation).
  • At MASK, an AR exhibition presented by the .ART Registry at ICANN87 in Bali (October 17–22, 2026), visitors wore five artists' masks on their own faces in the phone's browser after scanning a QR code (illust case study).

FAQ

What is the difference between a face mesh and a face texture?

The face mesh is the 3D shape fitted to the face. A face texture is a flat image wrapped over that shape. 3D masks and accessories attach to the mesh; face paint, makeup and tattoos are drawn as a texture.

Do I need a phone with a depth camera?

No. Face tracking in the browser estimates the mesh from the regular front camera.

Can illust set up a face mesh for my project?

Yes. illust can fit your 3D mask, headpiece or accessories to the face mesh and set up the effect so people open it by link or QR code in their phone's browser.

Related terms

More in this topic

Adobe Aero

Adobe Aero was Adobe’s free AR authoring app for iOS, Android and desktop, launched at Adobe MAX 2019 so designers could build interactive AR scenes.

AR art (augmented reality art)

AR art is artwork made to be experienced through augmented reality: digital sculptures, animations, sound and video that appear in real places, on physical artworks or on people, seen through a phone or glasses.

AR art exhibition

An AR art exhibition presents artworks in augmented reality, placed in a gallery, park, street or across a city, which visitors view through their phones.