Skip to main content

Motion model · Research preview

A face that listens.

Give a character a voice and it gets a face to go with it: lively while speaking, and the eyes stay with you while it listens.

Shio, the character in these demonstrations, is played by Hiyori Momose, a sample model by Live2D Inc.

Start talking,
and the character starts moving.

You talk. Tide listens to the voice and moves the character's face and upper body along with it, for as long as the conversation lasts.

  • Keeps up with a live stream

    Motion arrives while the words are still being spoken. It works for streams, calls and game dialogue. Tide's real-time API is open for a free trial. Write to us for access, and tell us what you think.

  • Acting through the silence

    Listening, waiting, about to answer: the character reacts through all of it and never drops back to an idle loop.

  • Plug it into what you have

    Keep your avatar and your software. No new rig and no capture hardware.

One voice.
Two faces.

On the left, the mouth follows the audio and the eyes blink on a timer, which is where most virtual characters stop. On the right, Tide adds everything else.

The talking has stopped.
The acting has not.

  • Before the first word

    The expression changes ahead of the first word.

  • While you talk

    You are mid-sentence and the reaction is already on the face.

  • Taking the turn

    The moment the turn comes: a glance at you, then a nod.

One conversation,
start to finish.

00:0000:00

How it connects
Speech in, motion out.

Tide sits between the voice and the avatar, and the avatar stays the one you already have.

Read the documentation
  1. Input

    Speech audio

  2. Output

    Facial expression and upper-body motion

  3. Avatar

    Your existing Live2D model; VTube Studio is supported today

Offered asReal-time API (free trial open) · Local licence

Who it is for

  • AI streamers, and AI co-hosts for human streamers
  • Characters in companion apps
  • Speaking characters in games and interactive stories

What comes next

  • Hands and full-body motion
  • Open access and a full API reference
  • General release

Request early access
The real-time API is open for a free trial.

Tell us what you are building and which avatar software you use, and we will write back with next steps. We would love to hear what you think.

Opens your mail app. We will write back.

Research previewMotion is still being refined; hands and full-body motion are not in yet.

Shio, the character in these demonstrations, is played by Hiyori Momose, a sample model by Live2D Inc.

This content uses sample data owned and copyrighted by Live2D Inc. The sample data are utilized in accordance with terms and conditions set by Live2D Inc. This content itself is created at the author’s sole discretion.

Tide provides the expression. Moon provides the timing.

Knowing when to speak up and when to stay quiet: that part is Moon.