1 - Introducing Puppets
We love dreaming-up fun and innovative ways for you to express yourself through your SwiftKey Keyboard.
Today we invite SwiftKey Beta users to try out Puppets – an interactive new feature that will allow you to control your own virtual character. There’s a choice between five different animated characters: Dinosaur, Panda, Cat, Owl or Dog – and each Puppet will mimic your facial expressions and head movements.
You can also record short videos of your Puppet in action, and then share recordings to your friends and family.
2 - How to create your Puppet
Puppets lives in your SwiftKey Beta Toolbar and requires a device running Android 7.0 (Nougat) and above, so you’ll only see the icon if your device satisfies this requirement.
- Open your SwiftKey Beta Toolbar
- Tap on the ‘Panda’ icon to launch Puppets
- On first run the Panda will be picked as default – let the camera find your face
To pick another character
- Tap on the Dinosaur, Cat, Dog or Owl icon.
- Press the ‘Download’ button. If you don’t want to use your data allowance, then make sure you connect to a Wi-Fi network first.
To share your Puppet
Pressing the red ‘Record’ icon will let you record short video (and audio) snippets. Each clip is limited to 30 seconds in length.
You can then share these video and audio recordings directly to your friends and family through most Android messaging and social apps.
If you'd like to share your Puppet with audio just tap the 'speaker' icon to toggle this on/off.
When you're done tinkering, tap 'Send' to share your character.
3 - Tips for an enjoyable Puppets experience
Before you use the feature for the first time, you’ll see an animated graphic that shows you the best angle to hold your phone.
To ensure best performance of your virtual puppet we recommend using the feature in a brightly lit environment, and your phone’s camera should have an unobstructed view of your face.
And while your Puppet should work when wearing glasses, you’ll probably have less luck if used with pets!
When recording video your audio will be picked up too, so why not make your Puppet talk?
4 - How does it work?
Puppets uses AI which has been trained using thousands of images and videos of people making different expressions to track and record facial movements. The feature understands everyone’s unique face shape by using facial anchors such as the corner of the eyes. Puppet animation is then achieved by transferring those tracked human facial expressions and head motions to the Puppet in real-time.
5 - Data and Privacy
Images collected by the camera are not stored and not transmitted. They are in device memory for a few milliseconds to recognize the expression locally on device and are then discarded.
6 - Help us to improve Puppets
Beta features are still a work in progress and may change over time before full release.
If you find your Puppet crashes or struggles to mimic specific expressions, we’d be grateful if you could share this feedback with us.
Please submit a support ticket by clicking here. When asked 'What's your question about?' choose the 'Emoji, Puppets, GIFs & Stickers' category and kindly provide us with as much information as possible.
Your feedback will help us improve the feature and shape the future of Puppets.