Eyebrow-controlled iOS game
Rainbrow was fortunate to receive praise from Apple and other media outlets as one of the first apps to leverage the new face-tracking technology of the iPhone X.
How it works
Rainbrow uses the True Depth camera system on recent iPhones and iPads to track the user's eyebrows. When the user lifts their eyebrows, the character jumps up. When the user lowers their eyebrows, the character jumps down.
I first built a prototype to validate the quality of the facial data. Of the available facial features, eyebrows were the easiest to control, provided a wide range of input, and made the user look sufficiently silly. 😜
Starting on paper, I drew some initial ideas. Since the user's eyebrow motion is vertical, I wanted match that with vertical movement of the on-screen character.
To simplify the experience, I designed the menu with the same background as the game. This provides a smooth transition into the game, and reduces the cognitive load of the user since they feel like they're in the same space.
Most of the design decisions were made and tested in code. Once I was able to feel the gameplay on a real device, it was much easier and quicker to iterate.
Creating the entire experience is fun because I can switch between coding, design, and art to keep things fresh.
The most rewarding part was testing the app with people and watching their reactions. Try it for yourself! The app is available for free on the App Store.