Industry

Industry

VR + Unity

VR + Unity

Timeline

Timeline

January - April 2024

January - April 2024

Colortales

Colortales

Colortales

Discovering limitless possibilities of color through the world around you.

VR coloring mixed reality experience.

My Role

My Role

Experience Designer

Experience Designer

XR Designer

XR Designer

Interaction Designer

Interaction Designer

Physical Protoyper

Physical Protoyper

Tools Used

Tools Used

Figma

Figma

Unity 3D

Unity 3D

Oculus

Oculus

Python

Arduino

Overview

Overview

Project Overview

Project Overview

Colortales is a project focused on discovering limitless possibilities of color through the world around you, for this project we used Arduino color sensors with a physical prototype to capture real-world hues. We then brought the concept into Unity, where the sensors allowed users to fill in a 3D coloring book-like environment with the colors they encountered in their surroundings, blending technology, play, and storytelling into an interactive experience.

Design Process

Design Process

Physical Prototype

Physical Prototype

We prototyped several variations of pen mockups and used an Arduino color sensor connected to Unity to read RGB values in real time. Alongside this, we experimented with different materials, including MDF and laser-cut plastic shapes, to test usability and determine which designs would be the easiest and most intuitive for children to interact with.

Design Library

Design Library

I created a design system that included a library of stories, each of which could be played and experienced through different interactions. The system also featured black-and-white outlines that acted like coloring book pages, allowing users to bring the stories to life with colors captured from the world around them.

I created a design system that included a library of stories, each of which could be played and experienced through different interactions. The system also featured black-and-white outlines that acted like coloring book pages, allowing users to bring the stories to life with colors captured from the world around them.

Unity 3D + Arduino Code

Unity 3D + Arduino Code

In Unity, we coded an Arduino color-sensing script that captured and translated RGB values to control the interactive experience. Alongside the technical integration, we animated the full storyline and 3D-modeled the characters, creating an immersive and dynamic environment that responded to the colors from the real world.

In Unity, we coded an Arduino color-sensing script that captured and translated RGB values to control the interactive experience. Alongside the technical integration, we animated the full storyline and 3D-modeled the characters, creating an immersive and dynamic environment that responded to the colors from the real world.

Game Play

Game Play

How to Experience

The user experience began with assembling a DIY coloring pen, which served as the primary tool for interacting with the system. After launching the platform, users could select a storybook to color and then use the pen to capture colors from their surroundings, filling in the storyline as they progressed through the book. At the end, the experience extended into Oculus, allowing users to step into their colored environment and explore the story in a new immersive dimension.