AR Concepts and Daily Use Cases

Explore the possibilities of utilizing AR in daily life. I started with the problems I encountered and have been researched and experimented how AR can be beneficial to tackle these issues and why the issues even matter.

1. Inspiration Zone

When putting the 3 common behaviors together, I started to see the correlation, it’s about human natural habits.

Furthermore, the discovery and information access with AR headset could be extended to The Method of Loci.

Method of loci is a method of memory enhancement which uses visualizations with the use of spatial memory, familiar information about one’s environment, to quickly and efficiently recall information. The method of loci is also known as the memory journey, memory palace, or mind palace technique.

Memory Techniques Wiki on Art of Memory
Bookmarked items from web and mobile without user assigned category would be transformed to similar real world objects vs. categorized articles would combine as books in user’s mind palace.

Object is targeted
Object is selected

Entire home is mind palace. Assign familiar items at the corners only you know and consolidate thoughts.

Can’t mention this classic scene from Sherlock when speaking of mind palace.
Ideas spark until our brain is full of existing elements to connect together

Concept development to be continued…

2. Tidy up invisible home mess

The idea simply started from a conversation with my mom complaining about why we always spend so much time finding stuff at home.

Well…you can’t expect Marie Kondo to visit your place and give you best advice everyday.

The Solution

Normal cabinet
Camera view from the cabinet

Concept development to be continued…

NYC Anniversary

Happy one year anniversary! I’ve moved to this diversified city almost around a year.
This are some of my illustration capturing the classic symbols from the city that inspire me: People around me have high enthusiasm talking about Pizza. I enjoy watching all kinds of taxi commercial signs while waiting the traffic lights. Food carts always look so tacky but you just can’t replace them with different formats or other design.


Color Harmonies Décor App


[This is a side project while I was interested in home decoration]

Home furnishings is a $79 billion industry, according to IBIS World as of December, and the space is attracting innovators and investors alike 2015.

Once home décor was dominated by retailers or professional interior designers, now we can see more innovative startups are leading the changes. I start to pay more attention on interior design when some of my friends and myself moved to new apartments.

Displaying wall art in home can enhance the character of living space and add color and vibrant to an otherwise plain room. Around the time combing with the picture frames project I was working on, I start to think about what would be a valuable way to help people picking aesthetic artworks or photos for decoration without an expert eye.

Problem 01: Not many people are able to afford to hire home decorators.
Problem 02: Buying art pieces is expensive that people don’t want to make the mistake buying a wrong match one.



I did an experiment seeing how color plays a huge role for the artworks people select and how the artwork would affect the entire home environment.





As we see the importance of color harmonies, I came up the mobile app concept so people do not need to invest time working with interior decorators to choose art would suit their home environment from color harmonies. It’s efficiently help narrow down the possibilities into the colors that best fit user’s vision for the space. And the simple process would encourage discovering.


How the Color Harmonies app work is by taking a picture, the system will analyze color palette based on the home photo and suggest artworks from third party or personal photos (if users allow the app accesses to their photos). To make the discovering process delightful, “core” as the primary color from the room; “Parallel” as the adjacent color based on the room and “Trilogy” as the triad color based on the room suggesting various of artworks according to the color palette.  

UI Design Tips for Multi-Touch Experiences

At Microsoft Production Studios, Director of Emerging Media, Paolo Tosolini and I have created a tutorial explaining some UI design techniques that we have adopted in a variety of multi-touch applications to be used on large displays. We hope this design sharing is helpful for any storytelling interactive experience!

UI design video shooting

I have worked at MS Studios for a year and designed 7+ interactive experiences for corporate events, trade shows and public spaces. Recently Paolo suggested that we should create a tutorial sharing some of design techniques we found effective in the year. Paolo is an expert in creating short storytelling video so we only spend three days completing the video from kick off meeting, writing scripts, shooting by iPhone and editing the pieces.
We would love to hear your feedback!

Backseat Driver: Intimate Interaction between Kids and Parents

Recently I have been researching some automotive apps on the market for another final project from class, COM597: Interactive Design. The practical functions of current  automotive apps include educational tutorials, driving logs, gas finders for cheap gas, repair estimates, finding a mechanic near you and tracking personal or business mileage any time with log applications. Since I don’t drive, I am not a huge fan downloading those apps. However, I am really impressed by one unique concept of an app called” Backseat Driver”. This iPhone application is introduced by Toyota, which allows users to enjoy driving from the back seat of their car.


How the app works is the player—it is designed for the kids— controls the app following the driver. The moves mirror the route of the real car in which the player is riding by GPS functionality but the scenes are created like animated cartoons. By steering left and right on the app, users follow the driver’s car path and pick up and collective items such as pencils or paperclips. Users can gain points by collecting the items, landmark icons of shops and facilities that are from the real maps. After gaining some points, they are able to customize their car with own designs. Besides, the route they took will be saved automatically for looking over. Having fun alone is not enough, the designs of the car and the saved route can be shared via the User’s Twitter.


The app targets kids who are not able to drive and builds an intimate interaction with the drivers. Their marketing strategy reminds me when I interviewed the car buyers for my final project and some of them mentioned when picking a car, they are influenced by the brand preferences of their family. Also, some brand images have already deeply rooted in their hearts. Therefore, apps like “Backseat Driver” definitely offer passengers a new way to enjoy driving and increase their brand favorability.

How to Motivate Retailer Shoppers with QR Codes

QR code is a kind of a gateway connecting a digital world and a true life via mobile devices. Though nowadays more and more people believe QR code is going to die out or be replaced by other cutting-edge techniques, marketers still put so much effort into encouraging customers to scan the QR code. Last week Kelly showed us some giant QR code from the slide which tried to catch customers’ eyes. In fact, not only the size matters, I find a QR code campaign impressively initiating conversation by a novel experiencing of a 3D QR code created by sun and its shadow.

The case is E-MART, the largest retail chain in Korea, recently launched a QR code campaign called” Sunny Sale”. The company realized there was a sales gap during weekday lunch time. We might take this phenomenon for granted but the marketers came up with the idea of giving people a unique lunch shopping experience to increase sales during the period.
擷取1E-MART launched 3D QR code sculpture only readable from 12:00pm to 1:00pm, due to the position of the sunlight and shadow. E-MART expanded a concept of QR code from digital 2D image which is composed of 0 and 1 to analog 3D figure as an artwork which has width, height and depth. The unique time limit restricting chance to participate per day quickly brings the attention to many people. The campaign gives an added scarcity value to participants making obtaining the benefits more attractive. Consumers who scanned the QR Code were directed to the E-MART online store and received $12 coupons for products to be delivered in their homes. This action expanded to 36 locations in Seoul, increased the number of members by 58%, and led to a 25% increase in sales during the lunch hour.


So, what’s the reason the sun plays a key role in the campaign? According to the marketers from this campaign, they indicates that sun uses that time to direct to the location, and represents positive meanings such as happiness, and hope for the brand. The campaign definitely brings positive thinking about E-MART and their brand to potential and original customers through experiencing a novel QR code created by sun and its shadow. Since this campaign was so creative and successful, it won 5 Lions at the Cannes Lions 2012, 2 prizes at London International Awards and 7 prizes at Spikes Asia 2012.

Why Should We Think about Mobile Security?

I complained to my friend that my phone is getting slow and crashing easily whenever I use some apps these days. “Hmmm…Have you tried an antivirus software on your phone?” she said. My mobile device should have Security Software? This is a totally new concept for me. An antivirus protection and firewalls have become necessary standard-issue software for our home, business computers and personal laptop. Mobile phones have more and more powerful hardware and the overall function almost matches the computer’s. We web surf, download, check e-mail and make online purchases on our phone.

However, the concept of antivirus protection is still not widespread. Our smartphone pretty much contains vital personal and business information, so we should consider mobile security software as the new standard to avoid smartphone from mobile threats. According to TopTenREVIEWS: 2013 Best Mobile Security Software Comparisons and Reviews,

A mobile virus can drain a phone’s battery, delete personal and business information, and even cause certain features to be completely nonfunctional. Not only can a virus disable functions on your phone, but other forms of malware may also send infected files to your contacts, send mass messages without permission, make expensive calls resulting in unwarranted billing, and turn your mobile device into a recorder or even a camera, taking pictures wherever you go and displaying them online ( TopTenREVIEWS, 2013).

This warning shows how we should emphasize the mobile security. Also, there should be a way to prevent crises if we carelessly leave our phone in a taxi, shopping mall or a restaurant. The best mobile security applications should give you the ability to lock phone and SIM card remotely, wipe important information from memory card and activate phone’s built-in GPS chip to locate a lost or stolen device. With the right software solution, users don’t have to sacrifice security for mobility.

Lastly, with the limited resources and small size of mobile phones, it is especially important that the design of mobile security software is straightforward and easy to navigate. Here I recommend LINE Antivirus with clear interface and cute icons surprising users when the software scans your system.


Another interesting usage of 2D Code

Most of our experience of 2D Code is

l   Step1: Open 2D Code Scanner

l   Step2: Stabilize your hands and scan the 2D Code from the posters, magazines or brochures

l   Step3: Follow the link to a website, watch a video or trailer

2D Codes only bring people to the web page and then leave them there, so that’s where business falls short. However, it is more like extension of the advertisements or marketing campaigns. The book “Go Mobile” mentions that “ Don’t run 2D Code program in isolation. If you integrate the promotion with other marketing campaigns, the result will improve.”


I found that JC Penney, the US department store chain, has come up with an ingenious use for QR Codes called “Who’s Your Santa” campaign, in last Christmas. JC Penney invited customers to personalize their Christmas giving with the use of 2D tags and mobile phone technology. When purchasing in JC Penny, consumers get a “Santa Tag” in the form of 2D Codes and enable so record a personalized gift message for each of their gifts. Attaching 2D Codes to gifts allows givers to record a 60-second message. The gift receivers scan the 2D Code on the gift and listen to the blessing message. At the same time, the codes enable the user to reply with a thank you note to the giver.

In fact, customers can complete the same process through e-mail or voice message instead of 2D Code. However, the process would be lack of the instant feeling of gifts being on hand and listening to the wish immediately. It is a small creativity but it breaks through the application of 2D Code for just accessing the website. The novel campaign is able to interact with the customers and improves the impression of JC Penney.

Fog of World: Turning your travel into a game


Usually people travel with smartphone aims to check locations or search the route. However, there is an app completes your travel experience more than those functions.

Two Taiwanese developers came up the idea about an app remembering everywhere users have been in their whole life journey and tuning the experience into a game. That is, an app documentaries the route where you have been. My college classmate from Taiwan visited me last Friday. When she arrived in Seattle, she could not wait to open the app “Fog of World” excitedly. The concept of this app is about imagining a world covered in fog which is not completely and totally explored yet. The app keeps on track while users exploring new place. As they go to new places, the map gets clearer. It sounds like the GPS on your mobile device but more than current navigation. In fact, there are a number of apps that show you where you went on a given day or trip.


“Fog of World” changes the user experience. The unique point is turns the documentation into a game. It uses the similar idea from games like covering an opponent ’s alignment until users get in range and applies it to the real world. The entire globe is covered in fog, and users slowly uncover it as they traveling with their smartphone. The interface is neat to see users’ path etched into the fog, and the app takes it a step further with achievements and percentage trackers as you keep uncovering fog. Users can also import the tracking as files through iTunes and Dropbox, sync and backup exploration data through Dropbox account.

Some users consider it would be more attractive if this app has more functions. They expect it integrates with Foursquare and has geotag access from photos or being able to leave message and interacts with other travelers. On the other hand, some users think more function make this app more complicities and lose the original features. No matter what, the app definitely makes traveling experience much fun and motivated.

Right now the app is mainly promoted by social media. There are 50% official website visitors from Twitter. Usually if developers are not well-known, it would be hard for them to get advertisements or cooperation in the beginning. For “Fog of World” developers, they do not worry too much about that. They believe that a fun app is able to create conversation and makes users want to share is already a successful begin.