AR Anchor Cards

Google maps, concept - Aug 2020
My Role
UX Research, UX Design, Concept Generation, Wireframing, Interaction Design ,Motion Design, Figma, Miro, Adobe After Effects, Adobe Premiere Pro, Google Tour
timeline
Jun 2020 - Aug 2020
TEam
2 UX designers

Overview

How might we design public transport navigation for travellers on a short visit?

Background

Travellers on a short visit have a tough time navigating convoluted public transport systems.

A friend of mine recently moved to New York to pursue higher education. While having a casual conversation with him, I learned about how troublesome and inaccessible the subway system is in New York.

He talked about how switching between trains was a problem, making mistakes when selecting between uptown and downtown and lastly route changes and train delays.

In January of 2018, just 58.1 percent of all weekday trains arriving at stations on time. If you add the overhead of learning an already complex public transport to the delay, you have a very frustrated traveller on your hands.

Having experienced a simpler navigation system in Delhi, India (Where we have both stayed for a bit), I set out to find out the details of why NY Subway system was difficult to use.

Research

To understand the problem at hand, We conducted desk research, collected survey results, interviewed New Yorkers and evaluated navigation applications used in New York.

From our research we uncovered that a lot of factors play into making navigation difficult for a new settler.

View Process Deck

What were the problems?

01

Understanding a new public transport system becomes difficult when you have an existing mental model of how it should work.

02

Travelers feel apprehensive to take public transport in NY as they fear they might experience terrifying encounters with the homeless population

03

Locals still had problems figuring out uptown or downtown, symbols and they often got locked out during payment.

04

People don't plot out their Public Transport route in advance. When the encounter route changes, delays and rush hours, they find their trips being restructured entirely.

User Persona

Meet Bilal

User persona of a new settler.
User persona of a new settler.
User Journey

Let's take a look at his daily commute

Bilal moves to a New York when he gets a new job at a startup. He has always lived in a small town in Europe.
When he moved to the new city, he finds himself overwhelmed, confused and apprehensive. He needs to figure out how to use the public transport to meet his date at a restaurant.

Journey map of a new settler using a public transport.
Design Principles

Making design more intentional.

To Form our guiding principles, we used idea mash up where we formed crazy solutions to solve for very real problems. Although these solutions were far from implementable, we formed solid principles we would like our final solution to use

01

Preparedness

02

Reliability

03

Familiarity

04

Delight

Rerouting our project journey.

After we conducted research we realized that maybe we were focusing on the lesser issues. We were trying to make delays communication better, advocating for aggregation of services and make cultural information available as a travel guide.

We realized that these solutions were either already implemented or won't be impactful. After Affinity mapping and concept generation we revisited the problem and revised our design goals.

Revised Design Goals

02

How might we improve the navigation by drawing more from user behavior?

03

How might we normalize cultural differences for tourists/new settlers for a short visit?

01

How might we provide onboarding support for people with limited knowledge about the city?

Narrowing down our concepts

Journey map of a new settler using a public transport.
Design Opportunity

Making navigation simpler, easier and contextual.

We finalized on contextual navigation with just in time information that was only possible through augmented reality and location anchors.

Furthermore, using AR based cards opened up possibilities to improve navigation and culture normalization through personalized directions and photo sharing respectively.

Concept Generation

Sketching out our ideas

Once we had our initial sketches, we used Balsamiq to make our low fidelity prototypes.
We went through 3 rounds of rapid iterations based on user feedback.

02

AR features for subway

03

AR Location Sharing

01

Basic AR navigation

Low Fidelity Prototypes

Not all ideas turn out great..

When we settled on AR, we wanted to implement a lot of user problems we discovered during our research. To implement that, we thought it would be best to let user define their specific problems. However, we could soon see why this wouldn't work.

Low fidelity mockups of Neighbourly + AR

The problems with this were plenty:

  • Cognitive load would increase by adding typing reliant interface on top of navigation
  • users might not get just in time information
  • There would be content moderation required to keep it friendly and useful
  • The solution won't work if someone asks for directions through questions.
  • Overload of AR cards
  • Engineering constraints as to where the card would be displayed (place of origin or a user specified place)
Low Fidelity Prototypes

Designing the interface

We went through 3 rounds of rapid iterations based on user feedback and iterated our concept further.

Low fidelity mockups of AR anchor points.

The Final Design

Concept 01

AR Micro Navigation

A hyper local, contextual information-focused solution that adds value for new travelers and daily commuters alike.

1.1

Uptown Vs. Downtown

Finding the right entrance is not as easy as it looks. From our research, experienced New Yorkers faced this issue too. If you take the incorrect gate, you not only end up losing money but also get locked out of the payment system for 18 mins. That's a loss of both time and money!

With our solution, we aim to bring uptown and downtown signs into focus. Commuters and travelers can now prevent making costly mistakes.

1.2

Navigating the labyrinth

Lines, numbers, and colors mean different things to people used to a different transport system. With subway micro navigation, a user needs to only worry about his next steps. You can now onboard faster without being delayed by deciphering signboards.

The filter chips are an addition that can add delight to the user's journey. Users in AR mode can set filters to see relevant content. For example, travelers can discover and learn about the culture through the AR culture filter.

1.3

Travel Optimization

By reimagining the crowd-sourced data Google collects, a traveler can now take a data-driven decision to optimize his travel experience.

Using the crowdsourced information, users can wait next to predestined location to ensure that they beat the crowd and have a comfortable travel experience.

1.4

Recommended cars

Crowdsourced data can also help users select subway cars best suited for their needs.

As the subway pulls up, users can take onboarding decisions using the sanitation, crowd, and temperature information.

Concept 02

AR Anchor Points

Building upon the idea of publicly available AR anchor cards, we found personalized directions to be another fruitful use case. Areas with complicated layouts and vertical traversal can benefit from personalized guided stickers. These stickers are shared privately between one Google Map user trying to reach the location shared by another Google Map User.

2.1

Request

New settlers like Bilal can navigate to a common meeting place by requesting AR anchor powered directions from a friend or an acquaintance.

To ensure the discoverability of this feature, the interaction pattern is kept the same as sharing live location.

2.2

Design and share

A friend or an acquaintance can help someone like Bilal who's unfamiliar with the location by providing them with user-generated anchor points. This feature is based on user behavior of navigating based on landmarks or places of significance.

Instead of being on the call and guiding in real time, the helpful friend can set the route with AR anchor points once and share the directions.

2.3

Navigate

After receiving the location from the friend, Bilal can now anticipate the journey and be prepared for any twists and turns before they show up.

Concept 03

AR Polaroids

Through AR polaroid, we aim to normalize cultural difference by making Bilal acquainted with the culture, the people and location. Bilal would be able to see past events, public photos and short form videos so that Bilal knows what to expect when he visits the place.

3.1

AR Memories

Taking the concept further, AR polaroid could also be used as a private photo map feature. Bilal could record his experiences of visiting a new place on the map. When he later visits the place again, he can relive the experience by comparing old photos with the real location.

This gives Bilal a chance to reminisce, share experience that feel lived in and form a stronger tie with Google products.

Opportunity #1

How might we provide onboarding support for people with limited knowledge about the city?

Design Decisions

AR MicroNavigation

Based on user testing, we designed cards with different levels of information that would be helpful based on their location.

The initial card design lacked visual hierarchy and the information was not grouped in a way to give users information at one glance. The revised cards har better hierarchy, were easy to follow can consisted of subway car suggestion as well based on crowdsourced data.

The bottom bar was designed to let users filter information most relevant to them in the AR mode. Apart from setting the filters, the user would be presented most relevant information such as route delays, landmark suggestions. If the user wants, a simple swipe up will give them all the information they need without having to leave the AR view.

Opportunity #2

How might we provide onboarding support for people with limited knowledge about the city?

Design Decisions

AR Anchor Points

The personalized AR Anchor Point's interface was based on the Google Pixel Playground(AR stickers.) This would ensure consistency with the ecosystem.

The initial card design did not give enough information about the system status. The revised card allowed users to view a snapshot of the location of the sender. By making this interaction, user would be assured that he would be travelling to the right location.

Opportunity #3

How might we normalize cultural differences for tourists/new settlers for a short visit?

Design Decisions

AR Polaroids

Through AR polaroid, we aim to normalize cultural difference by making Bilal acquainted with the culture, the people and location. Bilal would be able to see past events, public photos and short form videos so that Bilal knows what to expect when he visits the place.  

Final thoughts

What I learnt?

Trusting the research process

This is one of my favorite projects! My colleague and I started this project with the intent of making a smartwatch app. However, by putting faith in the research process and working to solve the problem, we ended up with a different solution altogether. It was a satisfying to have the final concepts connect back to the research while being solution agnostic.

Ability to extrapolate and evolve features

While exploring the concept of micro navigation, we were able to expand the concept to build upon the features already offered by Google Maps. Micro navigation for instance could be merged with personal location sharing and Local guides.  AR Polaroids shared publicly to reduce cultural shock can also be used to create memory markers that could be visited at a later date.

What could have been better?

Negating Experience Rot

Google Maps being a mature and complex application for navigation, we suggested features for it while being aware that adding complexity brings a decrease in quality of experience. While the functionality we added has value, the implementation will only be simplified once AR navigation is widely adopted.

Ensuring Feature Discovery

The second thing that I feel could have been better is feature discovery. Knowing that Google Maps is complex and has different moving parts, we had to map the entry point for our features to that of the underlying feature supporting it. For example AR cards had a dependency on the often undiscovered Live AR view. If I had more time I would have loved to redesign a version of Google Maps that had a bigger focus on AR.

Continue to my next project ➔