Pepper the robot with a tablet in one of the eObuwie stores

In a departure from conventional shoe store practices, eObuwie.pl has embarked on a groundbreaking path. Leveraging the triumph of their online eCommerce platform, they have taken a bold leap forward by introducing innovative brick-and-mortar stores. These unique retail spaces offer customers the opportunity to browse and select shoes via tablets, with the added convenience of trying them on within minutes. By eliminating the traditional display of shoes on shelves, eObuwie.pl revolutionizes the shopping experience.

The most recent store opening, held in Gdańsk during the last weekend of June, marked another milestone for eObuwie.pl. This time, the Snowdog team was present, accompanied by their humanoid robot, Pepper. This momentous occasion signifies the initial strides taken towards integrating humanoid robots into the retail landscape, propelling the industry into a new era of customer engagement and innovation.

Snowdog's role in the process

N/A
Pepper ready to chat with customers in Gdańsk

A team from Snowdog made up of two Android developers, Product Manager, Marketing manager and Pepper joined eobuwie.pl at their Gdańsk store launch. Our role was to facilitate customer interactions with Pepper so that they run as smoothly as possible, while observing the robot in a real retail setting. What better way to test Pepper, than in a real, non-simulated commercial environment? We reached an agreement that Pepper is such a unique technology, that it is virtually impossible to judge its capabilities in an office where we are working on it day-to-day.

“It is crucial to have as many interactions as possible at the beginning. We are really learning about customer behaviors and it helps us to improve the shopping experience with Pepper” — says Ewelina, Android Developer at Snowdog.

We want to combine Pepper’s speaking and conversation with content display on the tablet with the right balance. To achieve this we need to conduct a tremendous amount of testing to discover what responses people give to various situations, what reactions and unpredictable requests people might have. We are indeed learning a bit of psychology and linguistics to facilitate those conversations.

How did we do it?

N/A

Our approach to Pepper in different situations has evolved as we learn from our experiences. For instance, we have:

  1. backed off from assisting Pepper so much and
  2. increased observation of the interactions and helped them along by triggering a remote control.

We are still working on a solution for Pepper to detect when people are around and initiate a conversation, but currently the only way to start an interaction is from the side of the human. By using the remote trigger, we could automatically make Pepper say “Hi!”, to observe how people became aware of him and interact with him when Pepper initiates the conversation.

It sounds like cheating, but our aim was to use the remote as an experiment. It allows us to avoid intervening in conversations with Pepper, (which disrupt and impact the natural environment), it helps us pinpoint the exact moments in which people needed some input from the robot.

We observed that the entry threshold for interaction was high; despite our efforts to make it as simple as possible to chat with Pepper. Many people still find it hard to make the first move and start talking. The remote was a huge help in this regard; when we triggered Pepper to say “hello” while people were passing by, we saw a drastic increase in the number of people answering and starting a conversation.

The next step is working on human awareness functions so that Pepper can intelligently greet customers when he detects someone is looking at him. You can read more about how Pepper recognizes people:

What about obstacles in Pepper’s environment?

We came to the store opening in Gdańsk with a mission to identify the best locations and conditions which would allow proper usage of the robot’s capabilities.

Initially we placed Pepper in a cozy spot next to the “Reserve & Collect” tablets on the wall. It appeared to be an elegant spot due to the proximity of the checkout, but it was obstructing staff and customers from moving around comfortably. We additionally noticed a major issue: a speaker right above Pepper was playing loud music and interfering with Pepper’s listening communication.

N/A
Eobuwie.pl store in Gdańsk

We decided to try out a truck from Projekt Plaża and placed Pepper in there where music was muted and Pepper could rock. A huge improvement but not a great location since the most important spot is the one inside the actual store. Loud noises have the biggest impact on Pepper, so we moved back to the store and asked to lower the music volume and observed a much better performance as a result.

Lessons learned

N/A
Pepper at eobuwie.pl store in Gdańsk

Just as the eobuwie.pl team has to teach customers how to experience the store and use the tablets, our role here was to teach people how to interact with Pepper. We have not quite reached a completely seamless experience, where people can approach Pepper with open arms and know exactly how to behave and what to say. With events like these we are really focusing on pinpointing elements which require attention and improve as much as we can before we show up again to entertain you.

Interested in Pepper? Send us an email with your case and we will have it reviewed by team to figure out how we can help: pepper@snow.dog