b2b Evaluative Research Study

Olapic

PROJECT OVERVIEW

Role: User researcher & strategist, UX/UI design support
Methods:
Qualitative interviews, concept testing, beta testing, brainstorming
Skills: Interviewing, synthesizing, facilitating, design critique
Deliverables: Designs, sketches, workflows
Tools: Post-its, Zoom, Google Suite, Sketch, Mosaiq (Wordpress)

Opportunity

 

Olapic is a complex B2B platform that aggregates user-generated, influencer-generated and brand-generated content (photos, videos) into one repository. By engaging and working with under-generated content, brand visual content costs decrease and efficiency of optimizing visual content for every, unique e-commerce touch point increases.

The account managers at Olapic were regularly pulling specialized reports for clients, which was a very manual and time-consuming activity for them. More often than not, these reports would be pulled on weekly or monthly basis and included the same information. These requests would cause a burden for the account managers, taking away time better spent on other activities.

On the flip side, the clients would have to request the different reports and wait, patiently, as account managers put something together. Oftentimes, the clients needed the reports "yesterday" and would get frustrated having to wait. Additionally, clients and account managers would engage in a lot of back-and-forth emailing with regards to feedback, changes or any further information needed.

Strategy

 

With this opportunity in mind, I decided to take several different steps to better understand the problem. I spoke with account managers to understand their side of the problem and what they thought of the client's side of the problem. After speaking with internal stakeholders, I felt comfortable creating some concepts to put in front of clients in order to test the validity of our assumptions. Showing them these concepts came after a more generative, thirty minute conversation on what they need from and how they envisioned solving this problem. 

With feedback, we were able to go back to the drawing board and synthesize the information. We iterated on the concepts and ideas, creating more viable prototypes with which I conducted usability testing. 

Overall process

My process

 

Identify problems & plan

Who was involved: me, account managers, product manager, developers, designer

The analytics team (who was in charge of reporting), approached me with a problem they had been hearing from account managers: pulling regular reports for clients was becoming a huge burden. My first step was to pull in internal stakeholders to speak with them about their process and pain points and also understand what they thought of the client's pain points and process with regards to reporting.


I took this information and had a meeting with the product development team in charge of this area where we discussed the research plan, including objectives, goals, and what we wanted to learn from speaking to customers.



Internal concept testing

Who was involved: me, account managers, product manager, developers, designer

Once we conducted the initial internal interviews with account managers, I held a design studio in which the developers, product manager, and designer sketched out some ideas and concepts.

FullSizeRender+3.jpg
FullSizeRender+2.jpg

The main theme/trend we heard internally was the need for users to schedule their own automatic email reports. We picked our top two ideas by voting using colored stickers. Before voting, I reviewed our social media personas (who were the main users of this feature) and we voted through their mindset/mental model.

We shared these concepts and ideas with account managers, iterating and making a few changes before placing them in front of customers




Client-facing interviews & concept testing

Who was involved: me, product manager, developers, designer


Once we sketched some ideas, I began the process of reaching out to clients through account managers. I scheduled all remote sessions. We specifically targeted social media managers in the e-commerce space who were logging into the platform daily (our persona who would benefit from this problem being solved).




I conducted fifteen interviews, covering both our US and European markets. The interviews were 45 minutes, starting out with a general conversation on how they think about regular reports, the kind of information they need, how they share the reports, and how the current process was/wasn't working. For the last fifteen minutes, I shared the concepts we had asking for general feedback.




After holding all of those sessions, we learned that users really liked the concept of scheduled email reports and brought it up several times without being prompted. We also realized our initial report designs were not helpful to our customers as they did not feel "actionable enough" and users were "unsure how to use them."




With these insights, I created detailed research summaries that highlighted patterns and trends I had found across the research and we went back to the drawing board.




Concept testing round two

Who was involved: me, product manager, developers, designer

With the feedback and insights, we gathered from the previous interviews, we were able to rework our ideas and concepts into sketches better aligned with the user's mental model in how their view email reporting. I ran another design studio based on the information we had learned.




We were able to go back to the same clients and test our new designs and ideas, which they found much more helpful and in-depth




Beta testing

Who was involved: me, product manager, developers, designer, product marketing




We employed around ten clients to be part of the beta program for scheduled email reporting, where they were allowed early access to the feature with the promise of giving us feedback. They received weekly and monthly reports for a month when I reached back out to the client to have another 45-minute session with them, discussing what was going well, what wasn't working, what was missing, and any improvements they had in mind.

Deliverables

Socialization and evangelizing of the user is a huge aspect of research. Through the different brainstorming workshops and design studios, I was able to help familiarize the company with the different personas and themes that came up in research:

  • I used different brainstorming workshops and design studios to help familiarize the team with the research and how it could apply to different designs

  • I shared all of the research in a google docs folder as well as Mosaiq

Deliverables included:

  • Sketches

  • Workflows

  • Designs

What’s next & reflections

Next steps

We released the feature to all of our clients and have seen a 60% increase in usage since the release as clients stopped relying on account managers to complete these reporting tasks. Account managers now save 35% of time a week by not needing to complete these tasks for clients.

Joys

  • Engaging the product team with account managers and empathizing with their issues

  • Seeing a research project from end-to-end (although there is no true end)

  • Iterating on ideas and concepts (failing quickly)

  • Creating something new based on customer feedback


Challenges

  • Working with a remote development team, especially with design studios and synthesis workshops

  • Realizing the account manager's feedback on the client's problems was biased

  • The team felt slightly demoralized after receiving "negative" feedback

Lessons

  • Give teams a pep talk before interviews so they don't take any feedback personally

  • Leave some extra time at the end of interviews for others to ask questions

  • Don't rely too much on internal stakeholders knowledge/opinions