Connecting Quant & Qual: How Brands Are Leveraging Continuous Consumer Insights

00:05 - I am so thrilled to be here with you today and excited for the lineup we have in store.

00:10 - Today’s topic is about connecting qual and quant.

00:14 - And this is something that we’ve been talking a lot about here at Suzy, because if you remember at the end of last year, we launched Suzy Live.

00:22 - Suzy Live is an in-depth interview platform that makes conducting video-based qualitative research, easy for our customers.

00:30 - Suzy Live uses our own proprietary consumer network and takes care of the scheduling, the logistics, the transcription, the moderation, and everything in between allowing you to instantly book, and conduct a live interviews with consumers in just a few clicks.

00:47 - The feedback on Suzy Live has been tremendous and because of that, we’ve been spending time thinking about how qual and quant can work together to deliver powerful insights and help you make better business decisions.

01:01 - There are a ton of advantages to using Suzy Live.

01:04 - One of those is the ability to connect the dots between the qual and the quant in ways that no other software solution can.

01:13 - Because we have our own audience the ability to conduct quantitative research in Suzy and then follow up with specific consumers based on their responses using Suzy Live and then refining and repeating this process, has become a powerful workflow for some of our biggest customers.

01:30 - So today that’s what we’re gonna talk about.

01:33 - Connecting qual and quant together, to generate powerful insights and do so in a fraction of the time.

01:41 - In the next week, we’re gonna be launching the ability to save audiences in Suzy.

01:46 - You’ll be able to filter audiences based on responses and push them into Suzy Live for seamless scheduling and following up.

01:55 - This is our first step towards better connecting the two systems and making the process of qual and quant research easier and more robust.

02:04 - We believe that this first connection between Suzy and Suzy Live, sets the stage for a lot of the work we’re gonna be doing over the next few quarters.

02:13 - This includes adding better text analysis and even more use cases like focus groups and UX testing.

02:20 - Okay. So that’s enough of the setup.

02:23 - Let’s get into it. First up, our Chief Product Officer Nick Gauchat and our Head of Market Research William Cimarosa are gonna show you up close, how this integration works and how it can be leveraged using a fictional brand.

02:39 - I love it when these two guys geek out and I hope that you’ll love it also.

02:44 - When Nick and Will are done, we’re gonna bring in leaders from our market research center of excellence to run you through a few specific use cases of how qual and quant together, can be leveraged for foundational research for concept testing and shopper insights.

03:00 - This is gonna be followed with Q&A, hosted by our very own Chief Customer Officer, Katie Gross.

03:08 - It’s a jam packed agenda. So I won’t take up any more of your time without further ado, take it away Nick, and take it away Will.

03:18 - - Thanks Abi, Nick and I are excited to show everyone some of the updates we’ve done to Suzy Live.

03:24 - We’ve taken a platform that would now hosts both your quant and your qual, and we’ve turned it into a quant qual feedback loop.

03:32 - In order for me to truly tell the story of why this is so powerful, it makes the most sense to start with a story about two very close friends of mine.

03:40 - Their names are Klaim and Winnie. In my past, I worked on both the vendor and on the client side, creating quant qual mixed methodologies.

03:48 - A lot of the times in China. Klaim and Winnie were my interpreters and my translators.

03:53 - The complexity and the amount of detail that you need to go into, to execute essentially located quant-qual mixed methodology approach in China, required that we spend so much time together that we’re now all like family.

04:07 - When you spend hours upon hours in China traffic as pictured here, you become like family.

04:13 - And now when Klaim and Winnie are the United States, they stay with me.

04:16 - Here you can see Klaim on Wall Street. We’ve had countless bad international badminton matches, lots of different types of exotic hotpot, you know, and lots of late nights setting up quant qual mix methodologies, both as a client and as a vendor.

04:33 - Well, why was we spending so much time together? Well, let’s look at just some of the complexities that made our lives difficult.

04:42 - Executing quant qual studies especially from a central location standpoint has been time-consuming, expensive and stressful.

04:49 - Let’s start with a quant qual recruit. Building a quantitative sample, right? That could be two weeks easily in and of itself.

04:59 - But when you’re recruiting for a quant-qual, central location tests you’ve got a little bit of an extra added qual here.

05:05 - Not only do you need 200 to 300 category consumers who qualify for your study they need to also be willing to travel to a central location to take that survey, and you don’t know what you’re going to learn during that.

05:18 - So they need to be flexible, in case they’re one of the respondents that you want to keep back for more qualitative feedback.

05:25 - This adds time, complication and an expense to any study that can make it a barrier to leveraging a quant-qual feedback, approach.

05:34 - Preparation, this is the other reason we spent so much time together right? You can’t do a quantitative study with enough people in a traditional qualitative venue.

05:46 - Consequently, Klaim, Winnie and myself have traveled all over China, visiting dining halls, gyms, classrooms empty storefronts, building stadiums like environments from which we could project a survey, the amount of time it would take to then set up the actual equipment both the projection equipment, the proctoring equipment and the data collection equipment could take up to two days just for one study.

06:14 - We’ve run countless wires through, countless walls in China, lots of troubleshooting.

06:20 - You can see a picture of me seeing if our one way mirror that we set up randomly worked.

06:26 - It happened to be fully transparent and useless.

06:28 - We never knew what we were going to run into when we got there but it was intensive in terms of getting all of the mechanics to actually work.

06:35 - Two days just to prepare a study was generous in many cases.

06:43 - So once everything’s up and running you actually got to execute the thing.

06:47 - You’ve got hundreds of respondents showing up to your location, expecting to take a survey.

06:51 - Here, you can see the hotel staff had been trained to direct respondents down to their stadium seats, waiting for them was a handheld controller like an old-fashioned RF remote control frequency where they could put in a key entry based on how they want to answer the survey question which has been projected on a central screen.

07:10 - And you can see how that’s working there. In the back room, we are keeping an eye on the results to decide what it is we want to learn more about and who it is that we would call back and select for that qual.

07:22 - You can also see the proctoring that was involved to keep this many people together at the same pace.

07:28 - These were time-intensive, expensive and exhausting.

07:32 - Again, that’s why I’ve had to spend so much time with my friends Klaim and Winnie.

07:38 - But no matter how much work it was it was almost always worth it because qualitative diagnostics make your findings that much more actionable.

07:47 - Sure. There are lots of online platforms that you can go to avoid the central location.

07:54 - There’s a whole number of service providers that can do this for you.

07:57 - There are tech solutions that can give you both quantitative and qualitative feedback and they’re sampling companies that can get you the sample in a quicker fashion but you still have to bring these all together.

08:08 - When you’re going to write your report and your implications they don’t all live in the same place.

08:13 - You still have to jump from platform to platform which you don’t have to put up with that anymore.

08:20 - So, Nick, what did we do about it? We built a new way to get qualitative feedback on your quantitative survey all in one place.

08:30 - We’re going to use the happy animal teacher company that we introduced to you, when we launched our monadic feature earlier this year.

08:36 - Nick and I happened to be the founders of this company and the happy animal fish or shark t-shirt is our bestseller.

08:44 - The board as demanding as they are, want us to launch a new t-shirt.

08:48 - We’ve come up with a narwhal design, a penguin and a hippo design and using the monadic tool that we launched last or earlier this year, we quickly in a couple of clips were able to see how they perform.

09:00 - Our objective for this study was to outperform our fish shark tee in terms of appeal.

09:07 - We can see here that the Narwhal, using our monadic feature at a 90% confidence level is outperforming the shark T but it’s basically a parody to everything else.

09:18 - This sucks. So our board is demanding.

09:21 - We wanted stronger results, right? This is where the qual feedback loop becomes a real opportunity.

09:27 - What we’ve now done is we’ve added open ends to each of these key diagnostics.

09:33 - We asked the consumers what specifically they found appealing or unappealing in their own words.

09:38 - We ask them what makes it relevant or irrelevant in their own words, unique, believable, expensive, right? We allowed them to tell us in their own words why they rated it the way they did, Nick, can you show everyone how it is that we take that feedback and turn it into a quantified feedback loop? - So just show that and just to be clear the board, did they give us a few weeks to give those answers back or? - No, they didn’t.

10:06 - They gave us until Thursday. (indistinct) - Next week.

10:08 - So not a lot of time. So now we’re in the platform, you know this is the analysis that you just saw in our slide.

10:17 - Export format, obviously very easy for me to just download that as necessary in a couple of clicks but really what we’re excited to show everyone today.

10:28 - And our t-shirt company was really excited to use was this feature here.

10:32 - So we’re going to jump into these open-ended results and here you go, well, this is some of the feedback that we got and we’ve looked through some of this data already and we saw some interesting things related to how people were talking about design that we didn’t really expect initially.

10:54 - Is that correct? - Yeah. I mean, there was positives and negative mentioned around the design itself.

11:00 - Our goal is to make this more appealing and the design of a t-shirt obviously is critical, right? So what we want to do now is learn a little bit more about what they mean what do they mean when they refer to design? So let’s select a couple of consumers who have talked about design and both positive and negative ways, or have mentioned it and let’s use the quality of their responses to see if we’re going to get someone that we think is articulate.

11:24 - What Nick is doing in real time right now is selecting the people for our qual feedback.

11:30 - No, urgent backroom panic, right? We’re pulling the people right from the monadic survey and we’re turning them into a new audience.

11:40 - This is an audience that we can invite into a qualitative environment to find out what it was that made these designs either relevant or irrelevant to them.

11:50 - - Great. So now we’ve got a mix of some negative and positive feedback.

11:56 - So we can really dig in, from a qualitative standpoint and actually interview these people directly and Suzy Live based on the responses that they gave here.

12:07 - - That’s correct. And remember the questionnaire was just six questions.

12:11 - It was overall appeal, relevance, expensiveness believability, purchase intent with our openness.

12:18 - So I don’t feel like I need a moderate I’m ready to go and do this.

12:21 - I’m going to ask them specifically, what is it that you like? And don’t like about this, what would make this better? And let’s jump to the highlight reels, Shall we? - We shall.

12:36 - - What makes a t-shirt fit good? Like, what is it about the fit that’s important to you.

12:41 - - Yeah. So it’s gotta be soft. That’s something that I really value.

12:45 - And then it just, shouldn’t like just drape over me like a blanket or something.

12:49 - So I like it where it’s not too snug, but snug enough and just feels nice and cozy on my body.

12:54 - - My favorite t-shirt is this one actually that I got recently, it is a little bit fitted but also a little loose in the material is very soft and it has like, it’s a graphic tee, so it has something on the front that’s just kinda like irreverent and funny.

13:17 - And I like to wear it. - And I remember the image of the shirt looked like just almost like clip art from Microsoft paint or something.

13:25 - It just didn’t look like what the t-shirt would actually be.

13:28 - It said fitted. And so that didn’t look like a fitted shirt to me.

13:33 - So I kind of thought, well, that doesn’t look fitted.

13:35 - I don’t think I’d want to buy that because it doesn’t really look fitted at all in the image.

13:41 - - Yeah. I mean, it looked like one of the more like boxy type of cut t-shirts that I wouldn’t really wear outside.

13:49 - And for the price, I’m not going to buy a t-shirt like that to only wear at home, you know what I mean? - Yeah.

13:59 - The animal’s not super important. I’m definitely more concerned about the fit.

14:02 - Like I said, as a school teacher the kids kinda love seeing their teacher in a t-shirt and then with the animals, it’s fun but I’m not going to wear a t-shirt, if it doesn’t fit, right.

14:12 - So I’d probably buy several of those t-shirts with the animals on them, as long as it fit really well.

14:19 - But from the image, I didn’t get the idea that it would.

14:22 - - I’d say the animal is probably like second most important to the fit and material.

14:30 - I’d say that is more important. - So as you just saw in this example with Jared and Mackenzie had thoughts on the design and the design, wasn’t just about the animal.

14:41 - It was about the actual cut of the shirt itself, right? The key feedback we got from both the likes and dislikes was that the shape of this shirt was too generic.

14:52 - It’s not surprising because it’s clip art. It was generic.

14:55 - But what we’re hearing is in order for them to find this appealing, it needed to show them more about what the shape of the shirt would be and suggest what the fit would actually feel like to wear.

15:05 - They also thought the price was somewhat unrealistic.

15:09 - They felt for a shirt like this, it was overpriced.

15:13 - So what did we do with that feedback? We took it and showed it to our designers.

15:17 - They were then able to get much more realistic renderings for both male and female cuts that also illustrate and highlight the contours of the shirt and the texture and feel of the shirt.

15:28 - We heard while the animal is important that the actual shape and the fit was just as important.

15:33 - So we made sure that that was clear. We’re also able to bring down the price.

15:37 - Now you’ll recall from our previous round the shirt Narwhal was doing it looked like it was a winner.

15:43 - So we threw that back into the next test. As the founders of the company we also gave the hippo another shot because my daughter likes it.

15:50 - And as founders, we have that ability and we also tested align what is going to be the best option for us.

15:56 - I said, well, we actually went and we relaunched the survey to a new t-shirt audience.

16:01 - Let’s take a look at the results. And again, this is the same Monadic template that we’ve been using.

16:07 - And finally, we are actually seeing some results that we can take to the board.

16:11 - Our second round Narwhal t-shirt has now at a 95% confidence level outperformed all designs.

16:19 - That’s what the ACDF indicates by row. This is your classic monadic output by informing our designers to take these t-shirts add the cut and the texture to it.

16:30 - We finally got numbers. We can be excited about.

16:32 - We’ve outperformed our current t-shirt and we’ve outperformed all the other designs.

16:38 - Unfortunately, the hippo didn’t make it. To be sure we also included the designs from round one.

16:45 - So a 4. 71 monastically tested against our first version is significantly outperforming at F 4. 18.

16:53 - We did it. We actually improved our scores.

16:55 - We can feel good about going through the board on that meeting on Thursday.

16:58 - - And Will how did we really key in on the feedback that we heard from a qual standpoint and then really go back from a quant standpoint and make sure that when we presented to the board we were telling them when we actually listened to it and we saw the lift and the change is that something we should show in the platform? - Yeah, let’s… What if we wanted to Lets show it in the platform we can show how we could go back and optimize even more if we wanted it to.

17:30 - So the feedback loop that Nick is pulling up is based on not just the numeric scores at the quantitative scale, right? But the actual comments that we got from respondents and when we went back, we added a couple of other diagnostics, just for a gut check.

17:47 - We added another diagnostic around the cut and seeming like for someone like me, right? With a 23% top box strongly agree that this seems like a right trick for me.

17:58 - We feel much better that we’re now on track, right? We can go and add additional diagnostics based on what we’re hearing from respondents.

18:06 - If we wanted to learn a little bit more about how to make this feel like for someone like them we can go back into the open ends see what they said and invite them in quarterly.

18:14 - What we’ve now done in one platform has created a feedback loop.

18:19 - You get your quantitative scores. You can go back to the individual responses and invite them based on what you’re finding.

18:25 - You never know what you’re going to find but based on the patterns that are emerging, invite them into qual so that you can quickly iterate and evolve.

18:32 - In this use case, we did that with our Narwhal t-shirt and were able to significantly improve the performance just through one iterative round.

18:40 - So what are the impact of all of these changes right? Well, let’s go back to the original Klaim Winnie story.

18:45 - When we were setting up projects traveling all over the place trying to make these auditoriums stadium environments work between one and five days, right? What we were able to now do with our monadic tool and our open-end audience invite tool was take it from one to five days to set up the two clicks in five minutes.

19:03 - It’s that same quick easy monadic template that you’re used to.

19:07 - But now with open ends, you can invite them into Suzy Live.

19:10 - And instead of spending up to two weeks in field, in this case we were able to spend just four days.

19:15 - On Monday, we ran our first monadic test. We looked at the results and invited those respondents into Suzy Live interviews for Tuesday.

19:23 - On Wednesday, we showed the designers the results.

19:27 - They updated the designs and we were able to complete field work on Thursday, right? We’ve taken a 10 to 14 day process.

19:35 - We’re actually able to iterate it before the end of the week.

19:39 - The final analysis, I don’t have to jump between platforms.

19:41 - Now I’ve got my live interviews, my open-end and my quantitative results, all sitting right there.

19:47 - It’s just a matter of clicking download, right? We’ve been able to get a full project in under five working days, something that would in the United States for a central location version of this cost you 90 to a hundred, $10,000.

20:00 - It’s just costing you about 17 Suzy Live questions.

20:04 - We’ve taken the pain and the technical difficulty of getting qual feedback and turned it into one simple platform.

20:16 - - So now what we’re really able to do is go back to the board.

20:19 - We’ve run a couple of sprints, quant qual analysis and what we’re able to say and correct me if I’m wrong here Will is we’ve definitely seen a lift.

20:30 - And we tested, we ran with quant. We, ran some qual.

20:35 - We went back and we had quant. We saw significant lift based on the changes and up seats the designs that we made.

20:43 - We can either start production right away, get our t-shirts out there.

20:48 - We know people have been looking for other animals you know, where the animal t-shirt contests they want the next line coming out or we have the decision to run additional research and actually iterate more.

21:02 - Can you just talk about the ability to just have this ongoing quant qual sprint capability and how it allows us to really make decisions based on research versus timeline or budget or other things that generally determine research outcomes? - Yeah. So creating this quantifiable feedback loop is relevant to a number of different use cases, today, I just demonstrated or we just demonstrated the innovation pipeline, right? We innovated a new Narwhal t-shirt we used consumer feedback to improve it and measurably improve it.

21:36 - We have a quad call feedback loop, though, it’s useful for many other areas that are relevant to your business.

21:43 - It’s very relevant to foundational learning, learning more about who your consumer is, their attitudes and behaviors.

21:48 - You can actually go and ask them about the things that you’re measuring.

21:51 - The same is true with campaign or asset development or performance tracking or shopper marketing.

21:57 - You’re able to then take the observations at a quantitative scale.

22:01 - And double-click down to the individual respondents to learn more.

22:05 - It actually enables you to be an agile researcher.

22:08 - You can get the feedback, iterate and evolve all in one, easy to use platform.

22:15 - - That’s very exciting. Well, I’ve been super happy to show some of these updates in the platform and now, Will, I think you’re going to dig even deeper.

22:24 - - Yeah. We’re not going to take you through the use cases for each of these pillars.

22:30 - So this feedback loop enables you to be more agile.

22:35 - And in terms of how you’re going to design your research to inform acquisition, retention, and growth of your consumers.

22:41 - Well, we just demonstrated the innovation pipeline with the t-shirt example, this is relevant to foundational learning, campaign development performance tracking, and shopper marketing.

22:52 - Let’s double click into the foundational learning use case and see how this qualitative feedback loop can be used to make you more agile.

23:01 - Whenever you undertake a foundational learning study, it’s about understanding who your consumer is, who is the target? Who are they in terms of their attitudes, their beliefs, their demographics, ultimately that you can get to a size or price.

23:15 - In this fast changing world, you need to know who the right consumer is and what is the right message to deliver to them.

23:21 - And foundational learnings are key to getting to that understanding.

23:25 - This quad call feedback loop that we demonstrated can be a great way to get to that level of foundational understanding.

23:31 - You can begin, by using your qual to go into the product journey, right? Find the category users in your…

23:39 - That are relevant to your category and invite them into qualitative interviews throughout the product journey.

23:46 - Here, you can start to learn in their own words, all the different attitudes all the different need states, satisfiers, dissatisfiers and opportunity areas that are relevant at each step in the journey.

23:58 - These qualitative discussions should be targeted at learning what the breadth of experiences are.

24:05 - You want to understand not just about the journey but how they perceive the brand.

24:09 - What’s important to them about this product category.

24:12 - What are the opportunity areas where they could be delighted more? This is an area of exploration with qual the broader, the findings, the better.

24:20 - You want to leverage your Suzy Live interactions to find per full universe of attitudes and needs states So you can then turn that into a quantitative survey that will then be your measurement tool.

24:32 - You can now actually measure those occasions.

24:35 - Those needs dates, those satisfiers and dissatisfiers and what some of our advanced backend analytics Suzy can even help you generate either personas or full on consumer segmentations with supporting driver analysis.

24:49 - The output of a segmentation or foundational type study is usually going to be something that needs to be brought to life.

24:56 - It’s not enough to know just who the consumers are and how they’re broken up.

25:01 - They need to be relevant to the people who need to act, who actually have to make the innovation that needs to be relevant to the people who make the brand assets.

25:09 - You need to bring these consumer segments to life.

25:11 - By having a quantitative and qualitative feedback tool in the same platform.

25:16 - Just like we demonstrated with the t-shirt example you can not go back and bring these consumers to life by inviting them into actual Suzy life interviews.

25:26 - When you have findings around certain needs, states why not go back and have the consumers talk specifically about what that in each need state entails find out in their own words, what are the satisfiers and dissatisfiers putting that in front of your brand team putting that in front of your agency teams and your designers is going to be a great way to have an additional impact can bring your segmentation to life.

25:49 - You can now go and guide deeper than you ever did before.

25:53 - By actually going back to the respondents and asking them why they answered the way they did.

25:58 - The first rule of research to always remember is you never ask someone something that you can observe.

26:03 - Here, everything is now observable to you in one platform your initial qualitative exploration informs the development of a quantitative questionnaire.

26:13 - And now you can go back and learn more about those findings through this qualitative feedback loop and target consumers based on how they answered their survey bring them to life for maximum impact and for maximum agility I’m now going to pass this on to Laima, who’s going to share a little bit about how this can be done this feedback loop could be used in campaign development.

26:35 - Take it away Laima. - Thank you for the introduction Will, I appreciate it for this session we’re going to talk a little about creative development and testing to build on what we’ll share.

26:48 - I’d like to share a story with you. When I transitioned from the client side many, many years ago a good bulk of what I did centered on copy testing, right? And for those of you who are aware copy testing is really the very final stage of the creative development process.

27:08 - And so what I have often heard when I was involved in copy testing is that there was always a lot of surprise with results, right? And copy testing is around executing a quantitative survey to assess how something is going to do in market.

27:27 - And clients would often get surprises when we got copy testing results, either, things that they weren’t expecting to learn or hear or see in the data.

27:37 - And very often we heard things like that’s not what we heard in qualitative when we were early on in the development process.

27:45 - And so one of the things that we started to do is try to bridge that gap between early stage creative testing or even earlier than that idea generation to the copy testing end gain so that when we got there it wasn’t a surprise that there was learning along the cycle so that when copy testing results came in clients and agency partners were confident with what they were going to see in here.

28:15 - One of the challenges as Will had alluded to was really around the time it took to do this research and how labor intensive it was.

28:28 - And so in order to bridge that qualitative gap to that quantitative end game, what we would do is we did a mixed method methodology that was done in person for really done in central locations, right? Like focus group facilities where you would recruit in a whole host of respondents to take a quantitative surveys.

28:50 - So you aim at having a quant sample, come into a facility to take a quant survey using these dials, right.

28:58 - And then you’re able as the client, and as the agency you’re able to see the results in real time and pick people out from those quantitative surveys and then talk to them qualitatively.

29:11 - And the benefit to that kind of methodology was it really provides clients with quant confidence throughout the stages of campaign development overlaid with qualitative depth.

29:23 - And, why that’s important is you get your metrics, right.

29:27 - But you really want to understand the why behind the metrics, because that gives you the power to develop your optimization plan.

29:36 - So going back to our focus group facility where we have all these people coming in and taking these quant surveys and then going into focus groups it requires a lot of time to recruit a quantitative sample but it’s also very expensive.

29:52 - And so think about these projects, you know having a time window of out two to three weeks before you have your detailed learnings.

30:02 - And so some of what Suzy can do here is actually truly remove those barriers, right.

30:10 - To make that process agile, meaning fast and cost effective, right? So when you’re recruiting into facility and doing these quant qual mixed methodology projects you know, you’re looking at 50 to $125,000 depending on what your sample size is, right.

30:29 - Suzy removes those barriers and lets you use this agile integrated approach throughout the campaign development life cycle.

30:39 - So if you’re at the beginning and you’re exploring all the ideas you can have a quant survey launched to a sizeable population, get some feedback on those ideas.

30:52 - And then based on how you see those answers coming in you can cherry pick the people you want to pull into qualitative and talk to them to understand, you know what was it specifically about the idea that you liked and you didn’t like and why it was resonating with you but even more critically is to understand if it’s really landing on your campaign and brand objectives, right? So all of these things were so critical in the process of unpacking, why you’re seeing the performance you’re seeing quantitatively.

31:27 - Then you go to, once you’ve got your ideas and you’ve worked on the expression of those ideas in some rougher early stage asset you can put those in front of consumers in that early stage before you go into final production and get feedback and really flag places that may need optimization whether it’s a little or a lot before you invest heavily in final production.

31:57 - And so that’s really the benefit of this integrated method is getting some quant confidence when you’re launching things quantitatively but also being able to have that insight and that depth that you can get qualitatively and explore the reasons why behind the measures that you’re getting and all of this can be done in Suzy’s quant qual offering quickly, you know five to 10 days for the qual and Quant to be executed and very cost efficiently, which really arms you with the ability to do it multiple times as opposed to doing one big project.

32:38 - Somewhere within that window of development you can actually have the freedom and the flexibility to do it in multiple places throughout the campaign development cycle.

32:48 - I’ve done many of these quant-qual projects.

32:53 - And the learning for clients is so important because it really does help bring the agency and client teams together.

33:02 - Comprehensively cohesively. Everyone sort of goes on that learning journey together.

33:08 - So when you get to copy testing or even in market measurement, there aren’t surprises.

33:14 - So the benefit of these kinds of approaches is to minimize the risk, the exposure of the surprise.

33:21 - Once you’ve made that investment in campaign development.

33:26 - That is all I have for you on this topic this afternoon.

33:31 - We’ll be happy to take questions later on. We have one more session and I’d like to introduce you to Mary Baker.

33:39 - who’s our director of market research at Suzy.

33:42 - Mary, take it away. - Thank you, Laima.

33:45 - I’m thrilled to be here today to talk about how Suzy Lives offering can be applied to the customer journey experience.

33:50 - Understanding your customer’s journey, has multiple benefits.

33:54 - It can drive sales to your brand and to your products and services.

33:59 - It can improve the effectiveness of the messaging and communication you provide along the way in that journey.

34:07 - What we help you to do is understand what those touch points are and potentially pain points.

34:13 - We work with you to deep dive into your consumers via Suzy Lives offering.

34:21 - After some quantitative research we can really learn and get under the hood on what the potential improvements might be.

34:29 - We work with you as you iterate and we can retest any improvements to the process that you’ve made.

34:36 - And again, have quantitative and qualitative work together to unearth the reactions to these improvements and to really identify what impact they will have on your business going forward.

34:50 - We recently implemented this type of study for a major technology vendor who sells their product both from a bundle perspective also aftermarket.

35:01 - We were able to look at both of those consumer journeys.

35:06 - We were able to identify pain points as well as existing successes.

35:13 - And we recommended some improvements to the process and where they could interject and a more positive manner.

35:20 - They did so, and they were happy to see that when the consumer experienced their revisions or revised offerings they were much more satisfied with the process.

35:34 - They’re working with their retailers to the process as well who was also very open to receiving the feedback.

35:43 - We hope we can help all of our clients to identify those kinds of optimization opportunities as part of their customer journey.

35:52 - Now that you’ve heard of a variety of use cases for this methodology, I’d like to introduce our chief customer officer Katie Gross who will open the floor to some audience questions along with the team, from our center of excellence that you have heard from in this presentation.

36:09 - Thank you very much. - Hi, everyone.

36:25 - Just waiting for our panel to rejoin us. Awesome.

36:33 - Thank you so much all the presenters for walking us through all the facts.

36:36 - As Mary mentioned I’m Katie Gross chief customer officer here at Suzy and I’m welcoming back our panelists for an open Q&A everybody was very active in the chat on the side.

36:46 - So I’m going to do a dive into all of the questions that you had, a deeper dive into some parts of the presentation and hopefully answer the questions that you have.

36:55 - So I’m going to start off by saying thank you so much to everybody for the use cases.

37:02 - So if you can quickly go into a project timeline what a typical project timeline would look like on the Suzy platform and how that might compare to traditional research methodology and Laima, I’m going to ask you if that’s okay.

37:15 - - Yeah. I think that the comparison is between how they’re historically done and then how we can do it on Suzy.

37:24 - And if you think about a normal traditional approach you’re recruiting your quant you’re executing your quant and then you have to spend time separately recruiting your qual or if you’re doing an in-person central location testing you’re looking at a two to three week timeline easily, For me, the benefit of Suzy is as a client, you know you know, when whatever it is you’re wanting to explore is going to be ready whether it’s a questionnaire, stimuli, assets.

37:53 - So you can recruit a quant audience, save that audience and you’re ready to hit launch as soon as a questionnaire is approved.

38:03 - So that’s really the beauty of it. So you’re saving a lot of time on the upfront, right? So you can field your project sometimes in a couple of hours, depending on the population.

38:13 - If it’s a, general, you know high incidence population, we can fill it in a few hours.

38:19 - And then from there, pull those people out of the quant survey and then have conversations with them the next day right? So the access to these people are almost immediately, right.

38:31 - I think the variables that may drive shorter or longer timelines are really the size of your audience that you’re targeting how niche it is, but very fast and that, for me as someone who’s been executing these for years timelines have always been a big barrier to implementation.

38:50 - And so Suzy does truly remove that barrier.

38:54 - - Yeah. Wonderful. And actually one question, it was a follow-up to that is what is the difficult yield from invitations from a quant survey into the qualitative Suzy Live interview and what we’ve historically seen as a roundabout 80 to 90% which I know is significantly improved upon from many of the other platforms out there.

39:14 - And it’s in part because we own our own panel.

39:16 - It’s also because of course we, it’s an integrated seamless transition from the quant into the qaul so thank you for that question.

39:24 - Also- - Can I build on one thing you said I think this is a really important piece too, because I’ve tinkered a lot with recruiting quant panelists into qualitative, right? And a lot of us who’ve been in the industry for a while know that there’s a market difference between the quality of quant panelists and the quality of people that are recruited qualitatively.

39:45 - What I’ve been really amazed about with Suzy is the quality of these people when they’re in an IDI or in-depth interview Suzy Live environment these are good respondents, right? Because ultimately you want your qualitative to be set up around people who are articulate, who can share and think and really communicate well.

40:08 - And so we’ve had tremendous success not only on getting these people into Suzy Live quickly but the quality of them is also something that I think is really important to consider.

40:19 - - One thing that also helps with the quality is the way you could use the open ends.

40:23 - So in the example that we gave, we asked for specifics about what they liked and didn’t like throughout there, right? When you see how articulate respondent is and the open-end it’s telling of how engaged and how good of a respondent there’ll be.

40:37 - It becomes almost also like a screening mechanism.

40:39 - When we have such high yields, it allows you to be selective with those that are going to be most likely to be most articulate, right? Because we all know the risks of recruiting qual.

40:47 - You always have a couple of respondents that don’t work out because we have such a high yield and you’re able to use those open-ended to explore what are the topic areas you want to go into.

40:56 - It can help ensure that you get that high quality respondent.

40:58 - - Yeah, it’s great. It’s an incredibly engaged panel that we have for sure.

41:03 - A question for Mary, how many interviews would you recommend per project and what would that length of interview be that you would recommend? - Yes - We recommend 10 to 12 per segment.

41:14 - So if you’re at least 10 to 12 per segment if your sample is homogeneous, then we would stay around there.

41:24 - But if you want to look at individual segments within that, then we would recommend that many per segment to really get a good, broad understanding of opinions and perceptions among those groups.

41:36 - From a length standpoint, we typically do 30 minutes interviews, but it really depends on the objectives and how much, how many topics do you want to cover or how much stem there is to look at? So 30 to 60 minutes, probably ideal.

41:53 - But again, all of that is dependent upon what you intend to test, what your objectives are and such.

42:02 - - Great. Then the question that came in it’s about moderation who conducts the moderation for Suzy Lives.

42:07 - So I can take that one. It can either be yourself or it can be your own approved moderator.

42:13 - And we also here at Suzy also have a list of approved moderators who have specialization in certain areas.

42:20 - We also have a back room so that you and your colleagues can also take part in any kind of virtual two way mirror and converse with the moderator while they are live moderating on Suzy Lives as well.

42:31 - So a lot of fantastic functionality for the collaboration.

42:36 - Another question just came in from the audience.

42:39 - What would you suggest is the right order to conduct hybrid quant and qual? Would it be qual first and then quant or a combination of the two? Will I will hand to you? If that’s okay.

42:49 - - Yeah, sure. It does depend on the use case, right? And what you need to explore, right? Exploratory, if you’re looking to understand drivers and attitudes that you then need to go measure, it starts it makes sense to open up with qualitative find out what the ranges of things that are important to consumers and that drive behavior and to then go and measure it.

43:08 - How, important are those things that you’ve discovered in qual.

43:11 - Once, and you’ve measured, what drives usage we then recommend that you start with quants.

43:16 - So in the example here we didn’t have any specific diagnostics but we could have put them in from a foundational study.

43:22 - Diagnostics would have been additional questions like seems like it has a good fit.

43:26 - Seems like a premium brand, typical things that you’d get out of a foundational learning where you already have measured, what those drivers are.

43:34 - You then test your ideas to see how they’re performing right? You look and see which ones are rising to the top and which ones are going to the bottom from a statistical standpoint because we have the open ends tied to those answers.

43:45 - And you can see the performance differences.

43:48 - You can then dive in to the comments, dive in if one is underperforming or over-performing dive in there and see what those responses were and save that audience and invite them into a conversation.

43:58 - So you can learn the specifics of what’s driving that.

44:00 - Once we, in this last example understood that design really was about the look of the fit and it was more important than the animal itself.

44:07 - We were then able to iterate very quickly and go back and test it again.

44:11 - One thing that I want to point out is we kept some of a control of benchmark that we knew was our best performing.

44:17 - And we also kept the top performers from the previous round to make sure that we’d actually made a difference.

44:22 - From there, we actually got success. We statistically outperformed both the control and the top performing shirt from the first design but we could have gone and dug deeper.

44:32 - We could have found out from the likers and the dislikes what it was that they were driving their opinions and kept iterating and refining.

44:39 - So if you need to explore and then go measure, start with qual and get a measurement of what’s driving behavior.

44:44 - Once you understand what that behavior is use that to drive your basic questionnaire guide for your qualitative feedback loop.

44:51 - - Yeah, that’s a really good point. And actually one of the questions came in from the audience also was what happens if the kind of the narrative from both the qual and the Quant come out slightly differently sometimes the qual story does not always match the point.

45:06 - How do you marry the two? And I guess the part of that is iteration.

45:10 - - I can take that as well. How do you marry the two? Well, there’s nothing subjective about this.

45:16 - This isn’t a randomized selection of audiences we’re observing the actual answers, right? So if they’re two different storylines, we’re going to go in and identify what’s driving those answers, right? So if someone, if something is underperforming we’re going to go and actually select the respondents that indicated that this wasn’t performing up to their standards and learn why.

45:37 - We’re actually guiding our qual around what the numbers tell us if we don’t need to marry them.

45:42 - If we can actually use the numbers to actually then go and find those specific respondents.

45:47 - You rated this low or poorly on a seven point scale.

45:50 - Tell me a little bit why, right? There’s no need to line things up.

45:53 - Then I’ve actually observed this respondent make that answer, right? I can now go and find out what it was that was driving it to iterate.

46:00 - That’s the beauty of the open ends, right? You can look at and see why they answered the question the way they did speak and go and learn more.

46:07 - You’re marrying it by actually asking the questions about the answers you observed them actually submitting on the quad panel.

46:15 - - Fabulous. A couple more tactical questions, how are discussion guides created does Suzy provide strategic guidance along the way.

46:24 - Do you have a full service component? So we do indeed have a wonderful center of excellence team who are available.

46:30 - Mary I’ll let you do a little bit more of an explanation around how we consult with clients on discussion guides.

46:35 - - Absolutely. Typically moderators.

46:37 - If there’s a hired moderated they will typically take the reigns on the discussion guide but we also will provide content recommendations flow recommendations.

46:48 - If you choose to develop a guide on your own but an important component as well and Laima I’ve talked about previously is that we will you’re really looking to uncover the results from quantitative search get under that hood, you’ll include some of the same topics to explore with the respondents.

47:10 - So some of the content actually comes from the previous quantitative research but it really depends on the objectives and what you’re showing and absolutely we can provide guidance on that.

47:23 - - Awesome. That is great. A couple of questions on the sample that can be used.

47:27 - So Suzy owns his own panel. just over a million USA respondents which we can segment into your own audiences that you may be looking for.

47:35 - And so therefore we were marrying both the quantity and the qualitative when it comes to the sample that is used on our platform.

47:42 - So I hope that answered your question there.

47:46 - And one of the questions I had for you obviously you’ve worked client side you’ve brought to market research agency side you’ve seen you’re very much fair share of platforms.

47:56 - And so in your expert opinion why do you think Suzy has a specific benefit when it comes to these quant qual hybrid methodologies? - I think it’s a great question, Katie.

48:08 - And I can’t say enough times that the core benefit for me putting my client hat on is access and speed, right? We are all moving at a thousand miles a minute, right.

48:21 - And, we don’t, as marketers, as clients, as brand.

48:26 - Managers, don’t have the luxury of time to build into our development cycles long research projects, those days are gone.

48:36 - And so part of what Suzy does is have the ability to access consumer feedback really quickly, right? So you can feel like you’re on the journey for product improvements, developments whatever it is you’re working on and can always layer in the voice of the customer, right? So that voice of the customer is really feeding a lot of the things that you touch and do really quickly, very simply.

49:03 - And, I can’t stress enough, the power of the combination of metrics of hardcore quad numbers with the qualitative depth of what those numbers need.

49:17 - And that means like, you can show your leadership teams or whoever you’re doing the project for, you know a beautiful chart with, a bar chart with numbers but then you can hit a highlight reel where people are talking about what those numbers need.

49:34 - And so that just brings a lot of things to life in a very compelling way to help move decision-making, help move prioritization help move actioning along a lot faster.

49:47 - So for me, it is really just the integration, the speed, the time and the economy, right? Suzy offers an incredibly cost efficient way of doing this.

49:57 - - Yeah. I think that’s a key point.

49:59 - Having personally been on both sides as a client and as a vendor.

50:03 - We shouldn’t undersell the importance of the model, right? You’re not having to screen each time that you run a survey we build a panel around your screener which gives you that quick access.

50:13 - You’re not paying per complete. You’re paying by the question.

50:17 - And while that seems like a subtle nuance it really does allow you to be more agile in terms of speed.

50:22 - In the example that we gave with a t-shirt company we had a large sample of t-shirt enthusiast, ready to go.

50:28 - We were able to then field that over in one day in a couple of hours and iterate very quickly, again either towards the same audience or to a fresh one.

50:37 - In this case, we chose you to refresh one as you agreed, outperformed the original, right? But when you’re not having to recruit and incentivize each time that you want to do a quantitative study it really allows you to have quicker turnaround.

50:48 - We were able to run that study where we had one day of quants, one day of qual refinement and then go back into field.

50:55 - It’s very easy to do because we’re not screening the respondents each individual time.

50:58 - We’re building that panel and we’re targeting as we need to.

51:01 - And as we see fit. - Yeah, absolutely.

51:04 - And with our amazing show up rates and yield rates, also, it’s a significantly faster way of conducting the research.

51:12 - Thank you so much to everybody. That’s it, looks like it’s all the questions that we have right now.

51:19 - So as a quick reminder, Suzy Live is available today.

51:21 - Suzy Live save audiences will be available in all of our current clients dashboards on the 29th of June.

51:27 - When it goes live into the platform itself.

51:31 - We were really excited to have you all here and we’re super pleased to have you all test out the new Suzy Live features continue to build up in rich consumer insights platform.

51:41 - If you have any questions, please reach out to us directly or reach out to your customer success manager for any more details or any kind of thought-starters that you would want to discuss with anybody on the panel here today.

51:52 - Happy to set up a call with either them or people on our sales or customer success team.

51:58 - Thank you again, wishing you all a very happy start to the summer, even though it’s very much raining here in Northern New Jersey today.

52:06 - Thanks everybody. And thank you - Bye-bye - Bye. .