Executive Summary

Market research in emerging markets faces significant limitations when employing traditional methods. In-person interviews, while providing rich qualitative data, are often hindered by high costs and logistical challenges, particularly in remote or underdeveloped areas. Digital surveys, although scalable and cost-effective, frequently suffer from low engagement rates and fail to capture the depth and nuance necessary for comprehensive insights.

'AI-moderated Interviews' emerge as a transformative solution designed to address these issues. By leveraging the ubiquity and familiarity of WhatsApp, this AI-driven tool mimics the depth of in-person interviews while maintaining the scalability and efficiency of digital surveys. The AI adapts questions in real-time based on respondents' answers, ensuring a personalised and engaging interview experience that captures nuanced insights akin to those gathered by skilled human interviewers.

Key Points and Impact:

This white paper argues for the adoption of AI interviews via WhatsApp as a superior research methodology for specific research scenarios. It highlights the key advantages: deeper insights, cost and resource efficiency, and a broader reach. The potential impact includes more inclusive and representative data collection, improved decision-making for businesses, and a significant reduction in the logistical challenges traditionally associated with market research in emerging markets.

Note: To download this white paper as a PDF, click here.

Introduction

Traditional Research Methods:

Market research traditionally relies on two primary methods: qualitative and quantitative. Qualitative methods, such as in-person interviews and focus groups, provide detailed and context-rich insights. Quantitative methods, such as surveys, offer scalability and statistical significance but often lack the depth and context necessary to fully understand consumer behaviours and preferences (Colom, 2021).

Challenges in Emerging Markets:

Emerging markets present unique challenges for market researchers. The diverse and dispersed populations make it difficult to access representative samples. High costs and logistical barriers further complicate the deployment of traditional in-person interviews. Additionally, the digital divide, characterised by uneven internet access and varying levels of technological literacy, limits the effectiveness of online surveys. These challenges necessitate innovative approaches that can bridge these gaps and provide reliable and comprehensive data (Singer et al., 2020).

High Net Worth and Hard-to-Recruit B2B Individuals:

Market research isn't only challenging in emerging markets but also in reaching high net worth individuals or specialised professionals in the B2B sector. These groups are often difficult to engage using traditional methods due to their busy schedules and selective participation.

Example:

• Problem: A market research firm spends $200 per participant but faces a 20% non-response rate, particularly with specialised doctors or high-ranking executives.
• Solution: Implementing WhatsApp surveys to increase response rates.
• Outcome: Improved response rates save $10,000 annually by reducing non-responses.

Cultural Nuance:

Understanding cultural nuances is critical in market research, especially in diverse regions. Traditional methods often fall short in capturing the subtleties of cultural context, which can lead to misinterpretations and inaccurate data. An effective research methodology must be sensitive to these nuances and capable of engaging participants in a manner that respects and acknowledges their cultural background (Colom, 2021).

The Problem with Traditional Methods

In-Person Interviews:

In-person interviews are lauded for their ability to capture rich, qualitative data. However, they come with significant drawbacks:

• High Costs and Logistical Difficulties: Conducting in-person interviews is expensive, requiring travel, accommodation, and extensive coordination. These costs are prohibitive, especially for large-scale studies or in geographically dispersed regions (Gibson, 2020).
• Limited Scalability and Reach: The logistical challenges inherent in organising and conducting in-person interviews limit their scalability. Reaching remote or underdeveloped areas is particularly difficult, often resulting in unrepresentative samples (Singer et al., 2020).

Digital Surveys:

Digital surveys offer a scalable and cost-effective alternative to in-person interviews, but they too have significant limitations:

• Lack of Depth and Nuanced Responses: While digital surveys can reach a large audience quickly, they often fail to capture the depth and context of responses. Fixed questions do not allow for the probing and follow-up that can reveal deeper insights (Colom, 2021).
• Low Engagement Rates and Impersonal Nature: Many respondents find digital surveys impersonal and disengaging. As a result, response rates are often low, and the quality of the data collected can be compromised (Gibson, 2020).

The Power of WhatsApp for Market Research

Ubiquity and Familiarity:

WhatsApp is the most popular messaging app globally, with 2.7 billion monthly active users as of June 2023, accounting for 52% of the 5.44 billion internet users worldwide (Statista, "WhatsApp Users Worldwide 2023," 2023). In emerging markets, WhatsApp’s penetration is particularly high. For instance, in Kenya, WhatsApp penetration is around 90%, with over 23 million users; in South Africa, penetration is approximately 85%, with 40 million users; and in India, penetration stands at 78%, with over 487 million users (Statista, "WhatsApp Users in Selected Countries," 2023). This widespread use makes WhatsApp an ideal platform for market research, ensuring high participant engagement and response rates.

Benefits:

• Low Data Usage: WhatsApp requires minimal data, making it accessible even in regions with limited internet connectivity. Many users have WhatsApp or Meta data bundles, allowing them to use the app without additional data costs, unlike web-based surveys (Meta, "Connectivity Initiatives," 2023).
• High Response Rates: WhatsApp's familiarity and ease of use lead to significantly higher response rates compared to email surveys. Studies have shown that WhatsApp can achieve response rates up to 90%, compared to email surveys, which often see rates around 30-40% (Gibson, 2020).
• Ease of Use: The user-friendly interface of WhatsApp encourages participation from diverse demographic groups, enhancing the inclusivity and representativeness of the data collected (Singer et al., 2020).

Introducing the 'AI Moderated Interviews'

Capabilities and Technology:

• AI-Driven, Adaptive Questioning: The 'AI Moderated Interviews' use AI to adapt questions in real-time based on respondents' answers. This approach mimics the depth and engagement of in-person interviews, allowing for deeper insights and nuanced understanding. According to a study published on SSRN, AI interviewers can conduct in-depth, semi-structured interviews at a much larger scale compared to traditional face-to-face interviews, capturing nuanced insights similar to a skilled human interviewer (SSRN, "Conducting Qualitative Interviews with AI," 2023).
• Observing and Analysing Textual and Non-Verbal Cues: The AI can analyse not just the content of the responses but also textual non-verbal cues, such as hesitation or emphasis, to gain a more comprehensive understanding of participants' sentiments and opinions (SSRN, "Conducting Qualitative Interviews with AI," 2023).

Integration with WhatsApp:

• Utilisation of WhatsApp Features: The bot leverages WhatsApp’s features to conduct in-depth interviews, including text, voice notes, and multimedia sharing. Conducting interviews via a familiar chat interface like WhatsApp makes respondents feel a greater sense of privacy and control compared to in-person interviews. Many respondents even prefer AI interviewers over human interviewers, as noted in the SSRN study (SSRN, "Conducting Qualitative Interviews with AI," 2023).
• Security, Privacy, and Data Handling: WhatsApp’s end-to-end encryption ensures that all communications are secure and private, protecting participants' data from unauthorised access (WhatsApp, "Security," 2023) Link.

Voice Note and Language Features:

• Improved Representative Samples: Many participants find spelling and typing challenging. Voice notes offer an easier way for them to respond, providing richer context and more accurate data than text alone (Colom, 2021).
• Translation Services: Translation services are natively available in all top language models, allowing participants to respond in their preferred language. This feature enhances response rates and saves researchers on translation costs (Colom, 2021).

Comparative Advantages

Depth and Quality of Insights:

• Comparative Depth: AI interviews offer a depth of insight comparable to in-person interviews. The ability to ask follow-up questions and probe deeper into responses results in more comprehensive and nuanced data. A study found that AI interviews are highly cost-effective and time-saving, enabling the collection of qualitative data from large samples without the logistics and expenses involved in face-to-face interviews, making the approach well-suited for emerging markets (SSRN, "Conducting Qualitative Interviews with AI," 2023).
• Examples of Nuanced Understanding: Case studies and pilot projects have demonstrated that AI interviews can uncover insights that traditional surveys often miss. For instance, the AI's adaptive questioning can reveal underlying motivations and sentiments that fixed surveys cannot (Colom, 2021).

Cost and Resource Efficiency:

• Cost Savings: AI interviews significantly reduce the costs associated with in-person interviews, such as travel and accommodation. They also minimise the need for extensive human resources. According to research, respondents report high satisfaction with AI interviews, with over 80% rating the experience positively, and the method does not negatively impact the quality of the collected data (SSRN, "Conducting Qualitative Interviews with AI," 2023).
• Resource Efficiency: Conducting interviews via WhatsApp requires fewer resources, both in terms of time and personnel, making it a more efficient method for collecting qualitative data.

Scalability and Reach:

• Broad and Diverse Demographic Reach: The 'AI Moderated Interviews' can reach a wide and diverse audience, overcoming geographical and logistical barriers that limit traditional methods. The AI interview experience is comparable to chatting with a human interviewer, and metrics like message length and response time are similar regardless of the respondent's familiarity with AI tools (SSRN, "Conducting Qualitative Interviews with AI," 2023).
• Overcoming Barriers: By utilising a platform with high penetration and low data usage, the bot can effectively engage participants in remote or underdeveloped regions, ensuring a more representative sample (WhatsApp, "Business API," 2023).

Participant Experience:

• Privacy and Openness: Participants often feel more inclined to answer honestly because they do not feel judged by an AI. The sense of anonymity provided by the AI interviewer leads to more candid responses (SSRN, "Conducting Qualitative Interviews with AI," 2023).
• Natural and Human Feel: The AI interview feels more natural and human compared to a survey, particularly because questions carry the context of the participant’s response, creating a more engaging and conversational experience (SSRN, "Conducting Qualitative Interviews with AI," 2023).

‍

Case Studies and Success Stories

Detailed Case Studies:

• Singapore COVID-19 Study: In a study exploring knowledge, attitudes, and perceptions of COVID-19 in Singapore, WhatsApp was used to conduct focus group discussions. This method allowed for the collection of rich qualitative data while ensuring participant privacy and convenience (NCBI, "Using WhatsApp Focus Group Discussions," 2022). Link
• Youth Research in the UK: WhatsApp instant messenger interviews were used in a study focusing on youth research in the UK. The study highlighted the platform's ability to bridge the digital divide and facilitate the collection of detailed qualitative data (Gibson, 2020). Link

Testimonials:

• Research Professional Feedback: "Just completed the interview - totally surprised at how well this worked. Really intelligent questions in response to my inputs, and because I knew I wasn't speaking to a human, I felt less pressured to answer quickly and less pressured to give what might be perceived as the 'right' answer. I'm a people pleaser even during interviews! I think this made my responses better and probably more honest."
• Client Organisation Feedback: "The response rates were significantly higher than our previous email surveys. The participants felt more comfortable and engaged, leading to more honest and detailed responses. The cost savings were also substantial" (SSRN, "Conducting Qualitative Interviews with AI," 2023).

Conclusion

In summary, the 'AI Moderated Interviews' powered by WhatsApp present a transformative approach to market research in emerging markets. They address the significant limitations of traditional methods by combining the depth of in-person interviews with the scalability and efficiency of digital surveys. Key advantages include deeper insights, cost and resource efficiency, and a broader reach. By leveraging WhatsApp’s ubiquity, low data usage, and high participant engagement, this AI-driven tool ensures more inclusive and representative data collection.

As demonstrated through case studies and expert testimonials, AI interviews can significantly enhance the quality of market research while reducing costs and logistical challenges. While there are limitations and scepticism to address, continuous innovation and adaptation will ensure that AI-powered tools remain at the forefront of market research methodologies.

The future of market research in emerging markets looks promising with the integration of AI interviewers. These tools have the potential to revolutionise the field by providing richer, more accurate data, enabling better decision-making, and ultimately driving growth and development in these regions.

References:

• SSRN. "Conducting Qualitative Interviews with AI." 2023. Link
• Meta. "June 2023 Figures." Link
• Colom A. "Using WhatsApp for focus group discussions: Ecological validity, inclusion and deliberation." Qualitative Research, 22(3), 2021. Link
• Gibson K. "Bridging the digital divide: Reflections on using WhatsApp instant messenger interviews in youth research." Qualitative Research in Psychology, 2020. Link
• Singer B., et al. "WhatsApp as a medium to collect qualitative data among adolescents: Lessons learned and considerations for future use." Gates Open Research, 2020. Link
• Statista. "WhatsApp penetration rate in selected countries." 2023. Link

‍