RESEARCH OVERVIEW

Advancing User-Centered Data Policy

Client Objective

The Digital Impact Alliance — a global initiative supported by the United Nations Development Program (UNDP) and the Bill & Melinda Gates Foundation — sought to explore and understand user behaviors related to data privacy in emerging digital markets.

Timeline

October - December 2020

Team

Researchers x3

Skills

Surveys
Interviews
Desk Research

Responsibilites

Planning
Design + Execution
Analysis + Synthesis
BACKGROUND

The Why

When smartphones and mobile data became increasingly inexpensive in emerging markets, millions came online for the first time, generating vast amounts of personal data. Research into data sharing practices became crucial to protect user privacy in this rapidly emerging market.
PROCESS HIGHLIGHTS

The Process

Preparation

Stakeholder Interviews
Secondary Research
Refined Objectives

Design + Execution

Research Design
Participant Recruitment
Research Pilot

Analysis + Synthesis

Cross-Tabulation
Thematic Analysis
‍Tailoring Deliverables
PREPARATION

Stakeholder Interviews

We conducted stakeholder interviews to clarify objectives, align on goals, identify knowledge gaps, and recommend experts from their network. Additionally, expert interviews were carried out to uncover valuable resources, refine strategic direction, highlight potential pitfalls, and suggest relevant frameworks to enhance the research approach.
PREPARATION

Secondary Research

We reviewed a range of recommended studies and frameworks to gain a deeper understanding of the domain, as well as their research approaches and methodologies. Notable resources included Financial Diaries, Portfolios of the Poor, the Trusted Data Sharing Framework, and insights from the Consultative Group to Assist the Poor.
PREPARATION

Refined Objectives

Armed with this knowledge, we used affinity mapping to identify and prioritize the most pressing research questions, which were as follows:
  • Who are our users?
  • What data are they sharing?
  • What are their behaviours and perceptions around data sharing?
DESIGN + EXECUTION

Participant Recruitment

Our stakeholders encouraged us to research communities that allow us to move quickly. We chose India and Nepal due to proximity and the ability to leverage existing networks. We diversified our participant pool by conducting research cities of various sizes.
  • Tier 1: Bangalore, Hyderabad, Delhi, Kathmandu
  • Tier 2: Mathura, Vellore
  • Tier 3: Bahraich
Participants were verbally screened to ensure they were newly digitally active (individuals who recently began engaging with smartphones and the internet). We recruited 285 participants for quantitative surveys and 25 participants for qualitative interviews. Additionally, we collected usage data from 50 consenting participants.
DESIGN + EXECUTION

Research Design

To answer our research questions, we designed a comprehensive research plan utilizing the following research methodologies:
  • Surveys
  • Interviews
  • Desk Research
  • Data Collection

Surveys

We designed our survey questionnaire to collect data on the following probe areas:
  • Demographic Information
  • Digital Activity and Behavior
  • Perceptions surrounding Data Sharing

Interviews

Our discussion guide was carefully crafted to complement the probe areas explored in the survey and to delve deeper into qualitative insights.
  • A day in the life: Participants described their typical day, highlighting digital interactions.
  • Scenario-based testing: Observing participant behavior and decision-making.
  • Understanding mental models: How users perceive and respond to data-sharing.

Desk Research

We identified, through desk research, that we could correlate digital usage patterns with baseline data users are required to share to benefit from digital services. This allowed us to infer the types of data each user was sharing.

Data Collection

We intended to collect non-self reported usage data to compare users' perceptions with their actual behaviors. However, the absence of established data extraction tools and limited prior research posed challenges to the accuracy and methodology of our data collection. Twas a good idea tho!
ANALYSIS + SYNTHESIS

Research Pilot

In our study, we encountered mixed outcomes across different methods. For the surveys, participants expressed frustration with the length, leading us to shorten the survey to improve completion rates. In contrast, qualitative interviews were more successful, which we attribute to the compensation provided.

Meanwhile, our usage data collection system initially performed well during testing but faced challenges later in the study, particularly in collecting data consistently over longer periods. These insights guided adjustments to enhance both methodology and participant experience.
ANALYSIS + SYNTHESIS

Cross-Tabulation

We used cross-tabulation to analyze relationships between variables, uncovering insights into demographics, preferences, and digital activity for a deeper understanding of the data and our users.
ANALYSIS + SYNTHESIS

Thematic Analysis

We used thematic analysis to systematically analyze qualitative data and identify recurring patterns and themes. Themes emerged as we identified clusters of codes that reflected common insights.
ANALYSIS + SYNTHESIS

Tailoring Deliverables

To ensure our findings were clear and actionable, we synthesized them into data profiles, similar to personas, as part of our research report. This deliverable brought the users behind the data to the forefront, highlighting their humanity. By taking this thoughtful approach, we enabled policymakers to connect with the individuals represented, fostering empathy and a deeper understanding of their needs.
Data Profiles - Report Documentation

Limitations of our Research

Our research was primarily constrained by two key factors. First, participants demonstrated a limited understanding of data, which significantly influenced their perceptions and attitudes toward it. Second, the absence of robust data extraction tools, combined with a lack of prior research in this area, posed challenges to the accuracy and reliability of our data collection methods.

Future Directions

Although most respondents reported owning personal phones, interviews revealed many participants shared their devices with family, adding complexity to data-sharing behaviors. While beyond the scope of our research, we would have liked to explore this further.