Patchy signals: capturing women's voices in mobile phone surveys of rural India

Phone surveys are a rapid and cost-effective way to collect primary data for research, monitoring and evaluation purposes. But for these data to be precise, reliable and unbiased, women's perspectives must be accurately represented. Throughout 2020, we conducted seven household surveys in rural India to understand households' experiences of the COVID-19 pandemic and contemporaneous relief programmes. Given social distancing protocols, we conducted these surveys over the phone, using household phone numbers collected during earlier, face-to-face research. Analysing metadata from these surveys (along with women's responses to questions about phone use), we determine how gaps in phone access inhibit women's representation in phone surveys. We find that the prevalence of male management of household phones significantly reduces access to female respondents. This is a problem for two reasons. Firstly, men are usually the first to pick up the phone: in two surveys in which we tracked the gender of the person who picked up, men picked up 63.2% and 71.1% of the time, respectively. Moreover, only a small minority of those we reached by phone were able and willing to pass the phone to a household member of the opposite gender, when prompted (with no statistically significant difference between pass rates for women and men). This low immediate pass rate, in combination with low female pickup, led to fewer women respondents. As such, we recommend that researchers dedicate time and resources to taking appointments and making call-backs to reach more women. We also show that the use of female enumerators improves households' willingness to participate in women-centred surveys, and call for more investment into female enumerator teams.