Controlling for Selection Bias in Social Media Indicators through Official Statistics: a Proposal

被引:10
|
作者
Iacus, Stefano M. [1 ]
Porro, Giuseppe [2 ]
Salini, Silvia [1 ]
Siletti, Elena [1 ]
机构
[1] Univ Milan, Dept Econ Management & Quantitat Methods, Via Conservatorio 7, I-20122 Milan, Italy
[2] Univ Insubria, Dept Law Econ & Culture, Via St Abbondio 12, I-22100 Como, Italy
关键词
Well-being; big data; sentiment analysis; small area estimation; weighting; SMALL-AREA ESTIMATION; BIG DATA; TIME-SERIES; FUTURE; INCOME;
D O I
10.2478/JOS-2020-0017
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
With the increase of social media usage, a huge new source of data has become available. Despite the enthusiasm linked to this revolution, one of the main outstanding criticisms in using these data is selection bias. Indeed, the reference population is unknown. Nevertheless, many studies show evidence that these data constitute a valuable source because they are more timely and possess higher space granularity. We propose to adjust statistics based on Twitter data by anchoring them to reliable official statistics through a weighted, space-time, small area estimation model. As a by-product, the proposed method also stabilizes the social media indicators, which is a welcome property required for official statistics. The method can be adapted anytime official statistics exists at the proper level of granularity and for which social media usage within the population is known. As an example, we adjust a subjective wellbeing indicator of "working conditions" in Italy, and combine it with relevant official statistics. The weights depend on broadband coverage and the Twitter rate at province level, while the analysis is performed at regional level. The resulting statistics are then compared with survey statistics on the "quality of job" at macro-economic regional level, showing evidence of similar paths.
引用
收藏
页码:315 / 338
页数:24
相关论文
共 25 条