Making the most of imperfect data: a critical evaluation of standard information collected in farm household surveys

Simon Fraval*, James Hammond, Jannike Wichern, Simon J. Oosting, Imke J.M. De Boer, Nils Teufel, Mats Lannerstad, Katharina Waha, Tim Pagella, Todd S. Rosenstock, Ken E. Giller, Mario Herrero, David Harris, Mark T. van Wijk

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

37 Citations (Scopus)


Household surveys are one of the most commonly used tools for generating insight into rural communities. Despite their prevalence, few studies comprehensively evaluate the quality of data derived from farm household surveys. We critically evaluated a series of standard reported values and indicators that are captured in multiple farm household surveys, and then quantified their credibility, consistency and, thus, their reliability. Surprisingly, even variables which might be considered ‘easy to estimate’ had instances of non-credible observations. In addition, measurements of maize yields and land owned were found to be less reliable than other stationary variables. This lack of reliability has implications for monitoring food security status, poverty status and the land productivity of households. Despite this rather bleak picture, our analysis also shows that if the same farm households are followed over time, the sample sizes needed to detect substantial changes are in the order of hundreds of surveys, and not in the thousands. Our research highlights the value of targeted and systematised household surveys and the importance of ongoing efforts to improve data quality. Improvements must be based on the foundations of robust survey design, transparency of experimental design and effective training. The quality and usability of such data can be further enhanced by improving coordination between agencies, incorporating mixed modes of data collection and continuing systematic validation programmes.
Original languageEnglish
Pages (from-to)230-250
Number of pages21
JournalExperimental Agriculture
Issue number2
Early online date18 Dec 2018
Publication statusPublished - Apr 2019


Dive into the research topics of 'Making the most of imperfect data: a critical evaluation of standard information collected in farm household surveys'. Together they form a unique fingerprint.

Cite this