Data Quality in the Application of Tailored Calendar Methods in Hard-to-Reach Populations

M.Q. Navarra, W. van der Vaart, Anke Niehof

Research output: Contribution to conferenceConference paperAcademicpeer-review

Abstract

Abstract A tailored calendar method was used to collect retrospective data from hard-to-reach populations: people with very low levels of income, education and literacy that live in complex societal situations and have low trust in authorities. Recognizing the serious threats to data quality in surveying these populations, the presumed helpful graphical display and aided recall properties of calendar interviewing was supplemented by allowing ‘third persons’ to help the respondents. The subjects of the study are households who were involuntarily displaced and relocated by national governments due to man-made natural disaster and development projects. The site of the present study is in the Philippines, involving 6,144 households whose residency in the relocation site spans from one to 12-year period. A sample of 150 households was randomly selected from the master list of the supervising housing agency. A tailored calendar method was designed, involving a standardized, face-to-face, retrospective interview with the head of household about the rebuilding of the households’ “social capital” since resettlement. About one-third of the respondents is interviewed with help from ‘third persons’ (e.g. spouse, children, neighbours), while the rest is interviewed without such help. Characteristics of the ‘third persons’, respondents and households are related to the impact of the calendar procedure. Multiple indicators are used to assess the quality of the data obtained - e.g., “don’t know” and “not yet experienced” responses, completeness of information, rounding and heaping of numbers and dates, and evaluations by respondents and interviewers. The results will yield insights into what procedures can ‘help’ in collecting reliable data from the very hard-to-reach populations.
Original languageEnglish
Pages1-23
Publication statusPublished - 2012
EventACSPRI Conferences, RC33 Eighth International Conference on Social Science Methodology -
Duration: 9 Jul 201213 Jul 2012

Conference

ConferenceACSPRI Conferences, RC33 Eighth International Conference on Social Science Methodology
Period9/07/1213/07/12

Fingerprint

data quality
human being
housing agency
resettlement
move
interview
Philippines
development project
spouse
social capital
natural disaster
literacy
threat
income
evaluation
education

Cite this

Navarra, M. Q., van der Vaart, W., & Niehof, A. (2012). Data Quality in the Application of Tailored Calendar Methods in Hard-to-Reach Populations. 1-23. Paper presented at ACSPRI Conferences, RC33 Eighth International Conference on Social Science Methodology, .
Navarra, M.Q. ; van der Vaart, W. ; Niehof, Anke. / Data Quality in the Application of Tailored Calendar Methods in Hard-to-Reach Populations. Paper presented at ACSPRI Conferences, RC33 Eighth International Conference on Social Science Methodology, .
@conference{2941d877cc794b55b26a88a30c48583a,
title = "Data Quality in the Application of Tailored Calendar Methods in Hard-to-Reach Populations",
abstract = "Abstract A tailored calendar method was used to collect retrospective data from hard-to-reach populations: people with very low levels of income, education and literacy that live in complex societal situations and have low trust in authorities. Recognizing the serious threats to data quality in surveying these populations, the presumed helpful graphical display and aided recall properties of calendar interviewing was supplemented by allowing ‘third persons’ to help the respondents. The subjects of the study are households who were involuntarily displaced and relocated by national governments due to man-made natural disaster and development projects. The site of the present study is in the Philippines, involving 6,144 households whose residency in the relocation site spans from one to 12-year period. A sample of 150 households was randomly selected from the master list of the supervising housing agency. A tailored calendar method was designed, involving a standardized, face-to-face, retrospective interview with the head of household about the rebuilding of the households’ “social capital” since resettlement. About one-third of the respondents is interviewed with help from ‘third persons’ (e.g. spouse, children, neighbours), while the rest is interviewed without such help. Characteristics of the ‘third persons’, respondents and households are related to the impact of the calendar procedure. Multiple indicators are used to assess the quality of the data obtained - e.g., “don’t know” and “not yet experienced” responses, completeness of information, rounding and heaping of numbers and dates, and evaluations by respondents and interviewers. The results will yield insights into what procedures can ‘help’ in collecting reliable data from the very hard-to-reach populations.",
author = "M.Q. Navarra and {van der Vaart}, W. and Anke Niehof",
note = "paper, 23 pagina's; ACSPRI Conferences, RC33 Eighth International Conference on Social Science Methodology ; Conference date: 09-07-2012 Through 13-07-2012",
year = "2012",
language = "English",
pages = "1--23",

}

Navarra, MQ, van der Vaart, W & Niehof, A 2012, 'Data Quality in the Application of Tailored Calendar Methods in Hard-to-Reach Populations' Paper presented at ACSPRI Conferences, RC33 Eighth International Conference on Social Science Methodology, 9/07/12 - 13/07/12, pp. 1-23.

Data Quality in the Application of Tailored Calendar Methods in Hard-to-Reach Populations. / Navarra, M.Q.; van der Vaart, W.; Niehof, Anke.

2012. 1-23 Paper presented at ACSPRI Conferences, RC33 Eighth International Conference on Social Science Methodology, .

Research output: Contribution to conferenceConference paperAcademicpeer-review

TY - CONF

T1 - Data Quality in the Application of Tailored Calendar Methods in Hard-to-Reach Populations

AU - Navarra, M.Q.

AU - van der Vaart, W.

AU - Niehof, Anke

N1 - paper, 23 pagina's

PY - 2012

Y1 - 2012

N2 - Abstract A tailored calendar method was used to collect retrospective data from hard-to-reach populations: people with very low levels of income, education and literacy that live in complex societal situations and have low trust in authorities. Recognizing the serious threats to data quality in surveying these populations, the presumed helpful graphical display and aided recall properties of calendar interviewing was supplemented by allowing ‘third persons’ to help the respondents. The subjects of the study are households who were involuntarily displaced and relocated by national governments due to man-made natural disaster and development projects. The site of the present study is in the Philippines, involving 6,144 households whose residency in the relocation site spans from one to 12-year period. A sample of 150 households was randomly selected from the master list of the supervising housing agency. A tailored calendar method was designed, involving a standardized, face-to-face, retrospective interview with the head of household about the rebuilding of the households’ “social capital” since resettlement. About one-third of the respondents is interviewed with help from ‘third persons’ (e.g. spouse, children, neighbours), while the rest is interviewed without such help. Characteristics of the ‘third persons’, respondents and households are related to the impact of the calendar procedure. Multiple indicators are used to assess the quality of the data obtained - e.g., “don’t know” and “not yet experienced” responses, completeness of information, rounding and heaping of numbers and dates, and evaluations by respondents and interviewers. The results will yield insights into what procedures can ‘help’ in collecting reliable data from the very hard-to-reach populations.

AB - Abstract A tailored calendar method was used to collect retrospective data from hard-to-reach populations: people with very low levels of income, education and literacy that live in complex societal situations and have low trust in authorities. Recognizing the serious threats to data quality in surveying these populations, the presumed helpful graphical display and aided recall properties of calendar interviewing was supplemented by allowing ‘third persons’ to help the respondents. The subjects of the study are households who were involuntarily displaced and relocated by national governments due to man-made natural disaster and development projects. The site of the present study is in the Philippines, involving 6,144 households whose residency in the relocation site spans from one to 12-year period. A sample of 150 households was randomly selected from the master list of the supervising housing agency. A tailored calendar method was designed, involving a standardized, face-to-face, retrospective interview with the head of household about the rebuilding of the households’ “social capital” since resettlement. About one-third of the respondents is interviewed with help from ‘third persons’ (e.g. spouse, children, neighbours), while the rest is interviewed without such help. Characteristics of the ‘third persons’, respondents and households are related to the impact of the calendar procedure. Multiple indicators are used to assess the quality of the data obtained - e.g., “don’t know” and “not yet experienced” responses, completeness of information, rounding and heaping of numbers and dates, and evaluations by respondents and interviewers. The results will yield insights into what procedures can ‘help’ in collecting reliable data from the very hard-to-reach populations.

M3 - Conference paper

SP - 1

EP - 23

ER -

Navarra MQ, van der Vaart W, Niehof A. Data Quality in the Application of Tailored Calendar Methods in Hard-to-Reach Populations. 2012. Paper presented at ACSPRI Conferences, RC33 Eighth International Conference on Social Science Methodology, .