Integrating a gender perspective into data collection goes beyond recording the sex of the respondent (or household member, reference person, or head of the household, for that matter). It entails a review of the data collection process in all its stages – from the selection of topics to be covered by the survey or census, to questionnaire or form design, sample design, selection and training of interviewers and supervisors, data collection in the field, data coding and data editing – and paying attention to all factors that could potentially lead to a gender bias in the data.
- + A general model for integrating a gender perspective into censuses and surveys
- Setting out the objectives of surveys or censuses
The integration of a gender perspective into data collection should be taken into account from the stage of planning the data collection and setting out the objectives of the survey or census. Usually, the objectives of a survey or census are set out based on several factors: topics and policy issues that need to be addressed; review of previous data collections within the same programme; information available from other data sources; international statistical standards; country’s institutional capacity for collecting data; financial and other resources available. It is important that a gender perspective is incorporated in the review of previous data collections, both in terms of topics covered and the specific implementation, as reflected in data collection instruments and materials. National statistical offices can use their plan for the production of gender statistics to decide what gender statistics are to be collected by the particular survey or census developed at the time and what is to be covered by other sources of data. It is also important that gender specialists are involved in the process of developing data collection objectives. This process is typically based on extensive consultations between data producers and data users such as technical experts, data analysts, researchers, policy analysts, and policy makers. Both gender statisticians and gender specialists representing the point of view of data users and policy makers should be part of the team.
Questionnaire design and testing
Within the topics agreed to be covered by the survey or census, relevant gender issues should be identified and gender-specific conceptual and measurement issues should be taken into account (as discussed in chapter 2). These elements should be reflected in the questionnaire design, interviewer’s manual, and training of the interviewers and supervisors.
The questionnaire design should ensure that gender-specific conceptual and measurement issues are adequately reflected in the questions. It should benefit from consultations with a wide range of specialists, such as subject matter specialists, classification and coding experts, field supervisors, data processing staff, and data analysts. It is important that members of the team designing the questionnaire are knowledgeable of gender issues.
The language, terms, or phrasing of the questions should not induce gender biases. In particular, it is recommended that:
the questionnaire contains very short explanatory notes for the interviewer when needed, with more elaborate instructions, explanations of terms, or, in some cases, definitions and key concepts, provided in the interviewer’s manual.
probing questions are used in order to reduce under-reporting related to women, both to help respondents remember something that they may have forgotten and to help interviewers properly code the answers of some questions.
questions are written out in detail, with the reference period clearly specified. In some cases it may also be helpful to give examples of responses or the complete list of categories of answers.
the potential answers to questions should be categorized and pre-coded in such a way that answers related mainly to women are given the same importance as those mainly related to men.
questions should be kept as short and simple as possible, free from ambiguity, using common every day terms, so that all respondents, regardless of their educational level, have no difficulty in understanding them.
questions should not influence answers or be leading. Keywords in the questions should not apply exclusively to one of the two sexes (for example, “housewife” or “fisherman”) and they should maintain their meaning when translated into major languages of a country.
The questionnaire should be field-tested to ensure that both women and men understand the questions in the same way and to detect potential under-reporting or other bias related to either women or men.
Gender-related measurement issues and gender stereotypes should be addressed in the manuals for interviewers and supervisors. Manuals should have elaborate explanations on questions that may lead to underreporting or sex-selective underreporting (for example, domestic violence or economic activity); instructions and examples on how to use probing questions or lists (for example, in measuring economic activity); and, where applicable, instructions on how to code the answers (for example, in measuring self-employment or detailed marital status). The general language should be free of gender-based biases or other stereotypes related to the characteristics measured, and the examples given should not reinforce gender stereotypes.
Samples used should cover all groups of population, households, agricultural holdings or economic units known to have distinct gender patterns. The sample design should also ensure that reliable statistics are produced for both women and men in sufficient detail and allow disaggregation by other characteristics as required for meaningful gender analysis. For example, the sample of a survey measuring status in employment should be large enough to allow for the data to be analysed separated for female and male groups of employers or any other categories of self-employed, as well as further disaggregated by age group, rural/urban areas and educational attainment.
Selection and training of interviewers and supervisors
Selection and training of interviewers and supervisors are an important element in obtaining reliable gender statistics. Gender-related measurement issues and gender stereotypes should be addressed in the training for interviewers and supervisors. For example, the training should cover the situations when multiple respondents within the household need to be interviewed to avoid indirect reporting (for instance in recording literacy) or when information needs to be collected from household members that are most knowledgeable of the issue (for instance, household food consumption, number of children ever born). How to handle the interview environment when sensitive questions need to be asked, such as in the case of violence against women, or even in the case of women’s earnings, should be also included in the training. In addition, training should emphasize understanding of general gender issues related to the topics covered by the survey or census and how the data collected will address those issues, so that they can cope with issues and problems not specifically addressed in the manuals or training.
It is important that the field staff is selected on the basis of competence, and that both women and men are recruited as interviewers or supervisors. Certain types of surveys – such as violence against women surveys – need more careful selection and more extensive training of interviewers. The sex of the interviewer often play an important part in obtaining certain types of information from the respondents. Women, for example, are more likely to disclose information on sensitive topics such as violence against women or reproductive health to women interviewers than to men interviewers.
Data coding and data editing
It is important that gender bias is not introduced into the data at the stage of data coding and data editing. Data coding and data editing are data transformations that improve internal consistency and the conceptual soundness of data. Whenever possible, pre-coded responses are used in the questionnaires, and some of the data coding can be done by the interviewers directly in the field, by coding the respondent’s answer into the questionnaire. Other coding needs to be done by specialized coders using code books or computer programs, and some of the data errors may need to be fixed through data imputation. It is important that classification and subject matter specialists with training in gender issues are involved in formulating rules for data coding, data editing and data imputation, so that assumptions based on gender stereotypes are avoided.
- + Organization and use of the chapter
- The issues described above are general issues that need to be taken into account when mainstreaming gender into data collection. However, depending on the type of data collection, specific issues will need to be considered. The sections that follow provide guidance on bringing a gender perspective into three major data collection vehicles that yield gender statistics: population and housing censuses, agricultural censuses and surveys, and labour force surveys. Time use surveys and violence against women surveys are also presented but covered in less detail, as complete and recent manuals are dedicated to these gender-focused data collections5. For each of these sources of data, there are shown the types of topics usually covered in data collection; what is their relevance for gender statistics; and what practices have been used to improve, from a gender perspective, the data collection.
The information in this chapter can be used to take into account gender issues and gender biases in measurement when designing or redesigning surveys or censuses. Thus, it represents a complementary to the information already existing on data collection through censuses or surveys, and not a substitute for it.
5United Nations, Forthcoming. Guidelines for Producing Statistics on Violence against Women: Statistical surveys. DESA, Statistics Division, New York; and United Nations, 2005. Guide to Producing Statistics on Time Use: Measuring Paid and Unpaid Work. DESA, Statistics Division, New York.
6United Nations, Forthcoming. Guidelines for Producing Statistics on Violence against Women: Statistical surveys. DESA, Statistics Division, New York; and United Nations, 2005. Guide to Producing Statistics on Time Use: Measuring Paid and Unpaid Work. DESA, Statistics Division, New York.
- + References
- Grosh, Margaret, and Paul Glewwe (ed), 2000. Designing Household Survey Questionnaires for Developing Countries. Lessons from 15 years of the Living Standards Measurement Study. World Bank, Washington DC.
Hedman, Birgitta, Francesca Perucci and Pehr Sundström, 1996. Engendering Statistics. A Tool for Change. Statistics Sweden.
United Nations, 2005. Household Sample Survey in Developing and Transition Countries. Department of Economic and Social Affairs, Statistics Division. Studies in Methods. Series F No.96. New York.
United Nations, 2008. Principles and Recommendations for Population and Housing Censuses. Revision 2. Department of Economic and Social Affairs, Statistics Division. Series M No.67/Rev.2. New York.
United Nations Economic Commission for Europe and World Bank Institute, 2010. Developing Gender Statistics: A Practical Tool. Geneva.