Home

Survey-Based Evaluations

Some recent survey-based evaluation projects performed by HumRRO are described below:

Employment Retention and Advancement Evaluation Project

As part of the 12-month follow-up of this project, participants in the Employment Retention and Advancement (ERA) program in 14 sites across the country were contacted at the 12-month anniversary of their random assignment into the study. HumRRO developed an extensive database system to manage close to 10,000 cases from nearly 100 monthly cohorts that were handled during the 37-month data collection period. This 12-month CATI follow-up interview achieved an average response rate of 77 percent (74% - 81% per site). The 42-month follow-up, involved three sites across the country with approximately 4,000 sample members. Field trackers located respondents who no longer resided at their last-known address. HumRRO was involved in the questionnaire development phase of the project and had ongoing responsibility for data collection, data processing, and database management tasks.

Hard to Employ Demonstration and Evaluation Project

This study began in late 2005 and continued into early 2008. It evaluated programs designed to assist those persons who have found it particularly difficult to obtain and keep employment due to criminal history, mental health history, or poor job performance. Using Computer-Assisted Personal Interviewing, the study wacarried out at five sites across the country at the 15-month point after random assignment into either a treatment or control group. In three of the five sites, the development of children of sample members waassessed using standardized instruments; in one of the sites, bio-samples were collected from respondents and their children, and children 9 to 16 took a self-administered survey via Audio Computer-Assisted Self Administered Interview. Tracking and tracing hard-to-locate respondents was an integral part of this study. HumRRO staff were responsible for pretesting the instruments and had ongoing responsibility for data collection, data processing, and the maintenance of an extensive customized database.

MLA Survey of Hiring by Modern Language Departments

This study, conducted for the Modern Language Association (MLA), surveyed a sample of approximately 2,500 English and modern-language departments in colleges and universities in the United States and Canada to obtain information on the outcome of searches for new faculty members in the 2003 - 2004 academic year. The sample included both MLA Job Information List (JIL) advertisers and non-advertisers. Using a mixed-mode methodology of a Web-based survey with a paper questionnaire follow-up, the data collection effort resulted in completed interviews with 1,014 sample members. HumRRO staff, along with the client, were responsible for the development of the survey questionnaire and materials, conducting in-depth interviews with pretest respondents, implementing the sampling plan, and all activities related to data collection and data processing.

New Jersey TANF, NJ FamilyCare, and ABD Member Satisfaction Survey

Using survey instruments (in both English and Spanish) and data collection procedures developed by the Consumer Assessment of Healthcare Providers and Systems consortium, this survey of New Jersey Medicaid and SSI beneficiaries asked their assessment of the care provided by their health plans. Data were collected primarily by mail with telephone follow-up to maximize response. Each plan's performance was compared to that of other plans and over time. We provided findings of the survey to beneficiaries to assist them in selecting a health plan. We conducted surveys in 1999, 2001, 2002, and 2003. An overall sample of more than 13,000 beneficiaries was selected for inclusion in the 2003 survey, and nearly 5,000 interviews were completed - approximately 70 percent by mail and 30 percent by telephone. HumRRO oversaw all sampling, database, data collection and data processing activities and prepared all reports, including the management reports. This project was conducted for MAXIMUS, Inc.