California’s Previously Uninsured After The ACA’s Second Open Enrollment Period
This is the third in a series of surveys by the Kaiser Family Foundation (KFF) tracking the views and experiences of a group of Californians who were uninsured in the summer of 2013, prior to implementation of the ACA’s insurance market reforms and coverage expansions through Covered California and Medi-Cal. The first survey (Wave 1) was conducted from July 11-August 29, 2013, with a randomly selected group of individuals who were uninsured at the time of the interview, and was paid for entirely by KFF. The second survey (Wave 2) was conducted from April 1-June 15, 2014 and the current survey (Wave 3) was conducted from February 18-May 13, 2015, with the same longitudinal panel of respondents, whether they obtained coverage or remained uninsured. All three surveys were designed and analyzed by researchers at KFF. Social Science Research Solutions collaborated with KFF researchers on sample design, weighting, and supervised fieldwork. Fieldwork costs associated with Waves 2 and 3 of the survey were paid for by The California Endowment.
The Wave 1 survey was conducted among a representative random sample of 2,001 adults ages 19-64 living in California who reported having been without health insurance for at least two months at the time of the interview1 (NOTE: persons without a telephone could not be included in the random selection process). Computer-assisted telephone interviews conducted by landline (990) and cell phone (1,011, including 660 who had no landline telephone) were carried out in English and Spanish by SSRS. To increase efficiency in reaching this low-incidence, hard-to-reach group, both the landline and cell phone sampling frames oversampled areas with a lower-income population (since being uninsured is negatively correlated with income). The landline sample frame also oversampled households whose phone numbers were matched with directory listings indicating the presence of at least one person age 19-64 and a household income of less than $25,000. Additionally, 230 interviews (130 landline, 100 cell phone) were conducted with respondents who previously completed recent national SSRS omnibus surveys of the general public and indicated they were ages 19-64 and uninsured. These previous surveys were conducted with nationally representative, random-digit-dial landline and cell phone samples. Waves 2 and 3 also consisted of computer-assisted telephone interviews conducted in English and Spanish by landline and cell phone, including those who had no landline phone.
| Total | Landline | Cell phone (no landline) |
Web | |
| Wave 1 (July 11-August 29, 2013) | 2,001 | 990 | 1,011 (660) | Not applicable |
| Wave 2 (April 1-June 15, 2014) | 1,219 | 623 | 545 (327) | 51 |
| Wave 3 (February 18-May 13, 2015) | 1,105 | 555 | 463 (317) | 87 |
In order to re-connect with respondents who may be more willing to complete the survey online, an abbreviated web version was introduced on for Waves 2 and 3 after attempts had been made to reach respondents by phone. The online questionnaire was offered in English and Spanish and was limited to key questions about insurance status, type of coverage, and reasons for obtaining coverage or remaining uninsured. A total of 51 respondents in Wave 2 and 87 respondents in Wave 3 completed the online version of the survey.
Screening for Waves 2 and 3 involved verifying that the respondent had participated in Wave 1. Multiple attempts were made to reach every respondent from Wave 1 and encourage participation in later waves. Efforts included multiple dialing at various times of day and throughout the week, mailings and emails to those who provided such contact information, repeated dialing of non-working numbers, and attempts to find alternative phone numbers for non-working numbers.
A multi-stage weighting design was applied to ensure accurate representation of California’s nonelderly adult uninsured population prior to the ACA’s coverage expansions. The weighting process for Waves 2 and 3 involved corrections for sample design, as well as sample weighting to match the weighted Wave 2 sample and the weighted Wave 3 sample to Wave 1 responses along demographic characteristics. As it did for Wave 1, the base weight for Waves 2 and 3 accounted for the oversamples used in the sample design, as well as the likelihood of non-response for the sample from earlier omnibus surveys, number of eligible household members for the landline sample, and a correction to account for the fact that respondents with both a landline and cell phone have a higher probability of selection. Demographic weighting parameters for Waves 2 and 3 were based on Wave 1 weighted demographics, which were adjusted for age, education, race/ethnicity, nativity (for Hispanics only), Hispanics by gender, presence of own child in household, marital status, California region, poverty level, and phone usage. For more information on weighting and data sources, see the Wave 1 methodology. All differences referred to in the report are statistically significant. Statistical tests of significance account for the effect of weighting, and, for trend analysis, testing takes into account the survey’s panel design.
A unique consideration for panel surveys such as the Kaiser Family Foundation California Longitudinal Panel Survey, is whether those who participate in subsequent waves are different in terms of their attitudes or demographics than those who refuse to participate again or were unable to be re-contacted. Of the total 2,001 respondents who completed Wave 1, 1,219 participated in Wave 2 and 1,105 completed Wave 3. These completion rates are within an expected range given that the uninsured are already an often a difficult to reach population since many are lower income, younger, undocumented immigrants, and members of racial/ethnic minority groups, and may change phone numbers or move more often than the public at large. After data collection was complete, data from Wave 1 and Wave 3 were compared to evaluate the impact of some respondents not completing Wave 3, referred to as attrition. While there are some differences in the unweighted demographics of those who completed Wave 3 and the full Wave 1 sample, these differences are corrected for by weighting. As shown in the table below the total weighted distributions are similar for Wave 1 and Wave 3 for age, gender, race/ethnicity, party identification, education and income. See the Wave 3 Attrition Appendix for more information on attrition.
| Unweighted | Weighted | ||||||||
| Wave 1 (n=2001) | Completed Wave 3 (n=1105) |
Completed all 3 Waves (n=923) |
Percentage Point Difference (W1 – W3 Total) |
Wave 1 | Completed Wave 3 | Completed all 3 Waves | Percentage Point Difference (W1 – W3 Total) |
||
| Gender | |||||||||
| Male | 48% | 44% | 42% | 4 | 54% | 53% | 50% | 1 | |
| Female | 52% | 56% | 58% | -4 | 46% | 47% | 50% | -1 | |
| Race/ ethnicity | |||||||||
| White | 27% | 32% | 35% | -5 | 26% | 27% | 30% | -1 | |
| Black | 7% | 7% | 8% | 0 | 5% | 5% | 6% | 0 | |
| Hispanic | 58% | 54% | 50% | 4 | 56% | 55% | 53% | 1 | |
| Other Race | 8% | 7% | 8% | 1 | 12% | 11% | 11% | 1 | |
| Age | |||||||||
| 18 to 29 | 23% | 18% | 17% | 5 | 33% | 31% | 27% | 2 | |
| 30 to 39 | 21% | 19% | 20% | 2 | 24% | 24% | 25% | 0 | |
| 40 to 49 | 22% | 21% | 21% | 1 | 21% | 21% | 22% | 0 | |
| 50 to 64 | 35% | 41% | 42% | -6 | 22% | 24% | 26% | -2 | |
| Education | |||||||||
| HS or less | 57% | 51% | 50% | 6 | 58% | 56% | 55% | 2 | |
| Some college | 28% | 31% | 32% | -3 | 29% | 30% | 31% | -1 | |
| College Grad+ | 15% | 17% | 17% | -2 | 12% | 13% | 13% | -1 | |
| Phone status | |||||||||
| Landline | 49% | 54% | 55% | -5 | 42% | 45% | 48% | -3 | |
| Cell | 51% | 46% | 45% | 5 | 58% | 55% | 52% | 3 | |
| Marital status | |||||||||
| Married | 33% | 32% | 32% | 1 | 37% | 37% | 38% | 0 | |
| Not Married | 67% | 67% | 68% | 0 | 62% | 63% | 62% | -1 | |
| Family income | |||||||||
| <138% FPL | 60% | 58% | 58% | 2 | 52% | 53% | 54% | -1 | |
| 138%-400% FPL | 30% | 32% | 32% | -2 | 36% | 35% | 34% | 1 | |
| 400%+ FPL | 5% | 6% | 5% | -1 | 7% | 7% | 7% | 0 | |
| Language of interview | |||||||||
| English | 63% | 67% | 69% | -4 | 65% | 66% | 66% | -1 | |
| Spanish | 37% | 33% | 31% | 4 | 35% | 34% | 34% | 1 | |
| Resident Status | |||||||||
| Citizen/ legal immigrant | 79% | 83% | 84% | -4 | 78% | 80% | 81% | -2 | |
| Undocumented immigrant | 20% | 16% | 15% | 4 | 21% | 19% | 18% | 2 | |
| Party Identification | |||||||||
| Republican | 11% | 12% | 13% | -1 | 11% | 12% | 13% | -1 | |
| Democrat | 35% | 36% | 36% | -1 | 32% | 32% | 31% | 0 | |
| Independent | 35% | 35% | 34% | 0 | 37% | 39% | 38% | -2 | |
| Other | 9% | 8% | 8% | 1 | 9% | 8% | 8% | 1 | |
Another consideration for panel surveys is the potential for “sensitization effects,” that is, what effect returning to the same people about the same topics has on their experiences or views. For example, after taking the baseline survey that covered many aspects of the coverage expansions under the ACA, were people more likely to seek out information about health insurance and enroll than they would have been otherwise? While there is no direct way to measure this effect on this survey, other analyses have found that these effects are minimal and short-lived,2 and we do not believe they would have had a substantial impact on results presented here, particularly given all the other media coverage, advertising, and outreach targeted at this population during the fall and winter of 2013 and 2014.
The margin of sampling error including the design effect for the full sample is plus or minus 4 percentage points. For the recently insured, it is plus or minus 5 percentage points and for the remaining uninsured it is plus or minus 8 percentage points. Numbers of respondents and margin of sampling error for key subgroups are shown in the table below.
| Group | N | MOSE |
| Total Wave 3 | 1105 | +/- 4 percentage points |
| Recently Insured | 797 | +/- 5 percentage points |
| Recently insured by Medi-Cal | 411 | +/- 7 percentage points |
| Recently insured by non-group plan | 168 | +/- 11 percentage points |
| Recently insured through Covered California | 147 | +/- 12 percentage points |
| Recently insured through an employer | 143 | +/- 11 percentage points |
| Recently insured Hispanics | 380 | +/- 7 percentage points |
| Remaining Uninsured | 303 | +/- 8 percentage points |
| Remaining uninsured Hispanics | 209 | +/- 9 percentage points |
| Remaining uninsured undocumented immigrants | 110 | +/- 13 percentage points |
For results based on other subgroups, the margin of sampling error may be higher. Sample sizes and margin of sampling errors for other subgroups are available by request. Note that sampling error is only one of many potential sources of error in this or any other public opinion poll.
Some demographic measures referred to in the report were only asked during the baseline survey, such as questions about educational attainment, debilitating chronic condition, length of time uninsured, resident status, and race/ethnicity. For more information on the first and second waves of the Kaiser Family Foundation California Longitudinal Panel Survey visit:
Wave 1: https://www.kff.org/health-reform/report/californias-uninsured-on-the-eve-of-aca-open-enrollment/