KFF September 2024 Health Misinformation Tracking Poll Methodology

This KFF Health Tracking Poll/Health Misinformation Tracking Poll was designed and analyzed by public opinion researchers at KFF. The survey was conducted August 26-September 4, 2024, online and by telephone among a nationally representative sample of 1,312 U.S. adults in English (1,244) and in Spanish (68). The sample includes 1,028 adults (n=53 in Spanish) reached through the SSRS Opinion Panel either online (n=1,018) or over the phone (n=18). The SSRS Opinion Panel is a nationally representative probability-based panel where panel members are recruited randomly in one of two ways: (a) Through invitations mailed to respondents randomly sampled from an Address-Based Sample (ABS) provided by Marketing Systems Groups (MSG) through the U.S. Postal Service’s Computerized Delivery Sequence (CDS); (b) from a dual-frame random digit dial (RDD) sample provided by MSG. For the online panel component, invitations were sent to panel members by email followed by up to three reminder emails.

Another 284 (n=15 in Spanish) interviews were conducted from a random digit dial telephone sample of prepaid cell phone numbers obtained through MSG. Phone numbers used for the prepaid cell phone component were randomly generated from a cell phone sampling frame with disproportionate stratification aimed at reaching Hispanic and non-Hispanic Black respondents. Stratification was based on incidence of the race/ethnicity groups within each frame.

Respondents in the phone samples received a $15 incentive via a check received by mail, and web respondents received a $5 electronic gift card incentive (some harder-to-reach groups received a $10 electronic gift card). In order to ensure data quality, cases were removed if they failed two or more quality checks: (1) attention check questions in the online version of the questionnaire, (2) had over 30% item non-response, or (3) had a length less than one quarter of the mean length by mode. Based on this criterion, no cases were removed.

The combined cell phone and panel samples were weighted to match the sample’s demographics to the national U.S. adult population using data from the Census Bureau’s 2022 Current Population Survey (CPS), September 2021 Volunteering and Civic Life Supplement data from the CPS, and the 2024 KFF Benchmarking Survey with ABS and prepaid cell phone samples. The demographic variables included in weighting for the general population sample are gender, age, education, race/ethnicity, region, civic engagement, frequency of internet use, political party identification by race/ethnicity, and education. The sample of registered voters was weighted separately to match the U.S. registered voter population using the same parameters above derived from the 2024 KFF Benchmarking Survey. Both weights account for differences in the probability of selection for each sample type (prepaid cell phone and panel). This includes adjustment for the sample design and geographic stratification of the cell phone sample, within household probability of selection, and the design of the panel-recruitment procedure.

The margin of sampling error including the design effect for the full sample is plus or minus 4 percentage points and is plus or minus 4 percentage points for registered voters. Numbers of respondents and margins of sampling error for key subgroups are shown in the table below. For results based on other subgroups, the margin of sampling error may be higher. Sample sizes and margins of sampling error for other subgroups are available by request. Sampling error is only one of many potential sources of error and there may be other unmeasured error in this or any other public opinion poll. KFF public opinion and survey research is a charter member of the Transparency Initiative of the American Association for Public Opinion Research.

Group N (unweighted) M.O.S.E.
Total 1,312 ± 4 percentage points
Total registered voters 1,084 ± 4 percentage points
Democratic registered voters 377 ± 7 percentage points
Independent registered voters 335 ± 7 percentage points
Republican registered voters 332 ± 7 percentage points

 



KFF Survey of Immigrants: Election 2024 Methodology

This KFF Survey of Immigrants: Election 2024 was designed and analyzed by public opinion researchers at KFF. The survey was conducted August 19-September 17, 2024, online and by telephone among a nationally representative sample of 543 U.S. immigrants in English (429), Chinese (21), Spanish (80), Korean (12), and Vietnamese (1). The sample was reached through the SSRS/KFF Immigrants Panel either online (n=492) or over the phone (n=51). The SSRS/KFF Immigrants Panel is a nationally representative probability-based panel of immigrants where panel members were recruited randomly in one of three ways: (a) Through invitations mailed to respondents randomly sampled from an Address-Based Sample (ABS) provided by Marketing Systems Groups (MSG) through the U.S. Postal Service’s Computerized Delivery Sequence (CDS); (b) a random digit dial telephone sample of prepaid cell phone numbers obtained through MSG from a dual-frame random digit dial (RDD) sample provided by MSG or (c) calling back telephone numbers from recent SSRS RDD polls whose final disposition was “language barrier,” meaning the person answering the phone spoke a language other than English or Spanish.

An initial invitation letter to the survey was sent to panel members via USPS asking them to take the survey online or by calling a toll-free number. Invitation letters were also sent via email to panelists who provided an email address during registration. Email invitations were sent to those who provided an email address during panel registration. Outbound call attempts were also made to panelists who provided a phone number. Online respondents received a $10 electronic gift card incentive, and phone respondents received a $10 incentive check by mail.

The sample was weighted to match the sample’s demographics to the national U.S. adult immigrant population using data from the 2022 American Communities Survey. The demographic variables included in weighting are home ownership, number of adults in household, presence of children in household, census region, length of time in the U.S., English proficiency, citizenship status, gender, age, race/ethnicity, education, and country of origin. Weights account for recontact propensity and the design of the panel recruitment survey.

Comparisons to total US adults come from the September 2024 KFF Health Misinformation tracking poll which was conducted among a nationally representative sample of N=1,312 US adults in English (1,244) and Spanish (68) from August 26 to September 4, 2024. The sample was reached via the probability based SSRS Opinion Panel (1,028) and through a RDD sample of prepaid cell phone numbers (284). The combined cell phone and panel samples were weighted to match the sample’s demographics to the national U.S. adult population using data from the Census Bureau’s 2022 Current Population Survey (CPS), September 2021 Volunteering and Civic Life Supplement data from the CPS, and the 2024 KFF Benchmarking Survey with ABS and prepaid cell phone samples. The demographic variables included in weighting for the general population sample are gender, age, education, race/ethnicity, region, civic engagement, frequency of internet use, political party identification by race/ethnicity, and education. The sample of registered voters was weighted separately to match the U.S. registered voter population using the same parameters above derived from the 2024 KFF Benchmarking Survey. Both weights account for differences in the probability of selection for each sample type (prepaid cell phone and panel). This includes adjustment for the sample design and geographic stratification of the cell phone sample, within household probability of selection, and the design of the panel-recruitment procedure.

The margin of sampling error including the design effect for the immigrant adults sample is plus or minus 6 percentage points and is plus or minus 4 percentage points for US adults. Numbers of respondents and margins of sampling error for key subgroups are shown in the table below. For results based on other subgroups, the margin of sampling error may be higher. Sample sizes and margins of sampling error for other subgroups are available by request. Sampling error is only one of many potential sources of error and there may be other unmeasured error in this or any other public opinion poll. KFF public opinion and survey research is a charter member of the Transparency Initiative of the American Association for Public Opinion Research.

Group N (unweighted) M.O.S.E.
Total Immigrant Adults 543 ± 6 percentage points
Total US adults 1,312 ± 4 percentage points
Registered voters
Immigrant registered voters 315 ± 9 percentage points
Total US registered voters 1,084 ± 4 percentage points

 

Findings Appendix

KFF Headquarters: 185 Berry St., Suite 2000, San Francisco, CA 94107 | Phone 650-854-9400
Washington Offices and Barbara Jordan Conference Center: 1330 G Street, NW, Washington, DC 20005 | Phone 202-347-5270

www.kff.org | Email Alerts: kff.org/email | facebook.com/KFF | twitter.com/kff

The independent source for health policy research, polling, and news, KFF is a nonprofit organization based in San Francisco, California.