Purpose. The National Survey of College Graduates (NSCG) provides data on the characteristics of the nation’s college graduates, with a focus on graduates in the science and engineering (S&E) workforce. It samples individuals living in the United States during the survey reference week who have earned at least a bachelor’s degree and are younger than 76. By surveying college graduates in all academic disciplines, the NSCG provides data useful in understanding the relationship between college education and career opportunities, as well as the relationship between degree field and occupation.

The NSCG is designed to provide demographic, education, and career history information about college graduates and to complement the Survey of Doctorate Recipients (SDR). These two surveys share a common reference date, and they use similar questionnaires and data processing guidelines.

The 2023 NSCG data collection instrument includes revisions from the previous survey cycle to remove questions collecting information on the impact of the COVID-19 pandemic and to include new or expanded questions on telecommuting, race, and gender identity. The telecommuting question was expanded to include telecommuting frequency; the race question was expanded to include more detailed information through the collection of subgroup information for the Asian and the Native Hawaiian or Other Pacific Islander categories; and the sex question from the previous survey cycle was replaced with sex at birth and gender identity questions.

These technical notes provide an overview of the 2023 NSCG.

Data collection authority. Title 13, Section 8 of the United States Code; the National Science Foundation Act of 1950, as amended; and the America COMPETES Reauthorization Act of 2010 authorize this collection. The Office of Management and Budget control number is 3145-0141. The disclosure review number is NCSES-DRN24-091.

Survey contractor. Census Bureau.

Survey sponsor. The National Center for Science and Engineering Statistics (NCSES) within the U.S. National Science Foundation.

Frequency. Biennial.

Initial survey year. 1993.

Reference period. The week of 1 February 2023.

Response unit. Individuals with at least a bachelor’s degree.

Sample or census. Sample.

Population size. Approximately 71.7 million individuals.

Sample size. Approximately 161,000 individuals.

Target population. The NSCG target population includes individuals who meet the following criteria:

• Earned a bachelor’s degree^{​Bachelor’s degrees include equivalent undergraduate academic degrees awarded by colleges and universities in countries that may name their degrees differently.Bachelor’s degrees include equivalent undergraduate academic degrees awarded by colleges and universities in countries that may name their degrees differently.Bachelor’s degrees include equivalent undergraduate academic degrees awarded by colleges and universities in countries that may name their degrees differently.} or higher prior to 1 January 2022
• Are not institutionalized and reside in the United States or Puerto Rico as of 1 February 2023
• Are younger than 76 years as of 1 February 2023

Sampling frame. Using a rotating panel design, the 2023 NSCG includes new sample cases from the 2021 American Community Survey (ACS) and returning sample cases from the 2021 NSCG.

The NSCG sampling frame for new sample cases included the following eligibility requirements:

• Were residing in the United States or Puerto Rico as of the ACS interview date
• Were noninstitutionalized as of the ACS interview date
• Had earned at least a bachelor’s degree as of the ACS interview date
• Would be under the age of 76 as of 1 February 2023
• Did not have an inaccurate name or incomplete address on the ACS data file

Returning sample cases from the 2021 NSCG originated from three different frames (the 2015 ACS, 2017 ACS, and 2019 ACS) and had the following eligibility requirements:

• Were a complete interview or temporarily ineligible during their initial NSCG survey cycle
• Would be under the age of 76 as of 1 February 2023
• During the 2021 NSCG survey cycle, did not refuse to participate and did not request to be excluded from future NSCG cycles

Sample design. The NSCG sample design is cross-sectional with a rotating panel element. As a cross-sectional study, the NSCG provides estimates of the size and characteristics of the college graduate population for a point in time. As part of the rotating panel design, every new panel receives a baseline survey interview and three biennial follow-up interviews before rotating out of the survey.

The NSCG uses a stratified sampling design to select its sample from the eligible sampling frame. In the new sample, cases were selected using systematic probability proportional to size (PPS) sampling.^{​With PPS sampling, the probability of selection was proportional to the ACS final person-level weight, adjusted to account for imputed educational attainment, incomplete addresses, or invalid names.With PPS sampling, the probability of selection was proportional to the ACS final person-level weight, adjusted to account for imputed educational attainment, incomplete addresses, or invalid names.With PPS sampling, the probability of selection was proportional to the ACS final person-level weight, adjusted to account for imputed educational attainment, incomplete addresses, or invalid names.} Among the returning sample, all eligible cases were selected. The sampling strata were defined by the cross-classification of the following variables:

• Highest degree type (3 levels)
• Field of bachelor’s degree (7 levels)
• Occupation group (8 levels)
• Underrepresented minority status (2 levels)
• Recent degree status (2 levels)
• Nativity (U.S.-born or foreign-born) (2 levels)

As has been the case since the 2013 NSCG, the 2023 NSCG includes an oversample of young graduates to improve the precision of estimates for this important population. The 2023 NSCG includes approximately 161,000 sample cases drawn from the following:

• Returning sample from the 2021 NSCG who were originally selected from the 2015 ACS
• Returning sample from the 2021 NSCG who were originally selected from the 2017 ACS
• Returning sample from the 2021 NSCG who were originally selected from the 2019 ACS
• New sample selected from the 2021 ACS

Approximately 106,000 cases were selected from the returning sample members for one of the three biennial follow-up interviews that are part of the rotating panel design. For the baseline survey interview, about 55,000 new sample cases were selected from the 2021 ACS.

Data collection. The data collection period lasted approximately 6 months (25 May 2023 to 20 November 2023). The NSCG used a trimodal data collection approach: self-administered online survey (Web), self-administered paper questionnaire (via mail), and computer-assisted telephone interview (CATI). Individuals in the sample generally were started in the Web mode, depending on their available contact information and past preference. After an initial survey invitation, the data collection protocol included sequential contacts by postal mail, e-mail, and telephone that ran throughout the data collection period. At any time during data collection, sample members could choose to complete the survey using any of the three modes. Nonrespondents to the initial survey invitation received follow-up contacts via alternate modes.

Quality assurance procedures were in place at each data collection step (e.g., address updating, printing, package assembly and mailing, questionnaire receipt, data entry, CATI, coding, and post-data collection processing).

Mode. About 91% of the participants completed the survey by Web, 7% by mail, and 2% by CATI.

Response rates. Response rates were calculated on complete responses, that is, from instruments with responses to all critical items. Critical items are those containing information needed to report labor force participation (including employment status, job title, and job description), college education (including degree type, degree date, and field of study), and location of residency on the reference date. The overall unweighted response rate was 61%; the weighted response rate was 61%. Of the roughly 161,000 persons in the 2023 NSCG sample, 94,606 completed the survey.

Data editing. Response data had initial editing rules applied relative to the specific mode of capture to check internal consistency and valid range of response. The Web survey captured most of the survey responses and had internal editing controls where appropriate. A computer-assisted data entry (CADE) system was used to process the mailed paper forms. Responses from the three separate modes were merged for subsequent coding, editing, and cleaning necessary to create an analytical database.

Following established NCSES guidelines for coding NSCG survey data, including verbatim responses, staff were trained in conducting a standardized review and coding of occupation and education information, certifications, “other/specify” verbatim responses, state and country geographical information, and postsecondary institution information. For standardized coding of occupation (including auto-coding), the respondent's reported job title, duties and responsibilities, and other work-related information from the questionnaire were reviewed by specially trained coders who corrected respondents’ self-reporting errors to obtain the best occupation codes. For standardized coding of field of study associated with any reported degree (including auto-coding), the respondent’s reported department, degree level, and field of study information from the questionnaire were reviewed by specially trained coders who corrected respondents’ self-reporting errors to obtain the best field of study codes.

Imputation. Logical imputation was primarily accomplished as part of editing. In the editing phase, the answer to a question with missing data was sometimes determined by the answer to another question. In some circumstances, editing checks found inconsistent data, which were removed and then subject to statistical imputation.

The item nonresponse rates reflect data missing after logical imputation or editing but before statistical imputation. The rates presented in this section are unweighted item nonresponse rates. For key employment items—such as employment status, sector of employment, and primary work activity—the item nonresponse rates ranged from 0.0% to 1.3%. Nonresponse to questions deemed sensitive was higher: nonresponse to salary and earned income was 5.1% and 7.6%, respectively, for the new sample members and 4.5% and 7.0%, respectively, for the returning members. Personal demographic data of the new sample members had variable item nonresponse rates, with sex at birth at 0.8%, birth year at 0.04%, marital status at 0.6%, citizenship at 0.4%, ethnicity at 1.6%, and race at 3.7%. The nonresponse rates for returning sample members were 0.7% for marital status and 0.7% for citizenship.

Item nonresponse was typically addressed using statistical imputation methods. Most NSCG variables were subjected to hot deck imputation, with each variable having its own class and sort variables chosen by regression modeling to identify nearest neighbors for imputed information. For some variables, there was no set of class and sort variables reliably related to or suitable for predicting the missing value, such as day of birth. In these instances, random imputation was used, so the distribution of imputed values was similar to the distribution of reported values without using class or sort variables.

Imputation was not performed on critical items or on verbatim-based variables.

Weighting. Because the NSCG is based on a complex sampling design and subject to nonresponse bias, sampling weights were created for each respondent to support unbiased population estimates. The final analysis weights account for several factors, including the following:

• Adjustments to account for undercoverage of recent immigrants and undercoverage of recent degree-earners
• Adjustment for incorrect names or incomplete address information on the sampling frame
• Differential sampling rates
• Adjustments to account for non-locatability and unit nonresponse
• Adjustments to align the sample distribution with population controls
• Trimming of extreme weights
• Overlap procedures to convert weights that reflect the population of each frame (2015 ACS, 2017 ACS, 2019 ACS, and 2021 ACS) into a final sample weight that reflects the 2023 NSCG target population

The final sample weights enable data users to derive survey-based estimates of the NSCG target population. The variable name on the NSCG public use data files for the NSCG final sample weight is WTSURVY.

Variance estimation. The successive difference replication method (SDRM) was used to develop replicate weights for variance estimation. The theoretical basis for the SDRM is described in Wolter (1984); Fay and Train (1995); Ash (2014); and Opsomer et al. (2016). As with any replication method, successive difference replication involves constructing numerous subsamples (replicates) from the full sample and computing the statistic of interest for each replicate. The mean square error of the replicate estimates around their corresponding full sample estimate provides an estimate of the sampling variance of the statistic of interest. The 2023 NSCG produced 320 sets of replicate weights.

Disclosure protection. To protect against the disclosure of confidential information provided by NSCG respondents, the estimates presented in NSCG data tables are rounded to the nearest 1,000.

Data table cell values based on counts of respondents that fall below a predetermined threshold are deemed sensitive to potential disclosure, and the letter “D” indicates this type of suppression in a table cell.

Sampling error. NSCG estimates are subject to sampling errors. Estimates of sampling errors associated with this survey were calculated using replicate weights. Data table estimates with coefficients of variation (that is, the estimate divided by the standard error) that exceed a predetermined threshold are deemed unreliable and are suppressed. The letter “S” indicates this type of suppression in a table cell.

Coverage error. Coverage error occurs in sample estimates when the sampling frame does not accurately represent the target population and is a type of nonsampling error. Any missed housing units or missed individuals within sample households in the ACS would create undercoverage in the NSCG. Additional undercoverage errors may exist because of self-reporting errors in the ACS that led to incorrect classification of individuals as not having a bachelor's degree or higher when in fact they held such a degree.

Nonresponse error. The weighted response rate for the 2023 NSCG was 61%; the unweighted response rate was 61%. Analyses of NSCG nonresponse trends were used to develop nonresponse weighting adjustments to minimize the potential for nonresponse bias in the NSCG estimates. A hot deck imputation method was used to compensate for item nonresponse.

Measurement error. The NSCG is subject to reporting errors from differences in interpretation of questions and by modality (Web, mail, CATI). To reduce measurement errors, the NSCG questionnaire items were pretested in focus groups and cognitive interviews.

Data comparability. Year-to-year comparisons of the nation’s college-educated population can be made among the 1993, 2003, 2010, 2013, 2015, 2017, 2019, 2021, and 2023 survey cycles because many of the core questions remained the same. Since the 1995, 1997, 1999, 2006, and 2008 surveys only included individuals educated or employed in S&E fields and, therefore, do not provide full coverage of the nation’s college-educated population, any comparison between these cycles and other cycles should be limited to those individuals educated or employed in S&E fields.

Small but notable differences exist across some survey cycles, however, such as the collection of occupation and education data based on more recent taxonomies. Also, because of the use of different reference months in some survey cycles, seasonal differences may occur when making comparisons across years. Thus, use caution when interpreting cross-cycle comparisons.

There is overlap in the cases included in the 2010 NSCG through the 2017 NSCG, in the 2013 NSCG through the 2019 NSCG, in the 2015 NSCG through the 2021 NSCG, and in the 2017 NSCG through the 2023 NSCG (see figure 1). The overlap among cases allows for longitudinal analysis of a subset of the NSCG sample using restricted-use data files within NCSES’ Secure Data Access Facility (SDAF). Cases can be linked across survey years using a unique identification variable and single-frame weights are available for each survey year, allowing for the evaluation of estimates from each frame independently. If you are interested in applying for a license to access NSCG restricted-use data for longitudinal analysis purposes via the SDAF, please visit NCSES Restricted-Use Data Licensing. Moreover, the Federal Statistical Research Data Centers (FSRDCs) provide access to NSCG restricted-use data files that include a few additional data elements. Instructions for applying for access to the FSRDCs are also available at NCSES Restricted-Use Data Licensing.

Changes in survey coverage and population. None.

Changes in questionnaire

• 2023. The 2023 NSCG questionnaire aligned with the content in the 2021 NSCG aside from the following modifications:

1. COVID-19 pandemic-related revisions from the 2021 survey were removed from recurring questions. In the 2021 survey cycle, the pandemic was affecting the employment situation of many individuals. Where these effects could impact NSCG measures (e.g., employment status, part-time employment, job benefits, earnings, and conference attendance), the 2021 questionnaire allowed respondents to identify if the pandemic was involved. For the 2023 cycle, these revisions were removed.
2. The COVID-19 pandemic telework question transitioned to a general telework question. One item added to the 2021 NSCG questionnaire asked whether respondents were allowed or required to telework due to the COVID-19 pandemic. Because remote work is an important employment feature, the 2023 NSCG questionnaire added a new item to gauge employees’ participation in telework, regardless of the pandemic.
3. The race question was modified to also collect subgroup information for the Asian and the Native Hawaiian or Other Pacific Islander race categories.
4. The sex item was modified to collect both sex at birth and gender identity.
5. A few items received minor adjustments for clarity, to reduce participant burden, and increase data quality (e.g., using the word “when” in place of “in what year”).
6. The list of occupations and fields of study was updated to reflect NCSES’s latest taxonomies.
7. The mode preference item was removed, as Web is the predominant mode used to complete the NSCG.

• 2021. To gauge the effects of the COVID-19 pandemic on employment, the content of the NSCG questionnaire was modified for 2021 in two ways:

1. The response options of long-standing items were revised to identify pandemic-related consequences: for example, reasons for not working, reasons for working part time, reasons for changing employment, and available job benefits.
2. New items were added to understand the effects of the pandemic on salaries and earnings and to measure the prevalence of telework.

• 2019. The content of the 2019 NSCG questionnaire remained unchanged from the 2017 NSCG version.
• 2017. The 2017 NSCG questionnaire added two new questions about U.S. military veteran status that are asked on the ACS.
• 2015. The 2015 NSCG questionnaire added a section on professional certifications and licenses.
• 2013. The 2013 NSCG questionnaire added questions about attendance at community colleges, amounts borrowed to finance undergraduate and graduate degrees, and sources of financial support for undergraduate and graduate degrees. The 2013 questionnaire also differed from the 2010 questionnaire by splitting the first response category for the indicator of sample member location on the survey reference date into two categories. “United States, Puerto Rico, or another U.S. territory” became “United States or Puerto Rico” and “Another U.S. territory.”
• 2010. The 2010 NSCG questionnaire added items on components of job satisfaction, importance of job benefits, year of retirement, whether employer is a new business, and degree of difficulty concentrating, remembering, or making decisions.

Changes in reporting procedures or classification

• In the current survey cycle, the technical tables for field of degree (table A-1) and occupation (table A-2) have been updated to align with the NCSES taxonomies (Taxonomy of Disciplines and Taxonomy of Occupations) released in 2020. These taxonomies reflect compliance with the 2020 Classification of Instructional Programs (CIP) and the 2018 Standard Occupational Classification (SOC) systems, respectively. The technical tables in the previous cycles (2017 through 2021) were based on the 2010 CIP and 2010 SOC.
• Additionally, the technical tables may change from year to year due to decisions made by the Census Bureau’s Disclosure Review Board (DRB) to meet disclosure avoidance requirements. As a result, some detailed codes may be collapsed to protect respondent confidentiality.

Field of degree. NSCG respondents are asked to report each degree they have earned at the bachelor’s level or higher, along with the major field of study for each degree. The 2023 NSCG used a taxonomy of 137 “detailed” fields of study from which respondents could select the field that best represented their major. These 137 “detailed” fields of study were aggregated into 31 “minor” fields, 7 “major” fields, and 3 “broad” fields (S&E, S&E-related, and non-S&E). (See technical table A-1 for a list and classification of fields of study reported in the NSCG.)

Full-time and part-time employment. Full-time (working 35 hours or more per week) and part-time (working less than 35 hours per week) employment status is for the principal job only and not for all jobs held in the labor force. For example, an individual who works part time in his or her principal job but full time in the labor force would be tabulated as part time.

Highest degree level. NSCG respondents report the degrees they have earned at the bachelor’s level (e.g., BS, BA, AB), master’s level (e.g., MS, MA, MBA), and doctorate level (e.g., PhD, DSc, EdD), as well as other professional degrees (e.g., JD, LLB, MD, DDS, DVM). Because the NSCG is focused on the S&E workforce, the sampling strategy does not include a special effort to collect professional degrees. As such, there is not always sufficient data for the professional degrees to be displayed separately in the tables.

Occupation data. The occupational classification of the respondent was based on his or her principal job (including job title) held during the reference week—or on his or her last job held, if not employed in the reference week (survey questions A5, A6, A16, and A17). Also used in the occupational classification was a respondent-selected job code (survey questions A7 and A18). (See technical table A-2 for a list and classification of occupations reported in the NSCG.)

Race and ethnicity. Ethnicity is defined as Hispanic or Latino or not Hispanic or Latino. Values for those selecting a single race include American Indian or Alaska Native, Asian, Black or African American, Native Hawaiian or Other Pacific Islander, and White. The 2023 NSCG collected subgroup information for the Asian category (Asian Indian, Chinese, Filipino, Japanese, Korean, Vietnamese, and Other Asian) and the Native Hawaiian or Other Pacific Islander category (Native Hawaiian, Chamorro, Samoan, and Other Pacific Islander). Those persons who indicate two or more races and are not of Hispanic or Latino ethnicity are reported as More than one race.

Salary. Median annual salaries are reported for the principal job, rounded to the nearest $1,000, and computed for individuals employed full time. For individuals employed by educational institutions, no accommodation was made to convert academic year salaries to calendar year salaries.

Sector of employment. Employment sector is a derived variable based on responses to questionnaire items A13, A14, and A15. In the data tables, the category 4-year educational institution includes 4-year colleges or universities, medical schools (including university-affiliated hospitals or medical centers), and university-affiliated research institutes. Two-year and pre-college institutions include community colleges, technical institutes, and other educational institutions (which respondents reported verbatim in the survey questionnaire). For-profit business or industry includes respondents who were self-employed in an incorporated business. Self-employed includes respondents who were self-employed or were a business owner in a non-incorporated business.

Years since highest degree. This measure is calculated as the difference between the year one’s highest degree was earned and the survey year; hence, it is a whole number.

Underrepresented minority. Demographic groups that are underrepresented in science and engineering, relative to their numbers in the U.S. population: American Indian or Alaska Native, Black or African American, and Hispanic or Latino. For detailed data on racial and ethnic representation, see the 2023 NCSES report Diversity and STEM: Women, Minorities, and Persons with Disabilities: 2023.

Opsomer J, Breidt FJ, White M, Li Y. 2016. Successive Difference Variance Estimation in Two-Phase Sampling. Journal of Survey Statistics and Methodology, 4(1): 43-70.

Ash S. 2014. Using Successive Difference Replication for Estimating Variances. Survey Methodology, 40 (1): 47-59.

Fay RE, Train GF. 1995. Aspects of Survey and Model-Based Postcensal Estimation of Income and Poverty Characteristics for States and Counties. American Statistical Association Proceedings of the Section on Government Statistics, 154–59.

Wolter K. 1984. An Investigation of Some Estimators of Variance for Systematic Sampling. Journal of the American Statistical Association 79(388):781–90.