To understand how the COVID-19 pandemic has affected caregivers, we assessed its perceived impact on caregiving through a new measure: the Caregiver COVID-19 Limitations Scale (CCLS-9), in Spanish and English. We also compared levels of caregiver self-efficacy and burden pre-COVID-19 and early in the pandemic. We administered surveys via internet to a convenience sample of caregivers in January 2020 (pre-pandemic, n = 221) and in April–June 2020 (English, n = 177 and Spanish samples, n = 144) to assess caregiver self-efficacy, depression, pain, and stress. We used the early pandemic surveys to explore the validity of the CCLS-9. The pre-COVID-19 survey and the April English surveys were compared to determine how the COVID-19 pandemic affected caregivers. The CCLS-9 had strong construct and divergent validity in both languages. Compared to pre-COVID-19, caregiver stress (p =.002) and pain (p =.009) were significantly greater early in COVID-19, providing evidence of its validity. COVID-19 added to caregiver stress and pain.