The onset of the COVID-19 pandemic has brought unprecedented change to higher education. The implications of moving pedagogy online raise significant concerns about traditional student evaluations of instructors at many institutions. These surveys, usually administered at the end of each semester, allow students to provide feedback to help faculty inform teaching practices. In addition, these surveys provide institutions with information that can be used, in part, for annual reappointment, promotion, and tenure decisions. If instructors are evaluated in classes that are substantially different from the ones they’d planned, it may be unfair to administer these evaluations in an environment that is primarily beyond their control.