"For assessment to be successful, it is necessary to put aside the question, 'What’s the best possible knowledge?' and instead to ask, 'Do we have good enough knowledge to try something different that might benefit our students?'"

-Blaich, C. F., & Wise, K. S. (2011). From gathering to using assessment results: Lessons from the Wabash National Study (NILOA Occasional Paper No.8). Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment.

“[Assessments] are enablers of communication back and forth between students and instructors as the former demonstrates and the latter provides feedback upon learning milestones. The assessments are thus a means to an end, not an end in and of themselves.”

-Trogden, B.G. (2021). Using your sphere of influence to impact culturally responsive assessment. Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment.

---

Key Definitions & Frameworks

Data sources that are useful to consider in assessing student learning are:

1. Evidence of learning outcomes

   Direct measures of learning

   • These allow students to demonstrate their learning for faculty to assess how well a program's students are meeting the expected level of proficiency for skills or knowledge. Examples include capstone projects, papers, standardized tests, observations of students in a clinical setting, and quiz questions that align with a key area of knowledge needed.
     • Embedded assessments are direct measures of student learning that serve two purposes: as a course requirement for students (i.e., a normal work product like a paper, quiz, or a design project) and for a program's assessment processes. They most frequently are collected from required courses, capstone courses, or key classes where a student must demonstrate mastery of a specific learning objective important to the department.

   Indirect measures of learning

   • These gather students' perceptions of and satisfaction with their learning. Common examples are focus groups and student and alumni surveys.

   Multiple methods of assessment

   • Methods that pair direct and indirect methods are most valuable because:
     • Research indicates that students are not always able to accurately self-assess their learning, so the use of indirect measures alone may be inaccurate.
     • Some outcomes (e.g., attitudes) can be assessed only through surveys, interviews or focus groups.
     • Indirect measures (e.g., student dissatisfaction with some aspect of their learning experience) can help explain results seen through collection of direct measures (e.g., low student performance on a key learning outcome).
2. Background information about the students in the course or curriculum (i.e., inputs)
   • For example, what academic preparation do students bring into a course or academic program? What are the demographics of students in a class or program? What are their career or post-U-M educational aspirations? 
3. Documentation of the learning experience
   • In other words, what is the nature of the learning experience for students?

---

U-M Data Sources on Student Learning in U-M Curriculum and Co-Curriculum

This provides measurement tools for faculty and administrators to assess student learning indirectly and directly, for both classroom and program-level assessment.

Indirect Evidence of Learning

Large Student Surveys Used at U-M

Data Source	Coordination and Distribution of Findings
UMAY: This survey is open to all U-M undergraduates, and it is quite wide reaching. Each respondent answers a core set of questions about time use, academic/personal development, academic engagement, evaluation of the major, overall satisfaction, and climate.	UMAY is part of a nationwide study, Student Experience in the Research University (SERU), based at UC Berkeley. The local coordination of this project is through the Office of Budget and Planning. Annual UMAY reports are shared on the Office of Budget and Planning website. U-M's 2015 UMAY response rate is ~20%. Here is a sample recent UMAY instrument.
Destination Surveys: These studies examine LSA alumni’s, medical school applicants’ or law school applicants’ first experiences after college, looking at the "first destination" of job, graduate school, volunteer life, or family, and how the university served in preparing for that step.	The LSA study is conducted annually by the University Career Center. Select findings are presented on the University Career Center website.

Alumni and Exit Surveys

Other validated surveys (some are fee-based)

Focus groups

Sample assessment project at U-M using indirect evidence of learning

Direct Evidence of Learning

Rubrics are commonly used as an assessment tool for papers or projects.

Quiz questions, linked to specific key learning objectives

Concept inventories

Background information about the students in a course or curriculum

LSA Academic Reporting Toolkit (ART) (Requires authentication)

U-M Data Warehouse

• The U-M Data Warehouse is a collection of data that supports reporting activity for University business. The M-Pathways Student Records Data Set contains academic data for students who have matriculated at the University of Michigan, Ann Arbor. The data includes students' personal information (demographic data), enrollment, courses, grades, degrees, and transfer credit. For more information on the data available, see the student records data dictionary. To request access to these data, instructors should contact their school/college's data steward or the Office of the Registrar.

Documentation of the learning experience 

Common measures to document learning activities include:

---

CRLT staff work with groups of faculty in departments or schools/colleges to collect assessment data that will be useful for educational grant evaluation or curricular decisions. For example, CRLT staff use interviews, focus groups, and surveys of students, faculty, and alumni to provide feedback about:

• the effectiveness of a curriculum/program as a whole or a particular sequence of courses; 
• the effectiveness of a unit's training program for graduate student instructors; or
• a unit's climate for teaching and learning.