A
comprehensive report regarding the
UniLOA's validity can be found
here.
In social sciences research assessment development
and use, the concept of validity is of great
importance. Validity refers to whether or not the
assessment itself accurately measures the “thing(s)”
it purports to measure. The UniLOA measures seven
constructs, including:
- Critical Thinking
- Self Awareness
- Communication Skills
- Diversity
- Citizenship
- Membership/Leadership
- Relationships
There are
several types of validity that have been considered
in the construction of the UniLOA.
Construct Validity
Construct
validity refers to whether or not and the degree to
which the UniLOA measures the underlying constructs
upon which the assessment’s items are based. To
assure high a high degree of construct validity,
empirical research was first examined through an
exhaustive review of current literature. Next, a
wide variety of constituents having an interest in
higher education were consulted through structured
interviews, focus group meetings and surveys. Those
consulted included higher education faculty and
administrators, students, and employers.
Concurrent Validity
This type of
validity is measured when other instruments are
administered and the data collected analyzed and
interpreted that produce the same types of results
that emerge from the UniLOA. To date, the UniLOA
continues to produce data and interpretive results
that are consistent with the findings of other
instruments designed to explore the student
experience in higher education settings.
Criterion-Related Validity
Criterion-related validity considers how assessment
results are related to specific outcomes. Outcomes
in higher education settings are often seen in
persistence, retention, graduation, post-graduation
employment placement and a host of others. Like
concurrent validity, establishing criterion-related
validity is an on-going process that becomes more
precise with the passage of time. The UniLOA project
is attending to the continued measurement of
criterion-related validity as an area of
considerable interest.
|