|
NACADA Publications
Clearinghouse
Research
Journal
Academic Advising Today
Monthly Highlights
|
Assessment
and Evaluation
Annotated
Bibliography
for research published 1994 - 1999
Bibliography
compiled by George Steele and Melinda McDonald. Annotated bibliographies
of recent literature are published in each NACADA Journal.
Find out how to obtain full text of ERIC documents at http://www.askeric.org/Eric/Help/obtain.shtml
Accountability
and Productivity Report for the Illinois Community College System.
(1994). (ERIC
Docuemnt Reproduction Service No. ED 375 902)
This report summarizes
accountability, productivity, and quality enhancements within
the
Illinois community college system, including highlights from
reports prepared by the system's
49 colleges, systemwide analyses conducted by Illinois Community
College Board (ICCB), and
state-level accountability and productivity initiatives. Following
an executive summary and
brief introduction, the next major section presents college
productivity reports for the following
functions: instruction, academic and student support, overall
academic function, administration,
and public service. The next section presents college responses
to a series of questions from the
Illinois Board of Higher Education related to the use of benchmarks,
cooperative arrangements,
auxiliary enterprises, intercollegiate athletics, staffing analysis,
low-enrollment programs,
and cost analysis. Next, the report provides the results of
seven studies conducted by the ICCB
on administrative costs, student retention, minority achievement,
remedial education, community
college auxiliary enterprise funds, and transfer rates. The
next section outlines state-level
accountability and productivity initiatives including a review
of state-level processes and
procedures; goals for 1993-94 in the areas of accountability,
articulation, teaching and learning,
telecommunications, workforce preparation, and community college
advocacy. Appendixes making up
two-thirds of the report include detailed tables describing
college productivity improvement,
administrative costs, retention study results, minority achievement,
transfer rate, and auxiliary
enterprise funds.
Accountability Report
To Assess the Effectiveness of Undergraduate Education at Arapahoe
Community College. (1994). (ERIC Docuemnt Reproduction Service
No. ED 374 881)
This annual report provides an overview of Arapahoe Community
College's (Colorado)
efforts to improve undergraduate education and the success of
those efforts as of 1993-94.
After outlining changes made in the transfer, vocational education,
and developmental studies
programs, the report provides information on specific recommendations
implemented since
1992-93 related to vocational education; retention and completion;
alumni satisfaction; after
graduation performance; graduating students satisfaction; community
education; and business
and industr y se rvices. Appendixes comprise the bulk of the
report, providing data and
survey results related to the following: (1) a 1993-94 calculus
readiness test; (2) college algebra
instructional strategies; (3) a student self-evaluation communication
survey and instructor ratings
of student improvement in speech; (4) guidelines for English
instructors and results from surveys
of students confidence in their writing ability; (5) transfer
accountability projects; (6) two pilot
studies in developmental English; (7) a developmental reading
survey; (8) a developmental mathematics
tracking analysis; (9) minority student enrollment comparisons,
1992-94; (10) results of licensure exams,
1993-94; (11) a vocational education student satisfaction survey;
(12) a graduate employer survey;
(13) term-to-term retention/persistence rates for full-time,
part-time, and all students; (14) transfer
acceptance, grade point averages, and completion/persistence
rates for selected years from 1988-89 to
1993-94; (15) graduating student satisfaction levels; (16) community
education satisfaction levels; and
(17) business and industry student satisfaction reports.
Albright, B. N. (1995).
The Accountability Litmus Test: Long-Term Performance Improvement
with Contained Costs. New Directions for Higher Education,
91, 65-76.
Theme issue: Assessing Performance in an Age of Accountability:
Case Studies.
Budget reforms adopted at the University of Montana and by the
Arkansas state higher
education system illustrate a variety of strategies for long-range
planning. These efforts
include reform of faculty collective bargaining, funding b ased
on productivity enhancement,
and a multiyear fiscal plan encompassing both operating and
capital budgets.
Angelo, T. A. (1996).
Relating Exemplary Teaching to Student Learning. New Directions
for
Teaching and Learning, 65, 57-64. Theme issue topic: "Honoring
Exemplary Teaching."
Student learning, perhaps
the best measure of exemplary teaching, can be examined
indirectlythrough correlated measures of teaching. Guidelines
for good practice in assessment
of teaching include use of multiple methods; assessment of multiple
dimensions of learning;
use of multiple assessors; distinguishing qualities best assessed
by the teacher, students,
disciplinary peers, and campus colleagues; and assessment over
time.
Arismendi-Pardi, E.
J. Evaluation of student preparation in calculus for business,
management,
and social sciences for probability theory at Orange Coast College.
Emergence of higher
education in America. (ERIC Document Reprocuction Service No.
ED 412 782) Online.
ERIC. (1998, March).
This study evaluated
student preparation for a course in calculus for business, management,
and social sciences as a prerequisite for success in probability
theory. The study included
a review of the literature, development of an assessment instrument
and cut-off scores, and
review and validation of the study criteria, the assessment
instrument, and the cut-off scores.
A 33-item questionnaire was administered during the 1997 spring
semester to 20 students
enrolled in a probability theory course at Orange Coast College
(California). The students
had completed a course in calculus for business, management,
and social sciences. Results
of the study indicated that although students showed weakness
in four instructional
objectives: implicit differentiation, calculus applications
to probability, numerical
techniques, and proof construction, they nevertheless were deemed
adequately prepared for
the probability theory course. Appended are calculus course
instructional objectives, the
proficiency criteria developed, a diagnostic student assessment
examination in calculus, and
a data/assessment results table.
Armstrong, W. B. (1994,
November). Accountability as Educational Reform in the Community
Colleges: Policy and Implementation Issues. Paper submitted for
presentation to the Annual
Conference of the California Association for Institutional Research
, San Diego. (ERIC
Document Reproduction Service No. 374 850)
Community
college reform legislation in California mandates the development
and implementation
of a comprehensive accountability model. The reform model implemented
during the 1991-92
academic year will provide the legislature and state officials
without comes and process
data in five areas of community college services: student access,
student success, student
satisfaction, staff composition, and fiscal condition. The overall
intent of this reform
is to improve teaching and lea rning at community colleges. Uses
for accountability reform
include public relations; inter-college and district comparisons;
program review and evaluation;
campus budgets; and monitoring local indicators. The literature
suggests that currently designed
reform measures may not reach these intended goals. To increase
the likelihood of successful
implementation, institutional assessment should be driven by teaching
and learning goals, and
indicators should include more than outcomes-only data. Outcomes
indicators might best be composite
indicators comprised of collegiate context, student characteristics,
process, and environmental
variables measured longitudinally. The proposed model for accountability
uses indicators not as
barometers of effectiveness, but indicative of the conditions
that facilitate positive change.
Contains 15 references.
Assessment of Student
Academic Achievement.(1994).(ERIC Document Reproduction Service
No. 370 613)
Neosho
Community College (NCC) in Kansas developed an assessment program
to measure
changes in student learning and progress in courses and programs.
The specific objectives
of student assessment at NCC are to determine readiness for regular
college courses; to
determine proper placement; to assist students in meeting personal
objectives; and to improve
the effectiveness of curricular offerings. The primary areas assessed
are commu nications,
math, natural and physical sciences, and social and behavioral
sciences. All first-time,
full-time students taking 12 or more hours are tested, a nd if
a student fails to meet the
pre-established levels, he/she is required to enroll in the appropriate
class or classes for
remediation. First-time, full-time students are also required
to complete a general education
pre-test at a designated time. Primary instruments are the Collegiate
Assessment of Academic
Proficiency (CAAP) and a writing sample. After completing their
program of study, students
are retested as a requirement for graduation. In addition, e very
course satisfying a graduation
requirement utilizes an instructor-determined measure of student
gain to assess expected student
outcomes as stated in the syllabus. The assessment plan satisfies
accreditation questions posed
by the North Central Association. For each of the components of
the assessment plan, information
is provided on the office with primary responsibility, approximate
costs, and target population
for testing.
Banta, T. W., et al.
(1996). Performance Funding Comes of Age in Tennessee. Journal
of Higher
Education, 67, 23-45.
A
survey of 23 college and university coordinators who conduct assessment
activities and
report findings in connection with Tennessee's 15-year performance
funding initiative reveals
strengths and weaknesses associated with 10 indicators of institutional
performance. Reasons
for the program's longevity, designed to serve accountability
and improvement purposes, are
advanced.
Banta, T.W., et al.
(1996). Assessment in Practice: Putting Principles To Work on
College
Campuses. Jossey-Bass Higher and Adult Education Series. (ERIC
Docuement Reproduction
Service No. ED 388 163)
This book applies the "Principles of Good Practice for
Assessing Student Learning"
developed by the American Association for Higher Education (AAHE)
to 82 case examples
of assessment strategies being implemented at American institutions
of higher education.
Part 1 presents 10 chapters each covering one of the nine AAHE
principles (and an
additional principle proposed by the authors). Each of these
chapters begins
with a statement of the principle, followed by discussion of
the underlying
assumptions and rationale for the principle, then provides illustrations
of the
principle in action in the various cases presented later in
the book. Part 2 presents
the 82 full cases of assessment practice, originally obtained
from a national survey of
375 institutions with representatives attending a recent conference
on assessment.
Cases are presented in the words of faculty, student affairs
professionals, and campus
assessment administrators who developed the procedures. They
are grouped into six
sections: (1) "Assessing Student Achievement in the Major";
(2) "Assessing Student
Achievement in General Education"; (3) "Assessing
Student Development and Progress";
(4) "Assessment at the Classroom Level"; (5) "Faculty
Development to Promote Assessment";
and (6) "Developing a Campuswide Approach to the Assessment
of Institutional Effectiveness."
Beattie, J. F. (1995).
Assessment in higher education. Higher Education Management,
7,
281-96.
The current state of student assessment in higher education in
the United Kingdom is
examined, particularly in light of the introduction of government-sponsored,
standardized
national vocational qualifications, marking a new stage of government
intervention. A
review of current practice finds confusion about what to assess,
how to assess it, and the
educational and professional consequences of those assessments.
Belcher, M. J. (1995).
A Comparison of M-DCC Performance to Statewide Results on Community
College Accountability Measures. ( Research Report No. 95-03R).
(ERIC Document Reproduction
Service No. ED 390 515)
Based on data submitted in September 1994 to the Florida Community
College System for
its annual accountability report, this document compares accountability
outcomes for
Miami-Dade Community College (M-DCC) to the system as a whole.
Highlighted findings
include the following: (1) while 65% of the public high school
graduates and 61% of new
community college students were White systemwide, only 21% of
the high school graduates
and 13% of the community college students were White in M-DCC's
Dade County; (2) the
success rate of M-DCC students after 4 years was 70%, lower than
the systemwide rate of
72%, while M-DCC's graduation rate was 19%, compared to 23% systemwide;
(3) the average
grade point average (GPA) of M-DCC graduates in the state university
system was 2.72
compared to 2.77 systemwide, while 70% of White, 64% of Hispanics,
and 52% of Black
non-Hispanics at M-DCC had a GPA at or above 2.5; (4) 89.3% of
the students taking
licensure exams passed, and 91.1% of the associate degree students
found a job related
to their education or continued their education; (5) 69% of M-DCC
students failed
college-level entry tests, compared to 57% of community college
students statewide; and
(6) on state academic skills tests, 66% of M-DCC students passed
all four sections, compared
to a
Belcheir, M. J. Who's
Doing What? A Report on Assessment Activities at the Departmental
Level. Research Report 96-05. (ERIC Document Reproduction Service
No. ED 409 767)
Online. ERIC. (1997, December).
This report presents
the results of a survey of student assessment activities conducted
by
departments at Boise State University in Idaho. The university's
55 departments were asked
to provide information on the evaluation process for their majors
and for any core courses
they offered. The survey found that most of the departments
had completed mission
statements and nearly three-fourths had goals and objectives
for student learning. Less than
half, however, had developed plans that show where each goal
is addressed, and only about
one-fourth have ways to measure how well each goal is being
met. While over 90 percent
of departments indicated that they used program review, student
surveys of courses and
faculty, and internships with performance feedback to collect
assessment information, there
were many differences in which other methods they employed.
Departments were not nearly
as advanced in developing assessment plans for the core courses
they offered, with less than
half having completed mission statements and only 9 percent
having ways to measure how
each goal is being met. Appendixes include a copy of the survey
instrument and
departmental listings of the stages in the development of assessment
processes.
Berman, J., et al. (1995).
Significant Learning Outcomes. Northwestern Michigan College Ends
Report. (ERIC Docuemnt Reproduction Service No. 387 162)
In an effort to determine
success in fosterin g student developm ent as w ell-rounded
human-
beings, Northwestern Michigan College (NMC) undertook a st udy
of stu dent achievement
related to significant learning outcomes esta blished by the
c ollege. The study focused
on four measures of achievement: results from a spring 1995
administration of the Collegiate
Assessment of Academic Proficiency (CAAP), results from a spring
1995 American College Testing
College Outcomes Survey (COS) report, an NMC plan for assessing
academic achievement, and
outcomes from an Instructional Development and Effectiveness
Assessment (IDEA) conducted from
1990 to 1995. Study findings included the following: (1) on
the CAAP, NMC students scored above
the national mean in each of four academic skills (i.e., writing,
mathematics, reading, and critical
thinking); (2) regarding the COS, the learning outcome ranked
highest by students was acquiring
knowledge and skills needed for a career, while this outcome
was also ranked highest in terms of
students' self-assessment of progress; (3) NMC's assessment
plan will be implemented over the coming
year; and (4) with respect to the IDEA, students consistently
rated their learning in 10 areas
(i.e., gaining factual knowledge, learning principles and theories,
developing professional skills,
learning a discipline's methodology, improving thinking and
problem solving skills, developing
creative capacities and effective communication skills, gaining
a general, liberal education,
developing personal responsibility, and furthering self-understanding)
higher than the system-wide
norm. Results from the COS and CAAP are appended.
Bers, T. H., & Mittler,
M. L. (1994). Assessment and Testing: Myths and Realities. New
Directions for Community Colleges, 88. (ERIC Docuemnt Reproduction
Service No. ED 376 900)
Dealing with issues related to the asse ssment of community
colle ge acc ountability,
effectiveness, efficiency, productiv ity, student outcomes,
and quality improvement,
this volume examines the pra ctical considerations of assessmen
t fro m the perspectives
of state-level coordinating boards, accreditation agencies,
college presidents, and institutional
administrators. The following articles are included: (1) "Assessment
from the State Perspective,"
by Virginia K. McMillan; (2) "Latent and Leveraged Benefits
of Assessment: Expanding the
Value of Assessment Information," by Stephen D. Spangehl;
(3) "Assessment from a National
Perspective: Where Are We, Really?" by Jeffrey A. Seybert;
(4) "Assessment and Transfer:
Unexamined Complexities," by Mary L. Mittler and Trudy
H. Bers; (5)"Assessment from the
President's Perspective," by Richard Fonte; (6) "Obtaining
StudentCooperation for Assessment,"
by Betty Duvall; (7) "Assessment and Diversity: Outcome
and Climate Measurements," by
Scott P. Kerlin and Patricia B. Britz; (8) "QualitativeAssessment:
An Institutional Reality
Check," by Mary L. Mittler and Trudy H. Bers; (9) "A
Critical Review of Student Assessment
Options," by Joseph Prus and Reid Johnson; and (10)"Sources
and Information: Assessment and the
Community College," by Elizabeth Foote.
Boatright,
K. J. (1995). University of Wisconsin's System Accountability. New
Directions for
Higher Education, 91, 51-64.
Theme issue: Assessing
Performance in an Age of Accountability: Case Studies.
A discussion of the performance indicator system used at the
University of Wisconsin to
provide feedback to stakeholders and encourage continuous improvement
of services
includes background on the system's context and development,
legislative and governing
board involvement, resulting recommendations, and three examples
of specific accountability
indicators and their goals.
Borden, V.M.H. &
Bottrill, K. V. (1994). Performance Indicators: History, Definitions,
and
Methods. New Directions for Institutional Research, 82,
5-21.
Theme issue: "Using
Performance Indicators to Guide Strategic Decision Making."
The history of performance indicators for evaluation of institutions
of higher education
in the United States and Europe is chronicled to provide a context
for understanding the
definitions and methods used to develop them. Perfo rmance indicators
are defined and
described inrelation to other measures used for assessment of
institutions, drawing on
relevant literature.
Bucci, P. & Lee,
J. B. (1995). PACE Model Tech Prep Education Project. Evaluation
Report.
Washington, DC: Academy for Educational Development, Inc; Pendleton,
SC: Partnership
for Academic and Career Education.(ERIC Document Reproduction
Service No. ED 383 899)
The effective ness of the Partnership for Academic and Career
Education (PACE ) model tech
prep initiative was evaluated in a 2-year study conducted by
the Academy for Educational
Development. Information for the evaluation was collected through
site visits to 13 of the
20 secondary schools (9 high schools and 4 career centers) in
the 3 counties participating
in the PACE consortium and 3 separate surveys administered to
students, faculty, and staff
at the schools. The first two surveys were given to all graduating
seniors (approximately
2,500 students in 16 schools) and all faculty and staff (730
individuals) in the spring
of 1993. The final survey was administered to a selected group
of 400 of the originally
surveyed students 1 year after graduation. Three of the schools
had well-developed tech
prep programs, and three had less-established programs. The
surveys and site visits
confirmed the PACE model's claims that students will be more
motivated in tech prep and
that staff in tech prep schools will see better results. (Eighteen
tables/figures are
included. Appendixes constituting approximately 60% of the document
contain 10 tables of
data about students not planning to attend a four-year college
and the various surveys and
assessment inventories for tech prep implementation.)
Building
Communities by Assessing the Outcomes: AACJC/Kellogg Beacon College
Initiative
Minigrant. Final Report. (1994).(ERIC Docuemnt Reproduction Service
No. Ed 375 864)
In 1990, Massachusetts
Bay Community College (MBCC) collaborated with six other Massachusetts
colleges to assist them in using MBCC's assessment program as
a model to supplement or
replace their existing assessment strategi es. At eac h associate
college, campus
coordinators were selected and assessment task forces were formed
to identify assessment
issues pertinent to their institutions. Serving as lead college,
MBCC hosted community
colleges from throughout the state for the American Association
of Community Colleges
Teleconference, "Institutional Effectiveness: Look at Student
Outcomes and Assuring
Institutional Success in Community, Technical and Junior Colleges,"
and developed a
series of regional professional development workshops on teaching
and learning, and
assessment. Consistent with the mandate of the state regents,
the assessment of reading,
writing, mathematics, and language skills was evaluated, and,
in every instance, current
practices underwent extensive revision. Each associate college
identified the need to
automate tracking, and two colleges completely re-engineered
their assessment process for
incoming students based on the MBCC model. Assessment became
a mandatory activity for all
full- and part-time matriculating students. The assessment program
was expanded to
incorporate both entrance and exit components, and developmental
coursework was identified
and sequenced. Each of the participating colleges experienced
considerable disruption
between 1990 and 1993 because of the state's fiscal crisis and
the subsequent reductions
in financial support. Information on the critical success factors
identified by the task
forces at each of the six colleges is provided, along with budgetary
data, and the project
director's survey.
Chalkley, B. (1997).
Using optical mark readers for student assessment and course evaluation.
Journal of Geography in Higher Education, 21, 99-106.
Outlines the benefits
and limitations of automated assessment and offers practical
advice for
individuals and departments considering a move in that direction.
Maintains that using
optical mark readers (OMRs) in conjunction with objective tests
can result in significant
time savings. Briefly discusses using OMRs for student evaluations.
Chapple, M. & Murphy,
R. (1996). The nominal group technique: Extending the evaluation
of
students' teaching and learning experiences. Assessment &
Evaluation in Higher Education,
21, 147-59.
The Nominal Group Technique, in which groups of students jointly
evaluate a course, is
proposed as an alternative to individual course evaluation questionnaires
for student
assessment of college teacher performance. Evaluation of a new
course by three cohorts of
students using the technique is reported. Strengths and weaknesses
emerging in the study,
and uses in other contexts, are considered.
Cohen,
A. M. (1994). Indicators of Institutional Effectiveness. ERIC Digest.
Los Angeles, CA:
ERIC Clearinghouse for Community Colleges. (ERIC Document Reproduction
Service No.
ED 385 310)
Within the last few years, American schools have moved toward
routi nely measuring the
outcomes of their educational programs. Two national associations
deal ing with community
colleges have also developed quantitative indicators to assess
outcomes for two-year colleges.
There are still colleges that make only minimal efforts at assessment,
citing the `fairly
primitive level of assessment technologies and the difficulty
in selecting qualitative indicators
of effectiveness, but gains have been made nevertheless. For
example, the League for Innovation
in the Community College has described 5 major missions of the
community college (i.e., transfer,
career preparation, basic skills, continuing education and community
service, and access) and
suggested operational definitions, questions to be answered,
and data
sources. The League suggests assessing the transfer mission,
for exampl e, by variously
measuring student knowledge, the college's transfer rate, grades
that students earn after
transfer, and the number of college credits the univer sities
accepted. Other assessment
methods currently in use include surveys of: (1) students who
have recently graduated, dropped
out, or transferred; (2) student performance after transfer;
(3) occupational education
outcomes; (4) pre- and post-measures of student learning; and
(5) public-image studies to
determine community members' impressions of a college and students'
level of satisfaction.
Community
Colleges: Core Indicators of Effectiveness. AACC Special Reports
No. 4. A Report of
the Community College Roundtable. (1994). Washington, DC: American
Association of
Community Colleges. (ERIC Document Reproduction Service No. ED 367
411)
In December 1992,
the Community College Roundtable, a group of 10 two-year college
practitioners, convened to identify the core indicators of community
college effectiveness.
This report identifies and defines a few such measures th at
can be put to use on community
college campuses nationwide. After part I of the report explains
the composition and purpose
of the Roundtable, part II presents an overview of the emergence
of institutional effectiveness
as a compe lling i ssue on community college campuses and discusses
how the set of core
indicators w as developed. Part III reviews the aims, purpose,
focus, and organizati o n of the
report. Part IV provides a brief discussion of institutional
effectiveness and how it can be
defined and considered in community colleges. Part V includes
definitions and guidelines for
measuring core indicators. Part VI lists 13 core indicators
according to mission category.
The indicators are: (1) student goal attainment; (2) persistence
(fall to fall); (3) degree
completion rates; (4) placement rate in the work force; (5)
employer assessment of students;
(6) number and rate of transfers; (7) performance after transfer;
(8) success in subsequent,
related coursework; (9) demonstration of critical literacy skills;
(10) demonstration of citizenship
skills; (11) client assessment of programs and services; (12)
responsiveness to community needs;
and (13) participation rate in service area. Sources of data
for each indicator are listed along
with additional, related measures of effectiveness. Part VII
offers suggestions for utilizing and
measuring the indicators. Finally, part VIII lists five references.
Cosgrove, T. J. &
Marino, M. (1997). Technology and the transcript: Interactive
interface
provides renaissance for cocurricular skill document. Campus
Activities Programming, 30,
54-58.
The student development
transcript, conceived in the 1970s for recording and validating
student learning experiences outside the classroom, may come
closer to reaching its potential
through interactive computer technology. Programs combining
student assessment of the
college experience, mentoring, and use of the transcript grew
in the 1980s but have declined
since. A new incarnation using computers has seen success.
Crawford, C. B. &
Brungardt, C. (1995, November). Assessing student learning outcomes
in
teaching organizational communication. Paper presented at the
81st Annual Meeting of the
Speech Communication Association, San Antonio, TX.(ERIC Document
Reproduction
Service No. ED 402 635)
As administrators,
students, and the political machinery make higher education
more
accountable, assessment has become a relevant and timely topic.
Recent interest in
assessment and evaluation have brought significant changes in
the way that educators in the
field of organizational communication judge their students'
work. The lecture method is the
most preferred approach to teaching the course, but several
secondary methods include:
alternative media, case studies, simulation games, role playing,
videotapes, films, and
transparencies. Self-directed teams and internships are also
used. Various innovative
methods of assessment have emerged--among these a combination
of objective and
subjective evaluations like formal and/or informal evaluation
by the supervisor;
self-evaluation; informal evaluation by the faculty; evaluation
of a daily log kept by
students; and evaluation of students' work or portfolio. While
there is a distinction between
student assessment and evaluation and curriculum assessment
and evaluation, each has an
impact on the other. To best evaluate the role the learning
environment plays in the
development of the organizational communication student, faculty
should use four
traditional methods: reaction, knowledge, behavior, and results.
Cress, C. (1996). Assessment
and Testing: Measuring Up to Expectations. ERIC Digest. Los
Angeles, CA: ERIC Clearinghouse for Community Colleges.
(ERIC Document Reproduction
Service No. ED 391 559)
As a result of increasing pressure from external constituencies,
community colleges have
been called upon to demonstrate accountability through assessment
activities and research
on institutional effectiveness based on student outcomes. Since
community colleges include
transient student populations, students with a wide range of
ability and academic goals, and
large numbers of adjunct faculty, assessment should focus on
the improvement of campus
instructional and support programs to increase student success,
rather than on national
comparisons. In addition, it is critical that colleges determine
who will assess the information
collected and how it relates to student learning and instruction.
Available assessment
techniques and methods include competency-based models, self-reports,
third-party reports,
focus groups, in-depth interviews, participant observ ations
, case studies, exit surveys,
and alumni surveys. Assessment activities should take into consideration
the needs of culturally,
ethnically, religiously, and linguistically diverse students.
Although offering extrinsic
rewards encourages participation in assessment activities, assessment
only becomes an
integral partof the institution when this focus is clearly stated
in the mission of the
college and emphasized as a part of ensuring student success.
Faculty resistance and lack
of resources are often barriers to assessment processes. Finally,
rather than searching
for a single indicator to demonstrate success, institutions
should value the use of
different benchmarks as evidence of institutional effectiveness.
Daoud, A. (1994). City
College of San Francisco Accountability Atlas: Annual Report of
Institutional Effectiveness. (ERIC Document Reproduction Service
No. ED 380 163)
The Accountability
Atlas presents information about the students, progr ams, staff,
and services of the City College of San Francisco (CCSF), California.
Most of the
information is for the 1993-94 academic year, with some longitudinal
data provided. The atlas
is divided into the following six chapters: student access;
student success; student satisfaction;
staff composition; fiscal condition; and local indicators. Each
chapter begins with a definition
of the accountability area, a list of performance indicators,
master plan goals, and student equity
indicators. Data tables provide information on the following
indicators: (1) general participation;
(2) transition from high school and sources of new students;
(3) financial aid; (4) categorical
programs; (5) matriculation; (6) basic skills and English-as-a-Second-Language
enrollment;
(7) student persistence; (8) course completion; (9) degree completion
by field of study;
(10) transfer; (11) job placement; (12) access; (13) instruction;
(14) instructional support
services; (15) student services; (16) facilities; (17) staff
diversity; (18) number of
full- and part-time faculty; (19) community college funding;
(20) fiscal stability;
(21) staff development; (22) campus cl imate; (23) customer
satisfaction; (24)shared
governance; (25) deferred maintenance; and (26) educational
technology plan. Appendixes
include information on enrollment by zip code, and service area
population by gender and
ethnicity.
Dickinson, K. W., ET
AL.(1995). Perceptions of the Value of Quality Assessment in Scottish
Higher Education. Assessment& Evaluation in Higher Education,
20, 59-66.
The experience of Napier University (Scotland) with new mandatory
quality assessments is
examined, focusing on issues arising in the first two rounds
of evaluation site visits,
including defining quality; role of the lead evaluator; fra
mework for the visit; role of
the student; quality of the reports; and cost-benefit analysis.
Dixon, T. P. (1994,
July). A Discussion of Non-Traditional Outcomes Assessment Models.
Paper presented at the 48th Annual National Conference of Academic
Deans, Stillwater, OK.
(ERIC Document Reproduction Service No. ED 372 698)
This paper describes
three non-traditional higher education outcomes assessment models
and
identifies common characteristics of successful models of this
type. Institutions considering
how to meet state, national, and accrediting agency mandates
have two kinds of non-traditional
approaches available: formative and summative assessment. Formative
assessment helps institutions
make internal adjustments to student programs before the student
completes the program.
Summative assessment is that which evaluates the overalleffectiveness
of programs and services.
A third emerging model is the Assessment Center model in which
the testing and evaluating procedures
for an institution are coordinated. Common features of assessment
models all designed to meet
the unique needs of individualinstitutions include evaluation
of: clearly stated institutional
mission and goals developed by the institutional community;
in-place formal systems
procedures; faculty commitment;administrative support; feedback
from students and graduates;
student-faculty contact beyond class; assessment focus on student
completion; feedback to
students; and commitment fromchief leadership personnel. The
paper closes with a discussion of
the historical context of assessment pressures in higher education
and a look at why assessment
is now being mandated. Contains 18 references.
Documenting Student
Academic Achievement: A Plan for Outcomes Assessment at Owens
Community
College.(1994). Owens Community College, Toledo, OH. (ERIC Document
Reproduction Service
No. 368 436)
Prepared by the Outcomes
Assessment Task Force (OATF) at Owens Community College(OCC),
in Ohio, this document describe s the philosophy guiding assessment
at OCC and provides
a non-pre scriptive guide for implementing an assessment plan.
Part I provides an introduction
to outcomes assessment at OCC, including OCC's assessment philosophy,
a list of OATF members,
and a calendar of assessment events through summer 1996. This
section also outlines the following
steps in a procedural design for implementing the OATF's proposed
assessment plan: (1) examine
college mission; (2) examine division mission statements; (3)
examine department/program mission
and outcomes; (4) develop departmental assessment plans; (5)
implement and test assessment measures;
(6) use assessments to make improvements; (7) evaluate the effectiveness
of the assessment measures;
(8) evaluate the assessment plan itself; and (9) communicate
results to constituents. Part II
describes the theoretical orientation of the Task Force and
provides examples of the nine
steps of the OATF plan. Part III describes assessment methodologies
at OCC, indicating that
assessment is divided into institutional, general education
(GE), and department assessments,
and provides tables of institutional assessment functions and
activities. This section also
provides the nine expectations and indicators of effectiveness
of the Ohio Board of Regents,
a table of GE competencies, and a workbook for program specific
assessments providing information
on the functions of community colleges, writing department mission
statements, and measuring
results. Finally, part IV presents a model of institutional
effectiveness. Lists of general
education comp etencies and desired competencies for students
are appended.
Dooris, M. J. &
Teeter, D. J. (1994). Total Quality Management Perspective on
Assessing
Institutional Performance. New Directions for Institutional
Research, 82, 51-62.
Theme issue: "Using
Performance Indicators to Guide Strategic Decision Making."
Total Quality Management methods can build on conventional performa
nce indicators to
enhance their usefulness in monitoring and improving quality
and effectiveness in higher
education institutions. Experience with these methods at colleg
es and universities, particularly
in several academic and administrative areas at Pennsylvania
State University, is examined.
Duvall, B. (1994). Obtaining
Student Cooperation for Assessment. New Directions for Community
Colleges, 22, 47-52.
Discusses ways to
motivate students to participate in and take assessment effor
ts seriously.
Indicates that a strong institutional commitment to testing,
administrative support of
assessment, integration of testing into the curriculum, stu
dent and faculty participation
in testing operations, and reporting test results are major
factors in successful assessment
programs.
Ellett, C. D. et al.
(1997, March). Linking personal learning environment, quality
of teaching
and learning, and learning efficacy: An initial study of college
students. Paper presented at
the Annual Meeting of the American Educational Research Association,
Chicago, IL.
(ERIC Document Reproduction Service No. ED 410 770)
This study examined
the relationships among college students' perceptions of their
personal
(constructivist-based) learning environments, the extent to
which they viewed selected
teaching and learning activities as enhancing their personal
learning, and their personal
learning efficacy. A total of 2,190 students in 145 evening
classes offered by Louisiana State
University in the 1996 fall semester participated in the study.
The students completed three
separate measures of assessments of the quality of teaching
and learning, personal
perceptions of the learning environment, and motivation and
outcomes expectancy
assessments of personal learning efficacy. The results support
the validity of adapting the
Science Laboratory Environment Inventory (SLEI), an instrument
originally developed for
use in secondary classrooms, to the college classroom setting.
They also support the use of
the Student Assessment of Teaching and Learning (SATL) measure.
Correlations between
the SATL and SLEI subscales generated in this study suggest
that students' personal
perceptions of characteristics of the learning environment and
their self-reported experiences
and behaviors are significantly related to their self-reports
of learning enhancement. Copies
of the measures used in the study are appended.
Evaluating Institutional
Policies on the Evaluation of Student Achievement: General Guidelines.
(1994). Quebec Commission on the Evaluation of Collegiate Teaching.
(ERIC Document
Reproduction Service No. 369 435)
In June 1993, the Quebec Commission d'evaluation de l'enseigne
ment collegial (CEEC)
was created to conduct evaluations of the assessment of student
achievement and quality
of college programs of studies in the province. This repo rt
presents CEEC guidelines for
evaluating institutional policies for the evaluation of student
achievement (IPESA's).
Following an introduction to the CEEC and its focus on IPESA's,
the regulatory framework
regarding IPESA's in Quebec is described, indicating that colleges
are required to adopt
and implement an IPESA and submit it to the CEEC for evaluation.
Next, the CEEC's approach
is described, highlighting its guiding principles that students
have a right to fair evaluation,
that the quality of the evaluation depends on the quality of
the instruments used, that
institutional diversity must be respected, and that the evaluation
of student achievement
is an essential component of the teaching process. Then, the
essential components of an
IPESA are presented, indicating that an IPESA must include descriptions
of: (1) the
institution's goals and objectives; (2) the rules, methods,
procedures, and measures
used to achieve the objectives; (3) the roles and responsibilities
entrusted to various
individuals and bodies; and (4) the methods and criteria used
to evaluate the implementation
of the IPESA. The final section provides the CEEC's criteria
for evaluating IPESA's, including
comprehensiveness, coherence, and relevance; the rulings the
CEEC may render, from entirely
satisfactory to unsatisfactory; criteria for evaluating the
implementation of IPESA's, including
compliance, effectiveness, and equivalence; and information
on the CEEC's evaluation report.
Ewell, P. T & Jones,
D. P. (1994). Data, Indicators, and the National Center for Higher
Education
Management Systems. New Directions for Institutional Research,
82, 23-35.
Theme issue: "Using
Performance Indicators to Guide Strategic Decision Making."
The development of institutional performance indicators in higher
education is viewed
as part of a broader approach to management information and
decision making. The experience
of the National Center for Higher Education Management Systems
in developing useful information
from raw data, selecting appropriate performance indicators,
and applying indicators to
decision making is discussed.
Feldman, M. J. (1994).
A Strategy for Using Student Perceptions in the Assessment of
General
Education. Journal of General Education, 43, 151-67.
Describes a student survey to assess the effectiveness of Niagara
County Community
College's general education program. Students were asked to
assess their own levels of
competence in various knowledge and skill areas, and to evaluate
the college's contributions
to their skill development. Most students felt the college had
helped them develop stronger
general education competencies.
Fonte, R. (1994). Assessment
from the President's Perspective. New Directions for Community
Colleges, 22, 37-45.
Describes the ways
which college presidents can promote assessment by mobilizing
institutional resources for assessment; balancing conflicts
between assessing for
effectiveness, efficiency, and improvement; and communicating
assessment results to college
constituencies. Indicates that presidents must be actively involved
in planning and
implementing assessment on their campuses.
Foote, E. (1994). Sources
and Information: Assessment and the Community College. New
Directions for Community Colleges, 22, 85-94.
Provides an annotated
bibliography reflecting the major issues involved in accountability
and assessment programs at community colleges. Includes abstracts
of documents contained
in the ERIC database on assessment methods, student outcomes
studies, and the use of
assessment as a planning tool.
Freeman, T. M. (1995).
Performance Indicators and Assessment in the State University
of New
York System. New Directions for Higher Education, 91,
25-49.
Theme issue: Assessing
Performance in an Age of Accountability: Case Studies.
The development of a complex, highly computerized system of
performanc e indicators by
the State University of New York provides the means to monitor
internal progress, report to
a skeptical public, and compare the system's performance with
a national sample of institutions.
The system is described here, and the performance indicators
and data sources are charted.
Gaither, G. H. (1995).
Some Observations While Looking Ahead. New Directions for
Higher
Education, 91 , 7-101.
Theme issue: Assessing
Performance in an Age of Accountability: Case Studies.
The more successful college and university responses to the
demand for accountability and
assessment have been campus-based, with administrative and faculty
leadership and support.
Efforts initiated in state governments have been less substantive.
An emerging trend in
Europe is toward quality audits by peer assessment teams, reflecting
greater decentralization
of authority and oversight.
Gardiner, L. F. (1994).
Redesigning Higher Education: Producing Dramatic Gains in Student
Learning. (ASHE-ERIC Higher Education Report No. 7). (ERIC Document
Reproduction Service
No. ED 394 442)
This monograph reviews empirical studies on various aspects
of higher education relating
to the effectiveness of instruction in regard to four areas:
curriculum, instruction, campus
psyc hological climate, and academic advising. After a n introduction,
the first section
describes the development of critical skills, how these skills
develop, and the conditions
believed necessary to produce them. The following four sections
examine the four core areas
central to student development and the contribution research
suggests they now make to the
development: (1) curriculum (methods, the intellectual climate
of the classroom, students'
involvement, effects of the curriculum); (2) instruction (classroom
tests and grades);
(3) the campus climate (integration into the campus community,
commuter and part-time
students, students involvement with faculty, and minority group
members); and (4) academic
advising (developmental advising, the necessity for training
in advising, and evaluation,
recognition, and reward of advising). The next three sections
describe opportunities for
dramatic gains in students' learning, examining evidence about
the relative capacity of
students to learn at a very high level; describing seven specific
changes which can
improve students' learning, and addressing issues of leadership,
management, and professional
development. The final section presents a vision and a challenge
to develop a new kind of
community on campus.
Giddings, V. L. et al.
(1995). Assessment: Practices and implications for home economics
in
higher education. Family & Consumer Sciences Research
Journal, 23, 219-36.
Describes new methods
of higher education assessment: outcomes based (at end of course)
and value added (multiple measures over time). Reviews other
assessment
forms--standardized tests, program-based achievement instruments,
perception
measures--and gives suggestions for home economics student assessment.
Glenn, T. J. & Rahmes,
C. M. (1995, March) Using a Focused Visit to Its Best Advantage.
Paper presented at a preconference workshop of the 100th Annual
Meeting of the North Central
Association, Chicago, IL. (ERIC Document Reproduction Service
No. ED 388 340)
In summer 1994, the North Central Association of Colleges and
Schools (NCA) conducted
a focused evaluation visit of Cincin nati Technical College
(CTC)in Ohio to evaluate the
degree of success of CTC's adm inistrati ve st ructure and governance
model, review the
college's assessment plan, and review CTC's request for institutional
change in status
from a technical college to a comprehensive community college.
The focused evaluation
report required by the NCA was prepared with the participation
of the college's
Long-Range Planning Committee and broad involvement of the college
community. The report
described progress related to three concerns raised by a previous
accreditation team:
(1) the effectiveness of the administrative structure and governance
model, citing
evidence of improved methods for reviewing program curricula,
setting annual budgets,
and facilities planning; (2) the lack of coordination of general
institutional planning,
describing the establishment of the Long Range Planning Committee
to coordinate planning;
and (3) the inadequacy of facility allocations for student services,
pointing to new
equipment, an integrated computer system, and a 60% increase
in space. With respect
to the change from a technical to a community college and corresponding
addition of
two associate degree programs, the state Board of Trustees had
conducted a 2-year review
which resulted in favor of the conversion. The focus visit lasted
2 days, at the end of
which it was concluded that progress had been made in the areas
of governance and
administration and the request for institutional change was
approved.
Gravett, S. (1996).
The assessment of learning in higher education: Guiding principles.
South African Journal of Higher Education, 10, 76-82.
Argues that student
assessment plays a crucial role in the academic life of college
students, and assessment arrangements embody the purposes of
higher education. Reviews research
suggesting learners' perceptions of course testing procedures
is the single most important
influence on learning. Outlines six guiding principles of test
development to promote
teaching aims in higher education.
Gray, M. J. et al. (1996).
Student access and the "New" immigrants: Assessing their
impact on
institutions. Change, 28, 40-47.
The population of
immigrants to the United States is both growing and changing,
and
entering an economy in transition. A recent study focused on
their impact on access to
higher education and on the institutions themselves, including
efficiency of operation and
campus diversity. Unresolved issues include need for English
language skills, student
assessment, and legal status of immigrant students.
Harrington, T. F. Assessment
of Abilities. ERIC Digest. ERIC Clearinghouse on Counseling
and Student Services, Greensboro, NC. (ERIC Document Reproduction
Service No. ED 389
960) Online. ERIC. (1996, May).
This digest recommends assessing all of a person's abilities,
not just some. It also discusses
self-report in the context of ability assessment. Current use
of self assessment methodology
taps more ability areas than existing ability or aptitude tests
cover. Alternative testing
approaches have been called for which enhance self-discovery
and awareness. Some recent
self-report studies show at least comparable validity with more
traditional approaches. Some
researchers are advocating the self-assessment methodology which
can substantially cut loss
of instructional time and cost, evaluate hard-to-assess constructs,
and deliver information
most people feel is useful for self-knowledge and career planning.
Philosophically, the
process of self-evaluation fits the belief that individuals
are in the best position to assess
since they have access to a large data base on their own successes
and failures in their
abilities. Most misgivings about the methodology seem to center
around beliefs that
individuals have a tendency to be lenient and are not objective
enough in their self-analysis
to provide accurate self-reports.
Harris, J. (1994, July).
Unmet Data Needs of Community Colleges: A Call for Partnership.
Paper
presented at the State Higher Education Executive Officers/National
Center for Education Statistics
(SHEEO/NCES) National Data Conferenc e, Arlington, VA. (ERIC Document
Reproduction Service No. 371 781)
In 1969, the Virginia
Community College System (VCCS) established a centralized
student-specific data system from which state and federal reports
and management
information could be developed. However, this system provide
s no information about students
and graduates after they leave the system. In order to augment
the inconsistent data gathered
through follow-up surveys and feedback from senior colleges,
the VCCS needs access to in-state
and out-of-state databases that compile student-specific rather
than aggregate data. Student-specific
data permits the matching and merging of data records from other
sources with the VCCS data system to
produce a database for management information, assessment, academic
and institutional research,
and for compliance with federal higher education regulations
and anticipated accrediting requirements.
Specifically, the VCCS perceives a need for: (1) access to the
Virginia Council of Higher Education's
student-specific data system to receive transfer information
by name, social security
number, and other data elements; (2) the development of partnerships
with other states that would
allow the transfer of information from the higher education
state data files and the unemployment
insurance files of the employment commission across state boundaries;
(3) modification of the federal
unemployment insurance file to indicate the employee's full-
or part-time employment status and specific
occupation; (4) the development of federal regulations that
are easy to implement at the college level
with simple definitions and comparable data; and (5) the reassessment
of student classifications to better
reflect student intent and goals, creating some categories that
may not fit easily into federal or state
classification structures. Technology is available that will
allow the collection and sharing of data and
is a change in thinking.
Hawkins, L. & Lillibridge,
F. (1995, May). Development of the SPRE Compliance Matrix for
NMSU-Alamogordo. Paper presented at the 6th Annual Conference
of New Mexico Two-Year
Colleges, Ruidoso, NM, May 15-17, 1995). For more information
on the IASP, see JC 950 525.
(ERIC Document Reproduction Service No. ED 388 342)
In September 1994, the New Mexico Commission on Higher Education
issued standards for
the State Postsecondary Reporting Entity (SPRE). To comply with
these s tandards, New
Mexico State University-Alamogordo (NM SU-A) decided to use
its Integrated Assessment
and Strategic Planning (IASP) process, developed during a pre-accreditation
self-study
in 1993. To manage the increasing number of accountability requirements,
the IASP
committee established an Outcomes Committee to develop a SPRE
compliance matrix. In
developing the matrix, the Committee worked from five main goals:
(1) develop an understandable
matrix that would include all the standards and criteria the
college faced; (2) research
and develop ways to measure the effectiveness of student learning
and success after the
completion of a program; (3) develop a catalog of every external
reporting requirement
needing assessment; (4) analyze the cost of survey instruments;
and (5) research and
develop an effective method of measuring students' ability to
complete programs. Problems
encountered in developing the matrix included determining which
standards may become
serious issues, the cost/benefit ratio of periodically reviewing
accountability standards, which
standards are the most relevant for the college, and which institutional
unit will be
responsible for SPRE compliance. Now that the matrix has been
developed, NMSU-A will
need to compile other matrices for each institutional mission
and purpose, implement a
time-line for assessment, and design an internal audit system
to ensure compliance with
onsite reviews.
Hayes, C. R. (1995).
Development of Evaluation Indicators: Three Universities of the
Texas
A&M System. New Directions for Higher Education, 91, 91-96.
Theme issue: Assessing
Performance in an Age of Accountability: Case Studies.
To develop a set of effective performance indicators, three
campuses of Texas A&M
University collaborated: a large research university, a historically
black institution,
and an urban campus undergoing major changes. Evolution of the
project and the strategies
used to develop core indicators while addressing the different
institutional missions are
discussed.
Heath, D. (1994). Effective
Teaching Strategies. Optometric Education. 20, 19-20.
A discussion of effective
training for health professionals proposes that selection of
strategy be guided by knowledge needed by the graduating student;
skills to be mastered;
teaching methods effective for achieving these two objectives;
and whether the desired
knowledge,skills, and attitudes are reflected in assessment
methods and outcomes measures.
Hyman, R. E, et al. (1994).
Outcomes Assessment and Student Affairs: New Roles and
Expectations. NASPA Journal, 32, 20-30.
Describes how six colleges and universities, known for their assessment
programs, use
student outcomes assessment to improve programs. Each school preferred
to use nationally
normed tests and inventories supplemented with locally developed
instruments. Outcomes assessment
help schools to meaningfully reconsider their educational values
and practices
Imrie, B. W. (1995).
Assessment for learning: Quality and taxonomies. Assessment
&
Evaluation in Higher Education, 20, 175-89.
The use of taxonomies of types and levels of learning for student
assessment in higher
education is discussed. Five taxonomies designed for a variety
of instructional areas are
described. The reasons for their use are examined from four points
of view: pedagogical,
professional, quality assurance, and management.
Institutional Effectiveness
Program. Pima County Community College District Institutional
Effectiveness Series: 1 [1994]. TUCSON: AZ., Pima Community College,
Office of the
Vice Chancello. (ERIC Docuemnt Reproduction Service No. ED 375
912)
Describing Pima Community College's (Arizona) institutional effectiveness
program, this
report provides related board policy, an overview of the p rog
ram , and ananalys is of
each of the five program components. Following introductory materials
and a board statement
indicating the college's commitment to ensuring institutional
effectiveness through continuous
assessment and quality improvement, an overview of the program
is provided, including a
schematic diagram of program components and a list of documents
in which review results
are made available. Individual descriptions are then provided
for the following five
components of the institutional effectiveness program: (1) an
evaluation, every 5 years,
of the mission statement involving broad-based community involvement;
(2) annual reviews
of programs and services with respect to students, faculty, curriculum,
and financial
operation, as well 5-year reviews of goal achievement, faculty
development, and curriculum
modifications; (3) periodic evaluations of faculty, the chancellor,
administrators, staff,
and the board of governors; (4) student outcomes assessment, including
classroom mini-grants,
general education, occupational education, and student information
system reports; and
(5) continuous evaluation of the planning process. For each section,
information is provided
on participants in each component, the form of documentation,
and the utilization of
results. Timelines, the executive summaries of four research reports,
and other supporting
materials are appended.
Jonas, P. M & Weimer,
D. (1995, May). Core Curriculum Assessment Program: A Case Study.
Paper presented at the Annual Forum of the Association for Institutional
Research,Boston,
(ERIC Document Reproduction Service No. ED 390 325)
This paper reviews the development of a curriculum ass essment
plan by the Business and
Management Division of Cardinal Stritch College in M ilwaukee,
Wisconsin, and reports the
results of a study to determine the effectiveness of t he p lan.
The division, which
delivers accelerated instruction in evening courses, used the
comprehensive outcomes
assessment program (COAP) and the core curriculum assessment program
(CCAP) to evaluate
the division's programs and student achievement. The division
used the COAP and CCAP
measures to compare the pre- and post-test scores of 78 students
who have completed the
Bachelor of Science in Business Management program and 41 students
who have completed the
Master of Science in Management program. It also used the measures
to assess the pre-test
scores of 67 students who did not complete these programs. The
study found that students
who completed the Bachelor's or Master's programs exhibited a
significant increase in business
management skills. It also found that students who did not complete
the Bachelor's program
had significantly higher pre-test scores than students who received
their degree, while students
who did not complete the Master's program had lower pre-test scores
than those who did.
Johnson, A. (1997, May).
Assessment, outcomes measurement and attrition. (reflections,
definitions and delineations). Paper presented at the 37th Annual
Forum of the Association
for Institutional Research Orlando, FL. (ERIC Document Reproduction
Service No. ED 410
888).
This paper addresses issues in assessment of college students,
outcome studies, and attrition
research in the context of trends toward requiring greater accountability
from institutions
of higher education. First the paper considers how assessment,
student outcomes studies,
and attrition research terminology might be more clearly defined.
It suggests that these three
areas of inquiry, although distinctive, are highly interrelated
phenomena. The paper then
attempts to operationalize definitions and outline a recursive
research model appropriate for
research in these areas. Finally, it briefly describes how one
small liberal arts university is
currently thinking through the process of implementing a longitudinal
assessment program
including student outcomes studies and student attrition research
through a recursive
research model and operationalized definitions. Stressed is the
need for institutions to plan
their research to be consistent with the educational goals of
the institution.
Kelley, L. H. (1994,
May). Utilizing a Graduate Follow-up Survey To Assess Institutional
Effectiveness in the Small Liberal Arts College. Paper presented
at the Meeting of the
Association for Institutional Research 34th Annual Forum, New
Orleans, LA. (ERIC Document
Reproduction No. 376 765)
This paper reports on a 1992 fol low-up survey of graduates of
Virginia Wesleyan College
(VWC). The targ et p opulation o f 1,110 graduates from the classes
of 1987 through 1992
were surveyed, and 576 responded(51.9 percent). Responding graduates
indicated that they
were generally satisfied with their educational experiences and
with the programs and
services provided by the college. Graduates reported that the
school fostered personal
growth in cognitive and affective areas and that their VWC experiences
had adequately
prepared them for continued educational pursuits and/or employment.
Areas of concern that
emerged from the survey included students' experiences in student
activities and their
preparation in computers, responsibilities of citizenship, application
of scientific
principles and methods, and applied mathematics. Various college
services such as registration
process, library services, and cost of attending, also received
less favorable evaluations
from the graduates. Includes nine tables.
Latchaw, J. S. (1995,
March). Assessment and Community. Paper presented at the 46th
Annual
Meeting of the Conference on College Composition and Communication
Washington, DC.
(ERIC Document Reproduction Service No. ED 385 839)
In the service of accountability, educators h ave been emphasizing
the student as consumer,
client, customer. Consequently , assessment is asking the wr on
g ques tions of the wrong
people. Outcome measu res are often intended to evaluate student
and teacher performance
rather than to assess teaching and learning. Anthony Petrosky's
study of literacy in the
Mississippi Delta is a frightening example of how assessment can
masquerade as learning.
According to the Petrosky study, mandates based on assessment
measures typical of the
Mississippi School Reform Act are problematic in a number of ways:
(1) they focus on
solutions such as tests, upward mobility, not processes like teaching
and learning;
(2) they emphasize basic skills rather than high order critical
thinking strategies;
(3) they cause friction and isolation among teachers; and (4)
they perpetuate outmoded
styles of teaching (e.g., recitation rather than discussion).
Thomas Angelo and Patricia
Cross's "Classroom Assessment Techniques: A Handbook for
College Teachers" offers a number
of helpful directives that ensure that assessment is a means by
which teachers may improve
their effectiveness. To respond to the challenge set forth in
the handbook, one college-level
instructor began assigning the one-minute paper to her students,
an in-class writing
assignment that required her students to answer 2 questions: first,
what was the most
important thing learned in class today? and second, what important
question remains
unanswered? These essays led to spirited classroom discussions
and ultimately better teaching
and learning.
Leas, D. E. (1995). New Mexico State University at Grants College
Assessment and Planning
Process. (ERIC Document Reproduction Service No. ED 379 034)
The College Assessment
and Planning Process (CAPP) at New Mexico State University-Grants
(NMSU-G) combines in a 2-year cycle the pro cesses of assessment
of student academic
achievement, review of program effe ctiveness, str ategic planning,
and institutional development.
Virtually all faculty and staff are involved in the process,
which features individually
designed assessment strategies, and program and institutional
development throughout the
2-year cycle. Assessment activities are conducted on an ongoing
basis. These activities include
classroom assessment and classroom research; as well as assessments
of instructional programs,
instructional support, adult basic education, student services,
outreach services, and institutional
support. In addition to assessment activities, focus groups
provide the means of developing integrated
statements of strengths, concerns, and action plans. Focus group
activities occur primarily in the
second (i.e., fall) semester of the four-semester CAPP sequence,
with groups identifying strengths
and concerns related to instruction, student services, outreach
programs, and institutional support.
During alternate spring semesters, the campus director brings
together key players from
all college functions to conduct focus group institutional planning
activities. All college
employees and representatives from the community are invited
to participate in a retreat
where college-level strengths and concerns are identified and
an action plan is developed.
Implementation of the action plans may require the following
2 years of the sequence.
After the institutional action plan has been fully implemented,
the Alpha Group conducts
a review of the operation of the complete cycle of the CAPP
projects. The role of institutional
research in the CAPP process is two-fold: completing institution-wide
research projects
(e.g., student, employee, and community surveys) and coaching
and advising employees in
various departments as they develop individual assessment projects.
McMillan, V.K (1994).
Assessment from the State Perspective. New Directions for
Community
Colleges, 22, 5-11.
Identifies pertinent constituencies that interact with state-level
community college
governance and coordinating bodies in assessment; data and information
needed for and used
with these constituencies; the balance of potentially conf licting
pressures and ideas about
institutional autonomy and state uniformity and control; and mechanisms
for presenting
assessment data so they are accurate, comprehensible, and useful.
McNeill, B. W. &
Bellamy, L. Engineering core workbook for active learning, assessment
&
team training. Section Edition.Arizona State Univ., Tempe, Coll.
of Engineering and Applied
Sciences. (ERIC Document Reproduction Service No. ED 384 315)
Online. ERIC. (1995,
November).
This course workbook is designed to help students understand the
principles of active
learning, student assessment, and team training used in Arizona
State University's core
engineering curriculum. Eight sections focus on: (1) active learning,
teaching and learning
styles, and cooperative learning; (2) student assessment, levels
of learning, and degrees of
internalization, (3) a guide to self-evaluation and the documentation
of educational states;
(4) the use of teams; (5) team dynamics and effectiveness; (6)
communication skills and
teamwork; (7) tools for effective team decision-making; and (8)
competency matrices for
student self-evaluation.
Mittler, M. L &
Bers, T. H. (1994). Qualitative Assessment: An Institutional Reality
Check.
New Directions for Community Colleges, 22, 61-67.
Describes three qualitative research approaches used at Oakton
Community College to
provide insights into student experience as well as college assessment
and promotion
activities. Indicates that, when used with quantitative resea
rch, qualitative research
results in a more comprehensive and realistic appraisal of student
outcomes and institutional
effectiveness.
Muraski, E. J. (1995).
Core Indicators of Effectiveness and Student Success. (ERIC Document
Reproduction Service No. ED 384 365)
To help improve teaching and learning and to provide data required
by the California
community college system, Porterville College (PC) has assembled
a list of core indicators
of effectiveness and student success. This report d escr ibes
PC's indicators and includes
information on measurement criteria and data sources. First, definitions
are provided of
accountability, core indicators, and effectiveness, and a flowchart
is presented for the PC
planning process. The following core indicators developed for
the 1995-96 academic year,
are then presented, including information on measurement criteria,
data sources, and specific
college objectives: (1) student access to PC's educational offerings;
(2) student goal attainment;
(3) student persistence from fall to fall; (4) degree and certificate
program completion rates;
(5) placement rate in the work force; (6) employer assessment
of PC trained
students; (7) number and rate of students who transfer within
2 years to a degree program at
a four-year college or university; (8) student academic performance
after transfer; (9) success
of deficient students in subsequent coursework related to their
deficiency; (10) demonstration
of citizenship skills; (11) client assessment of programs and
services; (12) responsiveness
to community needs; (13) participation rate of the population
in the service area; (14)outreach
and recruitment of underrepresented students; (15) faculty and
staff diversity; and
(16) faculty and staff development.
Neal, J. E. (1995).
Overview of Policy and Practice: Differences and Similarities
in Developing
Higher Education Accountability. New Directions for Higher Education,
91, 5-10.
Theme issue: Assessing Performance in an Age of Accountabili ty:
Case Studies. (ERIC Document
Reproduction Service No. ED 384 365)
Higher Education's "accountability movement" is being
accompanied by greater use of performance
indicator systems in response to external mandates in the United
States and Europe. These
indicators are usually designed to examine institutional productivity
relative to the public
investment made in it, as contrasted with evaluation of educational
outcomes relative to
instructional processes.
Nightingale, P. et al.
(1995). A resource for improving the practice of assessment in
higher
education. Innovations in Education & Training International,
32, 344-55.
Describes a project commissioned by the Australian government
to help university teachers
improve student assessment. Eight modules incorporated the following
abilities: critical
thinking, problem solving, performing procedures and demonstrating
techniques,
self-directed learning, accessing and managing information, demonstrating
knowledge,
designing and performing, and communicating.
Nolte, W. H (1994)
. Student Outcomes and Performance Standards: Issues and Challenges
for
Community and Technical Colleges. (ERIC Document Reproduction
No. ED 373 849)
During the last few years, there has been a general emphasis in
higher ed ucation on
quality issues and the use of outcomes measures to assess institutional
effectiveness.
The quality emphasis in education suggests that previously defi
ned performance standards
are met through a review of outcomes assessment. This emphasis
on outcomes measures represents
a positive shift for community college occupational and technical
programs, since, to a
large extent, it is easier for occupational education to demonstrate
effectiveness and
accountability. An America n College Testing survey of 675 colleges
in 1990 found that
the two most important measures of institutional effectiveness
were employers' satisfaction
with graduates and the percentage of students who received jobs
. With respect to evaluating
specific programs, performance standards should be based on identifiable
and verified competencies
which are determined in advance and explicitly stated. Four major
steps for designing and
implementing a performance standards system include defining student
learning expectations in
conjunction with customers, reviewing existing state or licensing
agency standards, developing
or revising curricula to address the expected outcomes, and measuring
outcomes with the
goal of improving both the standards and curriculum. Finally,
to maintain relevancy, standards
must be constantly renewed to adjust to changes in the workplace
and assessment
methodologies of standards should be reviewed.
Oklahoma State Regents
for Higher Education, Oklahoma City. Annual Student Assessment
Report. (ERIC Document Reproduction Service No. ED 410 905) Online.
ERIC. (1998,
January).
This document presents required summaries of detailed student
assessment reports
submitted by the following Oklahoma institutions: University of
Oklahoma, Oklahoma State
University, University of Central Oklahoma, East Central University,
Northeastern State
University, Northwestern Oklahoma State University, Southeastern
Oklahoma State
University, Southwestern Oklahoma State University, Cameron University,
Langston
University, University of Science and Arts of Oklahoma, Oklahoma
Panhandle State
University, Conners State College, Eastern Oklahoma State College,
Murray State College,
Northeastern Oklahoma A&M College, Northern Oklahoma College,
Tulsa Community
College, Oklahoma State University Technical Branch Oklahoma City,
Oklahoma State
University Technical Branch Okmulgee, Western Oklahoma State College,
Redlands
Community College, Carl Albert State College, Seminole State College,
Rose State College,
Oklahoma City Community College, and Rogers University. Data are
presented on the four
required assessments: (1) at entry-level, to determine academic
preparation and course
placement; (2) at midlevel, to determine general educational competencies
in reading,
writing, mathematics, and critical thinking; (3) at exit level,
to evaluate outcomes in the
student's major; and (4) a general assessment of student satisfaction.
Data on the optional
assessment of graduate students is provided for four universities.
Also included are the
results of a student remediation survey conducted for 1995-96
activity. Appendixes include
a state regents assessment policy statement and a copy of the
remediation survey instrument.
Oklahoma State Regents
for Higher Education, Oklahoma City. Annual Student Assessment
Report. 1996-97. ERIC Document Reproduction Service No. ED 416
789) Online. ERIC.
(1998, July).
This report contains information on student assessment programs
at each of Oklahoma's 27
state colleges and universities, including community colleges.
An introductory section
offers background on state policy and requirements concerning
student assessment at five
levels: college entry; mid-program; program exit; student satisfaction;
and graduate study.
The annual assessment reports filed by each institution for 1996-97
form the bulk of the
report. Each report gives an overview and highlights of the institution's
student assessment
activities at each level. The state's "Policy Statement on
the Assessment of Students for
Purposes of Instructional Improvement and State System Accountability"
is appended.Entry
Month 9807
(A)Plan for the Evaluation
and Continuous Improvement of Texas' Community and Technical
Colleges: Report and Recommendations of the Task Force on Institutional
Effectiveness to
the Texas Higher Education Coordinating Board. (1994). Texas Higher
Education Coordinating
Board, Austin. (ERIC Document Reproduction Service No. ED 371
794)
In May 1993, the Texas Higher Education Coordinating Board forme
d the Task Force on
Institutional Effectiveness (TFIE) to develop a state-level evaluation
and continuous
improvement plan for community and technical co llege (CTC) workforce
education and
academic programs. This report presents the plan for utilizing
data collected on CTC's
in three main sections. Following an executive summary and recommendations,
the first
section describes the Task Force and its approach, indicating
that it reviewed models of
assessing institutional effectiveness and conducting state-level
evaluations in four
states. The second section describes the evaluation and continuous
improvement plan,
reviewing the purpose of state-level evaluation, operating definitions,
TFIE assumptions
in developing the plan, and the conceptual model for continuous
improvement. This section
also describes five critical success factors (i.e., commitment
to college mission;
access; achievement; quality; and effective use of resources)
and performance factors for
each. The third section focuses on the continuous improvement
process, providing an
implementation timeline, including the preparation of an annual
data profile; a seven-step
process for utilizing data, moving from CTC-generated data to
state-level planning actions;
and information on program rating and appeals processes. Extensive
appendixes provide
performance expectations for Texas CTC's; a description of powers
and duties of the
Coordinating Board; state-level goals for CTC's; a chart of performance
measures by
success factor; the 5-year on-site review process; and worksheets
for generating profiles
of access and achievement and institutional and program quality.
Prus, J. & Johnson.
R. (1994). A Critical Review of Student Assessment Options.
New Directions
for Community Colleges, 22, 69-83.
Describes 13 methodological options for assessing student learning
and development, discussing
advantages, disadvantages, techniques for reducing the disadvantages,
and bottomline
strategies as a guideline for selecting a suitable met hod. Indicates
that it is crucial to
use a multimethod approach to obtain maximum validity.
Rasor, R. A. & Barr,
J. (1993). Refinement in assessment validation: Technicalities
of dealing
with low correlations and instructor grading variation. Portions
of paper presented at the
Annual Research Conference of the RP Group, Granlibakken. (ERIC
Document
Reproduction Service No. ED 393 883)
Issues and problems in assessment research are explored, with
suggestions to help establish
an acceptable correlation between student assessment scores and
final grades. Topics
include assessing instructor grading variation, instructor grade
point average (GPA), success
rates, and lack of linearity in grade scales. Solutions to these
problems are offered in the
form of a new four-point research grading scale and a new "contextual"
student GPA based
on cumulative grade average with the final grade in the target
course removed from the
calculation. The contextual GPA was used to equate student "skill"
levels in course
selections when identifying the degree of instructor grading variation.
The techniques were
applied to a sample of 6,077 students covering performance data
in 26 courses. The
magnitude of the resulting correlations suggests giving much greater
emphasis to student
cumulative college GPA as a multiple measure when establishing
entrance "skill" levels
deemed necessary for success in general courses having no specific
course prerequisite.
Practical suggestions are included for identifying the true correlation
between assessment
test scores and grades given the problem of instructor grading
variation.
Schoenfeld, A., ed.
Student assessment in calculus. A report of the NSF Working Group
on
Assessment in Calculus. MAA Notes Number 43. Mathematical Association
of America,,
Washington, DC. (ERIC Document Reproduction Service No. ED 407
240) Online. ERIC.
(1997, September).
The purpose of this report is to outline the state of the art
in calculus assessment and to
indicate directions for explorations in assessment that will enable
educators to gain a deeper
understanding of student learning in order to improve student
learning through calculus
instruction. The purpose is accomplished in the context of two
major changes related to
calculus instruction: (1) a revised set of goals for instruction;
and (2) a much-expanded
research base regarding the nature of students' understandings
of mathematical concepts.
This approach is grounded in the principle that assessment requires
an understanding of
what it means to understand. This report can serve as a vehicle
for thinking about individual
student work, goals for instruction, and how well a particular
course or set of courses might
meet those goals. A user's guide to the report, goals for instruction
and student assessment
in calculus, an account of the state of knowledge about assessment
in general, specific
calculus-related assessment issues, an agenda for research and
development in calculus
assessment, and assessment examples are included.
Seybert, J. A. (1994).
Assessment from a National Perspective: Where Are We, Really?
New
Directions for Community Colleges, 22, 23-30.
Provides a comprehensive perspective on assessment in community
co lleges, indicating that
there is great variance among institutions in the extent and sophistication
of their assessment
practices. Suggests that there are three categories of outcomes:
student performance at community
colleges, transfer institutions, and occupations; student learning
levels; and student development.
Sheehan, E. P. (1994).
A multimethod Assessment of the Psychology Major. Teaching
of
Psychology. 21, 74-78.
Describes a multimethod assessment of psychology student outcomes
at the University of Northern
Colorado. Nineteen goals and objectives for psychology majors
were identified. Describes
changes in the psychology program prompted by the assessment results.
Smith, B. et al. (1997).
Integrating student assessment practices: The significance of
collaborative partnerships for curriculum and professional development
in a university
department. Higher Education Research & Development,
16, 69-86.
A project in a health sciences department of one Australian university,
designed to
encourage faculty collaboration on student assessment issues,
became a program of personal
and collective review giving insight into the processes and dynamics
of curriculum and
professional development. The project, its processes and products,
and implications
organizational change and for comfortable rather than critical
collaboration are examined.
Sorenson, R. (1996,
February). What Are the Roles of the Chair, Facult y Member, and
Dean in
Student Assessment? In: The Olympics of Leadership: Overcoming
Obstacles, Balancing
Skills, Taking Risks. Proceedings of the 5th Annual Interna tional
Conference of the National
Community College Chair Academy, Phoenix, AZ. (ERIC Document Reproduction
Service No. ED 394 599)
As state governments and the public demand greater ac countability
from community and
technical colleges, increasing focus is placed on the concept
of as sessing student academic
achievement. To be effective, assessment processes should provide
institutions with information
that helps develop specific plans for improving operations. While
processes for implementing
assessment programs vary, basic steps include articulating the
mission, establishing a planning
mechanism, developing an evaluation system that determines if
objectives were met, identifying
critical areas of success, establishing priority standards upon
which the college can judge
effectiveness, determining mechanisms for documenting outcomes,
and utilizing assessment results
for decision making. To be effective, assessment programs should
flow from the institution's
mission; have a clear conceptual framework; include faculty ownership
and responsibility; have
institution-wide support; use multiple measures to determine student
achievement; provide feedback
to students and the institution; be cost-effective; not restrict
or inhibit goals of access, equity,
and diversity; lead to improvement; and include a process for
evaluating the assessment program.
Finally, the importance of faculty support for any assessment
program cannot be overestimated and
for assessment programs to prosper, institutions should create
an environment in which risk-taking
and experimentation are encouraged. Contains 12 references.
Spangehl, S. D (1994).
Latent and Leveraged Benefits of Assessment: Expanding the Value
of
Assessment Information. New Directions for Community Colleges;
22, 13-21.
Acknowledges that assessment is often perceived as a costly ordeal
with minimal benefits
to the institution beyond meeting external reporting requirements.
Presents examples of
assessment data already available in existing records, and ways
in which colleges can leverage
the results of assessment to serve multiple purposes.
Student Outcomes Assessment
Plan. Pima County Community College District Institutional Effectiveness
Series: 5. [1994]. Tucson, AZ: Pima Community College, Office
of the Vice Chancellor.
(ERIC Docuemnt Reproduction Service No. Ed 375 916)
The Student Outcomes Assessment Program (SOAP) at Pima Community
College (PCC )in Arizona
has six major components: (1) the use of success ind icators to
assess the college's
success in achieving its mission; (2) a classroom a ssessment
mini- grant program designed
to support faculty research with a direct effect on learning;
(3) the use of general education
curriculum designation as a mechanism to incorporate formal student
outcomes assessment into a
major curriculum reform; (4) occupational curriculum renewal using
the DACUM (Developing A Curriculum)
process; (5) program and service reviews; and (6) the collection
of student information system
data. For the final component data were collection through a minority
student retention and transfer
study, a study of concurrent enrollment at PCC and the University
of Arizona, employer surveys,
graduate satisfaction surveys, and various other surveys. A vital
SOAP component is the dissemination
of research results to appropriate constituencies within the college,
a charge of PCC's College Research
and Information Steering Committee. In order to reach all segments
of the college, which comprises five
campuses and a district central office, multiple means are being
used to publicize the SOAP and related
student outcomes assessment activities. These include a multi-dimensional
publicity campaign,
widespread distribution of draft documents and final reports,
meetings with governance
groups, campus forums on research projects, and special involvement
with the accreditation
agency.
Taylor, K. E (1994).
Educational Outcomes for Students at Minnesota's Community Colleges:
Student Outcomes Study. (ERIC Document Reproduction Service No.
ED 372 800)
To gather data on the effectiveness of the Minnesota Community
College System (MCCS),
four studies were conducted of educational outcomes for graduates
of occupational programs,
Associate in Arts (AA) graduates, "leavers," and part-time
students enrolled for one quarter,
respectively. A compilation of job placement studies for 1992-93
occupational graduates
conducted individually at the 21 MCCS colleges indicated that
70% percent of associate degree
occupational graduates were employed in jobs related to their
studies, with another 24% employed
in unrelated jobs. Analysis of outcomes studies conducted at MCCS
colleges for 1992-93 AA
graduates revealed that 64% of the graduates had transferred to
a four-year college in fall 1993,
with over half transferring to Minnesota universities, and 24%
reported employment. A study
of 300 "leavers" enrolled in spring 1993 but not returning
in fall 1993 resulted in a
response rate of 65% and indicated that 75% of leavers were employed;
over half were currently
enrolled in higher education; 39% had transferred to a four-year
college; and 87% rated the
quality of instruction at their MCCS institution as good or excellent.
Finally, a systemwide
study of students enrolled for fewer than six credits during fall
1991 who had not returned
as of fall 1993 indicated that for completers (i.e., those who
completed at least 60% of their
credits) 89% had achieved their goals at least partially, while
58% of non-completers
(i.e., those who did not complete any credits) cited job or studies
conflicts and 29% cited
course/instructional factors. Data tables and the survey instruments
are appended to each
study.
Toohey, S. et al. (1996).
Assessing the practicum. Assessment & Evaluation in Higher
Education, 21, 215-27.
A literature review reveals differing conceptions of the learning
outcomes achieved through
practicums (workplace learning) in professional education. Five
distinct approaches to
student assessment are examined. Integration of the practicum
with the instructional
program provides opportunities for students to bring together
a range of knowledge and
skills.
Twomey, J.L., et al.
(1995, March). SPRE and the NMSU-A Integrated Assessment and
Strategic Planning (IASP) Process: What We've Learned and Where
We're Going. Paper
presented at the New Mexico Higher Education Assessment Conference,
Albuquerque, NM
(ERIC Document Reproduction Service No. Ed 388 341)
In September 1994, the New Mexico Commission on Higher Education
issued standards for
the State Postsecondary Reporting Entity (SPRE). To comply with
these standards, New
Mexico State University-Alamogordo (N MSU-A) decided to use its
integrated Assessment
and Strategic Planning (IASP) process, developed during a pre-accreditation
self-study in
1993. In developing the IASP, the college decided that planning
and assessment should be
closely based on its mission and purpose statements, while the
design and implementation
of the IASP included faculty, staff, and student involvement.
Since its original implementation,
the IASP has led to revisions of syllabi and course content, more
effective counseling services
for at risk students, reallocation of campus financial resources,
and greater attention towards
issues related to the Americans with Disabilities and Student
Right to Know and Campus Security
Acts. To respond to the new SPRE standards, the IASP committee
developed the SPRE Compliance
Matrix, listing significant outcomes and accountability measures
associated with external
entities. The matrix has served as the basis for developing outcomes
assessment data
instruments, research questions, implementation schedules, and
operating procedures. The
IASP process has proven to be very effective in driving positive
change at NMSU-A.
(The SPRE Compliance Matrix is appended.)
Walters, J. E. (1994,
March). AB 1725 Accountability: Work in Progress. A Report. Sacramento,
CA:
California Community Colleges, Office of the Chancellor. (ERIC
Document Reproduction
Service No. ED 366 386) Prepared as Agenda Item Number 12 at a
meeting of the Board of Governors
of the California Community Colleges, Sacramento, CA..
California Assembly Bill 1725 requires the development and implementation
of a comprehensive
community college educational and fiscalac countability system.
In response to the bill, the
Chancellor's Office (CO) of the California Community Colleges
is moving away from its traditional
functions of compliance and regulatory activity toward establishing
an accountability structure
based on student outcomes and district results rather than input
measures. An accountability
program has been developed which centrally collects information
on college outcomes related to
student access, student success, student satisfaction, staff composition,
and fiscal condition,
but also recognizes the importance of locally designed and managed
accountability efforts.
Obstacles have been identified to implementing the accountability
program, including the variance
in local management information system capabilities, uneven local
research competence, local
skepticism, and a patchwork of existing burdensome statewide reporting
requirements. The CO's
proposal for overcoming these obstacles includes the following
five components: (1) the annual
publication of a statewide accountability indicators report; (2)
annual in-depth studies of
individual accountability areas; (3) periodic statewide surveys
to assess student satisfaction;
(4) more effective data collection and dissemination; and (5)
disseminating exemplary accountability
models and providing technical assistance to districts. A work-in-progress
version of the accountability
indicators report and a table of non-participating districts are
appended.
Walters, S. J. &
Giovannini, G. (1994, March). Institutional Effectiveness for
a State-Wide
Technical College System. Paper presented at the 99th Annual Meeting
of the North Central
Association, Chicago, IL. (ERIC Docuemnt Reproduction Service
No. ED 373 835)
Indiana Vocational Technical College (IVTC) ranks among th e large
st two-year public colleges
in the country, offering degrees in 40 broad technologies, and
enrolling 61,00 students at 13 regional
campuses. The multi-campus system is un dergo ing a significant
shift in its accreditation status
with the North Central Association (NCA) from 13 regional accreditations
to reaccreditation as a
single institution. To prepare for the NCA accreditation visit,
IVTC embarked on a 24-month
statewide self-study. An Academic Program Review Model addressing
curriculum review and administrative
program review was initiated in spring 1994. Other portions of
the plan address the functional
areas of student services, human resources, business and industry
training, and college
administration. An Institutional Effectiveness Committee identified
the following effectiveness
indicators: (1) course completion rates; (2) transfer rates; (3)
basic skills assessment; (4)
general education outcomes; (5) student/faculty course evaluation;
(6) program outcome measures;
(7) retention; (8) enrollment trends; (9) full-time equivalency
(FTE) trends; (10) program and
faculty FTE; (11) credit hours taught; (12) degrees awarded; (13)
graduate surveys; (14) employer
surveys; (15) advisory committee survey; (16) program accreditation
audit; (17) faculty credential
audit; (18) student opinion survey; (19) former student survey;
and (20) student demographic profile.
The development of an institutional effectiveness plan must be
anchored in the institution's mission
and based on broad participation from all of the college's constituencies.
Weaver, R. & Chalkley,
B. (1997). Introducing objective tests and OMR-based student
assessment: A case study. Journal of Geography in Higher Education,
21, 114-21.
Describes the process by which objective tests utilizing an optical
mark reader (OMR) were
introduced into a number of first-year geography courses at the
University of Plymouth
(England). Presents the results of various statistical tests including
a comparison of student
performance in the objective and the traditional essay examinations.
Wilson, D. C, et al.
(1994, June). Integrating a Statewide Effectiveness Model with
Quality
Improvement Methods at Western Wisconsin Technical College. Paper
presented at the 6th
Summer Institute on Institutional Effectiveness and Student Success,
Atlantic City, NJ
(ERIC Docuemnt Reproduction Service No. ED 373 846).
Since 1988, Western Wisconsin Technical College (WWTC) h as taken
a leadership role in
integrating institutional effectiveness activities withi n the
Wisconsin Technical College
System (WTCS). In December 1992, the WTCS Administr ators Association
and the WTCS State Board
agreed to work with the University of Michigan's Community College
Consortium to develop
an institutional effectiveness model that would provide a valid
and consistent means of evaluating
the performance of each college and the system as a whole. The
statewide effectiveness
modeling project sought to identify core indicators that could
be used by WTCS colleges to
respond to accountability initiatives, accreditation requirements,
federal reporting
requirements, and quality management initiatives. In its adaptation
of the statewide model,
WWTC took the following steps: (1) representatives were selected
to attend a state conference
on institutional effectiveness; (2) an institutional effectiveness
committee was formed;
(3) the committee adapted the WTCS model by determinin g whether
each core indicator in
the model applied to the mission of WWTC and whether it could
be measured using the
resources available at WWTC; and (4) measurable factors of institutional
effectiveness were
identified for each core indicator in the categories of student
achievement and satisfaction;
organizational quality, harmony, and efficiency; public perception
and satisfaction; and
employer satisfaction. While this model helps detail the WTCS's
commitment to its mission and purpose, WWTC has found that the
Deming
Plan-Do-Study-Act cycle of improvement provides the methodology
for continuous
improvement.
Young, R. L. (1997).
Toward an empowering multicultural assessment technique. Teacher
Education Quarterly, 24, 21-27.
Discusses the move toward teaching strategies designed to empower
students, sharing one
university professor's experiences with a cooperative learning
method of student assessment
in a teacher training multicultural education course that utilized
an empowering model.
|