Kelly Shapley and Shapley Research Associates have authored a number of
evaluation reports, conference papers, and articles, and have developed
other products. The selected sample below represents a range of topics,
methodological approaches, and formats.
Please click on titles to review.
Evaluation of the
Texas Technology Immersion Pilot: Final Outcomes
This report provides final results for a four-year, quasi-experimental
study of the Technology Immersion model (1:1 laptop access plus supporting
resources). The study involved comparisons between 21 treatment and 21 control
schools, and used hierarchical linear growth models to examine differences
between groups on measures of teaching, learning, and academic achievement.
of the Texas Technology Immersion Pilot: Traits of Higher Implementing
Schools and Teachers
This study compares the traits of higher/lower Technology Immersion schools
and higher/lower Classroom Immersion teachers. The study employed a
mixed-methods approach with a combination of qualitative and quantitative
Study of Students at Risk: Efficacy of Grants Supporting Academic Success
This report examines the effectiveness of three state-level programs with
the common goal of helping students at risk of academic failure.
Researchers analyzed district- and student-level program and outcome data,
and used hierarchical linear models to examine associations between program
elements and outcomes.
Study of Students at Risk: Case Studies of Initiatives Supporting Ninth
This report presents cross-site findings from case studies of Ninth Grade
Success Initiative projects and the high school contexts in which they
operated. The synthesis incorporates findings from document reviews,
interviews, focus groups, surveys, and performance reports.
Integrating Technology into Teacher Education: Navigating
the Complexity of Institutional Change
This paper explains how Texas Woman’s University used federal grant funds
to build faculty capacity and infuse technology into the teacher
preparation program. The study gauged changes in technology proficiency,
implementation concerns (Concerns-Based Adoption Model), technology use,
and usefulness of experiences from the viewpoints of preservice
teachers and faculty members.
Open-Enrollment Charter Schools: Linking Conditions and Practices to
This paper describes a study that examined the characteristics and academic
performance of Texas charter schools operating during the 1999-2000 school
year. Additionally, a qualitative content analysis of charter applications
was used to compare the characteristics of a sub-set of schools identified
as either academically “successful” or “struggling.”
Characterizing Reading and Language Arts Instruction in
Title I Schoolwide Programs
This paper compares the instructional and learning characteristics of
reading/language arts classes in Title I schoolwide
programs (regular and Success for All) and instruction in two pullout
components (Reading Recoveryand Literacy Groups).
Trained observers used descriptive and time-interval ratings to document
teacher activities, student activities, intellectual rigor, and
Metacognition, Motivation, and
Learning: A Study of Middle School Students’ Use and Development of
Self-Regulated Learning Strategies
This paper describes a quasi-experimental study that assed the effects of
participation in a strategic thinking class on sixth graders’ use of
self-regulated learning strategies. Data came from structured interviews
with individual students (Self-Regulated Learning Interview Schedule).
Factorial multivariate analysis of variance (MANOVA) was used to examine
group (treatment and control) and achievement group (high, medium, and low)
differences for measures of self-regulation.
Developing a Valid and Reliable Portfolio Assessment in the
This article describes a reading/language arts portfolio that was developed
for use as an optional assessment in the Dallas Public Schools’ Title I
program (for prekindergarten to second-grade students). Analyses examined
the reliability of portfolio scores and the extent to which portfolio
contents provided a valid sample of student work.
of Mentor Training of Elementary Colleague Teachers
This article examines the effect of teacher participation in
mentor/colleague professional development workshops designed to promote
hands-on science investigations. Pre- and post-workshop measures examined
the effect of mentors’ training on colleagues’ science beliefs,
understanding, anxiety, and classroom time allocations.
Evaluation Toolkit: A
Tool for Evaluating a School Technology Program
This toolkit describes the evaluation principles, instruments, and analyses
employed in the scientific study of Technology Immersion. Components
provide direction for Using Toolkit Resources, Defining Scientific Research
in Education, and Scientifically Evaluating Educational Innovations.
Copies of instruments used in the study of Technology Immersion.