admin
Fri, 02/09/2024 - 19:56
Edited Text
PRIMARY ELEMENTARY INTERVENTIONS FOR STUDENTS
A Doctoral Capstone Project
Submitted to the School of Graduate Studies and Research
Department of Secondary Education and Administrative Leadership
In Partial Fulfillment of the
Requirements for the Degree of
Doctor of Education
Daniel R. Besch, Jr
California University of Pennsylvania
July 28, 2020
California University of Pennsylvania
School of Graduate Studies and Research
Department of Secondary Education and Administrative Leadership
We hereby approve the capstone of
Daniel R. Besch, Jr
Candidate for the Degree of Doctor of Education
ii
Acknowledgements
I would like to start by thanking Dr. David Foley and Dr. Gina MacFalls for all of their
work with me throughout the Capstone Project. They have been an incredible resource to me and
have supported my Capstone Project since the very beginning. They have encouraged me to
persevere during this process and I am forever grateful for their support. I would also like to
thank Mr. Kris Vancas, who is also completing his own Capstone Project. Having a fellow
administrator to talk with during this process has been a great help and I cannot thank him
enough for his encouragement and positive attitude. You are truly a friend who I look forward to
working with for many years to come.
Next, I would like to thank my family. First, thank you to my parents for instilling an
importance of continuing my education throughout my life. I would not be where I am today
without your love and support. Next, my children: Cati, JD, and Colby. Without their love,
support, and encouragement I would not have succeeded in this accomplishment. They have
always been the reasons that I work to be a better man, father, and educator. Finally, I would like
to say THANK YOU and I LOVE YOU to Sue, my wife and best friend. She has stood by me
through every step of the way and has encouraged me to persevere throughout this process. I am
very fortunate to have Sue in my life and I work hard every day to be the husband she deserves. I
told Sue many years ago I would never go back to school and now I am about to complete the
ultimate goal of many educators. I hope this shows that anyone with the right determination and
drive can accomplish great things.
iii
Abstract
The Capstone Project completed is designed to aide the Bellefonte Area School District in
students attaining grade level reading expectations by the third grade. The researcher studied the
reading data for the district’s current second grade students. The data that was analyzed was
Fountas and Pinnell BAS data and AimswebPlus assessment data. The primary grade level
teachers of the district were also surveyed to in order to determine the different reading
intervention strategies being used in classrooms, data that teachers are analyzing, and their
impressions of Fountas and Pinnell Classroom. The BAS and AimswebPlus data were cross
referenced with the teacher survey data to identify effective reading instructional strategies that
are being utilized in classrooms and share these strategies with the other teachers across the
district. The researcher found that teachers are using a wide array of data points and a variety of
instructional strategies in their classrooms. The research that was completed has shown a need
for a multi-tiered system of support (MTSS) for its students. The Capstone Project will support
the efforts to establish a MTSS program in all elementary schools for the district.
iv
Table of Contents
Acknowledgements (if included)
ii
Abstract
iii
List of Tables
vii
List of Figures
viii
CHAPTER I: Introduction
1
Reasons for Capstone Project
1
Research Questions
3
Action Research Methods
4
CHAPTER II. Literature Review
6
Reading Fluency
6
Reading Comprehension
10
Forms of Assessment Utilized for Data Collection
13
Importance of Differentiation
20
Guided Reading
23
Fountas and Pinnell Classroom
28
Multi-Tiered System of Supports
33
Individualized Professional Learning
35
CHAPTER III. Methodology
38
Purpose
38
Settings and Participants
40
Interventions / Research Plan
44
Methods of Data Collection
49
v
Validity
CHAPTER IV. Results of Research
52
56
Purpose
56
Data Utilized for Analysis
57
Data Analysis Test
60
Data Analysis Results
61
Teacher Survey Data Analysis
71
Triangulation of Data
76
Summary
77
CHAPTER V. Conclusion of Research
79
Summary of Results
79
Review of Research Questions
80
Research Question #1
81
Research Question #2
83
Research Question #3
87
Research Question #4
90
Financial Implications
92
Limitations
93
Recommendations for Further Research
95
Conclusions
96
References
99
APPENDIX A. California University of Pennsylvania Institutional Review Board
Approval
105
APPENDIX B. Bellefonte Area School District Data Request Letter
107
vi
APPENDIX C. Bellefonte Area School District Data Request Approval
110
APPENDIX D. Bellefonte Area School District Survey Invitations to Teachers
112
APPENDIX E. Bellefonte Area School District Primary Elementary Teacher Survey
116
vii
List of Tables
Table 1: Instructional Level Expectations for FPC
58
Table 2: AimswebPlus Benchmark Comparison Report Sample
59
Table 3: 2017-2018 Kindergarten Teacher Grade Level Expectations
62
Table 4: 2017-2018 Kindergarten Teacher Grade Level Standardized Residuals
63
Table 5: 2017-2018 Kindergarten Teacher AimswebPlus Risk Levels
64
Table 6: 2017-2018 Kindergarten Teacher AimswebPlus Standardized Residuals
64
Table 7: 2018-2019 First Grade Teacher Grade Level Expectations
66
Table 8: 2018-2019 First Grade Teacher Grade Level Standardized Residuals
66
Table 9: 2018-2019 First Grade Teacher AimswebPlus Risk Levels
67
Table 10: 2018-2019 First Grade Teacher AimswebPlus Standardized Residuals
67
Table 11: 2019-2020 Second Grade Teacher Grade Level Expectations
69
Table 12: 2019-2020 Second Grade Teacher Grade Level Standardized Residuals
69
Table 13: 2019-2020 Second Grade Teacher AimswebPlus Risk Levels
70
Table 14: 2019-2020 Second Grade Teacher AimswebPlus Standardized Residuals
71
Table 15: Student Data Points Used to Inform Instruction
73
Table 16: Ways Teachers Differentiate for Students
76
Table 17: Student Grade Level Performance and Socioeconomic Levels
87
viii
List of Figures
Figure 1: Elementary Building Breakdown of Teacher Responses
72
Figure 2: Grade Level Breakdown of Teacher Responses
72
Figure 3: Breakdown of Instructional Time Spent on ELA
73
Figure 4: Data Analysis Frequency Breakdown
74
Figure 5: Teacher Determined Effectiveness of Data Analysis
75
Figure 6: Fountas and Pinnell Classroom Components Utilized by Teachers
82
1
Chapter I
Introduction
The Bellefonte Area School District is very similar to many other districts across the
state. The district is located in the rural center of the state. Over the past several years, the district
has experienced a decline in English Language Arts (ELA) scores in the state mandated
assessments in grades three, four, and five. Many students are also showing little to no growth in
ELA scores on the district assessments in all grade levels. The district has been working to
identify possible reasons for these trends. Several theories for these struggles could be linked to
possible issues with inconsistencies in student data use, implementation of ELA curriculum, and
how teachers implement instructional strategies and interventions.
When becoming a teacher over twenty years ago, I had a strong desire to teach students
to not only learn science, but to also be lifelong learners. I quickly realized I was going to have
to teach students how to read and comprehend text in order to increase their learning
opportunities. This was found to be true whether teaching sixth grade science or high school
chemistry. Many students struggled to extract important information from text they were reading.
For these reasons I took a special interest in reading in the content area.
When I moved into administration, it became apparent that students continued to struggle
with reading in content areas. After four years as a high school vice principal, I moved to be a
vice principal at the elementary level. Over the next four years, I was able to study the process of
how elementary students learn how to read. These observations showed that reading fluency and
reading comprehension are crucial components of learning to read. Students need to be able to
recognize the words that are used frequently in text and need to be able read them fluently. Once
students are able to utilize skills to read text, they are then able to make the transition to
2
comprehending the text. The teaching of reading fluency and reading comprehension skills is
essential in elementary classrooms.
I have had the opportunity to observe teachers provide instruction on reading strategies
and it has strengthened my resolve to provide students with skills to be lifelong learners. Guided
Reading is a general instructional strategy that is used in the elementary classroom. Guided
Reading also allows teachers to provide students with small group instruction at their
instructional level. While this small group instruction is occurring, the rest of the class can be
found working in reading centers. These centers provide student with opportunities to practice
reading and writing strategies. Most of the centers that students are participating in are used
universally no matter what individual reading levels students have attained.
Several years ago, the school district evaluated and revised the language arts curriculum.
The committee that completed this process also evaluated and selected a new language arts
program to assist them in the delivery of the curriculum. Fountas and Pinnell Classroom (FPC)
was selected as that program. FPC’s program utilized a blend of direct instruction and responsive
teaching strategies. Teachers work to provide instruction that meets the learning needs of their
students and FPC was seen as the program to enhance instruction. Guide Reading is at the heart
of FPC, but there are other instructional contexts used. Interactive read-alouds, shared reading,
book clubs, and independent reading are the other key components of FPC. The students are
immersed in reading and are exposed to a large variety of text.
FPC and responsive teaching in practice is much more difficult than originally thought.
Many teachers are finding it difficult to regularly assess students to have current data. Teachers
are also finding it difficult to teach all of the components of FPC in a two-hour language arts
block. The district is continuing to struggle with how to effectively provide instruction to
3
students at their individual reading levels. After several years of FPC implementation teachers
are still looking for ways to effectively meet the students’ needs.
Multi-tier system of supports (MTSS) is a framework that many school districts are
utilizing in order to provide targeted instruction to students who are struggling. MTSS is based
on student data to make informed instructional decisions. Students are provided interventions
and progress monitored to determine the effectiveness of the interventions. The district has been
working to bring MTSS to the schools in order to provide students with targeted instruction that
is supported by data. In order to effectively meet the needs of students, schools need to
understand where the students are in their learning and how they are progressing. MTSS
provides schools with a proven framework for making data-based decisions.
The research conducted for this capstone project is based on four research questions. The
research questions are as follows:
1. What are the factors that are leading to the district’s struggle with low growth in ELA for
our students?
2. What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
3. What external factors are present that can aid the students in their ELA growth or hinder
their progress?
4. What professional learning opportunities do teachers need to ensure more consistent use
of data protocols and appropriate intervention strategies?
The Capstone Project is designed to help identify effective reading instructional strategies that
are being utilized in schools and share these strategies with the other teachers across the district.
4
The Capstone Project will be conducted by utilizing a mixed methods action research
process. There will be quantitative and qualitative data collected and analyzed. The quantitative
data will be used to identify classrooms that are demonstrating success. Qualitative data will be
collected from teachers in order to determine the different reading intervention strategies being
used in classrooms. The research is being completed to identify reading strategies that are proven
to have a positive effect on student learning. Professional learning will be provided to teachers
that focus on effective data use and strategies designed for improved student achievement. The
goal of the capstone project is to provide teachers with instructional strategies and interventions
that have shown positive student growth. The more strategies and interventions teachers have at
their disposal, the more likely they will deliver responsive teaching instruction.
The research being conducted may have a variety of financial implications to the district.
Delivering responsive instruction and intervention to the students will require instructional
materials and personnel. The implementation of MTSS will require professional learning time
for teachers and administrators to be trained in the processes. In order to provide effecting
interventions, building schedules may need to be revised. New resources may need to be
purchased for the interventions. There is also the potential to hire more reading specialists and
math interventionalists as well as building aides.
Many school districts across the state are looking to provide instruction that will improve
student achievement. Each school district is also looking at budget restrictions that make
purchasing new programs difficult each year. A way to help districts is to examine the
instructional strategies going on within the classrooms of the schools. By sharing resources and
knowledge, instruction across a district can improve and student achievement can increase. This
5
capstone action research project aims to provide the teachers of Bellefonte with tools that will
benefit the district’s students as a whole.
6
Chapter II
Literature Review
The literature review for this capstone project will review the research focused upon
language arts instruction in the elementary classroom. It is important to understand the
background of language arts instruction in order to learn how it can be organized to improve
student growth. The background knowledge provided throughout the review of literature will
provide a foundation for the organization of language arts instruction by increasing teacher
knowledge in the use of data and specific reading interventions.
The literature review is organized into seven different parts. The first part will focus on
the importance of reading fluency and reading comprehension in the language arts instructional
process. The next section will review the different forms of assessment that are collected locally
and how the information informs instruction. Third, I will focus on differentiation and its
importance in the elementary classroom, which will lead to the fourth section will review the
Guided Reading instructional process. The fifth section of the literature will be a synthesis of
Fountas and Pinnell approach to reading instruction and how it is utilized in the classroom. The
sixth section will focus on the Multi-Tiered Systems of Support utilized by schools today to
support student learning. Finally, I will review and discuss the professional learning model that
the Bellefonte Area School District employs and the importance of it in teacher growth.
Reading Fluency:
Research suggests that reading fluency and reading comprehension have emerged as two
key components in increasing student growth in language arts. Students who are able to read
fluently are able to break down text and then comprehend what they have read. Struggling
7
readers historically have demonstrated that they neither recognize the words from the text nor are
they able to decode words that they do not recognize. For decades, teachers have seen the
importance of reading comprehension, but they are now beginning to recognize the importance
of reading fluency (Hudson, Lane, Pullen, 2005).
Reading fluency appears to have many definitions, Raskinski (2004) highlights the
importance of reading fluency.
“Reading fluency refers to the reader's ability to develop control over surface-level text
processing so that he or she can focus on understanding the deeper levels of meaning embedded
in the text.”
If students are not able to read the text that is in front of them, then they will not be able to
understand the meanings found in the text.
The goal of all teachers should be to have students reading in a fluent manner in the
elementary classroom (Rasinski, 2004). Teachers want their students to be able to take the skill
of reading and then apply it across different subject areas. There are three main components that
a student must master in order to be considered a fluent reader. Students need to learn and
maintain the ability to read with accuracy, speed, and expression (International Literacy
Association, 2018). “Teachers of struggling readers need to realize that a common core problem
for them is the ability to read sight words, decode words, and read phrases and sentences
automatically and rapidly” (Ming & Dukes, 2008, p. 3).
Poor readers tend to be labored in their reading and are focused on decoding of words
(Hudson et al., 2005). Once students have “mastered the letter sounds, decoding rules, and a
good base of sight words, many pupils begin to feel the flow of good reading, and eventually, the
process becomes second nature” (Heitin, 2015).
8
“Accuracy is the essential foundation of reading fluency” (International Literacy
Association, 2018). If students are to understand what they are reading, then they need to be able
to accurately read the text. The decoding of words is essential if students are to read accurately.
Research has shown that students need to have a large bank of high-frequency words and have
the ability to blend sounds together to decode words correctly. Students who can look at a word
and know automatically what the word is will increase their accuracy in reading text, will be able
to sustain reading for longer periods of time, and will be able to read across a variety of texts
(Hudson et al., 2005).
Many teachers will develop a word wall throughout the year, but there needs to be more
work in high-frequency words to ensure students are learning their sight words. Most literacy
experts do agree that reading fluency should be taught in the classroom and the most effective
strategy is repeated readings (Heitin, 2015). Research is also starting to show that strategies such
as popcorn reading and sustained silent reading have no real effect on improving reading fluency
(Heitin, 2015).
The second component of reading fluency is the speed at which reading is completed.
First and foremost, reading fluently is not reading quickly. Another important point is reading
rates are different for all students, and teachers need to be able to recognize what is acceptable for
each student. Oral Reading Fluency (ORF) scores have become a recognized data point for
assessing a student’s reading rate. Teachers should remember that students who are reading in
the average rate range for ORF are on the correct path to become effective and fluent readers
(International Literacy Association, 2018). “Like blood pressure, body temperature, and
cholesterol, ORF scores can serve as ‘indicators’ of health and wellness, and scores at the
‘average’ level are, in fact, optimal” (International Literacy Association, 2018).
9
Finally, reading with expression will enable students to get the full context of the author’s
meaning in a text. “Struggling readers are often characterized as reading in a monotone without
expression or with inappropriate phrasing” (Hudson et al., 2005). The literature appears to show
that if students can read a text with expression, then students are showing they understand the text
they are reading. If students are able to read a passage and attend to the punctuation that the
author has provided, then they are showing they are able to interpret the text. Like speed, reading
with expression does not have an accepted minimum level for students to meet. Most feel that if
a student is able to read and it sounds as effortless as when speaking, then the student is reading
with acceptable expression (International Literacy Association, 2018).
Assessing a student’s reading fluency can be done by teachers just having students read
out loud. “By having students read one or two grade-level passages for one minute each, teachers
can get a quick sense of their students' level of decoding accuracy, automaticity, and prosodic
reading” (Rasinski, 2004). Many times, teachers are completing reading assessments at the
beginning, middle, and end of the year. Teachers will also assess a student’s reading fluency at
the end of the marking period. Teachers do not need to complete formal running records or
aimsweb assessments to get an understanding of where their students are in their reading fluency.
In reviewing the research done with regard to increasing student reading fluency, there are
several common practices that teachers can employ in their classrooms (Hudson, et al., 2005).
One of the main practices a teacher can implement with effective results is to model fluent
reading (Dukes, Ming, 2008). Struggling readers need to hear fluent readers reading fluently.
Teachers can implement read-alouds in the daily instruction. Also, repeated reading has proven
to show effective growth in reading fluency (Hudson, et al., 2005). Repeated reading can be done
in a variety of ways in the classroom. Teachers can use interventions like assisted reading, paired
10
readings, and computer programs as part of their guided reading centers. Students who have
reading fluency modeled and coached will show growth in accuracy, speed, and expression
(International Literacy Association, 2018).
Reading Comprehension:
Reading comprehension is defined as making meaning from texts that are read (Pardo,
2004). Reading comprehension is the process in which students utilize their prior knowledge and
experiences to interpret the meaning of what they are reading. The more background knowledge
students have the better they will be able to connect to the text and this will allow them to make
sense of what they are reading (Pardo, 2004). Students come to the classroom with a different
knowledge base and different skills.
“A major goal of reading comprehension instruction, therefore, is to help students
develop the knowledge, skills, and experiences they must have if they are to become competent
and enthusiastic readers” (Ramirez & Edward, 2013). This is where the teachers come to support
the students in reading comprehension and help develop good readers.
Students should be taught strategies to build upon and activate their prior knowledge
prior to reading. This will allow students to connect with concepts in the text during the reading.
There are several ways in which teachers can help students build upon their prior knowledge. If
the teacher knows that students do not have the prior knowledge, they can “support students’
acquisition of world knowledge by establishing and maintaining a rich, literate environment, full
of texts that provide students with numerous opportunities to learn content in a wide variety of
topics” (Pardo, 2004). Teachers can also utilize reading strategies, such as graphic organizers, to
11
help students connect prior knowledge to the text and show relationships between known words
and new words to build on new vocabulary (Pardo, 2004).
Teachers are constantly working to help their students improve their reading fluency and
comprehension. The Texas Education Agency (2002) stated that there are several characteristics
that can be found in all good readers. One component of being a good reader involves setting
goals before completing the reading. Good readers will also have good reading fluency in order
to connect sentences together to make meaning out of the text. In addition, good readers will also
summarize the content of a text it is read. Finally, good readers do make inferences from the text
by drawing on their background knowledge. Good readers will also look for clues in the text to
supply information about characters or events. There are many instructional practices that
teachers can use to help students become good readers.
“Effective comprehension instruction is instruction that helps students to become
independent, strategic, and metacognitive readers who are able to develop, control, and use a
variety of comprehension strategies to ensure that they understand what they read” (Ramirez &
Edwards, 2013).
When presenting reading comprehension strategies to students, teachers should model the
strategy (Pardo, 2004). When teachers model their thought process by using a think aloud about
a given comprehension strategy, the students learn how to implement the strategy and engage
with their text. After the strategy is modeled, the students should apply the comprehension
strategy with the teacher providing support (Pardo, 2004).
Reading comprehension strategies should be taught to students based upon the text they
are going to be reading. Students are typically going to read one of two types of text: narrative
or expository. Narrative text is text that tells a story to the reader. Examples of narrative texts
12
would be short stories, folktales, myths, fables, fantasies, and science fiction. In order to increase
a student’s reading comprehension for narrative text, teachers should work to implement several
instructional strategies.
Locklear (2018) outlines a variety of instructional strategies for teachers. These include
strategies like having students focus discussions on story elements and encouraging them to
relate story events to their own experiences. Students also want to be able to compare the
structure of one story to that of other stories. Finally, teachers can prepare visual guides, such as
story maps, to help students recall different story elements.
Expository text is text that is written to explain, inform, or even persuade. Examples of
expository texts are textbooks, biographies, journals, and brochures. Teachers who are teaching
reading comprehension strategies for expository texts will utilize a different set of instructional
strategies (Locklear, 2018). In order to learn how to draw information for expository text,
students should be chunking and summarizing information by related items and concepts.
Students should also interpret and analyze charts and tables found in the reading. This will help
them apply the information from the text to real world situations (Locklear, 2018).
Successful comprehension instruction will include large amounts of time for reading,
teacher-directed instruction in comprehension strategies, opportunities for collaborative learning,
and students talking to the teacher and one another about their responses to reading (Fielding,
Pearson, 1994). Students learn how to determine appropriate choices for text selections and
ensure that students spend time reading books that are appropriate in difficulty for the student.
Students want to be reading passages that help them increase their reading fluency. Finally,
student conversation about what they are reading provides them with opportunities to practice
the comprehension skills they have learned (Fielding, Pearson, 1994).
13
With the change in reading instruction, teachers look for a variety of texts for their
students to read. “With the rise of literacy approaches such as guided reading, many hail leveled
readers as a critical component of effective reading instruction” (Hewes, 2016). Level readers
provide students texts that they are able to read at their skill level. “In theory, then, if students are
reading a text that is not ‘just right,’ they are not as effectively able to practice applying the
desired skills because the text is either too challenging to allow them to focus on the skill at hand
or too simplistic for them to need to use the desired skill” (Hewes, 2016).
Level readers are typically used in guided reading instruction or as part of reading
literacy activities. There appear to be two ways in which leveled readers are established for
students. The first way is to level the pre-existing texts in the classroom library in order to
provide students with high-quality texts (Hewes, 2016). The second method employed is to
utilize books written and leveled by publishers, where the books tend to be simpler and less
engaging to students (Hewes, 2016). Leveled readers provide students with opportunities to read
texts that are at their independent and instructional levels.
The importance of reading fluency and reading comprehension cannot be overstated for
an elementary classroom. Lessons should be designed in order to increase student proficiency in
reading fluency and comprehension. However, students come to the classroom with different
experiences and background knowledge. In order to properly identify what deficiencies students
may have, we need to assess students’ knowledge, understanding, and ability to read. There is a
wide array of assessments that can be used with elementary students. The two assessments
utilized in our school district is AimswebPlus and running records.
Forms of Assessment Utilized for Data Collection:
14
The AimswebPlus assessment is a nationally normed assessment, data management, and
reporting system that is utilized for screening and progress monitoring of students (NCS Pearson,
2017). AimswebPlus collects two different types of assessment data: curriculum-based measures
(CBMs) and standards-based assessments (SBAs). This database system provides information
that helps teachers differentiate instruction as well as determine which students will benefit from
intensive intervention (NCS Pearson, 2017). AimswebPlus is often administered to all students
three times a year and can also be used as a progress monitoring tool for students receiving tiered
interventions.
“Curriculum-Based Measurement (CBM), a set of simple, time efficient, and
scientifically sound assessment tools, has increased rapidly for frequent basic skills progress
monitoring and screening students for risk” (Shinn, 2012). Schools today are searching for ways
to evaluate student growth and the effectiveness of their curriculum. Schools also began to use
CBM progress monitoring tools for universal screening to support early interventions (Shinn,
2012).
This has led to schools determining students’ Rate of Improvement (ROI). ROI is used to
determine how rapidly students are showing growth in their CBM data. “The distribution of
ROIs for a group of students—such as a class or grade that participates in universal screening
three times a year—serves as a measure of the effectiveness of the general educational program”
(NCS Pearson, 2012).
ROI can also be utilized in showing growth of individual students. “The ROI of a student
whose progress is being monitored is the primary indicator of the effectiveness of the
intervention” (NCS Pearson, 2012). Schools across the country are utilizing AimswebPlus CBMs
in order to determine student intervention. Students’ ROI can be compared to expected growth
15
data to determine if adequate progress is being made toward end-of-year goals (NCS Pearson,
2017).
AimswebPlus data can also be collected for progress monitoring data and is used in a
school’s Response to Instruction and Intervention (RtII) program. RtII is perfectly suited for
schools to evaluate the effects of evidence-based instruction in order to comply with the
Individuals with Disabilities Education Act (IDEA, 2004) and Every Student Succeeds Act
(ESSA, 2015) (NCS Pearson, 2017).
Progress monitoring is an important tool in guiding instruction for students with learning
disabilities and low achievement. “The AimswebPlus system supports accurate and frequent data
collection, automatically displays results and trends via graphs, projects growth trends alongside
growth expectations, and provides explicit rules for deciding whether a student is on or off track
to meet his or her end-of-year goals” (NCS Pearson, 2017).
Bellefonte is utilizing AimswebPlus assessment three times a year for universal screening
and benchmarking of all students. “CBM was seen as valid for purposes of frequent formative
evaluation to judge progress and facilitate any necessary modifications of intervention programs
and to enable very frequent (e.g., weekly) formative evaluation for at-risk students, with the
added capacity for beginning of the year universal screening” (Shinn, 2012).
Progress monitoring utilizes several processes that schools and teachers should follow.
First, deciding which students to progress monitor and which CBMs to use needs to be
addressed. Second, teachers should select the appropriate grade level of the CBMs to assess.
Third, teachers need to set a goal and create a schedule for data collection. During the data
collection, the CBM data is used to evaluate student progress while deciding whether student
16
progress is adequate and whether the instruction should be modified. Finally, determinations
should be made if the goal has been reached (NCS Pearson, 2017).
The use of AimswebPlus allow for schools to organize students into three tiers. “Students
in Tier 3 typically need intensive intervention to build skills and deepen their understanding of
learning standards taught in the core instructional program. Students in Tier 2 may need only
small-group instruction and additional practice on core content to get on track. Students in Tier 1
are expected to stay on track with high quality, research-based core instruction” (NCS Pearson,
2017). Students who are in Tier 3 are considered to be at risk and require frequent progress
monitoring, often on a weekly basis. “Progress monitoring is an important part of a dynamic
approach to guiding instruction and interventions for both groups and individuals” (NCS
Pearson, 2017).
The AimswebPlus program uses five color-coded performance level indicators, which are
based on national norms (NCS Pearson, 2017). The performance levels are as follows:
● Well Below Average, which is the 1st–10th percentiles, scores are displayed in
orange
● Below Average, the 11th–25th percentiles, scores are displayed in yellow
● Average, 26th–74th percentiles, scores are displayed in green
● Above Average, the 75th–89th percentiles, scores are displayed in teal
● Well Above Average, the 90th–99th percentiles, scores are displayed in blue
Color-coding makes it easier to identify each student’s performance level (NCS Pearson, 2017).
“AIMSweb provides these field-tested, validated, and independently reviewed CBM test
materials in the basic skills areas and organizes and reports the data for educators and parents”
(Shinn, 2012).
17
A running record is an assessment that has been used with students for many decades.
“Running records are a formative assessment and are one way to document teacher observations
of reading behaviors” (Stegman, 2015). A passage is orally read by a student and the teacher
records information on the student’s reading of the passage. The “running record — an easy-touse, standard coding system for capturing what young readers say and do while reading texts.
Running records are often taken to assess the text difficulty for the child and may be taken at
different time intervals to capture the child’s progress” (Fried, 2013). Running records are
another piece of data for a teacher to make instructional decisions.
“Running record data reveals the independent reading level, the instructional level, and
the frustration levels of a reader, along with information about how he or she is processing text”
(Herbert, 2004). Generally, students’ running records are found to fall in one of the three reading
level categories:
● Independent reading levels are found when a student is able to read with little to
know support and has an accuracy level of 95% to 100%.
● Instructional levels are found when students are reading with instructional support
and accuracy level of 90% to 94%.
● Frustration levels are found when students require extensive support in reading
the passage and have accuracy level less than 90% (Gunning, 2002).
Running records are known to be powerful in the early elementary grades. Running records help
teachers learn when text gets hard for an individual student and what the student does when that
happens (Gillett and Ellingson, 2017).
Combined with AimswebPlus data, running records can provide teachers with
information to guide planning and instruction. Teachers should not go back examine every error
18
made by the students. Teachers should be selective and focus on a few teaching points that will
have the biggest payoff for the child’s learning (Fried, 2013). Teachers can use the data from
running records to evaluate their teaching as well.
“Analyzing a set of running records for one teacher across multiple students reading
around the same level may also reveal teaching patterns, teaching decisions, and in some cases
patterns of tolds” (Fried, 2013). By evaluating running records of students, teachers can find
general reading error patterns that students are making. “Running record data provide direction
for making ongoing instructional decisions for students right in their zone of proximal
development” (Vygotsky, 1978).
While running records can provide teachers valuable student data, they are not to be used
for long term planning. “One misconception about running records is that data gained about a
reader is valid for a semester or longer. In fact, children's skills change so quickly that record
data is really only valid for approximately one month” (Herbert, 2004).
For many years, teachers would complete running records only four or five times a year.
Classroom routines can be established where running records can be given frequently. Herbert
(2004) stated that teachers “have a better chance of ‘hitting the instructional target’ for each and
every child if you conduct ongoing assessments throughout the year instead of just a few times
per year.”
Running records are assessments that have protocols teachers should follow when they
are administered. “The process of conducting a running record includes the teacher taking notes
on the student's errors and corrections when he or she is orally reading a leveled text” (Stegman,
2015). Running records need to be completed on a regular basis but do require instructional time
to complete. “A schedule will allow consistent data collection for all students. In the younger
19
elementary grades, students can move through guided reading levels very quickly, so it is
important to have timely data” (Stegman, 2015).
Running records provide instructional time for students and teachers to conference.
Teachers are provided an opportunity to praise students for their use of learned strategies and
help students understand how to better correct errors. “Structure the feedback so they have the
space to hypothesize, reflect on their learning, and evaluate their own approaches as well as
those of their peers” (Fisher, Frey, Hattie, 2017).
Data notebooks are proven to be beneficial when teachers and students utilize them
during instruction. “The goal of the data notebook should be to show student growth. All
students should have their own section that includes their running records. Over time, the data
notebook should show evidence that a student's accuracy is improving” (Stegman, 2015).
Students will have more investment in their learning if they are part of the data tracking process.
“Setting goals is one way to help students take ownership of their learning. They can set end-ofthe-year reading goals, as well as benchmark goals with the teacher” (Stegman, 2015). If
students are part of the goal-setting process, they will better understand what books they should
read to increase their learning.
Running records can also help teachers provide students with instructional materials that
will meet their learning needs. “Betts (1946) hypothesized that when students are presented with
tasks that are sufficiently familiar, yet still provide some degree of challenge, optimal learning
occurs. Optimally challenging tasks were referred to as tasks at the student's instructional level”
(Treptow, Bums, and McComas, 2007).
Teachers know that the more time on task students exhibit, the more learning they are
doing. Research suggests that “matching curricular materials and student skill could improve
20
short-term student outcomes (time on task and reading comprehension), which is also important
given the close link between classroom behavior problems and academic difficulties” (Treptow,
et al., 2007).
Importance of Differentiation:
Differentiation is an important aspect of a well-rounded classroom. Once teachers have
data, they should design lessons that meet the needs of their students. “In classrooms where one
lesson is designed for all learners, limits are placed on students’ achievement. Students who are
advanced academically are left behind because they are under-challenged, and students who may
be struggling are left frustrated and confused” (Koeze, 2007). Classrooms today should account
for the needs of all students and then provide instruction to meet those needs.
“Classrooms in which differentiation is taking place may help to close the achievement
gap that has been prevalent for years in American schools” (Koeze, 2007). In differentiated
classrooms, teachers are regularly collecting data, analyzing the data, and then designing
instruction to aid students in their growth and learning. “By developing lessons appropriate to
students’ readiness levels, interest, and learning profiles, teachers will be able to draw upon prior
knowledge and student experiences outside of the school environment which will empower
students to ask questions and share their opinions because they already have knowledge or
interest in the topic” (Koeze, 2007).
Carol Ann Tomlinson is one of the leading experts on differentiation in the classroom. In
her book, HOW TO Differentiate Instruction IN Mixed-Ability Classrooms (2001), Tomlinson
outlines what differentiated instruction is and what it is not. She stated that differentiation is not
21
the “Individualized Instruction” of the 1970s, not chaotic, not just another way to provide
homogeneous grouping, and not just “tailoring the same suit of clothes.”
Tomlinson did set guidelines as to what differentiation should look like. Differentiated
instruction is proactive, more qualitative than quantitative, and rooted in assessment. It is
student-centered and evolutionary, where students and teachers are learning together. Finally,
differentiated instruction is a blend of whole-class, group, and individual instruction while
providing multiple approaches to content, process, and product.
Tomlinson advocates for student learning by promoting that teachers know “students’
individual learning styles and levels of readiness first before designing a lesson plan” (Weselby,
2014). Knowing their students, teachers are able to design lessons that meet students’ learning
styles, assess student learning, and manage classroom procedures to create a safe and supportive
classroom environment (Weselby, 2014). According to Tomlinson, teachers can differentiate
lessons for students in four ways: content, process, product, and learning environment.
Cathy Weselby (2014) outlined ways in which teachers can differentiate according to
Tomlinson’s areas:
● Content can be differentiated by “designing activities for groups of students that
cover various levels of Bloom’s Taxonomy.”
● Successful differentiation includes the process of delivering the material to each
of the learning styles the students may possess: visual, auditory and kinesthetic,
and through words.
● The product that students produce can also be differentiated by utilizing various
forms of assessment: tests, projects, reports, etc.
22
● The learning environment conditions for optimal learning include both physical
and psychological elements: layout of classroom, positive classroom
management skills, etc.
Differentiation of classroom instruction is more involved than just providing more or less
work for students to complete. Differentiated lessons provide students with opportunities to
practice their use of the reading fluency and reading comprehension skills. If the classroom
lessons and routines are established, students will have a learning environment that will promote
growth in language arts.
In 2008 Laura Robb, a master teacher, language arts coach, and author, utilized the work
of Tomlinson and several others to develop a “list of some key principles that form the
foundation of differentiating instruction.” The first is ongoing, formative assessment, where
teachers need to continually assess to identify students’ strengths and areas of need. Second,
teachers need to recognize the diverse learners and their diverse levels of expertise and
experience with reading, writing, thinking, problem solving, and speaking. Third is group work,
where students should collaborate in pairs and small groups that enable students to engage in
meaningful discussions and learn from one another. Fourth, teachers want to focus on problem
solving which focuses on issues and concepts and encourages all students to explore big ideas
and expand their understanding of key concepts. The final principle, is student choice. Student
choice in their reading and writing experiences and in the tasks and projects will engage students
in their learning.
Robb (2008) also developed nine practices for teachers to use to differentiate reading
instruction in their classrooms: make read aloud a common teaching text, teach students with
diverse materials, organize instruction for all reading levels, value independent practice reading,
23
model for students how to construct meaning while reading, encourage discussion on readings,
write to explore, think, learn, and improve comprehension, use ongoing assessments to support
students, and plan units carefully. These components are also evident in Fountas and Pinnell
Classroom instructional practices.
“Differentiation is a way of teaching; it’s not a program or package of worksheets”
(Robb, 2008). Differentiation is designed to maximize student growth by providing different
ways for students to show their learning. Differentiation can be a valuable asset when
implementing a Response to Instruction and Intervention (RtII) program within a school.
“Differentiated instruction applies to all students, including those who struggle and need
academic and behavior supports. Response to Intervention is a way of focusing on students who
may need increasing levels of support to experience success” (Allan, 2010). Both programs have
goals of modifying instruction to meet the needs of the students in the classroom and promote
their growth.
“The major component that makes it not just a differentiated classroom but also an RtI
classroom is that, in addition to typical classroom assessment (both formative and summative),
the teacher keeps detailed records to monitor the progress of students who are struggling and
who may need more intensive Tier 2 support” (Allan, 2010). It is important in differentiation and
RtII that teachers keep detailed data on their students’ progress.
Guided Reading:
Guided reading has become an integral part of the elementary school classroom. “Guided
reading is a small-group instructional context in which a teacher supports each reader’s
development of systems of strategic actions for processing new texts at increasingly challenging
24
levels of difficulty” (Fountas & Pinnell, 2017). While teachers are increasingly implementing
guided reading, it is one part of the overall reading instruction in an effective language arts
lesson.
Fountas and Pinnell (2017) have outlined a variety of opportunities to engage with high
quality texts. The following list are some of the reading strategies they recommend:
● Interactive Read-Aloud promotes the joy of reading by using grade appropriate
texts that will expand vocabulary and the ability to think, talk, and write about the
text.
● Reading Minilessons provide explicit instruction that help students become
independent readers.
● Shared reading of texts allows students to learn how to construct meaning so they
can learn critical concepts of how texts work.
● Book Clubs provide an opportunity for students to discuss the self-selected books
they are reading.
● Independent Reading is an opportunity for students to read a large number of
books on their own with support of teacher conferences.
● Group Share brings the entire classroom together to discuss books they are
reading so they can share their reading experiences.
These strategies allow for students to be engaged in reading in a variety of manners in
order to reach each student. “Readers are actively engaged in the lesson as they learn how to take
words apart, flexibly and efficiently, while attending to the meaning of a text” (Fountas and
Pinnell, 2014).
25
Over time guided reading has shifted the teaching of reading to focus on an
understanding of how readers build effective processing systems and examine of the role of texts
and expert teaching in the process (Fountas and Pinnell, 2014). Guided reading lessons have a
common structure to them. Student guided reading groups are set up by combining students of
similar development in their reading skills based on the current data teachers have collected.
Fountas and Pinnell (2014) have developed a suggested structure to a guided reading
lesson:
● Appropriate text is selected for the students to support new learning for the group.
● Students are introduced to the text to scaffold the reading.
● Students then whisper read the entire text with the teacher providing instructional
support.
● Once the students have completed the text, the group discusses the text in order to
determine students’ comprehension.
● Students will engage in word work in order to increase their flexibility and word
analysis skills
● Finally, students will often engage in a writing activity in order to share and
extend their understanding.
“The ultimate goal of instruction is the enable readers to work their way through a text
independently, so all teaching is directed toward helping the individuals within the group build
systems of strategic actions that they initiate and control for themselves” (Fountas and Pinnell,
2017).
There is varied debate on instructional practices that have been employed throughout
time, but accelerated “reading instruction requires that the individual reader be able to process a
26
text with proficiency and, within a short time, take on the necessary understandings and
behaviors to process texts of similar difficulty independently” (Fountas and Pinnell, 2017).
Conferencing with students is a proven method of support for student independent reading.
However, individual instruction during conferencing is difficult due to time requirements for
instruction. “Guided reading is now considered by many to be a best practice and an effective
model of reading instruction” (Hansen, 2016).
Differentiation of classroom instruction becomes important when looking at the structure
of guided reading. Differentiation is vital for the modern-day classroom due to an increasingly
diverse student population and teachers who need to reach every learner but have a limited
amount of time to do so (Hansen, 2016). “The theory behind guided reading is anchored in the
importance of differentiation, the use of the student’s previous knowledge, the importance of
social interaction while learning, and the teaching of strategies within the context of actual
reading” (Hansen, 2016).
Guided reading lessons are to be structured with the teacher’s understanding of the
students, the texts, and teaching strategies to promote student growth in reading. “The better you
know the students in your class, the more effective and the more responsive you will be as a
teacher of reading” (Fountas and Pinnell, 2017). Through observation and discussion, teachers
can get evidence of student understanding of texts.
Another successful part of reading instruction is knowledge of texts. “The first step in
preparing for a guided reading lesson is to read the text yourself and think about the
characteristics” (Fountas and Pinnell, 2017). Pre-reading of texts allows teachers to determine
the sentence complexity, the words, and their meanings. Teaching strategies should be varied
throughout the lesson to meet student needs. “The real key to helping the readers take control of
27
the problem solving is the language that you use to support the reader’s learning across the
lessons” (Fountas and Pinnell, 2017).
With guided reading teachers take on a facilitator role. “Guided reading is set up so that
the teacher knows what the student knows, what they need to continue to work on, and what they
will be learning in the near future” (Hansen, 2016). Teachers act as guides who assist students in
constructing their own mastery of skills. “The lesson is highly structured and organized to
support learning; however, your teaching interactions with students depends on their responses
and the goals you see as important for them” (Fountas and Pinnell, 2017).
Students should be taught the guided reading lesson procedures so that routines are
automatic and lesson management is at a minimum and there is instructional time for learning
conversations (Fountas and Pinnell, 2017). Throughout the lessons, teachers vary their
interactions to engage students in inquiry, problem solving, and the like. “The better you know
your students and the more thoroughly you analyze the text, the easier it will be to plan your
guided reading lessons” (Fountas and Pinnell, 2017).
There are two different types of assessments utilized by teachers for guided reading
instruction. Fountas and Pinnell (2017) have labeled these assessments as interval and
continuous. Interval assessments use standardized assessment to help determine beginning
reading levels to form a profile of each student. These can be formative and summative
assessments that are part of the formal reporting system that is required in schools to document
change in achievement. Continuous assessments gather data to provide individual progress over
weeks of time throughout the year. These formative assessments also help assess the impact of
teaching on a day to day basis.
28
Fountas and Pinnell Classroom:
The Fountas and Pinnell Classroom (FPC), created by Irene Fountas and Gay Su Pinnell,
is a comprehensive program that focuses on the importance of leveled text and guided reading
instruction. “Fountas & Pinnell Classroom™ (FPC) is designed to support whole-group, smallgroup, and independent learning opportunities including: interactive read-aloud,
reading minilessons, shared reading, phonics, spelling, and word study, guided reading, book
clubs, and independent reading” (Fountas & Pinnell, 2018).
FPC is designed to engage students in many different types, and levels, of text in order to
increase their reading fluency and comprehension. Fountas and Pinnell have spent more than
twenty-five years researching literacy instruction. “All of Fountas and Pinnell’s curriculum
systems were developed from this research and are intricately connected to and complement one
another for true instructional coherence” (Fountas & Pinnell, 2018).
Throughout their research, Fountas and Pinnell have worked to develop a comprehensive
classroom instructional tool. “Fountas and Pinnell have identified six underpinning principles for
effective classroom literacy instruction for all students in grades PreK-6” (Fountas & Pinnell,
2018). The following is a brief summary of each principle from A Summary of the Research Base
for FOUNTAS & PINNELL CLASSROOM™ (2018):
1. Instructional Coherence: Each instructional strategy of PFC is designed to be part
of a coherent system to improve student performance. “When everyone in the
school uses the same literacy tools language as they move from observation to
instruction, a common conversation occurs.”
2. Responsive Teaching: FPC provides teachers with the opportunity to collect data
and observations to make relevant instructional decisions for students. “Regular
29
assessment is integrated into each context so teachers can meet students where
they are and move them forward.”
3. Multi-Text Approach: “Books, lots of authentic books, are at the heart of Fountas
& Pinnell Classroom™: exciting books to stir imagination; challenging books to
lift every reader; and diverse books to expand readers’ knowledge of the world.”
As FPC has been developed, books were carefully written and selected by
Fountas and Pinnell to promote student reading, expand vocabulary, and provide
students with the skills to think about, talk about, and write about different texts.
4. Student Inquiry: Since elementary students are naturally curious, FPC allow
students to participate in authentic learning. “As children think across texts, they
pursue lines of inquiry that interest and engage them as learners and build
knowledge of different topics and themes across a range of disciplines.”
5. Language-Based: Many of the instructional strategies that are found in FPC
provides students with an opportunity to discuss the texts they are exposed to in a
variety of ways. “This kind of talk structure allows students to share their
thinking, to learn the thinking of others, and to refine and sharpen their ideas,
which in turn enriches whole-class discussion.”
6. Teacher Expertise: “The FPC system is designed to create a sense of community
among teachers who are concerned not only about what students learn but also
about how and why they learn.” Teachers collaborate using FPC and its
instructional strategies in order to create a climate of community in the school.
30
FPC requires teachers to make a dramatic shift in their instructional practices. Teachers
are always collecting data and adjusting their instruction not only from marking period to
marking period, but day to day.
At the core of FPC is the use of small group instruction in the form of guided reading
based on data collected from the Benchmark Assessment Survey (BAS). “The Fountas and
Pinnell Benchmark Assessment System, created by Irene Fountas and Gay Su Pinnell, is
designed to place students appropriately into a guided reading program, show the gains in
student achievement, progress monitoring and identify students in need of intervention” (U.K.
Essays, 2018). The BAS system is a three-part assessment that should be completed at the end of
every marking period should be given to all students in kindergarten through fifth grade.
The first component of the BAS is a reading prompt that the teacher records data from.
“The test consists primarily of running records, in which the teacher records oral fluency, reading
errors and self-correction ratios” (U.K. Essays, 2018). The running record is followed by a
student-teachers conversation about the text the student has just read. This conversation provides
data on the student’s comprehension of the text. Finally, there is a writing prompt that can be
given to the student to complete.
The BAS assessment allows a teacher “to determine your students’ independent and
instructional reading levels, group students for reading instruction, select texts that will be
productive for a student’s instruction, assess the outcomes of teaching, assess a new student’s
reading level for independent reading and instruction, identify students who need intervention
and extra help, document student progress across a school year and across grade levels, create
class profiles and inform parents” (U.K. Essays, 2018)
31
FPC is a responsive teaching model that relies on a multitude of text that is leveled
according to reading and grade levels. “Leveled Literacy Intervention (LLI) is a short-term,
supplementary, small-group literacy intervention designed to help struggling readers achieve
grade-level competency” (US Department of Education, 2017). The best way to help students in
their growth is through small group instruction. “Small groups allow educators to meet all
students where they are academically whether it be to enrich what they have already learned,
reteach comprehension and decoding strategies, or pull them back a few grade levels to help
close the gap between the low students and their peers” (Odell, 2012).
This is where LLI is added as an instructional tool for teachers. “Teachers can use LLI to
match students to books that they can read without difficulty (referred to as “student’s
independent level” by the developer) and to books that provide more challenging text (referred to
as “student’s instructional level”)” (US Department of Education, 2017).
“Research suggests that children with poor early reading skills continue to struggle with
reading and writing in the later grades, and are more likely to drop out of school” (Waldera,
2017). It is critical that schools provide interventions for students who are identified as
struggling readers in primary elementary grade levels. Research has shown that students who are
not reading at grade level by third grade will “often falter in the later grades and drop out before
earning a high school diploma” (Waldera, 2017).
Many times, the students who struggle the most come from homes experiencing poverty.
It is crucial that reading intervention occur in primary grades when students are acquiring
literacy skills. FPC has research that suggests Fountas and Pinnell’s LLI is effective at
supporting students so that they can reach grade level appropriate reading expectations before
they develop long term reading deficiencies and academic issues (Waldera, 2017).
32
“The objective of LLI is to accelerate struggling readers so that they may quickly close
the gap between their personal reading achievement and their expected reading level” (Odell,
2012). LLI lessons are fast paced and structured with routines that students learn and follow.
“The structure and predictability of the lessons help students to feel comfortable in their
learning” (Odell, 2012). Each lesson has a similar structure to them. “Lessons include rereading
books from the previous day, assessing reading comprehension, instructing on phonics and
letters, assigning a writing task about the book that was read, and reading a new book” (US
Department of Education, 2017).
One advantage to the LLI lessons is the school to home connection. “LLI has a strong
home-school connection providing students with take home books to read with their families as
well as word work and response activities to do during independent work time in class or as
homework” (Odell, 2012).
LLI has had mixed reviews from teachers utilizing the program. LLI lessons are designed
for three to four students for thirty minutes a day. “It is hard to find effective and highly
educational literacy activities for the other students to do in the classroom while the teacher is
meeting with the LLI group” (Odell, 2012). This is one of the biggest drawbacks to LLI.
Scheduling the classroom instructional time is difficult with LLI. If a teacher is to meet with four
or five groups each day, then there will be two or more hours for guided reading instruction
alone. However, teachers have identified positives to the LLI system. “LLI has also been praised
for creating a solid home-school literacy connection, being highly motivating, and for
incorporating the familiar read with the lessons every day in addition to the instructional text
levels” (Odell, 2012).
33
FPC is a literacy teaching structure that has been researched and proven to be effective
with all levels of students. Students who are exposed to multiple types of text and express their
reading and understanding of text in multiple ways have proven to show growth and success in
their literacy skills. Fountas and Pinnell have provided educators with instructional strategies that
allow for differentiated lessons and guided reading practices to be built into the structure of the
day.
Multi-Tiered System of Supports:
Multi-Tiered System of Support (MTSS) is an intervention system that identifies students
who are struggling with academics and/or behaviors. “MTSS can be defined as ‘‘an evidencebased model of education that employs data-based problem-solving techniques to integrate
academic and behavioral instruction and intervention’’ (Eagle, Eagle, Snyder, Holtzman, 2015).
In many cases academic and behavior issues are often found to go hand in hand. MTSS is the
combination of Response to Intervention (RtI) and Positive Behavioral Intervention and Supports
(PBIS). “MTSS targets improvement in academic and behavioral outcomes for all students and
stresses the importance of implementation fidelity and leadership capacity” (Freeman, Sugai,
Simonsen, Everett, 2017)
There are several features of the MTSS framework that are important in its
implementation and sustainability. Jennifer Freeman, George Sugai, Brandi Simonsen, and
Susannah Everett authored MTSS Coaching: Bridging Knowing and Doing (2017) where they
provided three core features of MTSS. The first core feature is that decisions are based on data
that comes from universal screening, continued progress monitoring, and implementation
fidelity. The second feature is that evidence-based practices are supported, aligned to student
34
needs, and are contextually relevant. The third feature is that support systems used in MTSS are
implemented with fidelity.
“Decisions relative to data, practices, and systems are strategically focused on
maximizing the academic and behavioral success of all students, and the opportunity for more
intensive and individualized supports is formalized within the continuum of support and based
on student performance” (Freeman, et al., 2017).
MTSS framework is viewed as a three-tiered system. Tier 1 is the level of MTSS that all
students are exposed to, otherwise known as the core program and is generally thought of as
general education, where students receive instruction from a classroom teacher (L. Fuchs,
personal communication, 2015). Tier 2 is the intervention level. Interventions typically occurs in
small groups with a research validated program (L. Fuchs, personal communication, 2015).
Finally, there is Tier 3 which is the most intensive level of intervention. In most cases the
instruction at Tier 3 is delivered using special education services. “Whether what’s special
education versus general education, the key distinction should be the level of intensity, or
individualization that occurs at the three different levels of instruction. That said, sometimes
schools have more than 3 tiers” (L. Fuchs, personal communication, 2015).
The MTSS framework has several challenges in its implementation. MTSS requires that
schools not only collect benchmark data, but they must also collect progress monitoring data
regularly. In an interview in 2015, Joe Jenkins discussed the struggles that most schools face in
using the data they collect. “I think schools have a harder time using, [or] maximizing the use of
the progress monitoring data. [Using the data], it requires analysis, it requires making changes
off them that are problematic for teachers, because they, if they, try to make an adjustment that is
appropriate for some members of their group that actually needs a change, some kind of change,
35
some members of the group may not need the change” (J. Jenkins, personal communication,
2015).
Not only do teachers struggle with making the necessary changes for students, they
struggle with the time constraints of the school day. “Constraints in the schools with time,
resources, and often it’s really a mistake to underestimate the burden that teachers face
individualizing instruction” (J. Jenkins, personal communication, 2015). There is a lot of
planning required with MTSS, which is why MTSS requires a team to aid teachers in their
instructional decisions.
Individualized Professional Learning:
Professional development (PD) has been a part of education for many decades. It is
important that educators continue their learning in the profession. In general, there has been “the
strange atmospheric mix of bored resignation, eagerness for something new and fresh, and
cynical amusement that pervades these gatherings” (Jones, 2018).
Typical professional development has one of two effects on most teachers. On the
positive side, “PD sessions can renew our level of energy, stock a toolset of strategies, and
motivate us to be better teachers than we were yesterday” (Jones, 2018). However, a lot of PD
opportunities for professional staff just turn into a negative experience that make staff feel they
have wasted the past few hours.
Professional development has been making a transition to what is known as professional
learning (PL). PL has brought a new wave of ways in which teachers can access the learning.
“Not only will offering a variety of formats allow more teachers to attend, it could impact how
meaningful the session is for teachers” (Jones, 2018). PL also has to be planned in a different
36
manner. PL sessions are often structured like a lesson plan. “The biggest difference in planning
for adult learning versus planning classroom lessons is that adults have somewhat different needs
that affect their engagement” (Jones, 2018)
Teachers already know the level of support they need for new strategies and also need
opportunities to develop ways to immediately apply the strategies. Armed with this information,
the Bellefonte Area School District (BASD) looked to make professional learning a priority in
the district. The BASD has changed and re-energized the professional learning process for the
staff of the district.
For many years the district followed the same professional development format that many
districts use, one presentation for all. The staff would be divided for the day based upon the level
at which they taught. The professional development that was then presented would have a focus
directed at the classroom teachers. The interventionists and specials teachers would participate,
but not be engaged. Professional development within the district had lost its effectiveness and
many felt that the system that was being utilized just did not meet the teachers’ needs. This
began the shift to what is now referred to as Professional Learning.
The name change to professional learning was the first in many changes to the system.
The next change came in empowering the staff with great input into what learning was going to
be offered. This began by establishing a professional learning committee made up of teachers
and administrators from all levels across the district. This group began by organizing the format
of the professional learning day.
Professional learning in the district now offers staff as many as four learning sessions a
day that are between sixty and seventy-five minutes long. Each of the learning sessions have
between ten and fifteen different learning options for the participants to sign up and attend. This
37
allows the staff to attend sessions that they feel will best meet their needs. Another key change to
the professional learning in the district is that the sessions are designed and delivered by not only
administrators, but also the professional teaching staff. Teachers provide their fellow staff
members with the teaching strategies they are using in the classrooms. They will also provide
sessions on the learning they bring back to the district from conferences that are attended.
The changes to the district’s professional learning program has greatly increased the
staff’s participation in these days. The staff is encouraged to develop a focus for their
professional learning for the year. This is where the findings of this capstone project will be
presented to the teachers of the district. Sessions will be offered to the primary teachers of the
district on the strategies that have been identified to show growth in student learning. There will
also be an increase in professional learning sessions on data analysis strategies and protocols to
be used in the district. The more consistency utilized for data analysis, the better the schools will
be able to differentiate for students.
Data analysis is something that is often spoken of in elementary schools, but it is
something that is not done with consistent protocols. Teachers are currently using student
AimswebPlus and running record data, but they tend to provide interventions that are good for
the majority of students. A researched based data analysis program that is often utilized at the
elementary level is the Multi-Tiered System of Supports (MTSS) which was discussed in the
literature review. MTSS is the next intervention system that is needed in Bellefonte to support
teachers and aid students in their learning.
38
Chapter III
Methodology
The goal of the action research Capstone Project is to identify teaching strategies that are
improving student reading fluency and reading comprehension. The Capstone Project focuses on
determining classrooms that are demonstrating student growth in reading fluency and
comprehension. Once classrooms are identified, the research will cross-reference the quantitative
data results with the qualitative data that is collected from the teachers. The goal is to identify
instructional strategies being employed in the school district that can be utilized across all
schools to improve reading skills. This methodology discusses the purpose for the study, as well
as the setting and participants. It also reviews the research plan, methods of data collection, and
validity of the action research project.
Purpose:
The purpose of this Capstone Project is to identify learning activities that are being
utilized in the school district that are benefiting students. As previously stated, the Bellefonte
Area School District has shown little to no growth in the language arts scores on state mandated
assessments. Although these assessments do not communicate the complete picture of our
students, they are used to develop the yearly Future Ready Index report card for each school in
Pennsylvania. Students in school districts across the state must acquire reading fluency and
reading comprehension skills prior to entering third grade, which is when Pennsylvania state
assessments begin. The acquisition of reading skills represents a critical stepping stone in the
primary grades of elementary school.
39
The Capstone Project research is based on four research questions. The research
questions are as follows:
1. What are the factors that are leading to the district’s struggle with low growth in ELA for
our students?
2. What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
3. What external factors are present that can aid the students in their ELA growth or hinder
their progress?
4. What professional learning opportunities do teachers need to ensure more consistent use
of data protocols and appropriate intervention strategies?
The Capstone Project research data analysis will identify reading instructional strategies that are
being utilized in the elementary schools across the district. By cross referencing the student
quantitative data and the teachers’ qualitative survey responses, the data may reveal instructional
strategies that demonstrate student growth in reading fluency and comprehension skills.
Across the district the teachers of language arts are utilizing the Fountas and Pinnell
Classroom (FPC) program. FPC is a program that emphasizes a responsive teaching model for
classroom instruction. In a responsive teaching model, daily instruction is formulated based on
the learning needs of the students. Instruction is provided using both whole and small group
instruction. Teachers are able to utilize whole group instruction, but the majority of the language
arts block is taught using small group instruction. Teachers using FPC are to regularly examine
student data to identify learning goals for each student. The teachers are to then design lessons to
provide instruction to students to meet the set learning goals.
40
The research methods that will be used in the Capstone Project include both quantitative
and qualitative data analysis. Quantitative data will be collected from second-grade students in
the elementary schools across the district. The data being analyzed is AimswebPlus and running
records from the students’ kindergarten, first, and second grade years. The analysis of this data
may identify groups of students who are showing average to above average growth in their
reading fluency and reading comprehension skills. The data analysis may also allow the
identification of teachers who are teaching these groups of students. Qualitative data will be
collected via a survey of the primary teachers across the district. The quantitative and qualitative
data will be cross-referenced to identify classrooms showing growth. Once the classrooms are
identified, the instructional strategies utilized can be identified. Professional learning will be
offered to all professional staff on how these strategies are implemented as part of classroom
instruction.
Setting and Participants:
The Bellefonte Area School District is located in Centre County, Pennsylvania and is
considered a rural school district. The school district has one high school (grades 9 – 12), one
middle school (grades 6 – 8), and four elementary schools (grades K – 5). The district also is a
partner school with the Central PA Institute of Science and Technology (CPI). Bellefonte has the
highest student enrollment of member districts, which accounts for 48% of the enrollment of
CPI.
Bellefonte educates students from approximately 117 square miles and has an enrollment
of approximately 2600 students. Bellefonte does not have a diverse ethnic population as about
41
94% of the students are white. Approximately 30% of the students are economically
disadvantaged and 17% of the student population qualifies for special education services.
There are four elementary schools in the Bellefonte School District. The demographics of
the schools are as follows:
1. Bellefonte Elementary has an approximate enrollment of 340 students. The economically
disadvantaged rate is forty-eight percent and the special education enrollment of twentyone percent. The school’s ethnicity is broken down as follows: eighty-eight percent
white, six percent hispanic, and two and a half percent black. Bellefonte Elementary
qualifies as a Title 1 School.
2. Benner Elementary School’s enrollment is approximately 230 students. Benner differs
from Bellefonte with an economically disadvantaged rate of twenty-one percent and a
special education enrollment of eleven percent. The school’s ethnicity breakdown is
ninety-six percent white, one- and one-half percent Asian, and one percent black.
3. The student enrollment at Marion Walker Elementary School is approximately 360. This
school has the lowest economically disadvantaged student population at fifteen percent
and fourteen percent of the students qualify for special education services. Marion
Walker’s ethnic breakdown is ninety-six percent white and two percent Hispanic.
4. Pleasant Gap Elementary School is the smallest school in the district with an enrollment
of about 210 students. Forty percent of the students come from economically
disadvantaged homes and twenty percent of the students qualify for special education
services. Pleasant Gap also has the highest English Language Learner enrollment, with
over five percent of the students qualifying. The ethnic make-up of the school is ninety-
42
five percent white, three percent of two of more races, and two percent Hispanic. Pleasant
Gap Elementary also qualifies as a Title 1 school in the district.
The district has two elementary schools that receive Title 1 Federal funds, Bellefonte and
Pleasant Gap. Title 1 schools are identified by having a high population of low-income families.
These funds are utilized by the district to support programs that aid students in meeting content
and performance standards. The funds can be used to support students in language arts or
mathematics. The district uses a targeted assisted program in providing Title 1 services to
students that are the most at-risk academically in reading. Targeted assistance is a system that
begins by identifying students eligible for services. The primary targeted students are in first
grade with kindergarten and second grade students added as schedules allow. In some cases,
third grade students receive Title 1 services at Bellefonte. Once students are identified for Title 1
services, learning groups are formed in order to provide instruction to students with similar areas
of need. Instruction is provided in a pull-out program. The district utilizes a researched based
instructional program that helps to strengthen the established language arts curriculum and the
Fountas and Pinnell program utilized in the classrooms.
The teaching demographics of the district are varied as well. Each school has a varied
population, but there are typically two to three regular education teachers per grade level.
Bellefonte Elementary employs three reading specialist teachers while each of the other
elementary schools employs one reading specialist. Bellefonte utilizes the instructional expertise
of three special education teachers and is the site that hosts the elementary autistic support
classroom, while Marion Walker and Pleasant Gap each have two special education teachers.
Pleasant Gap also hosts the district’s elementary life skills classroom. Benner Elementary has
one special education teacher. Bellefonte and Marion Walker also share a math intervention
43
teacher to aid students in grade 3, 4, and 5 with math instruction. Benner and Pleasant Gap do
not have access to math intervention services for students.
The instructional setting for each elementary school is similar. Teachers in kindergarten,
first, second, and third grades are responsible for instruction in the areas of language arts,
writing, math, and science/social studies. Four years ago, the teachers in grades four and five
departmentalized. The departmentalized grade levels have one teacher responsible for language
arts, one responsible for math instruction, and one responsible for science/social studies and
writing. In the small buildings, a language arts teacher may also provide instruction for writing
and the math teacher provides instruction for science/social studies.
While the racial and ethnic diversity is limited in the district, the socio-economic
diversity is very large. Bellefonte and Pleasant Gap Elementary schools have historically had
high rates of economic disadvantaged students. Both elementary schools have several sections of
low-income housing in their school regions. Unfortunately, the trend appears to be that the
families of our economically disadvantaged students rarely provide the necessary support for
students leading up to, and while, attending school.
The economically disadvantaged students often enter school with little or no pre-school
experiences. Many of these students are not only learning letters and numbers for the first time,
but they are also learning how to socially interact with many other same aged peers. The schools
find that the teachers in the primary grades spend as much time teaching appropriate behaviors as
they do letter sounds. Those students who begin school not having preschool experience are at a
disadvantage when compared to their peers. The district strives to implement reading services;
however, a variety of challenges exist. Many students lack the necessary parental support to
encourage their learning. These students often also come from low socioeconomic families, who
44
are often struggling in many areas so education is often a lower priority. The parents’ perception
of school can also be a hindrance to a student’s growth. If a parent did not have a good school
experience he, or she, are less likely to support the education process at home. The more
effectively the district can identify and remedy student weaknesses, the more readily students can
develop into fluent readers.
Interventions/Research Plan:
The research plan for this Capstone Project involves the collection of quantitative and
qualitative data. The researcher started by contacting the superintendent of the Bellefonte Area
School District to receive permission to conduct research. The superintendent approved the
collection of AimswebPlus, running record, and survey data from the teachers. The researcher
utilized the services of the district language arts coach to assemble data from the 2017-2018,
2018-2019, and 2019-2020 school years.
The Capstone Project is focused upon the growth in reading fluency, reading
comprehension, reading levels for the district’s second grade students. The data collected will
come from the students’ kindergarten, first, and second grade years. The school district collects
data from reading fluency and comprehension assessments three times a year. The first round of
data is collected in early September, right after the start of the school year. Data is collected from
all elementary students, kindergarten through fifth grade. This provides teachers with baseline
data that will allow the staff to begin to plan and organize lessons. Students are divided into
reading groups based on their data points. The second round of data collection comes in January
at the middle of the school year. Again, data is collected from each student at the elementary
level. Teachers are able to utilize data to determine growth in their students. The final time data
45
is collected on each student occurs in May, at the end of the school year. This is data that is used
to determine student growth throughout the year. Teachers will utilize this data as part of their
student learning objective plans required in Pennsylvania. The end of year data is also used to
determine student regression over the summer after the students are assessed the next school
year.
The researcher will utilize the data collected from all four elementary schools within the
district. Analyzing the AimswebPlus and Fountas and Pinnell Classroom Benchmark Assessment
data will begin by compiling the data for each school year into one spreadsheet. This will be
done by looking at the growth reading levels of each student from the beginning of year
assessments, through the mid-year, and then the end of year assessments. The data points that
will be used are from the students’ kindergarten, first, and second grade year. The second-grade
data will only include beginning and mid-year assessment data due to the school closure for the
COVID-19 virus pandemic.
The researcher will start by randomly assigning a student number to each student in the
second grade for the 2019-2020 school year. The numbering system includes a building
identifier, which is the first two numbers. Each student will be identified using the third and
fourth numbers. The classroom identifier will be the last number. This will be comprised of three
numbers to represent the kindergarten, first grade, and second grade teachers. The following are
examples of the numbering system to be used: Bellefonte Elementary: 2101123; Benner
Elementary: 2201121; Marion Walker Elementary: 2301132; Pleasant Gap Elementary:
2601111. This number system will allow for the cross-referencing of students and elementary
classrooms they participated in.
46
The next step for the researcher will be to organize the data according to reading data
from the district. The reading fluency data will be organized using the Fountas and Pinnell BAS
data and the AimswebPlus data. Spreadsheets are being established that will include the
following data points:
1. Student Number - This will be organized based on the previously explained numbering
process.
2. Beginning, Middle, and End of Year BAS Reading Data:
a. Highest Instructional Level – This is the level at which students are able to read at
their own independent level.
b. Accuracy – The accuracy score represents the number of words read correctly in
the story. This is calculated by the number of words read correctly divided by the
total number of words.
c. Comprehension Score – The score is based off of a rubric established by Fountas
and Pinnell.
d. Fluency Rubric Score – Fluency scores are also based on a rubric developed by
Fountas and Pinnell.
e. Growth – The growth of a student is determined by counting the number of levels
the student has improved in their instructional levels.
f. Annual Growth – This is the growth of a student throughout the entire school
year.
3. AimswebPlus Composite Score – The composite score from AimswebPlus is developed
by using several probes. The probes are given and scores compiled to produce a
47
composite score for each student. The probes required to have AimswebPlus calculate a
composite score is as follows:
a. Kindergarten – Letter Naming Fluency, Letter Word Sounds Fluency, and
Vocabulary.
b. First Grade – Word Reading Fluency, Nonsense Word Fluency, and Oral Reading
Fluency.
c. Second Grade – Oral Reading Fluency, Reading Comprehension, and Vocabulary.
4. AimswebPlus Risk – This identifies the level of at risk the student is in comparison to
other students at their grade level. The risk level is based on a percentile ranging from 1
to 99. The following levels are used in the AimswebPlus scale:
a. Well-Below Average: 1st – 10th Percentile, color coded in orange; will be coded
as a “0”.
b. Below Average: 11th – 25th Percentile; color coded in yellow; will be coded as a
“1”.
c. Average: 26th – 74th Percentile; color coded in green; will be coded as a “2”.
d. Above Average: 75th – 89th Percentile; color coded in aqua; will be coded as a
“3”.
e. Well-Above Average: 90th-99th Percentile; color coded in blue; will be coded as a
“4”.
5. Grade Level – Grade level data points are utilized to determine if the student is reading
on grade level by the end of the school year. A “0” is assigned if the student is not on
grade level; a “1” is assigned if the student is on grade level; a “2” is assigned if a student
is above grade level.
48
6. Gender – If the student is a female, she will be assigned a “1”. If the student is a male, he
will be assigned a “2”.
7. Socio-economic Status – The socio-economic status of a student will be determined by
whether or not the student qualifies for the free and/or reduced lunch program. The
student will be assigned a “0” if they do not qualify or a “1” if they do qualify.
Each of these data points provides the researcher with multiple ways to analyze the data in order
to determine trends from the data on which schools and which classrooms are helping students
grow in their reading skills and abilities.
Once the students are identified as demonstrating significant growth in reading fluency,
reading comprehension, and reading levels the researcher will cross-reference the data against
the classroom data collected qualitatively from teachers. By cross-referencing the data, the
researcher will identify the instructional strategies the teachers are utilizing to achieve student
growth. The reading fluency and reading comprehension instructional strategies will be listed
and categorized for future reference and professional learning.
Once the data analysis is concluded, the researcher should be able to provide answers to
the following research questions:
•
What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
•
What professional learning opportunities do teachers need to ensure more consistent use
of data protocols and appropriate intervention strategies?
The end result of the research plan is to create a catalog of instructional strategies that are
research based and effectively utilized across the district.
49
Methods of Data Collection:
The methodology used for the Capstone Research Project involves a mixed methods
action research process. Quantitative and qualitative data were collected and analyzed. The
quantitative data included AimswebPlus student data and Fountas and Pinnell Classroom (FPC)
Benchmark Assessment Systems (BAS) data. BAS assessments were administered to students to
determine their independent and instructional reading levels. The BAS and AimswebPlus data
have been collected three times a year for elementary students. Qualitative data was collected
using a survey that was given to all primary teachers (kindergarten, first, and second grades).
Data collected using the AimswebPlus software program helps the district identify
students who could be eligible for reading support services. AimswebPlus assessments are
nationally normed assessments that identify students’ reading fluency and reading
comprehension levels. AimswebPlus is also a data management and reporting system that can be
a valuable resource for districts. AimswebPlus collects two different types of assessment data:
curriculum-based measures (CBMs) and standards-based assessments (SBAs). AimswebPlus is
also be used as a progress monitoring tool for students receiving tiered interventions.
In Bellefonte Area School District, this set of assessments is given to all students from
kindergarten through fifth grades in all elementary schools. AimswebPlus assessments are also
used as a progress monitoring tool for students who receive special education services. Using
AimswebPlus in this manner allows for an abundance of data to be collected. AimswebPlus data
will serve as one component of the quantitative data that will be analyzed for the Capstone
Project.
The second set of quantitative data that will be utilized includes the running record data
collected by the teacher. This data is routinely collected at least three times a year and is used in
50
the eligibility criteria for reading support services. The reading support services can include
classroom targeted interventions, Title 1, and possible learning support. In the FPC program,
running record data is collected using the Benchmark Assessment System (BAS). In the BAS
process, students are given a passage to read and the teacher records data based on the student’s
reading of the passage. The passage is followed by student-teacher conversation about the text.
This conversation provides the teachers with data regarding the student’s ability to comprehend
different types of literature. Teachers use the BAS assessments to identify students’ independent
and instructional reading levels. A student independent reading level can be defined by the
reader identifying a majority of the words and can comprehending what he or she have read. An
instructional reading level is one that is challenging for the student to both read and comprehend.
The analysis of the quantitative data will provide information regarding student growth.
The research will include analysis of the kindergarten data and identification of students with the
average to above average reading growth. The second stage of analysis will be completed on the
students’ first grade year data. Finally, the research will analyze the second-grade data of each
student. The data will then be cross-referenced to identify groups of students who are showing
average to above average reading growth. The goal is to identify the classrooms these students
were enrolled. Once the classrooms are identified, the researcher utilized qualitative data.
The Capstone Project will also include qualitative data. Qualitative data is being collected
using a survey that district teachers completed. Appendix E illustrates the survey that was
created and completed by the teachers. The survey was intended to collect data on the
instructional strategies being utilized in the classrooms across the district. Information was also
collected regarding the frequency in which teachers collect and analyze student data. The survey
51
also collected the use of FPC instructional strategies being used in the classrooms, as well as the
intervention strategies teachers are employing.
The qualitative data collected was cross-referenced with the quantitative data in order to
identify instructional strategies and interventions that support student growth in reading fluency
and comprehension. The researcher is also analyzing how many classrooms in which those
instructional strategies and interventions were being used. Throughout the district there are many
researched based instructional strategies being utilized, but many of them are not shared.
Instructional strategies that have been researched in the Capstone Project will then be applied
across all elementary schools through professional learning.
The research that was conducted for this Capstone Research Project will have some fiscal
impact on the school district. Professional learning can be provided to the primary teachers
through peer presentations. Additional funds will be spent on the preparation of the professional
learning. There will also need to be professional learning provided in the use of data for
informing instruction, which may be available through the local intermediate unit. If training is
not readily available, there may be a cost of $5,000.00 to $10,000.00 for a presenter to come to
the district.
The biggest cost to the district will come from the implementation of a Multi-Tier System
of Supports (MTSS). Implementation will require professional learning for staff. A MTSS coach
will need to be trained on the process and data analysis. The professional learning is also going
to require trainers to come into the district to provide that professional learning. This
professional learning will require substitutes, presenters’ fees, and resource materials. The
district will also need to hire staff to implement the interventions. This will cause an increase in
52
salaries and benefits for the district. There will need to be adjustments made to the school day
and schedules. This could result in financial implications for future staff contracts.
Implementing a MTSS program at Bellefonte will also require some changes to how the
district provides interventions. Pleasant Gap Elementary has started researching the MTSS
process. Several staff members have received professional learning on MTSS and will be the
building leaders of the program. The goal of MTSS will be to have all students enter the middle
school at the same point in their learning. While this may not be one-hundred percent achievable,
MTSS will provide the students with instruction that is data driven and tailored to their specific
needs.
Validity:
The validity of the Capstone project is going to focus on increasing the rigor of the
research. “In general, rigor refers to the quality, validity, accuracy, and credibility of action
research and its findings” (Mertler, 2019). Since the Capstone Project is utilizing both
quantitative and qualitative data, the validity of the research needs to be multifaceted. This
Capstone Project is aiming to solidify the instructional practices across the district. In order to do
this, there needs to be a high level of rigor to help ensure the results are not biased. The rigor also
needs to be seen as not reflective of the researcher’s point of view.
Since the Capstone Project is utilizing a mixed method action research process, validity is
going to be mixed as well. For the qualitative data, the researcher will use evaluative validity
during the analysis. The researcher needs to report the findings and summary of the research in
an unbiased manner. The researcher will also need to not make judgments on the data that was
collected in the survey. The research will also use transferability as a validity check. The
53
researcher will need to ensure that the action research is not too generalized and that readers can
identify with the setting of the research. While many schools face the same struggles as
Bellefonte, the researcher needs to keep this setting in the forefront of the research.
It is important for the researcher to remember that “validity refers to the degree to which
evidence supports the inferences a researcher makes based on the data he or she has collected
using a particular instrument” (Mertler, 2019). The researcher wants to ensure that conclusions
drawn from the results of the analysis are validated, not the instruments used to collect the data.
The validity of the quantitative data collected from the FPC BAS and AimswebPlus assessments
can be determined using the five sources of validity.
Mertler identifies five sources of validity evidence. These sources of evidence are
outlined below (Mertler, 2019):
1. Evidence of Validity Based on Test Content: This type of evidence usually is a logical
analysis of the content covered on the assessments. Content evidence requires the
researcher to have item validity and sampling validity.
2. Evident of Validity Base on Response Processes: The researcher needs to look at
patterns of responses to reveal underlying characteristics of the participants. This could
be gender, race, socio-economic, or the like.
3. Evidence of Validity Based on Internal Structure: This evidence of validity focuses on
how assessment items relate to one another. The researcher looks at the items as a group,
not individually.
4. Evidence of Validity Based on Relation to Other Variables: By analyzing the
relationships between assessment scores and other assessments of similar constructs, the
researcher is able to validate the evidence. One type of coefficients used to validate this
54
evidence is called concurrent validity coefficients. The coefficient measures the
relationship between the scores on the assessment instruments administered at the same
time.
5. Evidence of Validity Based on Consequences of Testing: Testing should not have a
negative effect on the participants. Testing is usually completed with the understanding
that some benefit will come from the use of its data. Educators want positive change to
come from testing, not negative consequences.
The researcher will be using the evidence of validity based on relation to other variables to help
ensure the Capstone Project’s rigor. The use of AimswebPlus and Fountas and Pinnell BAS data
will help to ensure that the teacher scored BAS assessment data aligns with the nationally
normed AimswebPlus composite scores.
Rigor is going to be increased for the quantitative data through the triangulation.
Triangulation of data will allow the researcher to verify the data’s accuracy. The researcher is
utilizing multiple data points from the Fountas and Pinnell BAS and AimswebPlus programs. By
showing the same trends in the data analysis, triangulation is going to confirm the conclusions of
the researcher. Triangulation may also clarify misconceptions of the researcher.
A researcher’s ability to validate data and conclusions is key in any action research
project. This Capstone Project may provide the school district with an in-depth view of student
performance, student growth, and instructional practices being utilized. It is imperative that the
data collection, analysis, and summary be validated as they will be used to assist the district in
providing better reading instruction to the students. It is important to ensure validity in the action
research Capstone Project. Staff members cannot review the data and the analysis and feel there
is bias. In order to gain buy-in from staff, the research project must recognize and disclose any
55
limitations of the project. The goal is to develop conclusions that may be generalizable to
different situations across the district or even across the region.
56
Chapter IV
Results of Research
The primary goal of the Capstone Project is to focus on determining which primary grade
level classrooms that are demonstrating student growth in reading. Reading fluency and reading
comprehension are the two main areas of focus in determining a student’s reading level. After
the classrooms are identified, the researcher will cross-reference the data results with the
qualitative data that is collected from the teachers. The goal is to identify instructional strategies
being employed in the school district that can be utilized across all elementary schools to
improve reading skills of all students. The results section will identify the instructional strategies
the researcher determined to aide students in their reading growth by analyzing reading grade
level data and AimswebPlus reading assessment data.
Purpose:
The goal of the Capstone Project is to identify learning activities that are being utilized in
the school district that benefit students academically. As previously stated, the students of the
Bellefonte Area School District have shown little growth with language arts scores on state
mandated assessments. The third grade student scores on the state English/Language Arts
assessments make up a large part of the school’s overall performance score, the Future Ready
Index. It is important for students to be on grade level for reading expectations, and as such,
students need to have acquired reading fluency and reading comprehension skills prior to
entering third grade. The acquisition of these reading skills is critical during the primary grades
of elementary school.
57
The Capstone Project research is based on four research questions. The research
questions are as follows:
1. What are the factors that are leading to the district’s struggle with low growth in ELA for
our students?
2. What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
3. What external factors are present that can aid the students in their ELA growth or hinder
their progress?
4. What professional learning opportunities do teachers need to ensure more consistent use
of data protocols and appropriate intervention strategies?
Research data results will identify classrooms that are getting students to grade level reading
performance by utilizing instructional practices that benefit student learning. The grade level
reading performance and AimswebPlus composite scores are used in the district to determine a
student’s reading growth. Both assessments utilize reading fluency and reading comprehension
data to determine a student’s reading level and risk factor for not reaching grade level reading
performance.
Data Utilized for Analysis:
The data being utilized in the Capstone Research project is student grade level reading
performance data and AimswebPlus risk factor data. The Bellefonte Area School District
(BASD) uses the Fountas and Pinnell Classroom (FPC) BAS data to track student growth. This
data is running record data that has been collected on students for many years. BASD sets grade
58
level performance marks based upon the BAS data. Table 1 shows the instructional level
expectations for each grade level using the BAS from FPC.
Table 1:
Instructional Level Expectations for FPC
BOY- BAS
Q1
Q2
Q3
Q4
BASELINE
Grade
B and above C and above D and above E and above
A
K
Grade E and above
1
B
C
D
A
B
C
A
B and below
F and above H and above J and above K and above
D
E
G
H/I
J
C
D
E/F
G
H/I
B and below
C and below D and below F and below G and below
Grade K and above L and above M and above M and above N and above
2
J
K
L
L
M
H/I
I/J
K
K
L
G and below H and below J and below J and below K and below
Key
Exceeding Expectations Approaching Expectations
Meeting Expectation
Not Meeting Expectations
The researcher used this information to determine the growth of each student for the
Capstone Project. Each student was assigned a number based on the grade level expectation: 4 –
exceeding expectations; 3 – meeting expectations; 2 – approaching expectations; 1 – not meeting
expectations. Since each student’s grade level reading score utilizes reading fluency and reading
comprehension data, the researcher is able to identify students who have achieved or are
59
exceeding grade level expectations. The researcher is then able to identify the classrooms in
which these students participated. This will help to identify the reading instructional strategies
being used by those teachers.
The second set of data that is being utilized is the AimswebPlus reading data. As
previously stated, AimswebPlus is a nationally normed assessment that informs teachers which
students are at the high risk for not acquiring the necessary reading skills to meet grade level
expectations. Table 2 is an example of a report that is produced from the AimswebPlus
assessment software, the Benchmark Comparison Report.
Table 2:
AimswebPlus Benchmark Comparison Report Example
Report
Benchmark Comparison
Student (42)
Composite
Grade
2nd
VOC (VS)
Battery
Reading
RC (VS)
Period
Fall 2019
ORF
%ile
Score
Acc
%ile
Score
Acc
Score
Acc
Lexile
19
37
80%
95L
21%
3
10
67%
BR
111
21%
7
16
84%
5L
31
131
38%
62
81
89%
315L
56%
41
139
46%
63
82
95%
320L
88%
68
158
67%
66
86
100%
345L
Score
Risk
Student #1
240
High
5
110
25%
11
111
21%
Student #2
259
High
27
143
50%
11
111
Student #3
278
Mod
49
159
63%
11
Student #4
298
Mod
13
127
38%
Student #5
331
Low
37
151
Student #6
399
Low
96
198
%ile
The AimswebPlus composite score and risk level are determined utilizing oral reading fluency
and reading comprehension assessment data. Students were assigned a number based on their
risk level from the composite score: 3 – high risk level; 2 – moderate risk level; 1 – low risk
level. Students who have low risk levels on their AimswebPlus assessments are on track to meet
grade level reading expectations. Students who are considered to be in the high-risk level
60
category are in danger of not meeting grade level expectations. The AimswebPlus composite
score and risk level can also be linked to a classroom in which the student participated. This will
allow the researcher to identify classrooms meeting with success and the instructional strategies
being employed with students.
Data Analysis Test:
The data analysis test chosen for the Capstone Project is the chi-square test of
independence. “The chi-square test of independence – also used appropriately with nominal, or
categorical, data – is used to test the significance of a relationship between two categorical
variables” (Mertler, 2019). The primary goal of using this test is to see if the variables being
analyzed are independent of one another or not. In this Capstone Project the researcher is trying
to determine if there is an association between a teacher and student achievement in reading
levels. In order to do this, the researcher set up a hypothesis and an alternate hypothesis, often
referred to as the null hypothesis. The following hypotheses are being used by the researcher
with the chi-square test of independence:
HO: A student’s reading performance and classroom assignment are independent in
the primary grade levels.
HA: A student’s reading performance and classroom assignment are not independent in
the primary grade levels.
In utilizing the chi-square test, the researcher is determining a p-value which represents
the probability of obtaining statistical results as extreme as the observed results. The accepted pvalue in statistics is a p = .05, or 5%. If the statistical results are lower than a p-value of 5%, the
stronger the evidence supports the null hypothesis. The researcher will perform the chi-square
61
test of independence for each primary grade level: kindergarten, first, and second grades. Chisquare tests will be conducted for grade level reading performance and AimswebPlus risk level.
The researcher will also calculate standardized residuals for each primary grade level for
grade level reading performance and AimswebPlus risk level. Standardized residuals are the
difference between the observed values and the expected values. When using standardized
residuals, researchers commonly use a standard deviation range of -2 to +2. Any residual that
falls between these two numbers is considered to be normal and accepted. Any residual value
below -2 is considered extremely weak in performance since the observed values are less than
the expected values. Conversely, any value above +2 is considered extremely positive
performance since the observed values are greater than the expected values. The researcher will
utilize the data from the chi-square tests to determine if the hypothesis, or null hypothesis, is
found to be true.
Data Analysis Results:
The researcher began by selecting the research group of students; the second grade for the
2019-2020 school year. Student data was collected for each student’s kindergarten, first grade,
and second grade years. The researcher began by evaluating the kindergarten grade level data for
each student from the 2017-2018 school year. The data was compiled and then broken down by
the 12 teachers who were employed to teach kindergarten during that school year. All assessment
data utilized was the end of year data for each classroom assignment. Table 3 shows the grade
level reading expectations data for each teacher.
The data is organized into the observed number of students meeting grade level
expectations and the expected number of students. The data acquired for approaching and not-
62
meeting grade level expectations was combined due to the need for meeting the required number
of 5 in the sample. The chi-square test provided the researcher with the expected number of
students who should be meeting each grade level performance level.
Table 3:
2017-2018 Kindergarten Teacher Grade Level Reading Expectations
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
Exceeding
- Observed
5
10
14
11
7
4
6
5
3
10
9
4
Exceeding
- Expected
6.25
8.04
8.04
7.14
8.04
8.04
6.7
6.7
6.7
6.7
8.04
7.59
Meeting Observed
5
7
4
2
6
7
6
5
8
3
4
7
Meeting Expected
4.5
5.8
5.8
5.19
5.84
5.84
4.87
4.87
4.87
4.87
5.84
5.52
Approaching
/ Not
Meeting
Observed
4
1
0
3
5
7
3
5
4
2
5
6
Approaching
/ Not
Meeting
Expected
3.2
4.11
4.11
3.65
4.11
4.11
3.42
3.42
3.42
3.42
4.11
3.88
The calculated p-value for this data set is 4.67%. The p-value is less than 5% which indicates a
discrepancy in the data. The researcher has accepted the null hypothesis and determined that the
grade level reading level data is not independent of the classroom assignment.
The researcher then calculated the standardized residuals for the grade level reading data.
The standardized residuals are listed in Table 4. This data table shows that there are teachers who
are performing above average and students are meeting or exceeding grade level reading
expectations. There are also teachers who are struggling to have students reach grade level
expectations. One particular teacher to note is Teacher #3. This teacher has exceeding scores and
approaching/not meeting scores over +2. This teacher was able to have students reach and
exceed grade level reading expectations.
63
Table 4 also identifies teachers who are struggling to have students meet the grade level
reading expectations. Teachers #6 and #12 both have negative residuals over -1.0. The data is
showing that these teachers are struggling to have students exceed expectations and have too
many students approaching or not meeting expectations.
Table 4:
2017-2018 Kindergarten Teacher Grade Level Standardized Residuals
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
Exceeding
-0.500
0.691
2.102
1.445
-0.367
-1.425
-0.270
-0.657
-1.429
1.275
0.339
-1.303
Meeting
0.236
0.498
-0.747
-1.400
0.066
0.480
0.512
0.059
1.418
-0.847
-0.761
0.630
Approaching
/ Not
Meeting
-0.447
1.534
2.027
0.340
-0.439
-1.426
0.227
-0.854
-0.314
0.768
-0.439
-1.076
The next data table, Table 5, shows the AimswebPlus risk level data for each teacher who
taught kindergarten in 2017-2018. All assessment data utilized was the end of year data for each
classroom assignment. The researcher calculated the p-value to be 5.5%. The p-value is close
enough to 5% that they are going to accept the null hypothesis as the AimswebPlus data shows
the student scores and classroom assignment does not show independence. The data table also
shows there are more teachers showing positive results in AimswebPlus student performance.
Six teachers demonstrated better observed results than the calculated expected. These teachers
are having students present a lower risk of not meeting grade level reading expectations. There
are also two teachers who are not meeting their expected AimswebPlus scores.
64
Table 5:
2017-2018 Kindergarten Teacher AimswebPlus Risk Levels
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
High/Mod RiskObserved
3
4
1
1
7
3
5
1
1
0
5
5
High/Mod Risk Expected
2.55
3.27
3.27
2.91
3.27
3.27
2.91
2.73
2.73
2.73
3.27
3.09
Low Risk Observed
11
14
17
15
11
15
11
14
14
15
13
12
Low Risk Expected
11.45
14.73
14.73
13.09
14.73
14.73
13.09
12.27
12.27
12.27
14.73
13.91
Table 6:
2017-2018 Kindergarten Teacher AimswebPlus Standardized Residuals
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
High/Mod Risk
Level
-0.282
-0.404
1.255
1.120
-2.063
0.149
-1.225
1.047
1.047
1.652
-0.957
-1.087
Low Risk
Level
-0.133
-0.190
0.591
0.528
-0.972
0.070
-0.578
0.494
0.494
0.779
-0.451
-0.512
The Kindergarten AimswebPlus standardized residuals support the data analysis for each teacher.
The same teachers identified from Table 5 are showing positive results and the same two
teachers are not meeting their expected number for each risk category.
65
In evaluating the grade level reading expectations data and the AimswebPlus risk level
data, there are three teachers who are identified as excelling in getting students to grade level and
above. Three teachers show that their students are exceeded grade level reading expectations
and having the lowest AimswebPlus risk level for students. These teachers are utilizing reading
instructional strategies that are proving to have positive results for students. Their instructional
strategies need to be evaluated for district wide use.
In the next step in the data analysis process, the researcher performed the same chi-square
test of independence for the students from first grade during the 2018-2019 school year. The
students being analyzed are the same, but the teachers have changed. This is a school year that
also had 12 teachers for first grade across the district. At BASD first grade is the primary grade
in providing students with reading interventions through the district’s Title I services. As stated
before, Bellefonte Elementary and Pleasant Gap Elementary are identified as Title I schools at
BASD. The other two elementary schools do offer Title I services, but Bellefonte and Pleasant
Gap have priority in services.
The evaluation of the grade level expectation data for first grade has a calculated p-value
of 13.8%. In looking at the hypotheses that have been established, the chi-square test of
independence shows that the hypothesis is accepted: A student’s reading performance and
classroom assignment are independent in the first grade. In reviewing Table 7 and Table 8, there
are six teachers showing positive results and are getting students to meet and/or exceed grade
level reading expectations.
66
Table 7:
2018-2019 First Grade Teacher Grade Level Reading Expectations
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
Exceeding
Observed
5
6
3
7
7
8
7
8
8
5
4
4
Exceeding
- Expected
6.51
5.43
6.15
5.79
5.79
6.87
5.79
5.79
5.07
6.15
5.79
6.87
Meeting Observed
1
2
5
5
4
0
3
1
2
5
4
8
Meeting Expected
3.62
3.02
3.42
3.22
3.22
3.82
3.22
3.22
2.81
3.42
3.2
3.8
Approaching
/ Not
Meeting
Observed
12
7
9
4
5
11
6
7
4
7
8
7
Approaching
/ Not
Meeting
Expected
7.87
6.56
7.43
6.99
6.99
8.31
6.99
6.99
6.12
7.43
6.99
8.306
Table 8:
2018-2019 First Grade Teacher Grade Level Standardized Residuals
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
Exceeding
-0.592
0.245
-1.270
0.503
0.503
0.431
0.503
0.918
1.301
-0.464
-0.744
-1.095
Meeting
-1.377
-0.587
0.854
0.992
0.435
-1.954
-0.123
-1.237
-0.483
0.854
0.447
2.155
Approaching /
Not Meeting
-1.472
-0.172
-0.576
1.131
0.753
-0.933
0.374
-0.004
0.857
0.158
-0.382
0.453
The data analysis for the first grade AimswebPlus risk levels are shown in Table 9 and
Table 10. The same chi-square test of independence was completed and produced a p-value of
46.7%. This p-value indicates there is strong support for the hypothesis which states that student
AimswebPlus risk level and teacher are independent of each other.
67
These tables also show there are several teachers identified as showing students obtaining
low risk level for meeting grade level reading skills. Seven teachers are providing instruction to
students that is increasing the students’ reading fluency and reading comprehension scores on
AimswebPlus assessments.
Table 9:
2018-2019 First Grade Teacher AimswebPlus Risk Levels
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
High/Mod RiskObserved
3
2
6
3
2
5
3
6
3
3
6
8
High/Mod Risk
- Expected
4.55
3.79
4.29
4.04
4.04
4.8
3.79
4.04
3.54
4.29
4.04
4.8
Low Risk Observed
15
13
11
13
14
14
12
10
11
14
10
11
Table 10:
2018-2019 First Grade Teacher AimswebPlus Standard Residuals
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
High/Mod Risk
Level
0.727
0.919
-0.826
0.517
1.015
-0.091
0.406
-0.975
0.287
0.623
-0.975
-1.461
Low Risk Level
0.423
0.535
-0.480
0.301
0.590
-0.053
0.236
-0.567
0.167
0.362
-0.567
-0.849
Low Risk Expected
13.45
11.21
12.71
11.96
11.96
14.2
11.21
11.96
10.46
12.71
11.96
14.2
68
In comparing the grade level expectation data and the AimswebPlus risk levels, there are
five teachers who have been identified as providing positive results in developing grade level
readers. The instructional strategies these teachers are using must be evaluated for use across the
first-grade classrooms throughout the district. There are also several teachers who are struggling
with students meeting grade level expectations. Implementation of professional learning for these
teachers regarding evaluation of student data and instructional strategies would support improved
student achievement.
The researcher concluded the student data analysis by completing the chi-square test of
independence for the students during their second-grade year, 2019-2020. The data set utilized in
this process is from the middle of the school year. During the 2019-2020 school year all schools
in Pennsylvania were closed on March 13, 2020 due to the COVID-19 pandemic. This means
that students were not able to complete a traditional school year and receive the same instruction
as if they were attending school daily. All districts were forced to turn to virtual teaching and
learning, which is going to have students return to school struggling academically, socially, and
emotionally as never experienced.
Table 11 displays the data for each of the 12 teachers for second grade. The calculated pvalue for the grade level reading expectation is 11.3%. This once again supports the original
hypothesis, which states student performance is independent of the teacher assignment. There are
five teachers who the researcher identified as successfully getting students to grade level or
exceeding grade level expectations. These teachers use strong instructional strategies with their
students and increasing their reading skills.
69
Table 11:
2019-2020 Second Grade Teacher Grade Level Reading Expectations
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
Exceeding
- Observed
7
5
4
10
6
4
3
4
7
6
6
2
Exceeding
- Expected
5.2
5.52
5.2
5.85
5.85
5.85
4.55
4.87
4.87
5.2
6.17
4.87
Meeting Observed
7
2
4
3
1
4
3
2
2
4
7
2
Meeting Expected
3.33
3.54
3.33
3.75
3.75
3.75
2.91
3.12
3.12
3.33
3.95
3.12
Approaching
/ Not
Meeting
Observed
2
10
8
5
11
10
8
9
6
6
6
11
Approaching
/ Not
Meeting
Expected
7.47
7.94
7.47
8.41
8.41
8.41
6.54
7.01
7.01
7.47
8.87
7.01
Table 12:
2019-2020 Second Grade - Grade Level Standardized Residuals
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
Exceeding
0.789
-0.221
-0.526
1.716
0.062
-0.765
-0.727
-0.394
0.965
0.351
-0.068
-1.301
Meeting
2.011
-0.819
0.367
-0.387
-1.420
0.129
0.053
-0.634
-0.634
0.367
1.535
-0.634
Approaching /
Not Meeting
2.001
-0.731
-0.194
1.176
-0.893
-0.548
-0.571
-0.752
0.381
0.538
0.964
-1.507
The standardized residual calculations for second grade are displayed in Table 12. This
data supports the findings from Table 11. In comparing these two tables, there are two teachers
who are exhibiting positive results in having their students meet or exceed grade level
expectations. Teachers #1 and #4 are able to have students learn reading fluency and reading
70
comprehension skills that will increase their grade level reading performance and lower their
AimswebPlus risk level.
The analysis of the AimswebPlus assessment data is displayed in Table 13 and Table 14.
The calculated p-value for the AimswebPlus risk level was 20.5%. Once again, the researcher
accepted the hypothesis. It is confirmed that there is no association between the teacher and the
risk level the student possesses in second grade. In evaluating the data, the researcher identified
five teachers who are able to have their students perform at a level of low risk on the
AimswebPlus assessment. These teachers are able to have fewer students in the high-risk level
category and more students in the low risk category. Administrators must provide professional
learning, curricular support, and coaching support to ensure all teachers are working to achieve
this goal.
Table 13:
2019-2020 Second Grade AimswebPlus Risk Levels
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
High/Mod RiskObserved
2
5
1
1
6
3
6
6
4
4
5
3
High/Mod
Risk Expected
3.76
3.99
3.76
4.22
3.76
4.22
3.52
3.52
3.52
3.76
4.22
3.76
Low Risk Observed
14
12
15
17
10
15
9
9
11
12
13
13
Low Risk Expected
12.24
13.01
12.24
13.78
12.24
13.78
11.48
11.48
11.48
12.24
13.78
12.24
71
Table 14:
2019-2020 Second Grade Teacher AimswebPlus Standardized Residuals
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
High/Mod Risk Level
0.908
-0.506
1.423
1.567
-1.155
0.594
-1.322
-1.322
-0.256
-0.124
-0.380
0.392
Low Risk Level
0.503
-0.280
0.789
0.867
-0.640
0.329
-0.732
-0.732
-0.142
-0.069
-0.210
0.217
The researcher is concerned with the grade level data that teachers are evaluating. As
previously stated, all schools were closed for the academic year on March 13, 2020 due to the
COVID-19 pandemic. The data that was utilized in the chi-square tests is from the middle of the
year assessment window for BASD. This data was collected at during December, 2019 or
January, 2020. This is an especially difficult time for students, and they struggle to meet their
true grade level performance. These areas of concern need to be considered in determining how
students are performing.
Teacher Survey Data Analysis:
The researcher distributed a survey for the classroom teachers to complete. The survey
asked teachers to respond to a variety of questions in order to identify common factors leading to
student’s growth in reading skills and grade level expectations. The survey, found in Appendix
A, contained 19 questions. The goal of the researcher was to have the survey completed in
approximately 15 minutes. The survey was sent to 32 teachers who are still teaching at BASD.
72
There were 17 responses to the survey by current BASD teachers. Three teachers have retired
and were unable to be reached. There was also one teacher who left the school district and could
not be reached.
The breakdown of responses for teachers is found in Figure 1 and Figure 2. The
researcher was able to get responses from each elementary school and from all primary grade
levels. The research feels this is important and will allow for connections to be made between
grade level teachers and strategies they employ.
Figure 1:
Elementary Building Breakdown of Teacher Responses
Figure 2:
Grade Level Breakdown of Teacher Responses
73
Figure 3 displays the breakdown of the number of minutes each responding teacher spent
providing ELA instruction in a school day. This may not accurately represent the true minutes
being allocated to ELA. It cannot be determined if teachers included only language arts
instruction or if they added writing instruction time.
Figure 3:
Breakdown of Instructional Time Spent on ELA
The next section of the survey focused on each teacher’s use of data to inform instruction.
The teachers were first asked to identify what data they are using to inform their instruction. The
survey results are found in Table 15.
Table 15:
Student Data Points Utilized to Inform Instruction
Data Point
BAS / Running Records
AimswebPlus
Guided Reading / Anecdotal Notes
Informal Assessments / Observations
Writing Samples
Word Work Activities
Letter Identification
PASI Scores
Build up Program
Comprehension Quizzes
Letter Sound Assessments
Phonics Intakes
Number of Teachers Utilizing
15
9
7
7
4
2
2
2
1
1
1
1
74
In reviewing this data, the researcher found that there was a wide array of data points being
collected by teachers. It appears that teachers are using data within their level of comfort and/or
familiarity. Figure 4 shows the frequency the teachers are reviewing their students’ data to
inform their instruction.
Figure 4:
Data Analysis Frequency Breakdown
The data found on teacher data analysis appears to be inconsistent. The teachers are not
following common data points to analyze to help inform their instruction. There also appears to
be inconsistency in the frequency teachers analyze data to inform instruction. The fifth figure
displays how effective each responding teacher feels their data analysis is in informing
instruction. There are several concerns, and questions, that the researcher has focused upon data
used by teachers at BASD. These inconsistencies are one potential answer to the first research
question posed by the researcher.
75
Figure 5:
Teacher Determined Effectiveness of Data Analysis
The next section of the survey collected data from teachers reveal impressions of the FPC
responsive teaching program BASD utilized in the elementary schools. All responding teachers
affirmed that the most effective FPC components are Guided Reading and the Interactive Read
Aloud strategies. Teachers at BASD have been utilizing guided reading techniques for many
years. FPC utilizes leveled books that are researched based and proven to increase student
reading levels.
The Interactive Read Aloud is a new component to BASD teachers. This component has
the teachers provide a whole group reading prompt and then ask specific, targeted questions that
increase student vocabulary. Interactive read alouds also increase the student’s ability to engage
with the text being read. In evaluating teacher responses to the Fountas and Pinnell Classroom
Components, the researcher has determined that the teachers are implementing the components
regularly in their classrooms. One component that has not been well received by teachers is Book
Clubs. Challenges exist with primary students due to the use of chapter books and that books
clubs are designed to extend at least a month or more.
76
Teachers were also asked how they are differentiating in their classrooms for their
students when not receiving Direct Instruction. Teachers utilized a wide array of differentiation
strategies in their classrooms. This inconsistent use of strategies is displayed on Table 16.
Diverse instructional strategies utilized by teachers are also an area of concern. There appears to
be inconsistencies in the strategies used by teachers to differentiate for students which provides
concern for the district’s overall student growth.
Table 16:
Ways Teachers Differentiate for Students
Differentiation Strategy
Center Work
Independent Reading Books
Online Programs
Writing
Small Groups
Reading Response Work
Guided Reading
Independent Work
Book Clubs
Questioning Variety
High Frequency Words
Individual Homework Packets
Number of Teachers Utilizing
7
5
4
4
2
2
1
1
1
1
1
1
Triangulation of Data:
The Capstone Project on primary interventions for students has utilized several different
types of data. During the analysis process data from Fountas and Pinnell Classroom BAS data
was used to determine student’s grade level reading expectation level. AimswebPlus risk level
data was also utilized to determine if the student is meeting grade level expectations. The
research used Evidence of Validity Based on Relation to Other Variables to validate the data. By
analyzing the relationships between the FPC BAS assessment data and the AimswebPlus data,
the researcher was able to validate the results. These assessment tools are administered to all
elementary students three times a year during the same assessment window.
77
In analyzing the chi-square tests completed on the grade level reading expectations and
the AimswebPlus risk level data validates the data. By determining the p-values for each group
of data, the researcher was able to show that the null hypothesis was accepted for kindergarten
and the original hypothesis was accepted for first and second grades. The data also provides
evidence that students are demonstrating growth in literacy skills each year during their time at
school. The teacher survey data triangulated the data as the researcher was able to find common
instructional strategies being utilized in the district in classrooms showing student reading
growth.
Summary:
The Capstone Project undertaken by the research sought to identify primary grade level
classrooms across the Bellefonte Area School District elementary schools that are showing
positive growth in student grade level reading expectations and AimswebPlus scores. By
analyzing student data specific to reading fluency and comprehension, the researcher identified
several teachers who are showing that their students are exceeding or meeting grade level
expectations.
The researcher also analyzed AimswebPlus composite scores and risk level, which
include assessment of oral reading fluency and reading comprehension. This analysis also
identified teachers who are able to have the majority of students with a low risk level. In several
cases, the data showed the same teachers were found to be providing positive results on both
assessments. These teachers will be utilized to assist the district in developing a professional
development plan moving forward.
78
The researcher has determined that the Fountas and Pinnell Classroom program is
beginning to demonstrate encouraging results for BASD. Teachers are utilizing the components
of the program and are conducting more regular assessments of the students to collect more
relevant data.
However, the research has now uncovered several areas of concern and is developing
more questions to be answered. There are several teachers who are struggling to advance their
students in their reading skills and grade level expectations. Teachers are also been identified as
showing positive AimswebPlus scores, but students are not reaching the proficiency threshold on
the BAS assessments. As the district works to improve student growth on grade level reading
expectations and state mandated assessments, the conclusion drawn from this Capstone Project
will enable the researcher to begin to move toward a multi-tiered system of supports (MTSS)
program across all elementary schools.
79
Chapter V
Conclusions of Research
The purpose of Chapter V is to discuss the findings and conclusions of the Capstone
Research Project. The conclusions are based on the literature review and data analysis. The key
findings of this research will help the Bellefonte Area School District guide professional learning
for primary elementary teachers. The findings will also reinforce the need for the district to
pursue implementation of a multi-tiered systems of supports (MTSS) at the elementary level.
The review of literature around the subject of students obtaining the necessary reading
skills by third grade solidified the importance of acquiring these skills early in their schooling. It
is crucial that the district provide students with an opportunity to learn reading fluency and
reading comprehension skills that will increase their ability to exceed or meet the grade level
reading expectations.
Summary of Results:
This Capstone Project was conducted to identify classrooms across the district’s
elementary schools that are having students grow in grade level reading expectations and
AimswebPlus scores. In analyzing the student data on reading fluency and comprehension,
through the Fountas and Pinnell BAS assessments, the researcher identified teachers that are
proving their students are meeting or exceeding grade level expectations. AimswebPlus
composite scores and risk levels, which include assessment on oral reading fluency and reading
comprehension, were also analyzed. This analysis identified teachers have the majority of their
students with a low risk level. The data showed that many of the same teachers were found to be
providing positive results on both assessments. These teachers will be utilized to assist the
80
district in developing a professional development plan moving forward. The FPC program,
started by the district several years ago, is also demonstrating encouraging results for BASD. The
components of the program have been established in the classrooms. Teachers are conducting
more regular assessments of the students to collect more relevant data in order to help inform
their instruction.
The researcher also found several areas of concern that require further review and
analysis. This has led to the development of more questions to be answered. There are teachers
who are struggling to advance their students in their reading skills. Several teachers have
students who are achieving positive AimswebPlus scores; however, the students are not meeting
grade level on the BAS assessments. The concerns raised by the researcher will spark new
conversations in the district and will assist with the implementation of MTSS programs.
Review of Research Questions:
This section of the conclusion will provide a brief review of the research questions the
researcher established for the Capstone Project. The research questions are as follows:
1. What are the factors that are leading to the district’s struggle with low growth in ELA for
our students?
2. What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
3. What external factors are present that can aid the students in their ELA growth or hinder
their progress?
4. What professional learning opportunities do teachers need to ensure more consistent use
of data protocols and appropriate intervention strategies?
81
The research results have identified classrooms that are showing students meeting or
exceeding grade level reading performance. Utilizing this information, the researcher will
identify instructional practices which are benefiting student growth in the acquisition of reading
skills. Grade level reading performance data and AimswebPlus risk factors are used in the
district to determine a student’s achievement in reading. Each of these assessments utilize
reading fluency and reading comprehension data in determining each student’s reading level and
risk factor in grade level reading performance.
Research Question #1:
The first research question for this Capstone Research Project is focused upon the factors
that lead to the Bellefonte Area School District’s (BASD) struggles in English/Language Arts
(ELA) growth. BASD has been struggling to show growth in ELA on Pennsylvania state
mandated assessments for many years. These assessments begin in third grade so it is important
that student acquire the skills in reading fluency and reading comprehension prior to the
mandated assessments. While no school will “teach to the test”, it is critical that students are able
to read fluently and understand what they are reading before leaving elementary school.
In reviewing the data, the researcher identified several teachers who are providing
students with instruction that allows students to reach higher than expected performance levels.
One common thread for the teachers is the implementation of the FPC instructional strategies in
their classrooms. The students who were tracked for the research project entered kindergarten the
year the district first implemented FPC. Now that these students have completed second grade,
their performance in grade level reading expectations is better than expected. Figure 6 shows the
FPC components that teachers are utilizing daily in their instruction.
82
Figure 6:
Fountas and Pinnell Classroom Components Utilized by Teachers
While FPC is beginning to show promise in the first several years of implementation, the
researcher also uncovered several concerns that may be leading to the district’s struggles. The
first area of concern is the teachers’ use in data to inform their instruction. In Table 15, the
teachers identified twelve different data sources they are evaluating the help guide their
instruction. If FPC provided teachers with common components to utilize in their instruction,
could the district identify data points that could be collected from those instructional practices?
Many of the teachers indicated in their survey responses that they feel they are effective
in their data analysis processes. When comparing teacher data, several of these same teachers are
not able to have students achieve grade level reading expectations. The data analysis has proven
that the district should identify common data points that all teachers must collect, and then
receive professional learning focused upon data analysis and its use to inform instruction. The
inconsistencies in data collection and analysis could be a strong factor in why the district is
struggling in ELA growth.
A second area of concern that the researcher has identified as a factor in the district
struggles is the wide variety of supplemental resources teachers are utilizing outside of the FPC
83
program. In responses from teachers, there were 20 different instructional strategies listed.
Several of the strategies involved the use of online programs such as RAZ Kids, Starfall,
readworks.org, and teachyourmonstertoread.com. Other strategies involved the use of phonics
activities, writing activities, and high frequency word activities. It appears that the teachers are
utilizing programs and strategies that they know and are comfortable with, not instructional
strategies that are research based and proven.
A reevaluation of the data analysis processes and instructional practices being utilized by
primary teachers in elementary schools must occur. While only 17 teachers responded to the
survey, the research can predict that there would have been an even greater number of
instructional practices listed on the survey. For growth to occur in ELA over time, there should
be an integration of a MTSS program into the elementary schools. MTSS is designed to have
teachers, administrators, school counselors, and school psychologists work collectively on
regularly collecting and evaluating data. MTSS integration in stages and by starting with primary
grade levels would be beneficial. Teacher involvement in the planning of the program will be
crucial to the success of the implementation of MTSS.
Research Question #2:
The second research question addresses, “What instructional strategies are teachers using
across the district to strengthen student reading fluency and comprehension?” During the
literature review, the researcher was able to identify the importance of reading fluency and
reading comprehension in a student’s grade level performance. Students must be able to read text
fluently, and with inflection, in order to aid them in the comprehension of the text. Many
kindergarten teachers focus on letter recognition and sounds in order to prepare students for the
84
decoding of words. This is an important step in a student’s acquisition of reading skills. A
student’s ability to learn to decode words in texts they do not know allows them to obtain the
proper context of the text passage. This all goes back to the reading instruction utilized by
teacher to strengthen a student’s reading fluency and comprehension.
As previously stated, FPC provides teachers with a research proven set of instructional
practices on increasing reading fluency and reading comprehension. For example, the Interactive
Read Aloud strategy promotes reading by using grade level appropriate texts that expand a
student’s vocabulary and their ability to think, talk, and write about the text. Interactive Read
Aloud is being utilized by all teachers who responded to the survey. Another FPC strategy
employed across the classrooms is Independent Reading. Students are provided a wide array of
texts at their reading level. Teachers support student independent reading by holding conferences
with students to discuss the books they are reading.
Teachers who responded to the survey also indicated they are using many different
strategies to promote reading fluency and reading comprehension with students. Strategies such
as re-reading, reading mini-lessons, small group reading, and Sound Partners are being utilized to
strengthen student reading skills. Teachers appear to be integrating writing into the strategies
utilized as well. Many classrooms are having students share their writing with fellow students
and book buddies. These strategies allow students to hear what they are writing and identify
ways in which to improve their writing.
One of the most utilized strategies is the FPC Guiding Reading. Guided Reading provides
teachers with an opportunity to work with students in a small group setting. “Guided reading is a
small-group instructional context in which students move from high teacher support to full
85
control of the reading process” (Fountas & Pinnell, 2017). As stated in the literature review,
Fountas and Pinnell established a routine for Guided Reading sessions.
Guided Reading begins with teachers selecting appropriate text for the students. Students
are then introduced to the text and then they whisper read the entire text with the teacher
providing support. Once the text is completed, the group discusses the text in order to determine
students’ comprehension while engaging in word work in order to increase their flexibility and
word analysis skills. Finally, students engage in writing activities in order to share and extend
their understanding. BASD teachers have been employing guided reading practices for many
years. FPC has provided teachers with proper books and text passages that students benefit from.
Several years ago, Bellefonte Elementary established a parallel block schedule for
kindergarten that provides small group instruction for all students in ELA. Students rotate
through a series of centers that are designed to provide each student with appropriate instruction.
There are three or four classrooms used in scheduling kindergarten and students are grouped with
other of like abilities. Each student follows a schedule that provides them with several small
group direct instruction opportunities in reading and writing. There is also a shared reading room
established where the students participate in center work. An enrichment room is also established
where the students work with a classroom aide on a reading activity and have a center for
structured play.
The teachers have identified the schedule implemented at Bellefonte Elementary as
benefitting their students in the acquisition of reading skills. They have indicated that the
schedule has provided students with an opportunity to receive instruction with fewer distractions
and has improved student behaviors and social skills. Teachers also report that they are able to
86
frequently regroup students across the grade level in order to provide students with
individualized and differentiated instruction.
In completing the data analysis of the grade level reading expectations and AimswebPlus
composite scores, the researcher has found several inconsistencies in the data. Even though
Bellefonte Elementary utilizes a special schedule for their students, the data demonstrates that
several teachers are struggling with students meeting grade level expectations. Two of the
teachers were identified as having standardized residuals in AimswebPlus risk level of -2.06 and
-1.23. This implies that teachers have more students in the high and moderate risk level as any
other teacher in who taught kindergarten in 2017-2018. Further evaluation of kindergarten data
should occur since the implementation of FPC. This data analysis will identify the true
effectiveness of the parallel schedule.
The research has also identified a concern with the wide array of instructional strategies
utilized in the classrooms. As previously stated, it is recommended that the district develop a
group of research proven strategies that will help students improve their grade level reading
performance. Too many teachers appear to rely on online software programs for center work for
students. The district should evaluate each program and determine its effectiveness before full
implementation occurs in the classroom. This will narrow down the options of programs used by
teachers and provide students with the most effective instructional programs.
BASD is working to properly implement the Fountas and Pinnell Classroom instructional
practices in all elementary classroom. The FPC instructional strategies are researched based and
provide students with opportunities to show growth in grade level reading performance. The
researcher recommends that a data analysis be completed of subsequent years be completed in
order to provide an effective evaluation of the FPC and parallel block scheduling programs.
87
Research Question #3:
The third research question established by the researcher is to identify external factors
that aid and/or hinder student growth in grade level reading performance. The researcher was
able to collect and analyze data on grade level reading expectations and AimswebPlus composite
scores for all students. The data was disaggregated to evaluate the students who are identified as
qualifying for free/reduced lunch. This is the primary way in which schools identify students as
being economically disadvantaged. The district does not collect data on family dynamics: ie.
divorced parents, time spent with each parent, and employment status of parents. The district
relies on parent to apply for the free/reduced lunch program, but many have reported that is an
underserved student group. The research has identified this as an area of concern. Table 17
shows the break down of student performance and qualification for free/reduced lunch services.
Table 17:
Student Grade Level Performance and Socioeconomic Level
Kindergarten
MW
Teachers
F/R Total
Non Total
BES
Teachers
F/R Total
Non Total
Benner
Teachers
F/R Total
Non Total
PG
Teachers
F/R Total
Non Total
First Grade
Exc
Mtg
Appr
Not
Mtg
2
4
1
1
38
14
2
Exc
Mtg
Appr
4
Not
Mtg
8
11
0
10
14
13
2
Exc
Mtg
Appr
8
Not
Mtg
2
1
2
2
11
10
3
Exc
Mtg
Appr
0
Not
Mtg
1
2
5
2
12
9
2
2
MW
Teachers
F/R Total
Non Total
BES
Teachers
F/R Total
Non Total
Benner
Teachers
F/R Total
Non Total
PG
Teachers
F/R Total
Non Total
Second Grade
Exc
Mtg
Appr
Not
Mtg
1
2
2
3
20
13
18
Exc
Mtg
Appr
7
Not
Mtg
13
2
5
10
17
6
9
Exc
Mtg
Appr
5
Not
Mtg
1
1
2
4
12
6
5
Exc
Mtg
Appr
0
Not
Mtg
1
4
2
4
7
8
6
3
MW
Teachers
F/R Total
Non Total
BES
Teachers
F/R Total
Non Total
Benner
Teachers
F/R Total
Non Total
PG
Teachers
F/R Total
Non Total
Exc
Mtg
Appr
Not
Mtg
2
0
1
6
24
16
6
Exc
Mtg
Appr
12
Not
Mtg
6
3
8
11
11
7
7
Exc
Mtg
Appr
13
Not
Mtg
1
0
3
4
12
6
4
Exc
Mtg
Appr
1
Not
Mtg
1
2
2
6
6
8
1
8
88
The data analysis implies that students Bellefonte and Pleasant Gap elementary who are
identified as low socioeconomics exhibit performance of that is lower than those of their fellow
students. In most elementary schools at BASD, 50% of the students who qualify for free/reduced
lunch are showing low growth in grade level reading performance. Frequently, students from low
socioeconomic standing come from split families, are often shared between households
throughout the week, and frequently struggle with completing homework and required readings.
Further analysis of the students’ backgrounds to determine the family factors that are hindering
student growth would be beneficial.
BASD does provide Title I services to students who qualify. Qualification is based on a
student’s poor grade level reading performance and a high-risk level based on AimswebPlus
composite scores. By providing students with Title I services, many students are able to receive
the additional reading instruction while at school. After the district evaluates data for eligibility
for Title I services, students are broken down by grade level and tiers. Tier 3 is the most at risk,
tier 2 is moderate, and tier 1 is low risk. The teachers begin by placing students who are
identified as Tier 3 and in first grade in services. The next group is Tier 3 students in second
grade and then Tier 2 in first grade. Kindergarten students are identified and offered services in
the spring of each year.
The researcher has identified Title I services as a factor that aids student growth in grade
level reading performance. The second-grade students whose data was analyzed have shown that
receiving the extra reading instruction from the district’s reading specialists has improved
student performance.
Another factor that could be considered an aid to students is their being identified for
learning support services. Student performance data is evaluated and students can be assessed for
89
learning support. Over the previous three years Bellefonte has had six second grade students
qualify for learning support services. Staff at Benner have identified one student, Marion Walker
seven students, and Pleasant Gap have five students identified. At BASD learning support
services are considered to be Tier 3 interventions.
In the evaluation of the student data the researcher found that most identified learning
support students are ending second grade at least one grade level behind in reading performance.
According to the data there are 17 students moving to third grade one grade level behind. There
are also three students moving on that are two grade levels behind. The researcher does question
the instruction they are receiving. Should these students receive more pull-out instruction from
their learning support teachers? Are there additional programs to be evaluated and utilized with
students? The concern is that students are receiving whole group instruction with fellow
classmates, guided reading instruction from the classroom teacher, and reading support from
learning support teachers but is still not making adequate progress. More data analysis and
further questions asked on the instructional practices for learning support students would benefit
the school district.
Research Question #3 has been the most difficult question to determine answers to. There
are so many external factors that influence student grade level reading performance. Many of
these factors are outside of the control of the school district. It is widely understood that schools
need the support of families in order to promote students in their education. Schools need to
begin to search for ways in which they can engage the parents in the learning process. The
difficulty comes is that many times the parents the school tries to engage the most, are also the
most resistant. This will require more research and the development of family engagement
practices for the district to promote.
90
Research Question #4:
The fourth, and final, research question is focused on the professional learning
opportunities that ensure consistent use of data protocols and appropriate instructional strategies
for the teachers at BASD. The analysis of the student data and the teacher survey has shown that
teachers are utilizing a wide array of instructional strategies to promote students reading
performance. The analysis has also demonstrated the importance of professional learning in the
area of data analysis to inform instruction. The researcher has determined that the teachers would
benefit from established data protocols to follow when they are evaluating student data.
The results of the analysis demonstrate a lack of general guidelines for teachers when
collecting and evaluating data. Teacher have reported that they are using a wide array of data
sources to evaluate student performance. In reviewing Table 15, from Chapter IV, one finds that
there are a dozen assessments being used by teachers. Some of the assessments are formative and
some are summative. Teachers are utilizing formal assessment such as FPC BAS and
AimswebPlus. They are also using their own anecdotal notes and guided reading notes. It
appears that the teachers are using the data that they are most confident in collecting and
analyzing.
Questions with the data teachers are collecting and analyzing have been identified by the
researcher. What protocols are the teachers using to collect and analyze reading data? How often
are the students being progress monitored on their reading fluency and reading comprehension
levels? What research based instructional practices are teacher using during their instruction?
The use of FPC in classrooms is also an area of concern. Teachers report that they are
utilizing the majority of the strategies recommended by FPC, but they expressed the need for
91
further training on FPC components. One of the most requested professional learning trainings
by teachers was the FPC Phonics, Spelling, and Word Study component. Teachers reported
utilizing different phonics interventions with their students. However, these are interventions
outside of the FPC program. The researcher believes that teachers are requesting professional
learning on the phonics component due to their previous work with FPC.
The researcher has also found a concern with how the district is using their professional
learning days for teachers. In recent years the district has moved to promoting teacher growth by
offering conference like sessions on professional learning days. The district offers four sessions
throughout the day where teachers sign up for any sessions they have an interest in. This
promotes teacher learning and provide teachers with specific options to choose from. One
teacher gave the following response to the professional learning request question on the survey:
“I often think we don't need more new learning as teachers as much as we need time to
get better at what we've already learned. When we do have new learning opportunities it
is usually theoretical, which is always good, but then we struggle to find time to put that
knowledge to practical use.”
Teachers are asking for time to collaborate and work to implement the new learning they have
acquired. The professional learning model should integrate more time to allow for teacher
collaboration.
A recommendation by the researcher, that has been made in prior sections, is that BASD
begin to research and implement a MTSS program the elementary school level. The
recommended process for the implementation of MTSS would be to research, set protocols, and
begin data analysis with one grade level. The district should select one school and one grade
level to create a pilot for the MTSS implementation. It is recommended that the school spend the
first semester on establishing data protocols for the teachers to follow. The administration of the
school should also utilize the ELA elementary coach to help with types of data to collect and
92
instructional practices to focus on. The team needs to work collectively and meet regularly to
discuss protocols, processes, and instruction in the classroom.
Financial Implications:
The financial implications for BASD will involve a variety of expenses. The researcher
has recommended that the district begin with the implementation of MTSS in one school with
one grade level. This implementation will serve as a pilot for the rest of the district. There will be
initial costs for trainings and substitutes for the administration, ELA coach, and several teachers
of the school. Paying teachers for afterschool meetings to develop the data protocols and
processes will add to the training costs.
There will be more costs associated with MTSS implementation than teacher training.
The ELA coach and teachers will need to review and evaluate instructional strategies and
interventions that can be utilized with students in their classrooms. Once instructional and
intervention materials are chosen, they will need to be purchased for the teachers. This could
come in the form of web-based software programs and/or updated paper products. Another cost
associated with implementing new programming will be the paying potential trainers for inperson or webinar trainings. The school district does have several intervention programs that are
at the teacher’s disposal. Program kits such as Spiral Up, Build Up, and Boost/Blast can be found
in all elementary schools. Teachers and para-educators will be trained in order to properly
integrate these interventions with students.
Part of MTSS is the support students in their behavior performance as well. Many times,
student academic performance and behaviors are linked. Many students who misbehave in the
classroom do not do well academically. MTSS can be tied to the existing Positive Behavior
93
Interventions and Support (PBIS) program already established at BASD. This will take some
planning and collaborating, but these two programs can work in conjunction with one another.
Unfortunately, the conclusion of the Capstone Research Project comes at a time where
school budgets are being cut and revenues are decreasing due to the school closures from the
COVID-19 pandemic. The state budget does not allow for more funds being allocated to school
districts. The school administration is going to have to be creative in the planning and prep work
to begin implementing MTSS.
Limitations:
Throughout the Capstone Project the researcher has been able to identify several
limitations to the research projects. One limitation involves the use of data from only one grade
level. The researcher selected the 2019-2020 second grade students due to the district’s
implementation of Fountas and Pinnell Classroom and now recommends completing the same
statistical analysis on students in first grade. Another limiting factor is that the data for only
Bellefonte Area School District was used in the Capstone Project. There would have been great
benefit by expanding the research project and collecting data from a neighboring district. The
data could be compared since the districts are mostly likely utilized different programs to support
their ELA curriculum.
Another limitation to the Capstone Project comes from the responses to the teacher
survey. Over thirty teachers were sent the survey to complete, but only 17 teachers provided
answers and feedback. While this provided insight into how teachers feel about FPC, their use of
data, and the instructional strategies they employ, this represents only 57% of the primary
teachers across the district. Another concern involving the survey is that several of the highest
94
performing teachers identified through the data analysis did not complete the survey. Had the
researcher been able to make direct contact with these teachers, they may have completed the
survey.
The truthfulness of the teachers in completing the survey for the project is a related
limitation. The teachers provided feedback on their instructional practices, but needed to be more
specific. The vague staff member responses have created challenges. An example of this is that
several teachers provided a response on collecting anecdotal notes, but did not specify the types
of notes they took. The research had to combine many responses into groups to have similar
responses. The teachers’ reluctancy to provide pertinent feedback may stem from the researcher
being a principal at an elementary school with BASD.
The largest limitation in the completion of the Capstone Research Project was the school
closures that occurred in March of 2020 due to the COVID-19 pandemic that spread across the
world. The school closures had an impact in the project by not allow for students to complete the
full year of grade level instruction. The school closure created an extreme break in student
learning which is going to result in deficits that will be larger than usual. The researcher did not
have a full year of data to analyze for the second-grade students which required teachers to
utilize mid-year data. This data is always difficult to rely on as it is collected at a time of the
school year that has several breaks and many interruptions.
Since the school closure prevented that last quarter of school to occur, the researcher can
only speculate as to how the end of the year data would have concluded. The researcher does feel
that many students would have had higher grade level reading performance and increased
AimswebPlus composite scores, which would have lowered their risk level. This would have
potentially shown that more teachers are having students meet or exceed grade level reading
95
expectations. Again, due to the speculative nature of this assertion, it may be difficult to confirm
in the future. At this time the reopening of schools is going to look different across Pennsylvania,
and there will be options provided to families for students to receive their schooling.
Recommendations for Further Research:
It is recommended that further research be conducted on the Fountas and Pinnell
Classroom program being utilized to support the district’s curriculum. Student data on grade
level reading expectations and AimswebPlus composite scores should be analyzed in the same
manner as it was in this Capstone Project. The data from kindergarten from the past two years as
well as data from this year’s first grade should be analyzed. Unfortunately, many of the same
limitations associated with the school closure will apply. A complete picture might not be
available for several years.
If data is continually collected and analyzed over the next several years, the district will
be able to get a picture of teacher performance. Since the primary grade level teachers do not
receive a teacher specific score from the state, the analysis of student data on a regular basis can
provide the district with important results as the effectiveness of the teacher’s instructional
practices in the classroom.
It is also recommended that the district begin to research the MTSS program model. The
research should focus around data collection and analysis. The MTSS research should also
include instructional strategies and interventions that are research based and proven to increase
student performance in reading and writing. The results have shown that the teachers of the
district are utilizing a wide array of interventions with their students, but a priority placed on
developing a common set of instructional strategies for teachers to use is essential.
96
Lastly, the district would benefit from research and conducting the proper professional
learning to staff on the MTSS process. The trainings involved for this will need to occur on the
district’s predetermined professional learning days. These professional learnings will come in a
variety of forms: trainer in-person, webinar, or teacher directed. The pilot school will work
through the struggle of limited funds as many trainings can be completed by using low/no cost
options.
Conclusions:
Throughout the Capstone Research Project, the researcher was focused on the
identification of instructional strategies and interventions that assist with improved student
achievement and growth in grade level reading performance. The researcher was to identify
classrooms that have proven to aid students in meeting and/or exceeding grade level reading
expectations. Administrators can now identify instructional strategies being utilized to aid in this
growth. More consistency in interventions being utilized across the elementary schools would
greatly benefit the students in their reading development.
In determining the conclusions of each research question posed at the onset of the
Capstone Project, the research has determined there are several themes that have emerged. The
first theme involves the implementation and use of FPC instructional strategies in the classroom.
Teachers have been implementing FPC components over the past several years, and staff
members appear to be utilizing those components on a daily basis. The teachers at the primary
grades have received training on these components, but have asked for more collaborative time
to work on refining the components used in the classroom. While all teachers appear to be
utilizing interactive read alouds and guided reading components, there are questions as to how
97
effective these components are at this time. Professional learning time spent having teachers
collaborate on FPC components being utilized can strengthen the component’s effectiveness in
the classroom.
Professional learning conducted on data collection and analysis processes will also be
essential to the district increasing student achievement on achieving grade level reading
expectations. While teachers are reporting that they are effectively analyzing data, the results of
the project have determined they are not using the data and informing their instruction using
unified protocols.
A second theme that has emerged from the conclusions is that teachers are not effectively
utilizing data to inform their instruction. Students are completing the FPC BAS assessments as
well as AimswebPlus assessments three times a year. Should teachers be regularly progress
monitoring students in their grade level reading performance? The teachers of the district would
benefit from training on what each data point measures and how it can be used to provide
students with the appropriate interventions. Rather than constantly searching for the next
intervention, teachers would then have a set of resources that they can use with students in direct
instruction or by self-paced instruction.
The final theme that has emerged is that the district is ready to move to a more structured
model of data analysis and intervention determination. The MTSS program will provide the
district with that structure and processes to use to increase student reading skill acquisition and
subsequently student grade level reading performance. The recommendations for implementation
and the financial implications have previously been discussed in this chapter. There will be a
slow and progressive implementation. There will also be financial implications to the school
district for trainings and resources to support MTSS. It is also likely that the implementation of
98
MTSS will not be an easy process. However, having a MTSS program in place will greatly assist
the school district in achieving their goal of having students reach second grade reading
expectations before entering the third grade.
The completion of this Capstone Research Project is only a first step in having the district
move forward in implementing processes to have student reach grade level expectations by the
end of second grade. There is also more research and data analysis to be completed in order to
see how FPC, and subsequently MTSS, is helping students grow in their reading skills for
fluency and comprehension. Teacher should continue to research more effective interventions for
their students and create a data base of these interventions for all to use. While the work for the
Capstone Research Project is complete, the work of implementing its findings and conclusions
has only begun.
99
References
Allan, S. D. (2010, October). Differentiated Instruction and RtI: A natural fit. Educational
Leadership, 68(2). Retrieved from http://www.ascd.org/publications/educationalleadership.aspx
Butler, S., Urrutia, K., Hunt, M., & Kozman, R. (2010). A review of the current research on
comprehension instruction. Retrieved from
https://rmcresearchcorporation.com/portsmouthnh/national-reading-technical-assistancecenter/
Educational Research Newsletter and Webinars. (2000, December 27). 'Frustration-level'
materials increase reading achievement. Retrieved from
https://www.ernweb.com/educational-research-articles/frustration-level-materialsincrease-reading-achievement/
Fielding, L. G., & Pearson, P. D. (1994, March). Synthesis of research / Reading
Comprehension: What works. Educational Leadership, 51(5), 62–68. Retrieved from
http://www.ascd.org/publications/educational-leadership.aspx
Fisher, D., Frey, N., & Hattie, J. A. C. (2016). Visible learning for literacy: Implementing the
practices that work best to accelerate student learning: Grades K-12. Thousand Oaks,
CA: Corwin.
Fisher, D., Frey, N., & Hattie, J. (2017). Teaching literacy in the visible learning classroom.
Thousand Oaks, CA: Corwin Literacy.
Fountas, I. C., & Pinnell, G. S. (2012). Guided Reading: the romance and the reality. Reading
Teacher, 66(4), 5-20. https://doi.org/10.1002/TRTR.01123
100
Fountas, I. C., & Pinnell, G. S. (2017). Guided reading: Responsive teaching across the
grades (2nd ed.). Portsmouth, NH: Heinemann.
Fried, M. D. (2013). Activating teaching: Using running records to inform teaching decisions.
Journal of Reading Recovery, 5–16. Retrieved from
https://www.pekin.net/cms/lib/IL01905155/Centricity/Domain/29/Activating%20Teachin
g%20Using%20Running%20Records%20to%20Inform%20Teaching%20Decisions.pdf
Furry, A., & Cooper, K. (2011). Strengthening comprehension instruction for higher
achievement in second and third grades. Retrieved from
https://rmcresearchcorporation.com/portsmouthnh/national-reading-technical-assistancecenter/
Gillett, E. P., & Ellingson, S. P. (2017, August 30). How will I know what my students need?
Preparing preservice teachers to use Running Records to make instructional
decisions. International Literacy Association. Retrieved from
https://ila.onlinelibrary.wiley.com/doi/abs/10.1002/trtr.1609
Hansen, K. (2016). Guided reading and how it affects reading comprehension in struggling,
middle level, and high level readers. (Master’s thesis). Retrieved from
https://fisherpub.sjfc.edu/education_ETD_masters/index.html#year_2016
Hebert, C. R. (2004, August). Running records every day: Revamp your routine to make time
for assessment. INSTRUCTOR, 30–32, 71. Retrieved from
http://www.scholastic.com/classmags
Heinemann. (2018). A summary of the research base for Fountas & Pinnell Classroom.
Retrieved from https://www.fountasandpinnell.com/resourcelibrary/resource?id=435
101
Heitin, L. (2015, May 13). Reading fluency viewed as neglected skill. Education Week,
34(30). Retrieved from https://www.edweek.org/ew/articles/2015/05/13/reading-fluencyviewed-as-neglected-skill.html
Hewes, N. (2016, June 16). Lolly's Classroom: The pros and cons of leveled readers.
Retrieved from https://www.hbook.com/?detailStory=pros-cons-leveled-readers
Hewes, N. (2016, June 23). Lolly's Classroom: What's in those leveled book boxes? Retrieved
from https://www.hbook.com/?detailStory=whats-in-those-leveled-book-boxes
Hudson, R. F., Lane, H. B., & Pullen, P. C. (2005, May). Reading fluency assessment and
instruction: What, why, and how? The Reading Teacher, 58(8), 702–714.
https://doi.org/10.1598/RT.58.8.1
International Literacy Association. (2018). Reading fluently does not mean reading fast
[Literacy leadership brief]. Newark, DE: Author.
Jones, B. K. (2018, November). An insider's perspective on transforming PD. Educational
Leadership, 76(3), 36–42. Retrieved from http://www.ascd.org/publications/educationalleadership.aspx
Knight, J. (2018, November). Escape from the zero-learning zone. Educational Leadership,
76(3), 20-26. Retrieved from http://www.ascd.org/publications/educationalleadership.aspx
Koeze, P. A. (2007). Differentiated instruction: The effect on student achievement in an
elementary school (Doctoral dissertation). Retrieved from
http://commons.emich.edu/cgi/viewcontent.cgi?article=1030&context=theses
102
Lemov, D. (2017, February). How knowledge powers reading. Educational Leadership,
74(5), 10–16. Retrieved from http://www.ascd.org/publications/educationalleadership.aspx
Locklear, P. (2018, August 16). What is effective comprehension instruction? Retrieved from
https://www.readingrockets.org/article/what-effective-comprehension-instruction
Manna, R. (2019). Leveled reading systems, explained. Retrieved from
https://www.scholastic.com/teachers/articles/teaching-content/leveled-reading-systemsexplained/
Ming, K., & Dukes, C. (2008, March). Fluency: A necessary ingredient in comprehensive
reading instruction in inclusive classrooms. TEACHING Exceptional Children Plus, 4(4)
Article 6. Retrieved from http://escholarship.bc.edu/education/tecplus/vol4/iss4/art6
NCS Pearson, Inc. (2017). AimswebPlus progress monitoring guide. Bloomington, MN.
Pearson, Inc.
Odell, K. (2012). The effects of Fountas & Pinnell’s Leveled Literacy Intervention on
kindergarten students reading below grade level. Retrieved from
https://www.nwmissouri.edu/library/researchpapers/2012/Odell, Kristi.pdf
Pardo, L. (2004, November). What every teacher needs to know about comprehension. The
Reading Teacher, 58(3), 272–280. Retrieved from
https://www.learner.org/workshops/teachreading35/pdf/teachers_know_comprehension.pd
f
Pearson. (2012). AIMSweb roi growth norms. Retrieved from
https://datacentral.esboces.org/Portals/0/Documents/AssessmentSupport/AIMSWeb/AIMS
web-ROI-Growth-Norms_FAQ.pdf
103
PourhoseinGilakjani, A. (2016). How can students improve their reading comprehension
skill? Journal of Studies in Education, 6(2), 229–240. Retrieved from
http://www.macrothink.org/journal/index.php/jse
Ramirez, M., & Edward, S. (2013, November 7). What research tells us about reading,
comprehension, and comprehension instruction. Retrieved from
https://www.readingrockets.org/article/what-research-tells-us-about-readingcomprehension-and-comprehension-instruction
Rasinski, T. (2004, March). Creating fluent readers. Educational Leadership, 61(6), 46–51.
Retrieved from http://www.ascd.org/publications/educational-leadership.aspx
Robb, L. (2019). What is differentiated instruction? Retrieved from
https://www.scholastic.com/teachers/articles/teaching-content/what-differentiatedinstruction/
Shinn, M. R. (2012). The relation of AIMSweb®, curriculum-based measurement, and the
Common Core Standards: All parts of meaningful school improvement. Retrieved from
https://images.pearsonassessments.com/Images/PDF/Webinar/CBMCommonCore_MarkS
hinn.pdf
Stegman, B. (2015, March 2). 7 tips to make running records manageable and useful.
Edutopia. Retrieved from https://www.edutopia.org/blog/make-running-recordsmanageable-useful-bridget-stegman
Tomlinson, C. A. (2001). How to differentiate instruction in mixed-ability classrooms (2nd
ed.). Alexandria, VA: Association for Supervision and Curriculum Development.
Tomlinson, C. A. (2014). The differentiated classroom: Responding to the needs of all
learners (2nd ed.). Alexandria, VA: ASCD.
104
Treptow, M. A., Burns, M. K., & McComas, J. J. (2007). Reading at the frustration,
instructional, and independent levels: The effects on students' reading comprehension and
time on task. School Psychology Review, 36(1), 159–166. Retrieved from
https://www.researchgate.net/publication/290278716_Reading_at_the_frustration_instruct
ional_and_independent_levels_The_effects_on_students'_reading_comprehension_and_ti
me_on_task
UK Essays. (2018, November). Evaluation of Fountas And Pinnell benchmark. Retrieved
from https://www.ukessays.com/essays/english-language/evaluation-of-fountas-andpinnell-benchmark-english-language-essay.php
U.S. Department of Education. (2017). WWC Intervention Report. Retrieved from
https://ies.ed.gov/ncee/wwc/Docs/InterventionReports/wwc_leveledliteracy_091917.pdf
Waldera, J. (2017). What is differentiated instruction? Examples of how to differentiate
instruction in the classroom. Retrieved from https://mdsoar.org/handle/11603/3909
Weselby, C. (2014, October 1). What is differentiated instruction? Examples of how to
differentiate instruction in the classroom. Retrieved from https://education.cuportland.edu/blog/classroom-resources/examples-of-differentiated-instruction/
Young, C. (2018). Increased frequency and planning: A more effective approach to guided
reading in Grade 2. The Journal of Educational Research, 112(1), 121–130. doi:
10.1080/00220671.2018.1451814
105
APPENDIX A
California University of Pennsylvania Institutional Review Board Approval
106
Institutional Review Board
California University of Pennsylvania
Morgan Hall, 310
250 University Avenue
California, PA 15419
instreviewboard@calu.edu
Melissa Sovak, Ph.D.
Dear Daniel,
Please consider this email as official notification that your proposal titled
“Primary Elementary Interventions for Students” (Proposal #18-093) has
been approved by the California University of Pennsylvania Institutional
Review Board as submitted.
The effective date of approval is 9/19/19 and the expiration date is 9/18/20.
These dates must appear on the consent form.
Please note that Federal Policy requires that you notify the IRB promptly
regarding any of the following:
(1) Any additions or changes in procedures you might wish for your study
(additions or changes must be approved by the IRB before they are
implemented)
(2) Any events that affect the safety or well-being of subjects
(3) Any modifications of your study or other responses that are
necessitated by any events reported in (2).
(4) To continue your research beyond the approval expiration date of
9/18/20 you must file additional information to be considered for continuing
review. Please contact instreviewboard@calu.edu
Please notify the Board when data collection is complete.
Regards,
Melissa Sovak, PhD.
Chair, Institutional Review Board
107
APPENDIX B
Bellefonte Area School District Data Request Letter
108
August 5, 2019
Dr. Michelle Saylor, Superintendent
Bellefonte Area School District
318 North Allegheny Street
Bellefonte, PA 16823
Dear Dr. Saylor,
As an administrator with Bellefonte, I have seen the school district experience little growth, or
even a decline, in student English Language Arts (ELA) scores over time at the elementary
level. The district has also identified a lack of consistency and/or low scores in our student
growth indicators. These struggles can be traced back to possible issues with inconsistencies in
student data use, implementation of ELA curriculum, and how teachers implement instructional
strategies and interventions. For the past year I have been completing coursework as a doctoral
student with the California University of Pennsylvania. I am working on completing my action
research project to answer the following questions:
a.
What are the factors that are leading to the district’s struggle with low growth in ELA for
our students?
b.
What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
c.
What external factors are present that can aid the students in their ELA growth or hinder
their progress?
d.
What professional learning opportunities do teachers need to insure more consistent use
of data protocols and appropriate intervention strategies.
I am writing to request the collection and use of student date for an action research project I am
working to complete. I would like to utilize the Aimsweb data as well as student running records
for this year’s second grade class. This data is collected at least three times a year for all
elementary level students. I would like to get the data from the 2017-2018, 2018-2019, and
2019-2020 school years for the research project. Please know that students will not be
interviewed or surveyed as part of my research project.
As part of the research project I would like to identify instructional practices and intervention
strategies that the teachers are using across the district. I would also like to request permission to
survey the elementary teaching staff for kindergarten, first, and second grades. The surveys will
be completely optional and their responses will be kept confidential. My hope is to be able to
identify which instructional practices aided the students in achieving significant gains in their
reading fluency and comprehension. Once those instructional strategies are identified, I plan on
working with the teachers and ELA coaches to provide professional learning for all elementary
professional staff members.
Please let me know if you have any questions about my action research project and how I plan to
utilize the data that I am requesting to collect. I am hopeful that we will be able to expand on the
findings of the research project and offer all teachers of the school district strategies to engage
109
our students and enrich their learning. If you have any questions please contact me at 814-5710702 or bes0123@calu.edu. Thank you for your time and consideration.
Sincerely,
Daniel Besch, Jr.
Doctoral Student, California University of PA
110
APPENDIX C
Bellefonte Area School District Data Request Approval
111
112
APPENDIX D
Bellefonte Area School District Survey Invitations to Teachers
113
March 20, 2020
To the Teachers of Kindergarten Students at BASD,
Over the past several years Bellefonte Area School District has experienced little growth, or even
a decline, in student English Language Arts (ELA) scores over time at the elementary level. For
the past year I have been completing coursework as a doctoral student with the California
University of Pennsylvania. I am working on completing my action research project to answer
the following questions:
a.
What are the factors that are leading to the district’s struggle with low growth in ELA for
our students?
b.
What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
c.
What external factors are present that can aid the students in their ELA growth or hinder
their progress?
d.
What professional learning opportunities do teachers need to insure more consistent use
of data protocols and appropriate intervention strategies.
As part of the research project I would like to identify instructional practices and intervention
strategies that the teachers are using across the district. My hope is to be able to identify which
instructional practices aided the students in achieving significant gains in their reading fluency
and comprehension. Once those instructional strategies are identified, I plan on working with the
teachers and ELA coaches to provide professional learning for all elementary professional staff
members.
I am writing to invite you to participate in a survey that will help to identify your use of data and
instructional practices in regards to reading fluency and reading comprehension. Please know
that the survey is voluntary and you may withdraw from the survey at anytime. All answers to
the survey will be kept confidential and only used as part of this research project. Names will
not be collected as part of the surveys at this time. I would expect the survey to take
approximately fifteen (15) minutes to complete. The research project has been approved by the
California University of Pennsylvania Institutional Review Board. This approval is effective
09/01/19 and expires 09/01/20.
Please let me know if you have any questions about my action research project and how I plan to
utilize the data that I am asking you to provide. I am hopeful that we will be able to expand on
the findings of the research project and offer all teachers of the school district strategies to
engage our students and enrich their learning. If you have any questions please contact me at
814-571-0702 or bes0123@calu.edu. Thank you in advance for your time and consideration.
Sincerely,
Daniel Besch, Jr.
Doctoral Student, California University of PA
114
March 20, 2020
To the Teachers of First Grade Students at BASD,
Over the past several years Bellefonte Area School District has experienced little growth, or even
a decline, in student English Language Arts (ELA) scores over time at the elementary level. For
the past year I have been completing coursework as a doctoral student with the California
University of Pennsylvania. I am working on completing my action research project to answer
the following questions:
What are the factors that are leading to the district’s struggle with low growth in ELA for our
students?
What instructional strategies are teachers using across the district to strengthen student reading
fluency and comprehension?
What external factors are present that can aid the students in their ELA growth or hinder their
progress?
What professional learning opportunities do teachers need to insure more consistent use of data
protocols and appropriate intervention strategies.
As part of the research project I would like to identify instructional practices and intervention
strategies that the teachers are using across the district. My hope is to be able to identify which
instructional practices aided the students in achieving significant gains in their reading fluency
and comprehension. Once those instructional strategies are identified, I plan on working with the
teachers and ELA coaches to provide professional learning for all elementary professional staff
members.
I am writing to invite you to participate in a survey that will help to identify your use of data and
instructional practices in regards to reading fluency and reading comprehension. Please know
that the survey is voluntary and you may withdraw from the survey at anytime. All answers to
the survey will be kept confidential and only used as part of this research project. Names will
not be collected as part of the surveys at this time. I would expect the survey to take
approximately fifteen (15) minutes to complete. The research project has been approved by the
California University of Pennsylvania Institutional Review Board. This approval is effective
09/01/19 and expires 09/01/20.
Please let me know if you have any questions about my action research project and how I plan to
utilize the data that I am asking you to provide. I am hopeful that we will be able to expand on
the findings of the research project and offer all teachers of the school district strategies to
engage our students and enrich their learning. If you have any questions please contact me at
814-571-0702 or bes0123@calu.edu. Thank you in advance for your time and consideration.
Sincerely,
Daniel Besch, Jr.
Doctoral Student, California University of PA
115
March 20, 2020
To the Teachers of Second Grade Students at BASD,
Over the past several years Bellefonte Area School District has experienced little growth, or even
a decline, in student English Language Arts (ELA) scores over time at the elementary level. For
the past year I have been completing coursework as a doctoral student with the California
University of Pennsylvania. I am working on completing my action research project to answer
the following questions:
What are the factors that are leading to the district’s struggle with low growth in ELA for our
students?
What instructional strategies are teachers using across the district to strengthen student reading
fluency and comprehension?
What external factors are present that can aid the students in their ELA growth or hinder their
progress?
What professional learning opportunities do teachers need to insure more consistent use of data
protocols and appropriate intervention strategies.
As part of the research project I would like to identify instructional practices and intervention
strategies that the teachers are using across the district. My hope is to be able to identify which
instructional practices aided the students in achieving significant gains in their reading fluency
and comprehension. Once those instructional strategies are identified, I plan on working with the
teachers and ELA coaches to provide professional learning for all elementary professional staff
members.
I am writing to invite you to participate in a survey that will help to identify your use of data and
instructional practices in regards to reading fluency and reading comprehension. Please know
that the survey is voluntary and you may withdraw from the survey at anytime. All answers to
the survey will be kept confidential and only used as part of this research project. Names will
not be collected as part of the surveys at this time. I would expect the survey to take
approximately fifteen (15) minutes to complete. The research project has been approved by the
California University of Pennsylvania Institutional Review Board. This approval is effective
09/01/19 and expires 09/01/20.
Please let me know if you have any questions about my action research project and how I plan to
utilize the data that I am asking you to provide. I am hopeful that we will be able to expand on
the findings of the research project and offer all teachers of the school district strategies to
engage our students and enrich their learning. If you have any questions please contact me at
814-571-0702 or bes0123@calu.edu. Thank you in advance for your time and consideration.
Sincerely,
Daniel Besch, Jr.
Doctoral Student, California University of PA
116
APPENDIX E
Bellefonte Area School District Primary Elementary Teacher Survey
117
Primary Elementary Interventions Survey
This survey is designed to collect your ideas and instructional practices that you are
utilizing in the classroom with students. The survey is completely optional and all
responses will be kept confidential. We hope to be able to utilize instructional practices
that are proving to increase student growth in reading fluency and comprehension across
all areas of the district. Your information will help to provide professional learning
opportunities for your peers.
* Required
1. Email address *
2.
Please use provide your current elementary building assignment. *
Mark only one oval.
Bellefonte Elementary
Benner Elementary
Marion Walker Elementary
Pleasant Gap Elementary
3.
Please provide the grade level you currently are teaching. *
Mark only one oval.
Kindergarten
First Grade
Second Grade
4.
How many minutes a day do you spend teaching ELA to your students?
Mark only one oval.
90 minutes
100 minutes
110 minutes
120 minutes
More than 120 minutes
5.
What data are you utilizing to inform your instruction? *
6.
How many times a week do you review data to inform your instruction? *
Mark only one oval.
1 to 2 times
2 to 3 times
3 to 4 times Each Day
7.
How effective do you feel your data analysis process is in informing your
instruction.
Mark only one oval.
118
1
2
3
Not Very Effective
8.
4
5
Very Effective
How many times a cycle do you meet with each guided reading group for
students that are Approaching or Not Yet Meeting grade level expectations?
*Mark only one oval.
2 to 3 times
3 to 4 times
4 to 5 times
5 or more times
9.
How do you feel about the effectiveness of your differentiated instruction
for guided reading?
Mark only one oval.
1
2
3
4
5
Not Very Effective
Very Effective
10. What components of the Fountas and Pinnell Classroom (FPC) program are
you using daily in your instruction? Check all that apply. *
Check all that apply.
Interactive Read Aloud - IRA
Shared Reading - SR
Reading Mini Lesson - RML
Phonics Word Study - PWS
Guided Reading - GR
Independent Reading - IR
Book Clubs - BC
11.
In your opinion, which component of FPC has the strongest impact on
student learning? *
12.
Why? *
13. In your opinion, which component of FPC has the weakest impact on
student learning? *
14.
Why? *
119
15.
What are your impressions of the strengths and weaknesses of FPC? *
16. What supplemental resources are you using with students that are outside of
the of the FPC program? Please indicate how often you utilize the strategy. *
17. How do you differentiate for your students when they are not receiving direct
instruction?
18.
What reading comprehension interventions or strategies are you using with
your students that you have found to be successful in promoting student
growth? *
19. What reading fluency interventions or strategies are you using with your students
that you have found to be successful in promoting student growth? *
20.
What professional learning opportunities do you feel would be beneficial to
you and the other staff members of the Bellefonte School District?
A Doctoral Capstone Project
Submitted to the School of Graduate Studies and Research
Department of Secondary Education and Administrative Leadership
In Partial Fulfillment of the
Requirements for the Degree of
Doctor of Education
Daniel R. Besch, Jr
California University of Pennsylvania
July 28, 2020
California University of Pennsylvania
School of Graduate Studies and Research
Department of Secondary Education and Administrative Leadership
We hereby approve the capstone of
Daniel R. Besch, Jr
Candidate for the Degree of Doctor of Education
ii
Acknowledgements
I would like to start by thanking Dr. David Foley and Dr. Gina MacFalls for all of their
work with me throughout the Capstone Project. They have been an incredible resource to me and
have supported my Capstone Project since the very beginning. They have encouraged me to
persevere during this process and I am forever grateful for their support. I would also like to
thank Mr. Kris Vancas, who is also completing his own Capstone Project. Having a fellow
administrator to talk with during this process has been a great help and I cannot thank him
enough for his encouragement and positive attitude. You are truly a friend who I look forward to
working with for many years to come.
Next, I would like to thank my family. First, thank you to my parents for instilling an
importance of continuing my education throughout my life. I would not be where I am today
without your love and support. Next, my children: Cati, JD, and Colby. Without their love,
support, and encouragement I would not have succeeded in this accomplishment. They have
always been the reasons that I work to be a better man, father, and educator. Finally, I would like
to say THANK YOU and I LOVE YOU to Sue, my wife and best friend. She has stood by me
through every step of the way and has encouraged me to persevere throughout this process. I am
very fortunate to have Sue in my life and I work hard every day to be the husband she deserves. I
told Sue many years ago I would never go back to school and now I am about to complete the
ultimate goal of many educators. I hope this shows that anyone with the right determination and
drive can accomplish great things.
iii
Abstract
The Capstone Project completed is designed to aide the Bellefonte Area School District in
students attaining grade level reading expectations by the third grade. The researcher studied the
reading data for the district’s current second grade students. The data that was analyzed was
Fountas and Pinnell BAS data and AimswebPlus assessment data. The primary grade level
teachers of the district were also surveyed to in order to determine the different reading
intervention strategies being used in classrooms, data that teachers are analyzing, and their
impressions of Fountas and Pinnell Classroom. The BAS and AimswebPlus data were cross
referenced with the teacher survey data to identify effective reading instructional strategies that
are being utilized in classrooms and share these strategies with the other teachers across the
district. The researcher found that teachers are using a wide array of data points and a variety of
instructional strategies in their classrooms. The research that was completed has shown a need
for a multi-tiered system of support (MTSS) for its students. The Capstone Project will support
the efforts to establish a MTSS program in all elementary schools for the district.
iv
Table of Contents
Acknowledgements (if included)
ii
Abstract
iii
List of Tables
vii
List of Figures
viii
CHAPTER I: Introduction
1
Reasons for Capstone Project
1
Research Questions
3
Action Research Methods
4
CHAPTER II. Literature Review
6
Reading Fluency
6
Reading Comprehension
10
Forms of Assessment Utilized for Data Collection
13
Importance of Differentiation
20
Guided Reading
23
Fountas and Pinnell Classroom
28
Multi-Tiered System of Supports
33
Individualized Professional Learning
35
CHAPTER III. Methodology
38
Purpose
38
Settings and Participants
40
Interventions / Research Plan
44
Methods of Data Collection
49
v
Validity
CHAPTER IV. Results of Research
52
56
Purpose
56
Data Utilized for Analysis
57
Data Analysis Test
60
Data Analysis Results
61
Teacher Survey Data Analysis
71
Triangulation of Data
76
Summary
77
CHAPTER V. Conclusion of Research
79
Summary of Results
79
Review of Research Questions
80
Research Question #1
81
Research Question #2
83
Research Question #3
87
Research Question #4
90
Financial Implications
92
Limitations
93
Recommendations for Further Research
95
Conclusions
96
References
99
APPENDIX A. California University of Pennsylvania Institutional Review Board
Approval
105
APPENDIX B. Bellefonte Area School District Data Request Letter
107
vi
APPENDIX C. Bellefonte Area School District Data Request Approval
110
APPENDIX D. Bellefonte Area School District Survey Invitations to Teachers
112
APPENDIX E. Bellefonte Area School District Primary Elementary Teacher Survey
116
vii
List of Tables
Table 1: Instructional Level Expectations for FPC
58
Table 2: AimswebPlus Benchmark Comparison Report Sample
59
Table 3: 2017-2018 Kindergarten Teacher Grade Level Expectations
62
Table 4: 2017-2018 Kindergarten Teacher Grade Level Standardized Residuals
63
Table 5: 2017-2018 Kindergarten Teacher AimswebPlus Risk Levels
64
Table 6: 2017-2018 Kindergarten Teacher AimswebPlus Standardized Residuals
64
Table 7: 2018-2019 First Grade Teacher Grade Level Expectations
66
Table 8: 2018-2019 First Grade Teacher Grade Level Standardized Residuals
66
Table 9: 2018-2019 First Grade Teacher AimswebPlus Risk Levels
67
Table 10: 2018-2019 First Grade Teacher AimswebPlus Standardized Residuals
67
Table 11: 2019-2020 Second Grade Teacher Grade Level Expectations
69
Table 12: 2019-2020 Second Grade Teacher Grade Level Standardized Residuals
69
Table 13: 2019-2020 Second Grade Teacher AimswebPlus Risk Levels
70
Table 14: 2019-2020 Second Grade Teacher AimswebPlus Standardized Residuals
71
Table 15: Student Data Points Used to Inform Instruction
73
Table 16: Ways Teachers Differentiate for Students
76
Table 17: Student Grade Level Performance and Socioeconomic Levels
87
viii
List of Figures
Figure 1: Elementary Building Breakdown of Teacher Responses
72
Figure 2: Grade Level Breakdown of Teacher Responses
72
Figure 3: Breakdown of Instructional Time Spent on ELA
73
Figure 4: Data Analysis Frequency Breakdown
74
Figure 5: Teacher Determined Effectiveness of Data Analysis
75
Figure 6: Fountas and Pinnell Classroom Components Utilized by Teachers
82
1
Chapter I
Introduction
The Bellefonte Area School District is very similar to many other districts across the
state. The district is located in the rural center of the state. Over the past several years, the district
has experienced a decline in English Language Arts (ELA) scores in the state mandated
assessments in grades three, four, and five. Many students are also showing little to no growth in
ELA scores on the district assessments in all grade levels. The district has been working to
identify possible reasons for these trends. Several theories for these struggles could be linked to
possible issues with inconsistencies in student data use, implementation of ELA curriculum, and
how teachers implement instructional strategies and interventions.
When becoming a teacher over twenty years ago, I had a strong desire to teach students
to not only learn science, but to also be lifelong learners. I quickly realized I was going to have
to teach students how to read and comprehend text in order to increase their learning
opportunities. This was found to be true whether teaching sixth grade science or high school
chemistry. Many students struggled to extract important information from text they were reading.
For these reasons I took a special interest in reading in the content area.
When I moved into administration, it became apparent that students continued to struggle
with reading in content areas. After four years as a high school vice principal, I moved to be a
vice principal at the elementary level. Over the next four years, I was able to study the process of
how elementary students learn how to read. These observations showed that reading fluency and
reading comprehension are crucial components of learning to read. Students need to be able to
recognize the words that are used frequently in text and need to be able read them fluently. Once
students are able to utilize skills to read text, they are then able to make the transition to
2
comprehending the text. The teaching of reading fluency and reading comprehension skills is
essential in elementary classrooms.
I have had the opportunity to observe teachers provide instruction on reading strategies
and it has strengthened my resolve to provide students with skills to be lifelong learners. Guided
Reading is a general instructional strategy that is used in the elementary classroom. Guided
Reading also allows teachers to provide students with small group instruction at their
instructional level. While this small group instruction is occurring, the rest of the class can be
found working in reading centers. These centers provide student with opportunities to practice
reading and writing strategies. Most of the centers that students are participating in are used
universally no matter what individual reading levels students have attained.
Several years ago, the school district evaluated and revised the language arts curriculum.
The committee that completed this process also evaluated and selected a new language arts
program to assist them in the delivery of the curriculum. Fountas and Pinnell Classroom (FPC)
was selected as that program. FPC’s program utilized a blend of direct instruction and responsive
teaching strategies. Teachers work to provide instruction that meets the learning needs of their
students and FPC was seen as the program to enhance instruction. Guide Reading is at the heart
of FPC, but there are other instructional contexts used. Interactive read-alouds, shared reading,
book clubs, and independent reading are the other key components of FPC. The students are
immersed in reading and are exposed to a large variety of text.
FPC and responsive teaching in practice is much more difficult than originally thought.
Many teachers are finding it difficult to regularly assess students to have current data. Teachers
are also finding it difficult to teach all of the components of FPC in a two-hour language arts
block. The district is continuing to struggle with how to effectively provide instruction to
3
students at their individual reading levels. After several years of FPC implementation teachers
are still looking for ways to effectively meet the students’ needs.
Multi-tier system of supports (MTSS) is a framework that many school districts are
utilizing in order to provide targeted instruction to students who are struggling. MTSS is based
on student data to make informed instructional decisions. Students are provided interventions
and progress monitored to determine the effectiveness of the interventions. The district has been
working to bring MTSS to the schools in order to provide students with targeted instruction that
is supported by data. In order to effectively meet the needs of students, schools need to
understand where the students are in their learning and how they are progressing. MTSS
provides schools with a proven framework for making data-based decisions.
The research conducted for this capstone project is based on four research questions. The
research questions are as follows:
1. What are the factors that are leading to the district’s struggle with low growth in ELA for
our students?
2. What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
3. What external factors are present that can aid the students in their ELA growth or hinder
their progress?
4. What professional learning opportunities do teachers need to ensure more consistent use
of data protocols and appropriate intervention strategies?
The Capstone Project is designed to help identify effective reading instructional strategies that
are being utilized in schools and share these strategies with the other teachers across the district.
4
The Capstone Project will be conducted by utilizing a mixed methods action research
process. There will be quantitative and qualitative data collected and analyzed. The quantitative
data will be used to identify classrooms that are demonstrating success. Qualitative data will be
collected from teachers in order to determine the different reading intervention strategies being
used in classrooms. The research is being completed to identify reading strategies that are proven
to have a positive effect on student learning. Professional learning will be provided to teachers
that focus on effective data use and strategies designed for improved student achievement. The
goal of the capstone project is to provide teachers with instructional strategies and interventions
that have shown positive student growth. The more strategies and interventions teachers have at
their disposal, the more likely they will deliver responsive teaching instruction.
The research being conducted may have a variety of financial implications to the district.
Delivering responsive instruction and intervention to the students will require instructional
materials and personnel. The implementation of MTSS will require professional learning time
for teachers and administrators to be trained in the processes. In order to provide effecting
interventions, building schedules may need to be revised. New resources may need to be
purchased for the interventions. There is also the potential to hire more reading specialists and
math interventionalists as well as building aides.
Many school districts across the state are looking to provide instruction that will improve
student achievement. Each school district is also looking at budget restrictions that make
purchasing new programs difficult each year. A way to help districts is to examine the
instructional strategies going on within the classrooms of the schools. By sharing resources and
knowledge, instruction across a district can improve and student achievement can increase. This
5
capstone action research project aims to provide the teachers of Bellefonte with tools that will
benefit the district’s students as a whole.
6
Chapter II
Literature Review
The literature review for this capstone project will review the research focused upon
language arts instruction in the elementary classroom. It is important to understand the
background of language arts instruction in order to learn how it can be organized to improve
student growth. The background knowledge provided throughout the review of literature will
provide a foundation for the organization of language arts instruction by increasing teacher
knowledge in the use of data and specific reading interventions.
The literature review is organized into seven different parts. The first part will focus on
the importance of reading fluency and reading comprehension in the language arts instructional
process. The next section will review the different forms of assessment that are collected locally
and how the information informs instruction. Third, I will focus on differentiation and its
importance in the elementary classroom, which will lead to the fourth section will review the
Guided Reading instructional process. The fifth section of the literature will be a synthesis of
Fountas and Pinnell approach to reading instruction and how it is utilized in the classroom. The
sixth section will focus on the Multi-Tiered Systems of Support utilized by schools today to
support student learning. Finally, I will review and discuss the professional learning model that
the Bellefonte Area School District employs and the importance of it in teacher growth.
Reading Fluency:
Research suggests that reading fluency and reading comprehension have emerged as two
key components in increasing student growth in language arts. Students who are able to read
fluently are able to break down text and then comprehend what they have read. Struggling
7
readers historically have demonstrated that they neither recognize the words from the text nor are
they able to decode words that they do not recognize. For decades, teachers have seen the
importance of reading comprehension, but they are now beginning to recognize the importance
of reading fluency (Hudson, Lane, Pullen, 2005).
Reading fluency appears to have many definitions, Raskinski (2004) highlights the
importance of reading fluency.
“Reading fluency refers to the reader's ability to develop control over surface-level text
processing so that he or she can focus on understanding the deeper levels of meaning embedded
in the text.”
If students are not able to read the text that is in front of them, then they will not be able to
understand the meanings found in the text.
The goal of all teachers should be to have students reading in a fluent manner in the
elementary classroom (Rasinski, 2004). Teachers want their students to be able to take the skill
of reading and then apply it across different subject areas. There are three main components that
a student must master in order to be considered a fluent reader. Students need to learn and
maintain the ability to read with accuracy, speed, and expression (International Literacy
Association, 2018). “Teachers of struggling readers need to realize that a common core problem
for them is the ability to read sight words, decode words, and read phrases and sentences
automatically and rapidly” (Ming & Dukes, 2008, p. 3).
Poor readers tend to be labored in their reading and are focused on decoding of words
(Hudson et al., 2005). Once students have “mastered the letter sounds, decoding rules, and a
good base of sight words, many pupils begin to feel the flow of good reading, and eventually, the
process becomes second nature” (Heitin, 2015).
8
“Accuracy is the essential foundation of reading fluency” (International Literacy
Association, 2018). If students are to understand what they are reading, then they need to be able
to accurately read the text. The decoding of words is essential if students are to read accurately.
Research has shown that students need to have a large bank of high-frequency words and have
the ability to blend sounds together to decode words correctly. Students who can look at a word
and know automatically what the word is will increase their accuracy in reading text, will be able
to sustain reading for longer periods of time, and will be able to read across a variety of texts
(Hudson et al., 2005).
Many teachers will develop a word wall throughout the year, but there needs to be more
work in high-frequency words to ensure students are learning their sight words. Most literacy
experts do agree that reading fluency should be taught in the classroom and the most effective
strategy is repeated readings (Heitin, 2015). Research is also starting to show that strategies such
as popcorn reading and sustained silent reading have no real effect on improving reading fluency
(Heitin, 2015).
The second component of reading fluency is the speed at which reading is completed.
First and foremost, reading fluently is not reading quickly. Another important point is reading
rates are different for all students, and teachers need to be able to recognize what is acceptable for
each student. Oral Reading Fluency (ORF) scores have become a recognized data point for
assessing a student’s reading rate. Teachers should remember that students who are reading in
the average rate range for ORF are on the correct path to become effective and fluent readers
(International Literacy Association, 2018). “Like blood pressure, body temperature, and
cholesterol, ORF scores can serve as ‘indicators’ of health and wellness, and scores at the
‘average’ level are, in fact, optimal” (International Literacy Association, 2018).
9
Finally, reading with expression will enable students to get the full context of the author’s
meaning in a text. “Struggling readers are often characterized as reading in a monotone without
expression or with inappropriate phrasing” (Hudson et al., 2005). The literature appears to show
that if students can read a text with expression, then students are showing they understand the text
they are reading. If students are able to read a passage and attend to the punctuation that the
author has provided, then they are showing they are able to interpret the text. Like speed, reading
with expression does not have an accepted minimum level for students to meet. Most feel that if
a student is able to read and it sounds as effortless as when speaking, then the student is reading
with acceptable expression (International Literacy Association, 2018).
Assessing a student’s reading fluency can be done by teachers just having students read
out loud. “By having students read one or two grade-level passages for one minute each, teachers
can get a quick sense of their students' level of decoding accuracy, automaticity, and prosodic
reading” (Rasinski, 2004). Many times, teachers are completing reading assessments at the
beginning, middle, and end of the year. Teachers will also assess a student’s reading fluency at
the end of the marking period. Teachers do not need to complete formal running records or
aimsweb assessments to get an understanding of where their students are in their reading fluency.
In reviewing the research done with regard to increasing student reading fluency, there are
several common practices that teachers can employ in their classrooms (Hudson, et al., 2005).
One of the main practices a teacher can implement with effective results is to model fluent
reading (Dukes, Ming, 2008). Struggling readers need to hear fluent readers reading fluently.
Teachers can implement read-alouds in the daily instruction. Also, repeated reading has proven
to show effective growth in reading fluency (Hudson, et al., 2005). Repeated reading can be done
in a variety of ways in the classroom. Teachers can use interventions like assisted reading, paired
10
readings, and computer programs as part of their guided reading centers. Students who have
reading fluency modeled and coached will show growth in accuracy, speed, and expression
(International Literacy Association, 2018).
Reading Comprehension:
Reading comprehension is defined as making meaning from texts that are read (Pardo,
2004). Reading comprehension is the process in which students utilize their prior knowledge and
experiences to interpret the meaning of what they are reading. The more background knowledge
students have the better they will be able to connect to the text and this will allow them to make
sense of what they are reading (Pardo, 2004). Students come to the classroom with a different
knowledge base and different skills.
“A major goal of reading comprehension instruction, therefore, is to help students
develop the knowledge, skills, and experiences they must have if they are to become competent
and enthusiastic readers” (Ramirez & Edward, 2013). This is where the teachers come to support
the students in reading comprehension and help develop good readers.
Students should be taught strategies to build upon and activate their prior knowledge
prior to reading. This will allow students to connect with concepts in the text during the reading.
There are several ways in which teachers can help students build upon their prior knowledge. If
the teacher knows that students do not have the prior knowledge, they can “support students’
acquisition of world knowledge by establishing and maintaining a rich, literate environment, full
of texts that provide students with numerous opportunities to learn content in a wide variety of
topics” (Pardo, 2004). Teachers can also utilize reading strategies, such as graphic organizers, to
11
help students connect prior knowledge to the text and show relationships between known words
and new words to build on new vocabulary (Pardo, 2004).
Teachers are constantly working to help their students improve their reading fluency and
comprehension. The Texas Education Agency (2002) stated that there are several characteristics
that can be found in all good readers. One component of being a good reader involves setting
goals before completing the reading. Good readers will also have good reading fluency in order
to connect sentences together to make meaning out of the text. In addition, good readers will also
summarize the content of a text it is read. Finally, good readers do make inferences from the text
by drawing on their background knowledge. Good readers will also look for clues in the text to
supply information about characters or events. There are many instructional practices that
teachers can use to help students become good readers.
“Effective comprehension instruction is instruction that helps students to become
independent, strategic, and metacognitive readers who are able to develop, control, and use a
variety of comprehension strategies to ensure that they understand what they read” (Ramirez &
Edwards, 2013).
When presenting reading comprehension strategies to students, teachers should model the
strategy (Pardo, 2004). When teachers model their thought process by using a think aloud about
a given comprehension strategy, the students learn how to implement the strategy and engage
with their text. After the strategy is modeled, the students should apply the comprehension
strategy with the teacher providing support (Pardo, 2004).
Reading comprehension strategies should be taught to students based upon the text they
are going to be reading. Students are typically going to read one of two types of text: narrative
or expository. Narrative text is text that tells a story to the reader. Examples of narrative texts
12
would be short stories, folktales, myths, fables, fantasies, and science fiction. In order to increase
a student’s reading comprehension for narrative text, teachers should work to implement several
instructional strategies.
Locklear (2018) outlines a variety of instructional strategies for teachers. These include
strategies like having students focus discussions on story elements and encouraging them to
relate story events to their own experiences. Students also want to be able to compare the
structure of one story to that of other stories. Finally, teachers can prepare visual guides, such as
story maps, to help students recall different story elements.
Expository text is text that is written to explain, inform, or even persuade. Examples of
expository texts are textbooks, biographies, journals, and brochures. Teachers who are teaching
reading comprehension strategies for expository texts will utilize a different set of instructional
strategies (Locklear, 2018). In order to learn how to draw information for expository text,
students should be chunking and summarizing information by related items and concepts.
Students should also interpret and analyze charts and tables found in the reading. This will help
them apply the information from the text to real world situations (Locklear, 2018).
Successful comprehension instruction will include large amounts of time for reading,
teacher-directed instruction in comprehension strategies, opportunities for collaborative learning,
and students talking to the teacher and one another about their responses to reading (Fielding,
Pearson, 1994). Students learn how to determine appropriate choices for text selections and
ensure that students spend time reading books that are appropriate in difficulty for the student.
Students want to be reading passages that help them increase their reading fluency. Finally,
student conversation about what they are reading provides them with opportunities to practice
the comprehension skills they have learned (Fielding, Pearson, 1994).
13
With the change in reading instruction, teachers look for a variety of texts for their
students to read. “With the rise of literacy approaches such as guided reading, many hail leveled
readers as a critical component of effective reading instruction” (Hewes, 2016). Level readers
provide students texts that they are able to read at their skill level. “In theory, then, if students are
reading a text that is not ‘just right,’ they are not as effectively able to practice applying the
desired skills because the text is either too challenging to allow them to focus on the skill at hand
or too simplistic for them to need to use the desired skill” (Hewes, 2016).
Level readers are typically used in guided reading instruction or as part of reading
literacy activities. There appear to be two ways in which leveled readers are established for
students. The first way is to level the pre-existing texts in the classroom library in order to
provide students with high-quality texts (Hewes, 2016). The second method employed is to
utilize books written and leveled by publishers, where the books tend to be simpler and less
engaging to students (Hewes, 2016). Leveled readers provide students with opportunities to read
texts that are at their independent and instructional levels.
The importance of reading fluency and reading comprehension cannot be overstated for
an elementary classroom. Lessons should be designed in order to increase student proficiency in
reading fluency and comprehension. However, students come to the classroom with different
experiences and background knowledge. In order to properly identify what deficiencies students
may have, we need to assess students’ knowledge, understanding, and ability to read. There is a
wide array of assessments that can be used with elementary students. The two assessments
utilized in our school district is AimswebPlus and running records.
Forms of Assessment Utilized for Data Collection:
14
The AimswebPlus assessment is a nationally normed assessment, data management, and
reporting system that is utilized for screening and progress monitoring of students (NCS Pearson,
2017). AimswebPlus collects two different types of assessment data: curriculum-based measures
(CBMs) and standards-based assessments (SBAs). This database system provides information
that helps teachers differentiate instruction as well as determine which students will benefit from
intensive intervention (NCS Pearson, 2017). AimswebPlus is often administered to all students
three times a year and can also be used as a progress monitoring tool for students receiving tiered
interventions.
“Curriculum-Based Measurement (CBM), a set of simple, time efficient, and
scientifically sound assessment tools, has increased rapidly for frequent basic skills progress
monitoring and screening students for risk” (Shinn, 2012). Schools today are searching for ways
to evaluate student growth and the effectiveness of their curriculum. Schools also began to use
CBM progress monitoring tools for universal screening to support early interventions (Shinn,
2012).
This has led to schools determining students’ Rate of Improvement (ROI). ROI is used to
determine how rapidly students are showing growth in their CBM data. “The distribution of
ROIs for a group of students—such as a class or grade that participates in universal screening
three times a year—serves as a measure of the effectiveness of the general educational program”
(NCS Pearson, 2012).
ROI can also be utilized in showing growth of individual students. “The ROI of a student
whose progress is being monitored is the primary indicator of the effectiveness of the
intervention” (NCS Pearson, 2012). Schools across the country are utilizing AimswebPlus CBMs
in order to determine student intervention. Students’ ROI can be compared to expected growth
15
data to determine if adequate progress is being made toward end-of-year goals (NCS Pearson,
2017).
AimswebPlus data can also be collected for progress monitoring data and is used in a
school’s Response to Instruction and Intervention (RtII) program. RtII is perfectly suited for
schools to evaluate the effects of evidence-based instruction in order to comply with the
Individuals with Disabilities Education Act (IDEA, 2004) and Every Student Succeeds Act
(ESSA, 2015) (NCS Pearson, 2017).
Progress monitoring is an important tool in guiding instruction for students with learning
disabilities and low achievement. “The AimswebPlus system supports accurate and frequent data
collection, automatically displays results and trends via graphs, projects growth trends alongside
growth expectations, and provides explicit rules for deciding whether a student is on or off track
to meet his or her end-of-year goals” (NCS Pearson, 2017).
Bellefonte is utilizing AimswebPlus assessment three times a year for universal screening
and benchmarking of all students. “CBM was seen as valid for purposes of frequent formative
evaluation to judge progress and facilitate any necessary modifications of intervention programs
and to enable very frequent (e.g., weekly) formative evaluation for at-risk students, with the
added capacity for beginning of the year universal screening” (Shinn, 2012).
Progress monitoring utilizes several processes that schools and teachers should follow.
First, deciding which students to progress monitor and which CBMs to use needs to be
addressed. Second, teachers should select the appropriate grade level of the CBMs to assess.
Third, teachers need to set a goal and create a schedule for data collection. During the data
collection, the CBM data is used to evaluate student progress while deciding whether student
16
progress is adequate and whether the instruction should be modified. Finally, determinations
should be made if the goal has been reached (NCS Pearson, 2017).
The use of AimswebPlus allow for schools to organize students into three tiers. “Students
in Tier 3 typically need intensive intervention to build skills and deepen their understanding of
learning standards taught in the core instructional program. Students in Tier 2 may need only
small-group instruction and additional practice on core content to get on track. Students in Tier 1
are expected to stay on track with high quality, research-based core instruction” (NCS Pearson,
2017). Students who are in Tier 3 are considered to be at risk and require frequent progress
monitoring, often on a weekly basis. “Progress monitoring is an important part of a dynamic
approach to guiding instruction and interventions for both groups and individuals” (NCS
Pearson, 2017).
The AimswebPlus program uses five color-coded performance level indicators, which are
based on national norms (NCS Pearson, 2017). The performance levels are as follows:
● Well Below Average, which is the 1st–10th percentiles, scores are displayed in
orange
● Below Average, the 11th–25th percentiles, scores are displayed in yellow
● Average, 26th–74th percentiles, scores are displayed in green
● Above Average, the 75th–89th percentiles, scores are displayed in teal
● Well Above Average, the 90th–99th percentiles, scores are displayed in blue
Color-coding makes it easier to identify each student’s performance level (NCS Pearson, 2017).
“AIMSweb provides these field-tested, validated, and independently reviewed CBM test
materials in the basic skills areas and organizes and reports the data for educators and parents”
(Shinn, 2012).
17
A running record is an assessment that has been used with students for many decades.
“Running records are a formative assessment and are one way to document teacher observations
of reading behaviors” (Stegman, 2015). A passage is orally read by a student and the teacher
records information on the student’s reading of the passage. The “running record — an easy-touse, standard coding system for capturing what young readers say and do while reading texts.
Running records are often taken to assess the text difficulty for the child and may be taken at
different time intervals to capture the child’s progress” (Fried, 2013). Running records are
another piece of data for a teacher to make instructional decisions.
“Running record data reveals the independent reading level, the instructional level, and
the frustration levels of a reader, along with information about how he or she is processing text”
(Herbert, 2004). Generally, students’ running records are found to fall in one of the three reading
level categories:
● Independent reading levels are found when a student is able to read with little to
know support and has an accuracy level of 95% to 100%.
● Instructional levels are found when students are reading with instructional support
and accuracy level of 90% to 94%.
● Frustration levels are found when students require extensive support in reading
the passage and have accuracy level less than 90% (Gunning, 2002).
Running records are known to be powerful in the early elementary grades. Running records help
teachers learn when text gets hard for an individual student and what the student does when that
happens (Gillett and Ellingson, 2017).
Combined with AimswebPlus data, running records can provide teachers with
information to guide planning and instruction. Teachers should not go back examine every error
18
made by the students. Teachers should be selective and focus on a few teaching points that will
have the biggest payoff for the child’s learning (Fried, 2013). Teachers can use the data from
running records to evaluate their teaching as well.
“Analyzing a set of running records for one teacher across multiple students reading
around the same level may also reveal teaching patterns, teaching decisions, and in some cases
patterns of tolds” (Fried, 2013). By evaluating running records of students, teachers can find
general reading error patterns that students are making. “Running record data provide direction
for making ongoing instructional decisions for students right in their zone of proximal
development” (Vygotsky, 1978).
While running records can provide teachers valuable student data, they are not to be used
for long term planning. “One misconception about running records is that data gained about a
reader is valid for a semester or longer. In fact, children's skills change so quickly that record
data is really only valid for approximately one month” (Herbert, 2004).
For many years, teachers would complete running records only four or five times a year.
Classroom routines can be established where running records can be given frequently. Herbert
(2004) stated that teachers “have a better chance of ‘hitting the instructional target’ for each and
every child if you conduct ongoing assessments throughout the year instead of just a few times
per year.”
Running records are assessments that have protocols teachers should follow when they
are administered. “The process of conducting a running record includes the teacher taking notes
on the student's errors and corrections when he or she is orally reading a leveled text” (Stegman,
2015). Running records need to be completed on a regular basis but do require instructional time
to complete. “A schedule will allow consistent data collection for all students. In the younger
19
elementary grades, students can move through guided reading levels very quickly, so it is
important to have timely data” (Stegman, 2015).
Running records provide instructional time for students and teachers to conference.
Teachers are provided an opportunity to praise students for their use of learned strategies and
help students understand how to better correct errors. “Structure the feedback so they have the
space to hypothesize, reflect on their learning, and evaluate their own approaches as well as
those of their peers” (Fisher, Frey, Hattie, 2017).
Data notebooks are proven to be beneficial when teachers and students utilize them
during instruction. “The goal of the data notebook should be to show student growth. All
students should have their own section that includes their running records. Over time, the data
notebook should show evidence that a student's accuracy is improving” (Stegman, 2015).
Students will have more investment in their learning if they are part of the data tracking process.
“Setting goals is one way to help students take ownership of their learning. They can set end-ofthe-year reading goals, as well as benchmark goals with the teacher” (Stegman, 2015). If
students are part of the goal-setting process, they will better understand what books they should
read to increase their learning.
Running records can also help teachers provide students with instructional materials that
will meet their learning needs. “Betts (1946) hypothesized that when students are presented with
tasks that are sufficiently familiar, yet still provide some degree of challenge, optimal learning
occurs. Optimally challenging tasks were referred to as tasks at the student's instructional level”
(Treptow, Bums, and McComas, 2007).
Teachers know that the more time on task students exhibit, the more learning they are
doing. Research suggests that “matching curricular materials and student skill could improve
20
short-term student outcomes (time on task and reading comprehension), which is also important
given the close link between classroom behavior problems and academic difficulties” (Treptow,
et al., 2007).
Importance of Differentiation:
Differentiation is an important aspect of a well-rounded classroom. Once teachers have
data, they should design lessons that meet the needs of their students. “In classrooms where one
lesson is designed for all learners, limits are placed on students’ achievement. Students who are
advanced academically are left behind because they are under-challenged, and students who may
be struggling are left frustrated and confused” (Koeze, 2007). Classrooms today should account
for the needs of all students and then provide instruction to meet those needs.
“Classrooms in which differentiation is taking place may help to close the achievement
gap that has been prevalent for years in American schools” (Koeze, 2007). In differentiated
classrooms, teachers are regularly collecting data, analyzing the data, and then designing
instruction to aid students in their growth and learning. “By developing lessons appropriate to
students’ readiness levels, interest, and learning profiles, teachers will be able to draw upon prior
knowledge and student experiences outside of the school environment which will empower
students to ask questions and share their opinions because they already have knowledge or
interest in the topic” (Koeze, 2007).
Carol Ann Tomlinson is one of the leading experts on differentiation in the classroom. In
her book, HOW TO Differentiate Instruction IN Mixed-Ability Classrooms (2001), Tomlinson
outlines what differentiated instruction is and what it is not. She stated that differentiation is not
21
the “Individualized Instruction” of the 1970s, not chaotic, not just another way to provide
homogeneous grouping, and not just “tailoring the same suit of clothes.”
Tomlinson did set guidelines as to what differentiation should look like. Differentiated
instruction is proactive, more qualitative than quantitative, and rooted in assessment. It is
student-centered and evolutionary, where students and teachers are learning together. Finally,
differentiated instruction is a blend of whole-class, group, and individual instruction while
providing multiple approaches to content, process, and product.
Tomlinson advocates for student learning by promoting that teachers know “students’
individual learning styles and levels of readiness first before designing a lesson plan” (Weselby,
2014). Knowing their students, teachers are able to design lessons that meet students’ learning
styles, assess student learning, and manage classroom procedures to create a safe and supportive
classroom environment (Weselby, 2014). According to Tomlinson, teachers can differentiate
lessons for students in four ways: content, process, product, and learning environment.
Cathy Weselby (2014) outlined ways in which teachers can differentiate according to
Tomlinson’s areas:
● Content can be differentiated by “designing activities for groups of students that
cover various levels of Bloom’s Taxonomy.”
● Successful differentiation includes the process of delivering the material to each
of the learning styles the students may possess: visual, auditory and kinesthetic,
and through words.
● The product that students produce can also be differentiated by utilizing various
forms of assessment: tests, projects, reports, etc.
22
● The learning environment conditions for optimal learning include both physical
and psychological elements: layout of classroom, positive classroom
management skills, etc.
Differentiation of classroom instruction is more involved than just providing more or less
work for students to complete. Differentiated lessons provide students with opportunities to
practice their use of the reading fluency and reading comprehension skills. If the classroom
lessons and routines are established, students will have a learning environment that will promote
growth in language arts.
In 2008 Laura Robb, a master teacher, language arts coach, and author, utilized the work
of Tomlinson and several others to develop a “list of some key principles that form the
foundation of differentiating instruction.” The first is ongoing, formative assessment, where
teachers need to continually assess to identify students’ strengths and areas of need. Second,
teachers need to recognize the diverse learners and their diverse levels of expertise and
experience with reading, writing, thinking, problem solving, and speaking. Third is group work,
where students should collaborate in pairs and small groups that enable students to engage in
meaningful discussions and learn from one another. Fourth, teachers want to focus on problem
solving which focuses on issues and concepts and encourages all students to explore big ideas
and expand their understanding of key concepts. The final principle, is student choice. Student
choice in their reading and writing experiences and in the tasks and projects will engage students
in their learning.
Robb (2008) also developed nine practices for teachers to use to differentiate reading
instruction in their classrooms: make read aloud a common teaching text, teach students with
diverse materials, organize instruction for all reading levels, value independent practice reading,
23
model for students how to construct meaning while reading, encourage discussion on readings,
write to explore, think, learn, and improve comprehension, use ongoing assessments to support
students, and plan units carefully. These components are also evident in Fountas and Pinnell
Classroom instructional practices.
“Differentiation is a way of teaching; it’s not a program or package of worksheets”
(Robb, 2008). Differentiation is designed to maximize student growth by providing different
ways for students to show their learning. Differentiation can be a valuable asset when
implementing a Response to Instruction and Intervention (RtII) program within a school.
“Differentiated instruction applies to all students, including those who struggle and need
academic and behavior supports. Response to Intervention is a way of focusing on students who
may need increasing levels of support to experience success” (Allan, 2010). Both programs have
goals of modifying instruction to meet the needs of the students in the classroom and promote
their growth.
“The major component that makes it not just a differentiated classroom but also an RtI
classroom is that, in addition to typical classroom assessment (both formative and summative),
the teacher keeps detailed records to monitor the progress of students who are struggling and
who may need more intensive Tier 2 support” (Allan, 2010). It is important in differentiation and
RtII that teachers keep detailed data on their students’ progress.
Guided Reading:
Guided reading has become an integral part of the elementary school classroom. “Guided
reading is a small-group instructional context in which a teacher supports each reader’s
development of systems of strategic actions for processing new texts at increasingly challenging
24
levels of difficulty” (Fountas & Pinnell, 2017). While teachers are increasingly implementing
guided reading, it is one part of the overall reading instruction in an effective language arts
lesson.
Fountas and Pinnell (2017) have outlined a variety of opportunities to engage with high
quality texts. The following list are some of the reading strategies they recommend:
● Interactive Read-Aloud promotes the joy of reading by using grade appropriate
texts that will expand vocabulary and the ability to think, talk, and write about the
text.
● Reading Minilessons provide explicit instruction that help students become
independent readers.
● Shared reading of texts allows students to learn how to construct meaning so they
can learn critical concepts of how texts work.
● Book Clubs provide an opportunity for students to discuss the self-selected books
they are reading.
● Independent Reading is an opportunity for students to read a large number of
books on their own with support of teacher conferences.
● Group Share brings the entire classroom together to discuss books they are
reading so they can share their reading experiences.
These strategies allow for students to be engaged in reading in a variety of manners in
order to reach each student. “Readers are actively engaged in the lesson as they learn how to take
words apart, flexibly and efficiently, while attending to the meaning of a text” (Fountas and
Pinnell, 2014).
25
Over time guided reading has shifted the teaching of reading to focus on an
understanding of how readers build effective processing systems and examine of the role of texts
and expert teaching in the process (Fountas and Pinnell, 2014). Guided reading lessons have a
common structure to them. Student guided reading groups are set up by combining students of
similar development in their reading skills based on the current data teachers have collected.
Fountas and Pinnell (2014) have developed a suggested structure to a guided reading
lesson:
● Appropriate text is selected for the students to support new learning for the group.
● Students are introduced to the text to scaffold the reading.
● Students then whisper read the entire text with the teacher providing instructional
support.
● Once the students have completed the text, the group discusses the text in order to
determine students’ comprehension.
● Students will engage in word work in order to increase their flexibility and word
analysis skills
● Finally, students will often engage in a writing activity in order to share and
extend their understanding.
“The ultimate goal of instruction is the enable readers to work their way through a text
independently, so all teaching is directed toward helping the individuals within the group build
systems of strategic actions that they initiate and control for themselves” (Fountas and Pinnell,
2017).
There is varied debate on instructional practices that have been employed throughout
time, but accelerated “reading instruction requires that the individual reader be able to process a
26
text with proficiency and, within a short time, take on the necessary understandings and
behaviors to process texts of similar difficulty independently” (Fountas and Pinnell, 2017).
Conferencing with students is a proven method of support for student independent reading.
However, individual instruction during conferencing is difficult due to time requirements for
instruction. “Guided reading is now considered by many to be a best practice and an effective
model of reading instruction” (Hansen, 2016).
Differentiation of classroom instruction becomes important when looking at the structure
of guided reading. Differentiation is vital for the modern-day classroom due to an increasingly
diverse student population and teachers who need to reach every learner but have a limited
amount of time to do so (Hansen, 2016). “The theory behind guided reading is anchored in the
importance of differentiation, the use of the student’s previous knowledge, the importance of
social interaction while learning, and the teaching of strategies within the context of actual
reading” (Hansen, 2016).
Guided reading lessons are to be structured with the teacher’s understanding of the
students, the texts, and teaching strategies to promote student growth in reading. “The better you
know the students in your class, the more effective and the more responsive you will be as a
teacher of reading” (Fountas and Pinnell, 2017). Through observation and discussion, teachers
can get evidence of student understanding of texts.
Another successful part of reading instruction is knowledge of texts. “The first step in
preparing for a guided reading lesson is to read the text yourself and think about the
characteristics” (Fountas and Pinnell, 2017). Pre-reading of texts allows teachers to determine
the sentence complexity, the words, and their meanings. Teaching strategies should be varied
throughout the lesson to meet student needs. “The real key to helping the readers take control of
27
the problem solving is the language that you use to support the reader’s learning across the
lessons” (Fountas and Pinnell, 2017).
With guided reading teachers take on a facilitator role. “Guided reading is set up so that
the teacher knows what the student knows, what they need to continue to work on, and what they
will be learning in the near future” (Hansen, 2016). Teachers act as guides who assist students in
constructing their own mastery of skills. “The lesson is highly structured and organized to
support learning; however, your teaching interactions with students depends on their responses
and the goals you see as important for them” (Fountas and Pinnell, 2017).
Students should be taught the guided reading lesson procedures so that routines are
automatic and lesson management is at a minimum and there is instructional time for learning
conversations (Fountas and Pinnell, 2017). Throughout the lessons, teachers vary their
interactions to engage students in inquiry, problem solving, and the like. “The better you know
your students and the more thoroughly you analyze the text, the easier it will be to plan your
guided reading lessons” (Fountas and Pinnell, 2017).
There are two different types of assessments utilized by teachers for guided reading
instruction. Fountas and Pinnell (2017) have labeled these assessments as interval and
continuous. Interval assessments use standardized assessment to help determine beginning
reading levels to form a profile of each student. These can be formative and summative
assessments that are part of the formal reporting system that is required in schools to document
change in achievement. Continuous assessments gather data to provide individual progress over
weeks of time throughout the year. These formative assessments also help assess the impact of
teaching on a day to day basis.
28
Fountas and Pinnell Classroom:
The Fountas and Pinnell Classroom (FPC), created by Irene Fountas and Gay Su Pinnell,
is a comprehensive program that focuses on the importance of leveled text and guided reading
instruction. “Fountas & Pinnell Classroom™ (FPC) is designed to support whole-group, smallgroup, and independent learning opportunities including: interactive read-aloud,
reading minilessons, shared reading, phonics, spelling, and word study, guided reading, book
clubs, and independent reading” (Fountas & Pinnell, 2018).
FPC is designed to engage students in many different types, and levels, of text in order to
increase their reading fluency and comprehension. Fountas and Pinnell have spent more than
twenty-five years researching literacy instruction. “All of Fountas and Pinnell’s curriculum
systems were developed from this research and are intricately connected to and complement one
another for true instructional coherence” (Fountas & Pinnell, 2018).
Throughout their research, Fountas and Pinnell have worked to develop a comprehensive
classroom instructional tool. “Fountas and Pinnell have identified six underpinning principles for
effective classroom literacy instruction for all students in grades PreK-6” (Fountas & Pinnell,
2018). The following is a brief summary of each principle from A Summary of the Research Base
for FOUNTAS & PINNELL CLASSROOM™ (2018):
1. Instructional Coherence: Each instructional strategy of PFC is designed to be part
of a coherent system to improve student performance. “When everyone in the
school uses the same literacy tools language as they move from observation to
instruction, a common conversation occurs.”
2. Responsive Teaching: FPC provides teachers with the opportunity to collect data
and observations to make relevant instructional decisions for students. “Regular
29
assessment is integrated into each context so teachers can meet students where
they are and move them forward.”
3. Multi-Text Approach: “Books, lots of authentic books, are at the heart of Fountas
& Pinnell Classroom™: exciting books to stir imagination; challenging books to
lift every reader; and diverse books to expand readers’ knowledge of the world.”
As FPC has been developed, books were carefully written and selected by
Fountas and Pinnell to promote student reading, expand vocabulary, and provide
students with the skills to think about, talk about, and write about different texts.
4. Student Inquiry: Since elementary students are naturally curious, FPC allow
students to participate in authentic learning. “As children think across texts, they
pursue lines of inquiry that interest and engage them as learners and build
knowledge of different topics and themes across a range of disciplines.”
5. Language-Based: Many of the instructional strategies that are found in FPC
provides students with an opportunity to discuss the texts they are exposed to in a
variety of ways. “This kind of talk structure allows students to share their
thinking, to learn the thinking of others, and to refine and sharpen their ideas,
which in turn enriches whole-class discussion.”
6. Teacher Expertise: “The FPC system is designed to create a sense of community
among teachers who are concerned not only about what students learn but also
about how and why they learn.” Teachers collaborate using FPC and its
instructional strategies in order to create a climate of community in the school.
30
FPC requires teachers to make a dramatic shift in their instructional practices. Teachers
are always collecting data and adjusting their instruction not only from marking period to
marking period, but day to day.
At the core of FPC is the use of small group instruction in the form of guided reading
based on data collected from the Benchmark Assessment Survey (BAS). “The Fountas and
Pinnell Benchmark Assessment System, created by Irene Fountas and Gay Su Pinnell, is
designed to place students appropriately into a guided reading program, show the gains in
student achievement, progress monitoring and identify students in need of intervention” (U.K.
Essays, 2018). The BAS system is a three-part assessment that should be completed at the end of
every marking period should be given to all students in kindergarten through fifth grade.
The first component of the BAS is a reading prompt that the teacher records data from.
“The test consists primarily of running records, in which the teacher records oral fluency, reading
errors and self-correction ratios” (U.K. Essays, 2018). The running record is followed by a
student-teachers conversation about the text the student has just read. This conversation provides
data on the student’s comprehension of the text. Finally, there is a writing prompt that can be
given to the student to complete.
The BAS assessment allows a teacher “to determine your students’ independent and
instructional reading levels, group students for reading instruction, select texts that will be
productive for a student’s instruction, assess the outcomes of teaching, assess a new student’s
reading level for independent reading and instruction, identify students who need intervention
and extra help, document student progress across a school year and across grade levels, create
class profiles and inform parents” (U.K. Essays, 2018)
31
FPC is a responsive teaching model that relies on a multitude of text that is leveled
according to reading and grade levels. “Leveled Literacy Intervention (LLI) is a short-term,
supplementary, small-group literacy intervention designed to help struggling readers achieve
grade-level competency” (US Department of Education, 2017). The best way to help students in
their growth is through small group instruction. “Small groups allow educators to meet all
students where they are academically whether it be to enrich what they have already learned,
reteach comprehension and decoding strategies, or pull them back a few grade levels to help
close the gap between the low students and their peers” (Odell, 2012).
This is where LLI is added as an instructional tool for teachers. “Teachers can use LLI to
match students to books that they can read without difficulty (referred to as “student’s
independent level” by the developer) and to books that provide more challenging text (referred to
as “student’s instructional level”)” (US Department of Education, 2017).
“Research suggests that children with poor early reading skills continue to struggle with
reading and writing in the later grades, and are more likely to drop out of school” (Waldera,
2017). It is critical that schools provide interventions for students who are identified as
struggling readers in primary elementary grade levels. Research has shown that students who are
not reading at grade level by third grade will “often falter in the later grades and drop out before
earning a high school diploma” (Waldera, 2017).
Many times, the students who struggle the most come from homes experiencing poverty.
It is crucial that reading intervention occur in primary grades when students are acquiring
literacy skills. FPC has research that suggests Fountas and Pinnell’s LLI is effective at
supporting students so that they can reach grade level appropriate reading expectations before
they develop long term reading deficiencies and academic issues (Waldera, 2017).
32
“The objective of LLI is to accelerate struggling readers so that they may quickly close
the gap between their personal reading achievement and their expected reading level” (Odell,
2012). LLI lessons are fast paced and structured with routines that students learn and follow.
“The structure and predictability of the lessons help students to feel comfortable in their
learning” (Odell, 2012). Each lesson has a similar structure to them. “Lessons include rereading
books from the previous day, assessing reading comprehension, instructing on phonics and
letters, assigning a writing task about the book that was read, and reading a new book” (US
Department of Education, 2017).
One advantage to the LLI lessons is the school to home connection. “LLI has a strong
home-school connection providing students with take home books to read with their families as
well as word work and response activities to do during independent work time in class or as
homework” (Odell, 2012).
LLI has had mixed reviews from teachers utilizing the program. LLI lessons are designed
for three to four students for thirty minutes a day. “It is hard to find effective and highly
educational literacy activities for the other students to do in the classroom while the teacher is
meeting with the LLI group” (Odell, 2012). This is one of the biggest drawbacks to LLI.
Scheduling the classroom instructional time is difficult with LLI. If a teacher is to meet with four
or five groups each day, then there will be two or more hours for guided reading instruction
alone. However, teachers have identified positives to the LLI system. “LLI has also been praised
for creating a solid home-school literacy connection, being highly motivating, and for
incorporating the familiar read with the lessons every day in addition to the instructional text
levels” (Odell, 2012).
33
FPC is a literacy teaching structure that has been researched and proven to be effective
with all levels of students. Students who are exposed to multiple types of text and express their
reading and understanding of text in multiple ways have proven to show growth and success in
their literacy skills. Fountas and Pinnell have provided educators with instructional strategies that
allow for differentiated lessons and guided reading practices to be built into the structure of the
day.
Multi-Tiered System of Supports:
Multi-Tiered System of Support (MTSS) is an intervention system that identifies students
who are struggling with academics and/or behaviors. “MTSS can be defined as ‘‘an evidencebased model of education that employs data-based problem-solving techniques to integrate
academic and behavioral instruction and intervention’’ (Eagle, Eagle, Snyder, Holtzman, 2015).
In many cases academic and behavior issues are often found to go hand in hand. MTSS is the
combination of Response to Intervention (RtI) and Positive Behavioral Intervention and Supports
(PBIS). “MTSS targets improvement in academic and behavioral outcomes for all students and
stresses the importance of implementation fidelity and leadership capacity” (Freeman, Sugai,
Simonsen, Everett, 2017)
There are several features of the MTSS framework that are important in its
implementation and sustainability. Jennifer Freeman, George Sugai, Brandi Simonsen, and
Susannah Everett authored MTSS Coaching: Bridging Knowing and Doing (2017) where they
provided three core features of MTSS. The first core feature is that decisions are based on data
that comes from universal screening, continued progress monitoring, and implementation
fidelity. The second feature is that evidence-based practices are supported, aligned to student
34
needs, and are contextually relevant. The third feature is that support systems used in MTSS are
implemented with fidelity.
“Decisions relative to data, practices, and systems are strategically focused on
maximizing the academic and behavioral success of all students, and the opportunity for more
intensive and individualized supports is formalized within the continuum of support and based
on student performance” (Freeman, et al., 2017).
MTSS framework is viewed as a three-tiered system. Tier 1 is the level of MTSS that all
students are exposed to, otherwise known as the core program and is generally thought of as
general education, where students receive instruction from a classroom teacher (L. Fuchs,
personal communication, 2015). Tier 2 is the intervention level. Interventions typically occurs in
small groups with a research validated program (L. Fuchs, personal communication, 2015).
Finally, there is Tier 3 which is the most intensive level of intervention. In most cases the
instruction at Tier 3 is delivered using special education services. “Whether what’s special
education versus general education, the key distinction should be the level of intensity, or
individualization that occurs at the three different levels of instruction. That said, sometimes
schools have more than 3 tiers” (L. Fuchs, personal communication, 2015).
The MTSS framework has several challenges in its implementation. MTSS requires that
schools not only collect benchmark data, but they must also collect progress monitoring data
regularly. In an interview in 2015, Joe Jenkins discussed the struggles that most schools face in
using the data they collect. “I think schools have a harder time using, [or] maximizing the use of
the progress monitoring data. [Using the data], it requires analysis, it requires making changes
off them that are problematic for teachers, because they, if they, try to make an adjustment that is
appropriate for some members of their group that actually needs a change, some kind of change,
35
some members of the group may not need the change” (J. Jenkins, personal communication,
2015).
Not only do teachers struggle with making the necessary changes for students, they
struggle with the time constraints of the school day. “Constraints in the schools with time,
resources, and often it’s really a mistake to underestimate the burden that teachers face
individualizing instruction” (J. Jenkins, personal communication, 2015). There is a lot of
planning required with MTSS, which is why MTSS requires a team to aid teachers in their
instructional decisions.
Individualized Professional Learning:
Professional development (PD) has been a part of education for many decades. It is
important that educators continue their learning in the profession. In general, there has been “the
strange atmospheric mix of bored resignation, eagerness for something new and fresh, and
cynical amusement that pervades these gatherings” (Jones, 2018).
Typical professional development has one of two effects on most teachers. On the
positive side, “PD sessions can renew our level of energy, stock a toolset of strategies, and
motivate us to be better teachers than we were yesterday” (Jones, 2018). However, a lot of PD
opportunities for professional staff just turn into a negative experience that make staff feel they
have wasted the past few hours.
Professional development has been making a transition to what is known as professional
learning (PL). PL has brought a new wave of ways in which teachers can access the learning.
“Not only will offering a variety of formats allow more teachers to attend, it could impact how
meaningful the session is for teachers” (Jones, 2018). PL also has to be planned in a different
36
manner. PL sessions are often structured like a lesson plan. “The biggest difference in planning
for adult learning versus planning classroom lessons is that adults have somewhat different needs
that affect their engagement” (Jones, 2018)
Teachers already know the level of support they need for new strategies and also need
opportunities to develop ways to immediately apply the strategies. Armed with this information,
the Bellefonte Area School District (BASD) looked to make professional learning a priority in
the district. The BASD has changed and re-energized the professional learning process for the
staff of the district.
For many years the district followed the same professional development format that many
districts use, one presentation for all. The staff would be divided for the day based upon the level
at which they taught. The professional development that was then presented would have a focus
directed at the classroom teachers. The interventionists and specials teachers would participate,
but not be engaged. Professional development within the district had lost its effectiveness and
many felt that the system that was being utilized just did not meet the teachers’ needs. This
began the shift to what is now referred to as Professional Learning.
The name change to professional learning was the first in many changes to the system.
The next change came in empowering the staff with great input into what learning was going to
be offered. This began by establishing a professional learning committee made up of teachers
and administrators from all levels across the district. This group began by organizing the format
of the professional learning day.
Professional learning in the district now offers staff as many as four learning sessions a
day that are between sixty and seventy-five minutes long. Each of the learning sessions have
between ten and fifteen different learning options for the participants to sign up and attend. This
37
allows the staff to attend sessions that they feel will best meet their needs. Another key change to
the professional learning in the district is that the sessions are designed and delivered by not only
administrators, but also the professional teaching staff. Teachers provide their fellow staff
members with the teaching strategies they are using in the classrooms. They will also provide
sessions on the learning they bring back to the district from conferences that are attended.
The changes to the district’s professional learning program has greatly increased the
staff’s participation in these days. The staff is encouraged to develop a focus for their
professional learning for the year. This is where the findings of this capstone project will be
presented to the teachers of the district. Sessions will be offered to the primary teachers of the
district on the strategies that have been identified to show growth in student learning. There will
also be an increase in professional learning sessions on data analysis strategies and protocols to
be used in the district. The more consistency utilized for data analysis, the better the schools will
be able to differentiate for students.
Data analysis is something that is often spoken of in elementary schools, but it is
something that is not done with consistent protocols. Teachers are currently using student
AimswebPlus and running record data, but they tend to provide interventions that are good for
the majority of students. A researched based data analysis program that is often utilized at the
elementary level is the Multi-Tiered System of Supports (MTSS) which was discussed in the
literature review. MTSS is the next intervention system that is needed in Bellefonte to support
teachers and aid students in their learning.
38
Chapter III
Methodology
The goal of the action research Capstone Project is to identify teaching strategies that are
improving student reading fluency and reading comprehension. The Capstone Project focuses on
determining classrooms that are demonstrating student growth in reading fluency and
comprehension. Once classrooms are identified, the research will cross-reference the quantitative
data results with the qualitative data that is collected from the teachers. The goal is to identify
instructional strategies being employed in the school district that can be utilized across all
schools to improve reading skills. This methodology discusses the purpose for the study, as well
as the setting and participants. It also reviews the research plan, methods of data collection, and
validity of the action research project.
Purpose:
The purpose of this Capstone Project is to identify learning activities that are being
utilized in the school district that are benefiting students. As previously stated, the Bellefonte
Area School District has shown little to no growth in the language arts scores on state mandated
assessments. Although these assessments do not communicate the complete picture of our
students, they are used to develop the yearly Future Ready Index report card for each school in
Pennsylvania. Students in school districts across the state must acquire reading fluency and
reading comprehension skills prior to entering third grade, which is when Pennsylvania state
assessments begin. The acquisition of reading skills represents a critical stepping stone in the
primary grades of elementary school.
39
The Capstone Project research is based on four research questions. The research
questions are as follows:
1. What are the factors that are leading to the district’s struggle with low growth in ELA for
our students?
2. What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
3. What external factors are present that can aid the students in their ELA growth or hinder
their progress?
4. What professional learning opportunities do teachers need to ensure more consistent use
of data protocols and appropriate intervention strategies?
The Capstone Project research data analysis will identify reading instructional strategies that are
being utilized in the elementary schools across the district. By cross referencing the student
quantitative data and the teachers’ qualitative survey responses, the data may reveal instructional
strategies that demonstrate student growth in reading fluency and comprehension skills.
Across the district the teachers of language arts are utilizing the Fountas and Pinnell
Classroom (FPC) program. FPC is a program that emphasizes a responsive teaching model for
classroom instruction. In a responsive teaching model, daily instruction is formulated based on
the learning needs of the students. Instruction is provided using both whole and small group
instruction. Teachers are able to utilize whole group instruction, but the majority of the language
arts block is taught using small group instruction. Teachers using FPC are to regularly examine
student data to identify learning goals for each student. The teachers are to then design lessons to
provide instruction to students to meet the set learning goals.
40
The research methods that will be used in the Capstone Project include both quantitative
and qualitative data analysis. Quantitative data will be collected from second-grade students in
the elementary schools across the district. The data being analyzed is AimswebPlus and running
records from the students’ kindergarten, first, and second grade years. The analysis of this data
may identify groups of students who are showing average to above average growth in their
reading fluency and reading comprehension skills. The data analysis may also allow the
identification of teachers who are teaching these groups of students. Qualitative data will be
collected via a survey of the primary teachers across the district. The quantitative and qualitative
data will be cross-referenced to identify classrooms showing growth. Once the classrooms are
identified, the instructional strategies utilized can be identified. Professional learning will be
offered to all professional staff on how these strategies are implemented as part of classroom
instruction.
Setting and Participants:
The Bellefonte Area School District is located in Centre County, Pennsylvania and is
considered a rural school district. The school district has one high school (grades 9 – 12), one
middle school (grades 6 – 8), and four elementary schools (grades K – 5). The district also is a
partner school with the Central PA Institute of Science and Technology (CPI). Bellefonte has the
highest student enrollment of member districts, which accounts for 48% of the enrollment of
CPI.
Bellefonte educates students from approximately 117 square miles and has an enrollment
of approximately 2600 students. Bellefonte does not have a diverse ethnic population as about
41
94% of the students are white. Approximately 30% of the students are economically
disadvantaged and 17% of the student population qualifies for special education services.
There are four elementary schools in the Bellefonte School District. The demographics of
the schools are as follows:
1. Bellefonte Elementary has an approximate enrollment of 340 students. The economically
disadvantaged rate is forty-eight percent and the special education enrollment of twentyone percent. The school’s ethnicity is broken down as follows: eighty-eight percent
white, six percent hispanic, and two and a half percent black. Bellefonte Elementary
qualifies as a Title 1 School.
2. Benner Elementary School’s enrollment is approximately 230 students. Benner differs
from Bellefonte with an economically disadvantaged rate of twenty-one percent and a
special education enrollment of eleven percent. The school’s ethnicity breakdown is
ninety-six percent white, one- and one-half percent Asian, and one percent black.
3. The student enrollment at Marion Walker Elementary School is approximately 360. This
school has the lowest economically disadvantaged student population at fifteen percent
and fourteen percent of the students qualify for special education services. Marion
Walker’s ethnic breakdown is ninety-six percent white and two percent Hispanic.
4. Pleasant Gap Elementary School is the smallest school in the district with an enrollment
of about 210 students. Forty percent of the students come from economically
disadvantaged homes and twenty percent of the students qualify for special education
services. Pleasant Gap also has the highest English Language Learner enrollment, with
over five percent of the students qualifying. The ethnic make-up of the school is ninety-
42
five percent white, three percent of two of more races, and two percent Hispanic. Pleasant
Gap Elementary also qualifies as a Title 1 school in the district.
The district has two elementary schools that receive Title 1 Federal funds, Bellefonte and
Pleasant Gap. Title 1 schools are identified by having a high population of low-income families.
These funds are utilized by the district to support programs that aid students in meeting content
and performance standards. The funds can be used to support students in language arts or
mathematics. The district uses a targeted assisted program in providing Title 1 services to
students that are the most at-risk academically in reading. Targeted assistance is a system that
begins by identifying students eligible for services. The primary targeted students are in first
grade with kindergarten and second grade students added as schedules allow. In some cases,
third grade students receive Title 1 services at Bellefonte. Once students are identified for Title 1
services, learning groups are formed in order to provide instruction to students with similar areas
of need. Instruction is provided in a pull-out program. The district utilizes a researched based
instructional program that helps to strengthen the established language arts curriculum and the
Fountas and Pinnell program utilized in the classrooms.
The teaching demographics of the district are varied as well. Each school has a varied
population, but there are typically two to three regular education teachers per grade level.
Bellefonte Elementary employs three reading specialist teachers while each of the other
elementary schools employs one reading specialist. Bellefonte utilizes the instructional expertise
of three special education teachers and is the site that hosts the elementary autistic support
classroom, while Marion Walker and Pleasant Gap each have two special education teachers.
Pleasant Gap also hosts the district’s elementary life skills classroom. Benner Elementary has
one special education teacher. Bellefonte and Marion Walker also share a math intervention
43
teacher to aid students in grade 3, 4, and 5 with math instruction. Benner and Pleasant Gap do
not have access to math intervention services for students.
The instructional setting for each elementary school is similar. Teachers in kindergarten,
first, second, and third grades are responsible for instruction in the areas of language arts,
writing, math, and science/social studies. Four years ago, the teachers in grades four and five
departmentalized. The departmentalized grade levels have one teacher responsible for language
arts, one responsible for math instruction, and one responsible for science/social studies and
writing. In the small buildings, a language arts teacher may also provide instruction for writing
and the math teacher provides instruction for science/social studies.
While the racial and ethnic diversity is limited in the district, the socio-economic
diversity is very large. Bellefonte and Pleasant Gap Elementary schools have historically had
high rates of economic disadvantaged students. Both elementary schools have several sections of
low-income housing in their school regions. Unfortunately, the trend appears to be that the
families of our economically disadvantaged students rarely provide the necessary support for
students leading up to, and while, attending school.
The economically disadvantaged students often enter school with little or no pre-school
experiences. Many of these students are not only learning letters and numbers for the first time,
but they are also learning how to socially interact with many other same aged peers. The schools
find that the teachers in the primary grades spend as much time teaching appropriate behaviors as
they do letter sounds. Those students who begin school not having preschool experience are at a
disadvantage when compared to their peers. The district strives to implement reading services;
however, a variety of challenges exist. Many students lack the necessary parental support to
encourage their learning. These students often also come from low socioeconomic families, who
44
are often struggling in many areas so education is often a lower priority. The parents’ perception
of school can also be a hindrance to a student’s growth. If a parent did not have a good school
experience he, or she, are less likely to support the education process at home. The more
effectively the district can identify and remedy student weaknesses, the more readily students can
develop into fluent readers.
Interventions/Research Plan:
The research plan for this Capstone Project involves the collection of quantitative and
qualitative data. The researcher started by contacting the superintendent of the Bellefonte Area
School District to receive permission to conduct research. The superintendent approved the
collection of AimswebPlus, running record, and survey data from the teachers. The researcher
utilized the services of the district language arts coach to assemble data from the 2017-2018,
2018-2019, and 2019-2020 school years.
The Capstone Project is focused upon the growth in reading fluency, reading
comprehension, reading levels for the district’s second grade students. The data collected will
come from the students’ kindergarten, first, and second grade years. The school district collects
data from reading fluency and comprehension assessments three times a year. The first round of
data is collected in early September, right after the start of the school year. Data is collected from
all elementary students, kindergarten through fifth grade. This provides teachers with baseline
data that will allow the staff to begin to plan and organize lessons. Students are divided into
reading groups based on their data points. The second round of data collection comes in January
at the middle of the school year. Again, data is collected from each student at the elementary
level. Teachers are able to utilize data to determine growth in their students. The final time data
45
is collected on each student occurs in May, at the end of the school year. This is data that is used
to determine student growth throughout the year. Teachers will utilize this data as part of their
student learning objective plans required in Pennsylvania. The end of year data is also used to
determine student regression over the summer after the students are assessed the next school
year.
The researcher will utilize the data collected from all four elementary schools within the
district. Analyzing the AimswebPlus and Fountas and Pinnell Classroom Benchmark Assessment
data will begin by compiling the data for each school year into one spreadsheet. This will be
done by looking at the growth reading levels of each student from the beginning of year
assessments, through the mid-year, and then the end of year assessments. The data points that
will be used are from the students’ kindergarten, first, and second grade year. The second-grade
data will only include beginning and mid-year assessment data due to the school closure for the
COVID-19 virus pandemic.
The researcher will start by randomly assigning a student number to each student in the
second grade for the 2019-2020 school year. The numbering system includes a building
identifier, which is the first two numbers. Each student will be identified using the third and
fourth numbers. The classroom identifier will be the last number. This will be comprised of three
numbers to represent the kindergarten, first grade, and second grade teachers. The following are
examples of the numbering system to be used: Bellefonte Elementary: 2101123; Benner
Elementary: 2201121; Marion Walker Elementary: 2301132; Pleasant Gap Elementary:
2601111. This number system will allow for the cross-referencing of students and elementary
classrooms they participated in.
46
The next step for the researcher will be to organize the data according to reading data
from the district. The reading fluency data will be organized using the Fountas and Pinnell BAS
data and the AimswebPlus data. Spreadsheets are being established that will include the
following data points:
1. Student Number - This will be organized based on the previously explained numbering
process.
2. Beginning, Middle, and End of Year BAS Reading Data:
a. Highest Instructional Level – This is the level at which students are able to read at
their own independent level.
b. Accuracy – The accuracy score represents the number of words read correctly in
the story. This is calculated by the number of words read correctly divided by the
total number of words.
c. Comprehension Score – The score is based off of a rubric established by Fountas
and Pinnell.
d. Fluency Rubric Score – Fluency scores are also based on a rubric developed by
Fountas and Pinnell.
e. Growth – The growth of a student is determined by counting the number of levels
the student has improved in their instructional levels.
f. Annual Growth – This is the growth of a student throughout the entire school
year.
3. AimswebPlus Composite Score – The composite score from AimswebPlus is developed
by using several probes. The probes are given and scores compiled to produce a
47
composite score for each student. The probes required to have AimswebPlus calculate a
composite score is as follows:
a. Kindergarten – Letter Naming Fluency, Letter Word Sounds Fluency, and
Vocabulary.
b. First Grade – Word Reading Fluency, Nonsense Word Fluency, and Oral Reading
Fluency.
c. Second Grade – Oral Reading Fluency, Reading Comprehension, and Vocabulary.
4. AimswebPlus Risk – This identifies the level of at risk the student is in comparison to
other students at their grade level. The risk level is based on a percentile ranging from 1
to 99. The following levels are used in the AimswebPlus scale:
a. Well-Below Average: 1st – 10th Percentile, color coded in orange; will be coded
as a “0”.
b. Below Average: 11th – 25th Percentile; color coded in yellow; will be coded as a
“1”.
c. Average: 26th – 74th Percentile; color coded in green; will be coded as a “2”.
d. Above Average: 75th – 89th Percentile; color coded in aqua; will be coded as a
“3”.
e. Well-Above Average: 90th-99th Percentile; color coded in blue; will be coded as a
“4”.
5. Grade Level – Grade level data points are utilized to determine if the student is reading
on grade level by the end of the school year. A “0” is assigned if the student is not on
grade level; a “1” is assigned if the student is on grade level; a “2” is assigned if a student
is above grade level.
48
6. Gender – If the student is a female, she will be assigned a “1”. If the student is a male, he
will be assigned a “2”.
7. Socio-economic Status – The socio-economic status of a student will be determined by
whether or not the student qualifies for the free and/or reduced lunch program. The
student will be assigned a “0” if they do not qualify or a “1” if they do qualify.
Each of these data points provides the researcher with multiple ways to analyze the data in order
to determine trends from the data on which schools and which classrooms are helping students
grow in their reading skills and abilities.
Once the students are identified as demonstrating significant growth in reading fluency,
reading comprehension, and reading levels the researcher will cross-reference the data against
the classroom data collected qualitatively from teachers. By cross-referencing the data, the
researcher will identify the instructional strategies the teachers are utilizing to achieve student
growth. The reading fluency and reading comprehension instructional strategies will be listed
and categorized for future reference and professional learning.
Once the data analysis is concluded, the researcher should be able to provide answers to
the following research questions:
•
What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
•
What professional learning opportunities do teachers need to ensure more consistent use
of data protocols and appropriate intervention strategies?
The end result of the research plan is to create a catalog of instructional strategies that are
research based and effectively utilized across the district.
49
Methods of Data Collection:
The methodology used for the Capstone Research Project involves a mixed methods
action research process. Quantitative and qualitative data were collected and analyzed. The
quantitative data included AimswebPlus student data and Fountas and Pinnell Classroom (FPC)
Benchmark Assessment Systems (BAS) data. BAS assessments were administered to students to
determine their independent and instructional reading levels. The BAS and AimswebPlus data
have been collected three times a year for elementary students. Qualitative data was collected
using a survey that was given to all primary teachers (kindergarten, first, and second grades).
Data collected using the AimswebPlus software program helps the district identify
students who could be eligible for reading support services. AimswebPlus assessments are
nationally normed assessments that identify students’ reading fluency and reading
comprehension levels. AimswebPlus is also a data management and reporting system that can be
a valuable resource for districts. AimswebPlus collects two different types of assessment data:
curriculum-based measures (CBMs) and standards-based assessments (SBAs). AimswebPlus is
also be used as a progress monitoring tool for students receiving tiered interventions.
In Bellefonte Area School District, this set of assessments is given to all students from
kindergarten through fifth grades in all elementary schools. AimswebPlus assessments are also
used as a progress monitoring tool for students who receive special education services. Using
AimswebPlus in this manner allows for an abundance of data to be collected. AimswebPlus data
will serve as one component of the quantitative data that will be analyzed for the Capstone
Project.
The second set of quantitative data that will be utilized includes the running record data
collected by the teacher. This data is routinely collected at least three times a year and is used in
50
the eligibility criteria for reading support services. The reading support services can include
classroom targeted interventions, Title 1, and possible learning support. In the FPC program,
running record data is collected using the Benchmark Assessment System (BAS). In the BAS
process, students are given a passage to read and the teacher records data based on the student’s
reading of the passage. The passage is followed by student-teacher conversation about the text.
This conversation provides the teachers with data regarding the student’s ability to comprehend
different types of literature. Teachers use the BAS assessments to identify students’ independent
and instructional reading levels. A student independent reading level can be defined by the
reader identifying a majority of the words and can comprehending what he or she have read. An
instructional reading level is one that is challenging for the student to both read and comprehend.
The analysis of the quantitative data will provide information regarding student growth.
The research will include analysis of the kindergarten data and identification of students with the
average to above average reading growth. The second stage of analysis will be completed on the
students’ first grade year data. Finally, the research will analyze the second-grade data of each
student. The data will then be cross-referenced to identify groups of students who are showing
average to above average reading growth. The goal is to identify the classrooms these students
were enrolled. Once the classrooms are identified, the researcher utilized qualitative data.
The Capstone Project will also include qualitative data. Qualitative data is being collected
using a survey that district teachers completed. Appendix E illustrates the survey that was
created and completed by the teachers. The survey was intended to collect data on the
instructional strategies being utilized in the classrooms across the district. Information was also
collected regarding the frequency in which teachers collect and analyze student data. The survey
51
also collected the use of FPC instructional strategies being used in the classrooms, as well as the
intervention strategies teachers are employing.
The qualitative data collected was cross-referenced with the quantitative data in order to
identify instructional strategies and interventions that support student growth in reading fluency
and comprehension. The researcher is also analyzing how many classrooms in which those
instructional strategies and interventions were being used. Throughout the district there are many
researched based instructional strategies being utilized, but many of them are not shared.
Instructional strategies that have been researched in the Capstone Project will then be applied
across all elementary schools through professional learning.
The research that was conducted for this Capstone Research Project will have some fiscal
impact on the school district. Professional learning can be provided to the primary teachers
through peer presentations. Additional funds will be spent on the preparation of the professional
learning. There will also need to be professional learning provided in the use of data for
informing instruction, which may be available through the local intermediate unit. If training is
not readily available, there may be a cost of $5,000.00 to $10,000.00 for a presenter to come to
the district.
The biggest cost to the district will come from the implementation of a Multi-Tier System
of Supports (MTSS). Implementation will require professional learning for staff. A MTSS coach
will need to be trained on the process and data analysis. The professional learning is also going
to require trainers to come into the district to provide that professional learning. This
professional learning will require substitutes, presenters’ fees, and resource materials. The
district will also need to hire staff to implement the interventions. This will cause an increase in
52
salaries and benefits for the district. There will need to be adjustments made to the school day
and schedules. This could result in financial implications for future staff contracts.
Implementing a MTSS program at Bellefonte will also require some changes to how the
district provides interventions. Pleasant Gap Elementary has started researching the MTSS
process. Several staff members have received professional learning on MTSS and will be the
building leaders of the program. The goal of MTSS will be to have all students enter the middle
school at the same point in their learning. While this may not be one-hundred percent achievable,
MTSS will provide the students with instruction that is data driven and tailored to their specific
needs.
Validity:
The validity of the Capstone project is going to focus on increasing the rigor of the
research. “In general, rigor refers to the quality, validity, accuracy, and credibility of action
research and its findings” (Mertler, 2019). Since the Capstone Project is utilizing both
quantitative and qualitative data, the validity of the research needs to be multifaceted. This
Capstone Project is aiming to solidify the instructional practices across the district. In order to do
this, there needs to be a high level of rigor to help ensure the results are not biased. The rigor also
needs to be seen as not reflective of the researcher’s point of view.
Since the Capstone Project is utilizing a mixed method action research process, validity is
going to be mixed as well. For the qualitative data, the researcher will use evaluative validity
during the analysis. The researcher needs to report the findings and summary of the research in
an unbiased manner. The researcher will also need to not make judgments on the data that was
collected in the survey. The research will also use transferability as a validity check. The
53
researcher will need to ensure that the action research is not too generalized and that readers can
identify with the setting of the research. While many schools face the same struggles as
Bellefonte, the researcher needs to keep this setting in the forefront of the research.
It is important for the researcher to remember that “validity refers to the degree to which
evidence supports the inferences a researcher makes based on the data he or she has collected
using a particular instrument” (Mertler, 2019). The researcher wants to ensure that conclusions
drawn from the results of the analysis are validated, not the instruments used to collect the data.
The validity of the quantitative data collected from the FPC BAS and AimswebPlus assessments
can be determined using the five sources of validity.
Mertler identifies five sources of validity evidence. These sources of evidence are
outlined below (Mertler, 2019):
1. Evidence of Validity Based on Test Content: This type of evidence usually is a logical
analysis of the content covered on the assessments. Content evidence requires the
researcher to have item validity and sampling validity.
2. Evident of Validity Base on Response Processes: The researcher needs to look at
patterns of responses to reveal underlying characteristics of the participants. This could
be gender, race, socio-economic, or the like.
3. Evidence of Validity Based on Internal Structure: This evidence of validity focuses on
how assessment items relate to one another. The researcher looks at the items as a group,
not individually.
4. Evidence of Validity Based on Relation to Other Variables: By analyzing the
relationships between assessment scores and other assessments of similar constructs, the
researcher is able to validate the evidence. One type of coefficients used to validate this
54
evidence is called concurrent validity coefficients. The coefficient measures the
relationship between the scores on the assessment instruments administered at the same
time.
5. Evidence of Validity Based on Consequences of Testing: Testing should not have a
negative effect on the participants. Testing is usually completed with the understanding
that some benefit will come from the use of its data. Educators want positive change to
come from testing, not negative consequences.
The researcher will be using the evidence of validity based on relation to other variables to help
ensure the Capstone Project’s rigor. The use of AimswebPlus and Fountas and Pinnell BAS data
will help to ensure that the teacher scored BAS assessment data aligns with the nationally
normed AimswebPlus composite scores.
Rigor is going to be increased for the quantitative data through the triangulation.
Triangulation of data will allow the researcher to verify the data’s accuracy. The researcher is
utilizing multiple data points from the Fountas and Pinnell BAS and AimswebPlus programs. By
showing the same trends in the data analysis, triangulation is going to confirm the conclusions of
the researcher. Triangulation may also clarify misconceptions of the researcher.
A researcher’s ability to validate data and conclusions is key in any action research
project. This Capstone Project may provide the school district with an in-depth view of student
performance, student growth, and instructional practices being utilized. It is imperative that the
data collection, analysis, and summary be validated as they will be used to assist the district in
providing better reading instruction to the students. It is important to ensure validity in the action
research Capstone Project. Staff members cannot review the data and the analysis and feel there
is bias. In order to gain buy-in from staff, the research project must recognize and disclose any
55
limitations of the project. The goal is to develop conclusions that may be generalizable to
different situations across the district or even across the region.
56
Chapter IV
Results of Research
The primary goal of the Capstone Project is to focus on determining which primary grade
level classrooms that are demonstrating student growth in reading. Reading fluency and reading
comprehension are the two main areas of focus in determining a student’s reading level. After
the classrooms are identified, the researcher will cross-reference the data results with the
qualitative data that is collected from the teachers. The goal is to identify instructional strategies
being employed in the school district that can be utilized across all elementary schools to
improve reading skills of all students. The results section will identify the instructional strategies
the researcher determined to aide students in their reading growth by analyzing reading grade
level data and AimswebPlus reading assessment data.
Purpose:
The goal of the Capstone Project is to identify learning activities that are being utilized in
the school district that benefit students academically. As previously stated, the students of the
Bellefonte Area School District have shown little growth with language arts scores on state
mandated assessments. The third grade student scores on the state English/Language Arts
assessments make up a large part of the school’s overall performance score, the Future Ready
Index. It is important for students to be on grade level for reading expectations, and as such,
students need to have acquired reading fluency and reading comprehension skills prior to
entering third grade. The acquisition of these reading skills is critical during the primary grades
of elementary school.
57
The Capstone Project research is based on four research questions. The research
questions are as follows:
1. What are the factors that are leading to the district’s struggle with low growth in ELA for
our students?
2. What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
3. What external factors are present that can aid the students in their ELA growth or hinder
their progress?
4. What professional learning opportunities do teachers need to ensure more consistent use
of data protocols and appropriate intervention strategies?
Research data results will identify classrooms that are getting students to grade level reading
performance by utilizing instructional practices that benefit student learning. The grade level
reading performance and AimswebPlus composite scores are used in the district to determine a
student’s reading growth. Both assessments utilize reading fluency and reading comprehension
data to determine a student’s reading level and risk factor for not reaching grade level reading
performance.
Data Utilized for Analysis:
The data being utilized in the Capstone Research project is student grade level reading
performance data and AimswebPlus risk factor data. The Bellefonte Area School District
(BASD) uses the Fountas and Pinnell Classroom (FPC) BAS data to track student growth. This
data is running record data that has been collected on students for many years. BASD sets grade
58
level performance marks based upon the BAS data. Table 1 shows the instructional level
expectations for each grade level using the BAS from FPC.
Table 1:
Instructional Level Expectations for FPC
BOY- BAS
Q1
Q2
Q3
Q4
BASELINE
Grade
B and above C and above D and above E and above
A
K
Grade E and above
1
B
C
D
A
B
C
A
B and below
F and above H and above J and above K and above
D
E
G
H/I
J
C
D
E/F
G
H/I
B and below
C and below D and below F and below G and below
Grade K and above L and above M and above M and above N and above
2
J
K
L
L
M
H/I
I/J
K
K
L
G and below H and below J and below J and below K and below
Key
Exceeding Expectations Approaching Expectations
Meeting Expectation
Not Meeting Expectations
The researcher used this information to determine the growth of each student for the
Capstone Project. Each student was assigned a number based on the grade level expectation: 4 –
exceeding expectations; 3 – meeting expectations; 2 – approaching expectations; 1 – not meeting
expectations. Since each student’s grade level reading score utilizes reading fluency and reading
comprehension data, the researcher is able to identify students who have achieved or are
59
exceeding grade level expectations. The researcher is then able to identify the classrooms in
which these students participated. This will help to identify the reading instructional strategies
being used by those teachers.
The second set of data that is being utilized is the AimswebPlus reading data. As
previously stated, AimswebPlus is a nationally normed assessment that informs teachers which
students are at the high risk for not acquiring the necessary reading skills to meet grade level
expectations. Table 2 is an example of a report that is produced from the AimswebPlus
assessment software, the Benchmark Comparison Report.
Table 2:
AimswebPlus Benchmark Comparison Report Example
Report
Benchmark Comparison
Student (42)
Composite
Grade
2nd
VOC (VS)
Battery
Reading
RC (VS)
Period
Fall 2019
ORF
%ile
Score
Acc
%ile
Score
Acc
Score
Acc
Lexile
19
37
80%
95L
21%
3
10
67%
BR
111
21%
7
16
84%
5L
31
131
38%
62
81
89%
315L
56%
41
139
46%
63
82
95%
320L
88%
68
158
67%
66
86
100%
345L
Score
Risk
Student #1
240
High
5
110
25%
11
111
21%
Student #2
259
High
27
143
50%
11
111
Student #3
278
Mod
49
159
63%
11
Student #4
298
Mod
13
127
38%
Student #5
331
Low
37
151
Student #6
399
Low
96
198
%ile
The AimswebPlus composite score and risk level are determined utilizing oral reading fluency
and reading comprehension assessment data. Students were assigned a number based on their
risk level from the composite score: 3 – high risk level; 2 – moderate risk level; 1 – low risk
level. Students who have low risk levels on their AimswebPlus assessments are on track to meet
grade level reading expectations. Students who are considered to be in the high-risk level
60
category are in danger of not meeting grade level expectations. The AimswebPlus composite
score and risk level can also be linked to a classroom in which the student participated. This will
allow the researcher to identify classrooms meeting with success and the instructional strategies
being employed with students.
Data Analysis Test:
The data analysis test chosen for the Capstone Project is the chi-square test of
independence. “The chi-square test of independence – also used appropriately with nominal, or
categorical, data – is used to test the significance of a relationship between two categorical
variables” (Mertler, 2019). The primary goal of using this test is to see if the variables being
analyzed are independent of one another or not. In this Capstone Project the researcher is trying
to determine if there is an association between a teacher and student achievement in reading
levels. In order to do this, the researcher set up a hypothesis and an alternate hypothesis, often
referred to as the null hypothesis. The following hypotheses are being used by the researcher
with the chi-square test of independence:
HO: A student’s reading performance and classroom assignment are independent in
the primary grade levels.
HA: A student’s reading performance and classroom assignment are not independent in
the primary grade levels.
In utilizing the chi-square test, the researcher is determining a p-value which represents
the probability of obtaining statistical results as extreme as the observed results. The accepted pvalue in statistics is a p = .05, or 5%. If the statistical results are lower than a p-value of 5%, the
stronger the evidence supports the null hypothesis. The researcher will perform the chi-square
61
test of independence for each primary grade level: kindergarten, first, and second grades. Chisquare tests will be conducted for grade level reading performance and AimswebPlus risk level.
The researcher will also calculate standardized residuals for each primary grade level for
grade level reading performance and AimswebPlus risk level. Standardized residuals are the
difference between the observed values and the expected values. When using standardized
residuals, researchers commonly use a standard deviation range of -2 to +2. Any residual that
falls between these two numbers is considered to be normal and accepted. Any residual value
below -2 is considered extremely weak in performance since the observed values are less than
the expected values. Conversely, any value above +2 is considered extremely positive
performance since the observed values are greater than the expected values. The researcher will
utilize the data from the chi-square tests to determine if the hypothesis, or null hypothesis, is
found to be true.
Data Analysis Results:
The researcher began by selecting the research group of students; the second grade for the
2019-2020 school year. Student data was collected for each student’s kindergarten, first grade,
and second grade years. The researcher began by evaluating the kindergarten grade level data for
each student from the 2017-2018 school year. The data was compiled and then broken down by
the 12 teachers who were employed to teach kindergarten during that school year. All assessment
data utilized was the end of year data for each classroom assignment. Table 3 shows the grade
level reading expectations data for each teacher.
The data is organized into the observed number of students meeting grade level
expectations and the expected number of students. The data acquired for approaching and not-
62
meeting grade level expectations was combined due to the need for meeting the required number
of 5 in the sample. The chi-square test provided the researcher with the expected number of
students who should be meeting each grade level performance level.
Table 3:
2017-2018 Kindergarten Teacher Grade Level Reading Expectations
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
Exceeding
- Observed
5
10
14
11
7
4
6
5
3
10
9
4
Exceeding
- Expected
6.25
8.04
8.04
7.14
8.04
8.04
6.7
6.7
6.7
6.7
8.04
7.59
Meeting Observed
5
7
4
2
6
7
6
5
8
3
4
7
Meeting Expected
4.5
5.8
5.8
5.19
5.84
5.84
4.87
4.87
4.87
4.87
5.84
5.52
Approaching
/ Not
Meeting
Observed
4
1
0
3
5
7
3
5
4
2
5
6
Approaching
/ Not
Meeting
Expected
3.2
4.11
4.11
3.65
4.11
4.11
3.42
3.42
3.42
3.42
4.11
3.88
The calculated p-value for this data set is 4.67%. The p-value is less than 5% which indicates a
discrepancy in the data. The researcher has accepted the null hypothesis and determined that the
grade level reading level data is not independent of the classroom assignment.
The researcher then calculated the standardized residuals for the grade level reading data.
The standardized residuals are listed in Table 4. This data table shows that there are teachers who
are performing above average and students are meeting or exceeding grade level reading
expectations. There are also teachers who are struggling to have students reach grade level
expectations. One particular teacher to note is Teacher #3. This teacher has exceeding scores and
approaching/not meeting scores over +2. This teacher was able to have students reach and
exceed grade level reading expectations.
63
Table 4 also identifies teachers who are struggling to have students meet the grade level
reading expectations. Teachers #6 and #12 both have negative residuals over -1.0. The data is
showing that these teachers are struggling to have students exceed expectations and have too
many students approaching or not meeting expectations.
Table 4:
2017-2018 Kindergarten Teacher Grade Level Standardized Residuals
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
Exceeding
-0.500
0.691
2.102
1.445
-0.367
-1.425
-0.270
-0.657
-1.429
1.275
0.339
-1.303
Meeting
0.236
0.498
-0.747
-1.400
0.066
0.480
0.512
0.059
1.418
-0.847
-0.761
0.630
Approaching
/ Not
Meeting
-0.447
1.534
2.027
0.340
-0.439
-1.426
0.227
-0.854
-0.314
0.768
-0.439
-1.076
The next data table, Table 5, shows the AimswebPlus risk level data for each teacher who
taught kindergarten in 2017-2018. All assessment data utilized was the end of year data for each
classroom assignment. The researcher calculated the p-value to be 5.5%. The p-value is close
enough to 5% that they are going to accept the null hypothesis as the AimswebPlus data shows
the student scores and classroom assignment does not show independence. The data table also
shows there are more teachers showing positive results in AimswebPlus student performance.
Six teachers demonstrated better observed results than the calculated expected. These teachers
are having students present a lower risk of not meeting grade level reading expectations. There
are also two teachers who are not meeting their expected AimswebPlus scores.
64
Table 5:
2017-2018 Kindergarten Teacher AimswebPlus Risk Levels
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
High/Mod RiskObserved
3
4
1
1
7
3
5
1
1
0
5
5
High/Mod Risk Expected
2.55
3.27
3.27
2.91
3.27
3.27
2.91
2.73
2.73
2.73
3.27
3.09
Low Risk Observed
11
14
17
15
11
15
11
14
14
15
13
12
Low Risk Expected
11.45
14.73
14.73
13.09
14.73
14.73
13.09
12.27
12.27
12.27
14.73
13.91
Table 6:
2017-2018 Kindergarten Teacher AimswebPlus Standardized Residuals
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
High/Mod Risk
Level
-0.282
-0.404
1.255
1.120
-2.063
0.149
-1.225
1.047
1.047
1.652
-0.957
-1.087
Low Risk
Level
-0.133
-0.190
0.591
0.528
-0.972
0.070
-0.578
0.494
0.494
0.779
-0.451
-0.512
The Kindergarten AimswebPlus standardized residuals support the data analysis for each teacher.
The same teachers identified from Table 5 are showing positive results and the same two
teachers are not meeting their expected number for each risk category.
65
In evaluating the grade level reading expectations data and the AimswebPlus risk level
data, there are three teachers who are identified as excelling in getting students to grade level and
above. Three teachers show that their students are exceeded grade level reading expectations
and having the lowest AimswebPlus risk level for students. These teachers are utilizing reading
instructional strategies that are proving to have positive results for students. Their instructional
strategies need to be evaluated for district wide use.
In the next step in the data analysis process, the researcher performed the same chi-square
test of independence for the students from first grade during the 2018-2019 school year. The
students being analyzed are the same, but the teachers have changed. This is a school year that
also had 12 teachers for first grade across the district. At BASD first grade is the primary grade
in providing students with reading interventions through the district’s Title I services. As stated
before, Bellefonte Elementary and Pleasant Gap Elementary are identified as Title I schools at
BASD. The other two elementary schools do offer Title I services, but Bellefonte and Pleasant
Gap have priority in services.
The evaluation of the grade level expectation data for first grade has a calculated p-value
of 13.8%. In looking at the hypotheses that have been established, the chi-square test of
independence shows that the hypothesis is accepted: A student’s reading performance and
classroom assignment are independent in the first grade. In reviewing Table 7 and Table 8, there
are six teachers showing positive results and are getting students to meet and/or exceed grade
level reading expectations.
66
Table 7:
2018-2019 First Grade Teacher Grade Level Reading Expectations
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
Exceeding
Observed
5
6
3
7
7
8
7
8
8
5
4
4
Exceeding
- Expected
6.51
5.43
6.15
5.79
5.79
6.87
5.79
5.79
5.07
6.15
5.79
6.87
Meeting Observed
1
2
5
5
4
0
3
1
2
5
4
8
Meeting Expected
3.62
3.02
3.42
3.22
3.22
3.82
3.22
3.22
2.81
3.42
3.2
3.8
Approaching
/ Not
Meeting
Observed
12
7
9
4
5
11
6
7
4
7
8
7
Approaching
/ Not
Meeting
Expected
7.87
6.56
7.43
6.99
6.99
8.31
6.99
6.99
6.12
7.43
6.99
8.306
Table 8:
2018-2019 First Grade Teacher Grade Level Standardized Residuals
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
Exceeding
-0.592
0.245
-1.270
0.503
0.503
0.431
0.503
0.918
1.301
-0.464
-0.744
-1.095
Meeting
-1.377
-0.587
0.854
0.992
0.435
-1.954
-0.123
-1.237
-0.483
0.854
0.447
2.155
Approaching /
Not Meeting
-1.472
-0.172
-0.576
1.131
0.753
-0.933
0.374
-0.004
0.857
0.158
-0.382
0.453
The data analysis for the first grade AimswebPlus risk levels are shown in Table 9 and
Table 10. The same chi-square test of independence was completed and produced a p-value of
46.7%. This p-value indicates there is strong support for the hypothesis which states that student
AimswebPlus risk level and teacher are independent of each other.
67
These tables also show there are several teachers identified as showing students obtaining
low risk level for meeting grade level reading skills. Seven teachers are providing instruction to
students that is increasing the students’ reading fluency and reading comprehension scores on
AimswebPlus assessments.
Table 9:
2018-2019 First Grade Teacher AimswebPlus Risk Levels
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
High/Mod RiskObserved
3
2
6
3
2
5
3
6
3
3
6
8
High/Mod Risk
- Expected
4.55
3.79
4.29
4.04
4.04
4.8
3.79
4.04
3.54
4.29
4.04
4.8
Low Risk Observed
15
13
11
13
14
14
12
10
11
14
10
11
Table 10:
2018-2019 First Grade Teacher AimswebPlus Standard Residuals
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
High/Mod Risk
Level
0.727
0.919
-0.826
0.517
1.015
-0.091
0.406
-0.975
0.287
0.623
-0.975
-1.461
Low Risk Level
0.423
0.535
-0.480
0.301
0.590
-0.053
0.236
-0.567
0.167
0.362
-0.567
-0.849
Low Risk Expected
13.45
11.21
12.71
11.96
11.96
14.2
11.21
11.96
10.46
12.71
11.96
14.2
68
In comparing the grade level expectation data and the AimswebPlus risk levels, there are
five teachers who have been identified as providing positive results in developing grade level
readers. The instructional strategies these teachers are using must be evaluated for use across the
first-grade classrooms throughout the district. There are also several teachers who are struggling
with students meeting grade level expectations. Implementation of professional learning for these
teachers regarding evaluation of student data and instructional strategies would support improved
student achievement.
The researcher concluded the student data analysis by completing the chi-square test of
independence for the students during their second-grade year, 2019-2020. The data set utilized in
this process is from the middle of the school year. During the 2019-2020 school year all schools
in Pennsylvania were closed on March 13, 2020 due to the COVID-19 pandemic. This means
that students were not able to complete a traditional school year and receive the same instruction
as if they were attending school daily. All districts were forced to turn to virtual teaching and
learning, which is going to have students return to school struggling academically, socially, and
emotionally as never experienced.
Table 11 displays the data for each of the 12 teachers for second grade. The calculated pvalue for the grade level reading expectation is 11.3%. This once again supports the original
hypothesis, which states student performance is independent of the teacher assignment. There are
five teachers who the researcher identified as successfully getting students to grade level or
exceeding grade level expectations. These teachers use strong instructional strategies with their
students and increasing their reading skills.
69
Table 11:
2019-2020 Second Grade Teacher Grade Level Reading Expectations
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
Exceeding
- Observed
7
5
4
10
6
4
3
4
7
6
6
2
Exceeding
- Expected
5.2
5.52
5.2
5.85
5.85
5.85
4.55
4.87
4.87
5.2
6.17
4.87
Meeting Observed
7
2
4
3
1
4
3
2
2
4
7
2
Meeting Expected
3.33
3.54
3.33
3.75
3.75
3.75
2.91
3.12
3.12
3.33
3.95
3.12
Approaching
/ Not
Meeting
Observed
2
10
8
5
11
10
8
9
6
6
6
11
Approaching
/ Not
Meeting
Expected
7.47
7.94
7.47
8.41
8.41
8.41
6.54
7.01
7.01
7.47
8.87
7.01
Table 12:
2019-2020 Second Grade - Grade Level Standardized Residuals
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
Exceeding
0.789
-0.221
-0.526
1.716
0.062
-0.765
-0.727
-0.394
0.965
0.351
-0.068
-1.301
Meeting
2.011
-0.819
0.367
-0.387
-1.420
0.129
0.053
-0.634
-0.634
0.367
1.535
-0.634
Approaching /
Not Meeting
2.001
-0.731
-0.194
1.176
-0.893
-0.548
-0.571
-0.752
0.381
0.538
0.964
-1.507
The standardized residual calculations for second grade are displayed in Table 12. This
data supports the findings from Table 11. In comparing these two tables, there are two teachers
who are exhibiting positive results in having their students meet or exceed grade level
expectations. Teachers #1 and #4 are able to have students learn reading fluency and reading
70
comprehension skills that will increase their grade level reading performance and lower their
AimswebPlus risk level.
The analysis of the AimswebPlus assessment data is displayed in Table 13 and Table 14.
The calculated p-value for the AimswebPlus risk level was 20.5%. Once again, the researcher
accepted the hypothesis. It is confirmed that there is no association between the teacher and the
risk level the student possesses in second grade. In evaluating the data, the researcher identified
five teachers who are able to have their students perform at a level of low risk on the
AimswebPlus assessment. These teachers are able to have fewer students in the high-risk level
category and more students in the low risk category. Administrators must provide professional
learning, curricular support, and coaching support to ensure all teachers are working to achieve
this goal.
Table 13:
2019-2020 Second Grade AimswebPlus Risk Levels
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
High/Mod RiskObserved
2
5
1
1
6
3
6
6
4
4
5
3
High/Mod
Risk Expected
3.76
3.99
3.76
4.22
3.76
4.22
3.52
3.52
3.52
3.76
4.22
3.76
Low Risk Observed
14
12
15
17
10
15
9
9
11
12
13
13
Low Risk Expected
12.24
13.01
12.24
13.78
12.24
13.78
11.48
11.48
11.48
12.24
13.78
12.24
71
Table 14:
2019-2020 Second Grade Teacher AimswebPlus Standardized Residuals
Teacher
1
2
3
4
5
6
7
8
9
10
11
12
High/Mod Risk Level
0.908
-0.506
1.423
1.567
-1.155
0.594
-1.322
-1.322
-0.256
-0.124
-0.380
0.392
Low Risk Level
0.503
-0.280
0.789
0.867
-0.640
0.329
-0.732
-0.732
-0.142
-0.069
-0.210
0.217
The researcher is concerned with the grade level data that teachers are evaluating. As
previously stated, all schools were closed for the academic year on March 13, 2020 due to the
COVID-19 pandemic. The data that was utilized in the chi-square tests is from the middle of the
year assessment window for BASD. This data was collected at during December, 2019 or
January, 2020. This is an especially difficult time for students, and they struggle to meet their
true grade level performance. These areas of concern need to be considered in determining how
students are performing.
Teacher Survey Data Analysis:
The researcher distributed a survey for the classroom teachers to complete. The survey
asked teachers to respond to a variety of questions in order to identify common factors leading to
student’s growth in reading skills and grade level expectations. The survey, found in Appendix
A, contained 19 questions. The goal of the researcher was to have the survey completed in
approximately 15 minutes. The survey was sent to 32 teachers who are still teaching at BASD.
72
There were 17 responses to the survey by current BASD teachers. Three teachers have retired
and were unable to be reached. There was also one teacher who left the school district and could
not be reached.
The breakdown of responses for teachers is found in Figure 1 and Figure 2. The
researcher was able to get responses from each elementary school and from all primary grade
levels. The research feels this is important and will allow for connections to be made between
grade level teachers and strategies they employ.
Figure 1:
Elementary Building Breakdown of Teacher Responses
Figure 2:
Grade Level Breakdown of Teacher Responses
73
Figure 3 displays the breakdown of the number of minutes each responding teacher spent
providing ELA instruction in a school day. This may not accurately represent the true minutes
being allocated to ELA. It cannot be determined if teachers included only language arts
instruction or if they added writing instruction time.
Figure 3:
Breakdown of Instructional Time Spent on ELA
The next section of the survey focused on each teacher’s use of data to inform instruction.
The teachers were first asked to identify what data they are using to inform their instruction. The
survey results are found in Table 15.
Table 15:
Student Data Points Utilized to Inform Instruction
Data Point
BAS / Running Records
AimswebPlus
Guided Reading / Anecdotal Notes
Informal Assessments / Observations
Writing Samples
Word Work Activities
Letter Identification
PASI Scores
Build up Program
Comprehension Quizzes
Letter Sound Assessments
Phonics Intakes
Number of Teachers Utilizing
15
9
7
7
4
2
2
2
1
1
1
1
74
In reviewing this data, the researcher found that there was a wide array of data points being
collected by teachers. It appears that teachers are using data within their level of comfort and/or
familiarity. Figure 4 shows the frequency the teachers are reviewing their students’ data to
inform their instruction.
Figure 4:
Data Analysis Frequency Breakdown
The data found on teacher data analysis appears to be inconsistent. The teachers are not
following common data points to analyze to help inform their instruction. There also appears to
be inconsistency in the frequency teachers analyze data to inform instruction. The fifth figure
displays how effective each responding teacher feels their data analysis is in informing
instruction. There are several concerns, and questions, that the researcher has focused upon data
used by teachers at BASD. These inconsistencies are one potential answer to the first research
question posed by the researcher.
75
Figure 5:
Teacher Determined Effectiveness of Data Analysis
The next section of the survey collected data from teachers reveal impressions of the FPC
responsive teaching program BASD utilized in the elementary schools. All responding teachers
affirmed that the most effective FPC components are Guided Reading and the Interactive Read
Aloud strategies. Teachers at BASD have been utilizing guided reading techniques for many
years. FPC utilizes leveled books that are researched based and proven to increase student
reading levels.
The Interactive Read Aloud is a new component to BASD teachers. This component has
the teachers provide a whole group reading prompt and then ask specific, targeted questions that
increase student vocabulary. Interactive read alouds also increase the student’s ability to engage
with the text being read. In evaluating teacher responses to the Fountas and Pinnell Classroom
Components, the researcher has determined that the teachers are implementing the components
regularly in their classrooms. One component that has not been well received by teachers is Book
Clubs. Challenges exist with primary students due to the use of chapter books and that books
clubs are designed to extend at least a month or more.
76
Teachers were also asked how they are differentiating in their classrooms for their
students when not receiving Direct Instruction. Teachers utilized a wide array of differentiation
strategies in their classrooms. This inconsistent use of strategies is displayed on Table 16.
Diverse instructional strategies utilized by teachers are also an area of concern. There appears to
be inconsistencies in the strategies used by teachers to differentiate for students which provides
concern for the district’s overall student growth.
Table 16:
Ways Teachers Differentiate for Students
Differentiation Strategy
Center Work
Independent Reading Books
Online Programs
Writing
Small Groups
Reading Response Work
Guided Reading
Independent Work
Book Clubs
Questioning Variety
High Frequency Words
Individual Homework Packets
Number of Teachers Utilizing
7
5
4
4
2
2
1
1
1
1
1
1
Triangulation of Data:
The Capstone Project on primary interventions for students has utilized several different
types of data. During the analysis process data from Fountas and Pinnell Classroom BAS data
was used to determine student’s grade level reading expectation level. AimswebPlus risk level
data was also utilized to determine if the student is meeting grade level expectations. The
research used Evidence of Validity Based on Relation to Other Variables to validate the data. By
analyzing the relationships between the FPC BAS assessment data and the AimswebPlus data,
the researcher was able to validate the results. These assessment tools are administered to all
elementary students three times a year during the same assessment window.
77
In analyzing the chi-square tests completed on the grade level reading expectations and
the AimswebPlus risk level data validates the data. By determining the p-values for each group
of data, the researcher was able to show that the null hypothesis was accepted for kindergarten
and the original hypothesis was accepted for first and second grades. The data also provides
evidence that students are demonstrating growth in literacy skills each year during their time at
school. The teacher survey data triangulated the data as the researcher was able to find common
instructional strategies being utilized in the district in classrooms showing student reading
growth.
Summary:
The Capstone Project undertaken by the research sought to identify primary grade level
classrooms across the Bellefonte Area School District elementary schools that are showing
positive growth in student grade level reading expectations and AimswebPlus scores. By
analyzing student data specific to reading fluency and comprehension, the researcher identified
several teachers who are showing that their students are exceeding or meeting grade level
expectations.
The researcher also analyzed AimswebPlus composite scores and risk level, which
include assessment of oral reading fluency and reading comprehension. This analysis also
identified teachers who are able to have the majority of students with a low risk level. In several
cases, the data showed the same teachers were found to be providing positive results on both
assessments. These teachers will be utilized to assist the district in developing a professional
development plan moving forward.
78
The researcher has determined that the Fountas and Pinnell Classroom program is
beginning to demonstrate encouraging results for BASD. Teachers are utilizing the components
of the program and are conducting more regular assessments of the students to collect more
relevant data.
However, the research has now uncovered several areas of concern and is developing
more questions to be answered. There are several teachers who are struggling to advance their
students in their reading skills and grade level expectations. Teachers are also been identified as
showing positive AimswebPlus scores, but students are not reaching the proficiency threshold on
the BAS assessments. As the district works to improve student growth on grade level reading
expectations and state mandated assessments, the conclusion drawn from this Capstone Project
will enable the researcher to begin to move toward a multi-tiered system of supports (MTSS)
program across all elementary schools.
79
Chapter V
Conclusions of Research
The purpose of Chapter V is to discuss the findings and conclusions of the Capstone
Research Project. The conclusions are based on the literature review and data analysis. The key
findings of this research will help the Bellefonte Area School District guide professional learning
for primary elementary teachers. The findings will also reinforce the need for the district to
pursue implementation of a multi-tiered systems of supports (MTSS) at the elementary level.
The review of literature around the subject of students obtaining the necessary reading
skills by third grade solidified the importance of acquiring these skills early in their schooling. It
is crucial that the district provide students with an opportunity to learn reading fluency and
reading comprehension skills that will increase their ability to exceed or meet the grade level
reading expectations.
Summary of Results:
This Capstone Project was conducted to identify classrooms across the district’s
elementary schools that are having students grow in grade level reading expectations and
AimswebPlus scores. In analyzing the student data on reading fluency and comprehension,
through the Fountas and Pinnell BAS assessments, the researcher identified teachers that are
proving their students are meeting or exceeding grade level expectations. AimswebPlus
composite scores and risk levels, which include assessment on oral reading fluency and reading
comprehension, were also analyzed. This analysis identified teachers have the majority of their
students with a low risk level. The data showed that many of the same teachers were found to be
providing positive results on both assessments. These teachers will be utilized to assist the
80
district in developing a professional development plan moving forward. The FPC program,
started by the district several years ago, is also demonstrating encouraging results for BASD. The
components of the program have been established in the classrooms. Teachers are conducting
more regular assessments of the students to collect more relevant data in order to help inform
their instruction.
The researcher also found several areas of concern that require further review and
analysis. This has led to the development of more questions to be answered. There are teachers
who are struggling to advance their students in their reading skills. Several teachers have
students who are achieving positive AimswebPlus scores; however, the students are not meeting
grade level on the BAS assessments. The concerns raised by the researcher will spark new
conversations in the district and will assist with the implementation of MTSS programs.
Review of Research Questions:
This section of the conclusion will provide a brief review of the research questions the
researcher established for the Capstone Project. The research questions are as follows:
1. What are the factors that are leading to the district’s struggle with low growth in ELA for
our students?
2. What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
3. What external factors are present that can aid the students in their ELA growth or hinder
their progress?
4. What professional learning opportunities do teachers need to ensure more consistent use
of data protocols and appropriate intervention strategies?
81
The research results have identified classrooms that are showing students meeting or
exceeding grade level reading performance. Utilizing this information, the researcher will
identify instructional practices which are benefiting student growth in the acquisition of reading
skills. Grade level reading performance data and AimswebPlus risk factors are used in the
district to determine a student’s achievement in reading. Each of these assessments utilize
reading fluency and reading comprehension data in determining each student’s reading level and
risk factor in grade level reading performance.
Research Question #1:
The first research question for this Capstone Research Project is focused upon the factors
that lead to the Bellefonte Area School District’s (BASD) struggles in English/Language Arts
(ELA) growth. BASD has been struggling to show growth in ELA on Pennsylvania state
mandated assessments for many years. These assessments begin in third grade so it is important
that student acquire the skills in reading fluency and reading comprehension prior to the
mandated assessments. While no school will “teach to the test”, it is critical that students are able
to read fluently and understand what they are reading before leaving elementary school.
In reviewing the data, the researcher identified several teachers who are providing
students with instruction that allows students to reach higher than expected performance levels.
One common thread for the teachers is the implementation of the FPC instructional strategies in
their classrooms. The students who were tracked for the research project entered kindergarten the
year the district first implemented FPC. Now that these students have completed second grade,
their performance in grade level reading expectations is better than expected. Figure 6 shows the
FPC components that teachers are utilizing daily in their instruction.
82
Figure 6:
Fountas and Pinnell Classroom Components Utilized by Teachers
While FPC is beginning to show promise in the first several years of implementation, the
researcher also uncovered several concerns that may be leading to the district’s struggles. The
first area of concern is the teachers’ use in data to inform their instruction. In Table 15, the
teachers identified twelve different data sources they are evaluating the help guide their
instruction. If FPC provided teachers with common components to utilize in their instruction,
could the district identify data points that could be collected from those instructional practices?
Many of the teachers indicated in their survey responses that they feel they are effective
in their data analysis processes. When comparing teacher data, several of these same teachers are
not able to have students achieve grade level reading expectations. The data analysis has proven
that the district should identify common data points that all teachers must collect, and then
receive professional learning focused upon data analysis and its use to inform instruction. The
inconsistencies in data collection and analysis could be a strong factor in why the district is
struggling in ELA growth.
A second area of concern that the researcher has identified as a factor in the district
struggles is the wide variety of supplemental resources teachers are utilizing outside of the FPC
83
program. In responses from teachers, there were 20 different instructional strategies listed.
Several of the strategies involved the use of online programs such as RAZ Kids, Starfall,
readworks.org, and teachyourmonstertoread.com. Other strategies involved the use of phonics
activities, writing activities, and high frequency word activities. It appears that the teachers are
utilizing programs and strategies that they know and are comfortable with, not instructional
strategies that are research based and proven.
A reevaluation of the data analysis processes and instructional practices being utilized by
primary teachers in elementary schools must occur. While only 17 teachers responded to the
survey, the research can predict that there would have been an even greater number of
instructional practices listed on the survey. For growth to occur in ELA over time, there should
be an integration of a MTSS program into the elementary schools. MTSS is designed to have
teachers, administrators, school counselors, and school psychologists work collectively on
regularly collecting and evaluating data. MTSS integration in stages and by starting with primary
grade levels would be beneficial. Teacher involvement in the planning of the program will be
crucial to the success of the implementation of MTSS.
Research Question #2:
The second research question addresses, “What instructional strategies are teachers using
across the district to strengthen student reading fluency and comprehension?” During the
literature review, the researcher was able to identify the importance of reading fluency and
reading comprehension in a student’s grade level performance. Students must be able to read text
fluently, and with inflection, in order to aid them in the comprehension of the text. Many
kindergarten teachers focus on letter recognition and sounds in order to prepare students for the
84
decoding of words. This is an important step in a student’s acquisition of reading skills. A
student’s ability to learn to decode words in texts they do not know allows them to obtain the
proper context of the text passage. This all goes back to the reading instruction utilized by
teacher to strengthen a student’s reading fluency and comprehension.
As previously stated, FPC provides teachers with a research proven set of instructional
practices on increasing reading fluency and reading comprehension. For example, the Interactive
Read Aloud strategy promotes reading by using grade level appropriate texts that expand a
student’s vocabulary and their ability to think, talk, and write about the text. Interactive Read
Aloud is being utilized by all teachers who responded to the survey. Another FPC strategy
employed across the classrooms is Independent Reading. Students are provided a wide array of
texts at their reading level. Teachers support student independent reading by holding conferences
with students to discuss the books they are reading.
Teachers who responded to the survey also indicated they are using many different
strategies to promote reading fluency and reading comprehension with students. Strategies such
as re-reading, reading mini-lessons, small group reading, and Sound Partners are being utilized to
strengthen student reading skills. Teachers appear to be integrating writing into the strategies
utilized as well. Many classrooms are having students share their writing with fellow students
and book buddies. These strategies allow students to hear what they are writing and identify
ways in which to improve their writing.
One of the most utilized strategies is the FPC Guiding Reading. Guided Reading provides
teachers with an opportunity to work with students in a small group setting. “Guided reading is a
small-group instructional context in which students move from high teacher support to full
85
control of the reading process” (Fountas & Pinnell, 2017). As stated in the literature review,
Fountas and Pinnell established a routine for Guided Reading sessions.
Guided Reading begins with teachers selecting appropriate text for the students. Students
are then introduced to the text and then they whisper read the entire text with the teacher
providing support. Once the text is completed, the group discusses the text in order to determine
students’ comprehension while engaging in word work in order to increase their flexibility and
word analysis skills. Finally, students engage in writing activities in order to share and extend
their understanding. BASD teachers have been employing guided reading practices for many
years. FPC has provided teachers with proper books and text passages that students benefit from.
Several years ago, Bellefonte Elementary established a parallel block schedule for
kindergarten that provides small group instruction for all students in ELA. Students rotate
through a series of centers that are designed to provide each student with appropriate instruction.
There are three or four classrooms used in scheduling kindergarten and students are grouped with
other of like abilities. Each student follows a schedule that provides them with several small
group direct instruction opportunities in reading and writing. There is also a shared reading room
established where the students participate in center work. An enrichment room is also established
where the students work with a classroom aide on a reading activity and have a center for
structured play.
The teachers have identified the schedule implemented at Bellefonte Elementary as
benefitting their students in the acquisition of reading skills. They have indicated that the
schedule has provided students with an opportunity to receive instruction with fewer distractions
and has improved student behaviors and social skills. Teachers also report that they are able to
86
frequently regroup students across the grade level in order to provide students with
individualized and differentiated instruction.
In completing the data analysis of the grade level reading expectations and AimswebPlus
composite scores, the researcher has found several inconsistencies in the data. Even though
Bellefonte Elementary utilizes a special schedule for their students, the data demonstrates that
several teachers are struggling with students meeting grade level expectations. Two of the
teachers were identified as having standardized residuals in AimswebPlus risk level of -2.06 and
-1.23. This implies that teachers have more students in the high and moderate risk level as any
other teacher in who taught kindergarten in 2017-2018. Further evaluation of kindergarten data
should occur since the implementation of FPC. This data analysis will identify the true
effectiveness of the parallel schedule.
The research has also identified a concern with the wide array of instructional strategies
utilized in the classrooms. As previously stated, it is recommended that the district develop a
group of research proven strategies that will help students improve their grade level reading
performance. Too many teachers appear to rely on online software programs for center work for
students. The district should evaluate each program and determine its effectiveness before full
implementation occurs in the classroom. This will narrow down the options of programs used by
teachers and provide students with the most effective instructional programs.
BASD is working to properly implement the Fountas and Pinnell Classroom instructional
practices in all elementary classroom. The FPC instructional strategies are researched based and
provide students with opportunities to show growth in grade level reading performance. The
researcher recommends that a data analysis be completed of subsequent years be completed in
order to provide an effective evaluation of the FPC and parallel block scheduling programs.
87
Research Question #3:
The third research question established by the researcher is to identify external factors
that aid and/or hinder student growth in grade level reading performance. The researcher was
able to collect and analyze data on grade level reading expectations and AimswebPlus composite
scores for all students. The data was disaggregated to evaluate the students who are identified as
qualifying for free/reduced lunch. This is the primary way in which schools identify students as
being economically disadvantaged. The district does not collect data on family dynamics: ie.
divorced parents, time spent with each parent, and employment status of parents. The district
relies on parent to apply for the free/reduced lunch program, but many have reported that is an
underserved student group. The research has identified this as an area of concern. Table 17
shows the break down of student performance and qualification for free/reduced lunch services.
Table 17:
Student Grade Level Performance and Socioeconomic Level
Kindergarten
MW
Teachers
F/R Total
Non Total
BES
Teachers
F/R Total
Non Total
Benner
Teachers
F/R Total
Non Total
PG
Teachers
F/R Total
Non Total
First Grade
Exc
Mtg
Appr
Not
Mtg
2
4
1
1
38
14
2
Exc
Mtg
Appr
4
Not
Mtg
8
11
0
10
14
13
2
Exc
Mtg
Appr
8
Not
Mtg
2
1
2
2
11
10
3
Exc
Mtg
Appr
0
Not
Mtg
1
2
5
2
12
9
2
2
MW
Teachers
F/R Total
Non Total
BES
Teachers
F/R Total
Non Total
Benner
Teachers
F/R Total
Non Total
PG
Teachers
F/R Total
Non Total
Second Grade
Exc
Mtg
Appr
Not
Mtg
1
2
2
3
20
13
18
Exc
Mtg
Appr
7
Not
Mtg
13
2
5
10
17
6
9
Exc
Mtg
Appr
5
Not
Mtg
1
1
2
4
12
6
5
Exc
Mtg
Appr
0
Not
Mtg
1
4
2
4
7
8
6
3
MW
Teachers
F/R Total
Non Total
BES
Teachers
F/R Total
Non Total
Benner
Teachers
F/R Total
Non Total
PG
Teachers
F/R Total
Non Total
Exc
Mtg
Appr
Not
Mtg
2
0
1
6
24
16
6
Exc
Mtg
Appr
12
Not
Mtg
6
3
8
11
11
7
7
Exc
Mtg
Appr
13
Not
Mtg
1
0
3
4
12
6
4
Exc
Mtg
Appr
1
Not
Mtg
1
2
2
6
6
8
1
8
88
The data analysis implies that students Bellefonte and Pleasant Gap elementary who are
identified as low socioeconomics exhibit performance of that is lower than those of their fellow
students. In most elementary schools at BASD, 50% of the students who qualify for free/reduced
lunch are showing low growth in grade level reading performance. Frequently, students from low
socioeconomic standing come from split families, are often shared between households
throughout the week, and frequently struggle with completing homework and required readings.
Further analysis of the students’ backgrounds to determine the family factors that are hindering
student growth would be beneficial.
BASD does provide Title I services to students who qualify. Qualification is based on a
student’s poor grade level reading performance and a high-risk level based on AimswebPlus
composite scores. By providing students with Title I services, many students are able to receive
the additional reading instruction while at school. After the district evaluates data for eligibility
for Title I services, students are broken down by grade level and tiers. Tier 3 is the most at risk,
tier 2 is moderate, and tier 1 is low risk. The teachers begin by placing students who are
identified as Tier 3 and in first grade in services. The next group is Tier 3 students in second
grade and then Tier 2 in first grade. Kindergarten students are identified and offered services in
the spring of each year.
The researcher has identified Title I services as a factor that aids student growth in grade
level reading performance. The second-grade students whose data was analyzed have shown that
receiving the extra reading instruction from the district’s reading specialists has improved
student performance.
Another factor that could be considered an aid to students is their being identified for
learning support services. Student performance data is evaluated and students can be assessed for
89
learning support. Over the previous three years Bellefonte has had six second grade students
qualify for learning support services. Staff at Benner have identified one student, Marion Walker
seven students, and Pleasant Gap have five students identified. At BASD learning support
services are considered to be Tier 3 interventions.
In the evaluation of the student data the researcher found that most identified learning
support students are ending second grade at least one grade level behind in reading performance.
According to the data there are 17 students moving to third grade one grade level behind. There
are also three students moving on that are two grade levels behind. The researcher does question
the instruction they are receiving. Should these students receive more pull-out instruction from
their learning support teachers? Are there additional programs to be evaluated and utilized with
students? The concern is that students are receiving whole group instruction with fellow
classmates, guided reading instruction from the classroom teacher, and reading support from
learning support teachers but is still not making adequate progress. More data analysis and
further questions asked on the instructional practices for learning support students would benefit
the school district.
Research Question #3 has been the most difficult question to determine answers to. There
are so many external factors that influence student grade level reading performance. Many of
these factors are outside of the control of the school district. It is widely understood that schools
need the support of families in order to promote students in their education. Schools need to
begin to search for ways in which they can engage the parents in the learning process. The
difficulty comes is that many times the parents the school tries to engage the most, are also the
most resistant. This will require more research and the development of family engagement
practices for the district to promote.
90
Research Question #4:
The fourth, and final, research question is focused on the professional learning
opportunities that ensure consistent use of data protocols and appropriate instructional strategies
for the teachers at BASD. The analysis of the student data and the teacher survey has shown that
teachers are utilizing a wide array of instructional strategies to promote students reading
performance. The analysis has also demonstrated the importance of professional learning in the
area of data analysis to inform instruction. The researcher has determined that the teachers would
benefit from established data protocols to follow when they are evaluating student data.
The results of the analysis demonstrate a lack of general guidelines for teachers when
collecting and evaluating data. Teacher have reported that they are using a wide array of data
sources to evaluate student performance. In reviewing Table 15, from Chapter IV, one finds that
there are a dozen assessments being used by teachers. Some of the assessments are formative and
some are summative. Teachers are utilizing formal assessment such as FPC BAS and
AimswebPlus. They are also using their own anecdotal notes and guided reading notes. It
appears that the teachers are using the data that they are most confident in collecting and
analyzing.
Questions with the data teachers are collecting and analyzing have been identified by the
researcher. What protocols are the teachers using to collect and analyze reading data? How often
are the students being progress monitored on their reading fluency and reading comprehension
levels? What research based instructional practices are teacher using during their instruction?
The use of FPC in classrooms is also an area of concern. Teachers report that they are
utilizing the majority of the strategies recommended by FPC, but they expressed the need for
91
further training on FPC components. One of the most requested professional learning trainings
by teachers was the FPC Phonics, Spelling, and Word Study component. Teachers reported
utilizing different phonics interventions with their students. However, these are interventions
outside of the FPC program. The researcher believes that teachers are requesting professional
learning on the phonics component due to their previous work with FPC.
The researcher has also found a concern with how the district is using their professional
learning days for teachers. In recent years the district has moved to promoting teacher growth by
offering conference like sessions on professional learning days. The district offers four sessions
throughout the day where teachers sign up for any sessions they have an interest in. This
promotes teacher learning and provide teachers with specific options to choose from. One
teacher gave the following response to the professional learning request question on the survey:
“I often think we don't need more new learning as teachers as much as we need time to
get better at what we've already learned. When we do have new learning opportunities it
is usually theoretical, which is always good, but then we struggle to find time to put that
knowledge to practical use.”
Teachers are asking for time to collaborate and work to implement the new learning they have
acquired. The professional learning model should integrate more time to allow for teacher
collaboration.
A recommendation by the researcher, that has been made in prior sections, is that BASD
begin to research and implement a MTSS program the elementary school level. The
recommended process for the implementation of MTSS would be to research, set protocols, and
begin data analysis with one grade level. The district should select one school and one grade
level to create a pilot for the MTSS implementation. It is recommended that the school spend the
first semester on establishing data protocols for the teachers to follow. The administration of the
school should also utilize the ELA elementary coach to help with types of data to collect and
92
instructional practices to focus on. The team needs to work collectively and meet regularly to
discuss protocols, processes, and instruction in the classroom.
Financial Implications:
The financial implications for BASD will involve a variety of expenses. The researcher
has recommended that the district begin with the implementation of MTSS in one school with
one grade level. This implementation will serve as a pilot for the rest of the district. There will be
initial costs for trainings and substitutes for the administration, ELA coach, and several teachers
of the school. Paying teachers for afterschool meetings to develop the data protocols and
processes will add to the training costs.
There will be more costs associated with MTSS implementation than teacher training.
The ELA coach and teachers will need to review and evaluate instructional strategies and
interventions that can be utilized with students in their classrooms. Once instructional and
intervention materials are chosen, they will need to be purchased for the teachers. This could
come in the form of web-based software programs and/or updated paper products. Another cost
associated with implementing new programming will be the paying potential trainers for inperson or webinar trainings. The school district does have several intervention programs that are
at the teacher’s disposal. Program kits such as Spiral Up, Build Up, and Boost/Blast can be found
in all elementary schools. Teachers and para-educators will be trained in order to properly
integrate these interventions with students.
Part of MTSS is the support students in their behavior performance as well. Many times,
student academic performance and behaviors are linked. Many students who misbehave in the
classroom do not do well academically. MTSS can be tied to the existing Positive Behavior
93
Interventions and Support (PBIS) program already established at BASD. This will take some
planning and collaborating, but these two programs can work in conjunction with one another.
Unfortunately, the conclusion of the Capstone Research Project comes at a time where
school budgets are being cut and revenues are decreasing due to the school closures from the
COVID-19 pandemic. The state budget does not allow for more funds being allocated to school
districts. The school administration is going to have to be creative in the planning and prep work
to begin implementing MTSS.
Limitations:
Throughout the Capstone Project the researcher has been able to identify several
limitations to the research projects. One limitation involves the use of data from only one grade
level. The researcher selected the 2019-2020 second grade students due to the district’s
implementation of Fountas and Pinnell Classroom and now recommends completing the same
statistical analysis on students in first grade. Another limiting factor is that the data for only
Bellefonte Area School District was used in the Capstone Project. There would have been great
benefit by expanding the research project and collecting data from a neighboring district. The
data could be compared since the districts are mostly likely utilized different programs to support
their ELA curriculum.
Another limitation to the Capstone Project comes from the responses to the teacher
survey. Over thirty teachers were sent the survey to complete, but only 17 teachers provided
answers and feedback. While this provided insight into how teachers feel about FPC, their use of
data, and the instructional strategies they employ, this represents only 57% of the primary
teachers across the district. Another concern involving the survey is that several of the highest
94
performing teachers identified through the data analysis did not complete the survey. Had the
researcher been able to make direct contact with these teachers, they may have completed the
survey.
The truthfulness of the teachers in completing the survey for the project is a related
limitation. The teachers provided feedback on their instructional practices, but needed to be more
specific. The vague staff member responses have created challenges. An example of this is that
several teachers provided a response on collecting anecdotal notes, but did not specify the types
of notes they took. The research had to combine many responses into groups to have similar
responses. The teachers’ reluctancy to provide pertinent feedback may stem from the researcher
being a principal at an elementary school with BASD.
The largest limitation in the completion of the Capstone Research Project was the school
closures that occurred in March of 2020 due to the COVID-19 pandemic that spread across the
world. The school closures had an impact in the project by not allow for students to complete the
full year of grade level instruction. The school closure created an extreme break in student
learning which is going to result in deficits that will be larger than usual. The researcher did not
have a full year of data to analyze for the second-grade students which required teachers to
utilize mid-year data. This data is always difficult to rely on as it is collected at a time of the
school year that has several breaks and many interruptions.
Since the school closure prevented that last quarter of school to occur, the researcher can
only speculate as to how the end of the year data would have concluded. The researcher does feel
that many students would have had higher grade level reading performance and increased
AimswebPlus composite scores, which would have lowered their risk level. This would have
potentially shown that more teachers are having students meet or exceed grade level reading
95
expectations. Again, due to the speculative nature of this assertion, it may be difficult to confirm
in the future. At this time the reopening of schools is going to look different across Pennsylvania,
and there will be options provided to families for students to receive their schooling.
Recommendations for Further Research:
It is recommended that further research be conducted on the Fountas and Pinnell
Classroom program being utilized to support the district’s curriculum. Student data on grade
level reading expectations and AimswebPlus composite scores should be analyzed in the same
manner as it was in this Capstone Project. The data from kindergarten from the past two years as
well as data from this year’s first grade should be analyzed. Unfortunately, many of the same
limitations associated with the school closure will apply. A complete picture might not be
available for several years.
If data is continually collected and analyzed over the next several years, the district will
be able to get a picture of teacher performance. Since the primary grade level teachers do not
receive a teacher specific score from the state, the analysis of student data on a regular basis can
provide the district with important results as the effectiveness of the teacher’s instructional
practices in the classroom.
It is also recommended that the district begin to research the MTSS program model. The
research should focus around data collection and analysis. The MTSS research should also
include instructional strategies and interventions that are research based and proven to increase
student performance in reading and writing. The results have shown that the teachers of the
district are utilizing a wide array of interventions with their students, but a priority placed on
developing a common set of instructional strategies for teachers to use is essential.
96
Lastly, the district would benefit from research and conducting the proper professional
learning to staff on the MTSS process. The trainings involved for this will need to occur on the
district’s predetermined professional learning days. These professional learnings will come in a
variety of forms: trainer in-person, webinar, or teacher directed. The pilot school will work
through the struggle of limited funds as many trainings can be completed by using low/no cost
options.
Conclusions:
Throughout the Capstone Research Project, the researcher was focused on the
identification of instructional strategies and interventions that assist with improved student
achievement and growth in grade level reading performance. The researcher was to identify
classrooms that have proven to aid students in meeting and/or exceeding grade level reading
expectations. Administrators can now identify instructional strategies being utilized to aid in this
growth. More consistency in interventions being utilized across the elementary schools would
greatly benefit the students in their reading development.
In determining the conclusions of each research question posed at the onset of the
Capstone Project, the research has determined there are several themes that have emerged. The
first theme involves the implementation and use of FPC instructional strategies in the classroom.
Teachers have been implementing FPC components over the past several years, and staff
members appear to be utilizing those components on a daily basis. The teachers at the primary
grades have received training on these components, but have asked for more collaborative time
to work on refining the components used in the classroom. While all teachers appear to be
utilizing interactive read alouds and guided reading components, there are questions as to how
97
effective these components are at this time. Professional learning time spent having teachers
collaborate on FPC components being utilized can strengthen the component’s effectiveness in
the classroom.
Professional learning conducted on data collection and analysis processes will also be
essential to the district increasing student achievement on achieving grade level reading
expectations. While teachers are reporting that they are effectively analyzing data, the results of
the project have determined they are not using the data and informing their instruction using
unified protocols.
A second theme that has emerged from the conclusions is that teachers are not effectively
utilizing data to inform their instruction. Students are completing the FPC BAS assessments as
well as AimswebPlus assessments three times a year. Should teachers be regularly progress
monitoring students in their grade level reading performance? The teachers of the district would
benefit from training on what each data point measures and how it can be used to provide
students with the appropriate interventions. Rather than constantly searching for the next
intervention, teachers would then have a set of resources that they can use with students in direct
instruction or by self-paced instruction.
The final theme that has emerged is that the district is ready to move to a more structured
model of data analysis and intervention determination. The MTSS program will provide the
district with that structure and processes to use to increase student reading skill acquisition and
subsequently student grade level reading performance. The recommendations for implementation
and the financial implications have previously been discussed in this chapter. There will be a
slow and progressive implementation. There will also be financial implications to the school
district for trainings and resources to support MTSS. It is also likely that the implementation of
98
MTSS will not be an easy process. However, having a MTSS program in place will greatly assist
the school district in achieving their goal of having students reach second grade reading
expectations before entering the third grade.
The completion of this Capstone Research Project is only a first step in having the district
move forward in implementing processes to have student reach grade level expectations by the
end of second grade. There is also more research and data analysis to be completed in order to
see how FPC, and subsequently MTSS, is helping students grow in their reading skills for
fluency and comprehension. Teacher should continue to research more effective interventions for
their students and create a data base of these interventions for all to use. While the work for the
Capstone Research Project is complete, the work of implementing its findings and conclusions
has only begun.
99
References
Allan, S. D. (2010, October). Differentiated Instruction and RtI: A natural fit. Educational
Leadership, 68(2). Retrieved from http://www.ascd.org/publications/educationalleadership.aspx
Butler, S., Urrutia, K., Hunt, M., & Kozman, R. (2010). A review of the current research on
comprehension instruction. Retrieved from
https://rmcresearchcorporation.com/portsmouthnh/national-reading-technical-assistancecenter/
Educational Research Newsletter and Webinars. (2000, December 27). 'Frustration-level'
materials increase reading achievement. Retrieved from
https://www.ernweb.com/educational-research-articles/frustration-level-materialsincrease-reading-achievement/
Fielding, L. G., & Pearson, P. D. (1994, March). Synthesis of research / Reading
Comprehension: What works. Educational Leadership, 51(5), 62–68. Retrieved from
http://www.ascd.org/publications/educational-leadership.aspx
Fisher, D., Frey, N., & Hattie, J. A. C. (2016). Visible learning for literacy: Implementing the
practices that work best to accelerate student learning: Grades K-12. Thousand Oaks,
CA: Corwin.
Fisher, D., Frey, N., & Hattie, J. (2017). Teaching literacy in the visible learning classroom.
Thousand Oaks, CA: Corwin Literacy.
Fountas, I. C., & Pinnell, G. S. (2012). Guided Reading: the romance and the reality. Reading
Teacher, 66(4), 5-20. https://doi.org/10.1002/TRTR.01123
100
Fountas, I. C., & Pinnell, G. S. (2017). Guided reading: Responsive teaching across the
grades (2nd ed.). Portsmouth, NH: Heinemann.
Fried, M. D. (2013). Activating teaching: Using running records to inform teaching decisions.
Journal of Reading Recovery, 5–16. Retrieved from
https://www.pekin.net/cms/lib/IL01905155/Centricity/Domain/29/Activating%20Teachin
g%20Using%20Running%20Records%20to%20Inform%20Teaching%20Decisions.pdf
Furry, A., & Cooper, K. (2011). Strengthening comprehension instruction for higher
achievement in second and third grades. Retrieved from
https://rmcresearchcorporation.com/portsmouthnh/national-reading-technical-assistancecenter/
Gillett, E. P., & Ellingson, S. P. (2017, August 30). How will I know what my students need?
Preparing preservice teachers to use Running Records to make instructional
decisions. International Literacy Association. Retrieved from
https://ila.onlinelibrary.wiley.com/doi/abs/10.1002/trtr.1609
Hansen, K. (2016). Guided reading and how it affects reading comprehension in struggling,
middle level, and high level readers. (Master’s thesis). Retrieved from
https://fisherpub.sjfc.edu/education_ETD_masters/index.html#year_2016
Hebert, C. R. (2004, August). Running records every day: Revamp your routine to make time
for assessment. INSTRUCTOR, 30–32, 71. Retrieved from
http://www.scholastic.com/classmags
Heinemann. (2018). A summary of the research base for Fountas & Pinnell Classroom.
Retrieved from https://www.fountasandpinnell.com/resourcelibrary/resource?id=435
101
Heitin, L. (2015, May 13). Reading fluency viewed as neglected skill. Education Week,
34(30). Retrieved from https://www.edweek.org/ew/articles/2015/05/13/reading-fluencyviewed-as-neglected-skill.html
Hewes, N. (2016, June 16). Lolly's Classroom: The pros and cons of leveled readers.
Retrieved from https://www.hbook.com/?detailStory=pros-cons-leveled-readers
Hewes, N. (2016, June 23). Lolly's Classroom: What's in those leveled book boxes? Retrieved
from https://www.hbook.com/?detailStory=whats-in-those-leveled-book-boxes
Hudson, R. F., Lane, H. B., & Pullen, P. C. (2005, May). Reading fluency assessment and
instruction: What, why, and how? The Reading Teacher, 58(8), 702–714.
https://doi.org/10.1598/RT.58.8.1
International Literacy Association. (2018). Reading fluently does not mean reading fast
[Literacy leadership brief]. Newark, DE: Author.
Jones, B. K. (2018, November). An insider's perspective on transforming PD. Educational
Leadership, 76(3), 36–42. Retrieved from http://www.ascd.org/publications/educationalleadership.aspx
Knight, J. (2018, November). Escape from the zero-learning zone. Educational Leadership,
76(3), 20-26. Retrieved from http://www.ascd.org/publications/educationalleadership.aspx
Koeze, P. A. (2007). Differentiated instruction: The effect on student achievement in an
elementary school (Doctoral dissertation). Retrieved from
http://commons.emich.edu/cgi/viewcontent.cgi?article=1030&context=theses
102
Lemov, D. (2017, February). How knowledge powers reading. Educational Leadership,
74(5), 10–16. Retrieved from http://www.ascd.org/publications/educationalleadership.aspx
Locklear, P. (2018, August 16). What is effective comprehension instruction? Retrieved from
https://www.readingrockets.org/article/what-effective-comprehension-instruction
Manna, R. (2019). Leveled reading systems, explained. Retrieved from
https://www.scholastic.com/teachers/articles/teaching-content/leveled-reading-systemsexplained/
Ming, K., & Dukes, C. (2008, March). Fluency: A necessary ingredient in comprehensive
reading instruction in inclusive classrooms. TEACHING Exceptional Children Plus, 4(4)
Article 6. Retrieved from http://escholarship.bc.edu/education/tecplus/vol4/iss4/art6
NCS Pearson, Inc. (2017). AimswebPlus progress monitoring guide. Bloomington, MN.
Pearson, Inc.
Odell, K. (2012). The effects of Fountas & Pinnell’s Leveled Literacy Intervention on
kindergarten students reading below grade level. Retrieved from
https://www.nwmissouri.edu/library/researchpapers/2012/Odell, Kristi.pdf
Pardo, L. (2004, November). What every teacher needs to know about comprehension. The
Reading Teacher, 58(3), 272–280. Retrieved from
https://www.learner.org/workshops/teachreading35/pdf/teachers_know_comprehension.pd
f
Pearson. (2012). AIMSweb roi growth norms. Retrieved from
https://datacentral.esboces.org/Portals/0/Documents/AssessmentSupport/AIMSWeb/AIMS
web-ROI-Growth-Norms_FAQ.pdf
103
PourhoseinGilakjani, A. (2016). How can students improve their reading comprehension
skill? Journal of Studies in Education, 6(2), 229–240. Retrieved from
http://www.macrothink.org/journal/index.php/jse
Ramirez, M., & Edward, S. (2013, November 7). What research tells us about reading,
comprehension, and comprehension instruction. Retrieved from
https://www.readingrockets.org/article/what-research-tells-us-about-readingcomprehension-and-comprehension-instruction
Rasinski, T. (2004, March). Creating fluent readers. Educational Leadership, 61(6), 46–51.
Retrieved from http://www.ascd.org/publications/educational-leadership.aspx
Robb, L. (2019). What is differentiated instruction? Retrieved from
https://www.scholastic.com/teachers/articles/teaching-content/what-differentiatedinstruction/
Shinn, M. R. (2012). The relation of AIMSweb®, curriculum-based measurement, and the
Common Core Standards: All parts of meaningful school improvement. Retrieved from
https://images.pearsonassessments.com/Images/PDF/Webinar/CBMCommonCore_MarkS
hinn.pdf
Stegman, B. (2015, March 2). 7 tips to make running records manageable and useful.
Edutopia. Retrieved from https://www.edutopia.org/blog/make-running-recordsmanageable-useful-bridget-stegman
Tomlinson, C. A. (2001). How to differentiate instruction in mixed-ability classrooms (2nd
ed.). Alexandria, VA: Association for Supervision and Curriculum Development.
Tomlinson, C. A. (2014). The differentiated classroom: Responding to the needs of all
learners (2nd ed.). Alexandria, VA: ASCD.
104
Treptow, M. A., Burns, M. K., & McComas, J. J. (2007). Reading at the frustration,
instructional, and independent levels: The effects on students' reading comprehension and
time on task. School Psychology Review, 36(1), 159–166. Retrieved from
https://www.researchgate.net/publication/290278716_Reading_at_the_frustration_instruct
ional_and_independent_levels_The_effects_on_students'_reading_comprehension_and_ti
me_on_task
UK Essays. (2018, November). Evaluation of Fountas And Pinnell benchmark. Retrieved
from https://www.ukessays.com/essays/english-language/evaluation-of-fountas-andpinnell-benchmark-english-language-essay.php
U.S. Department of Education. (2017). WWC Intervention Report. Retrieved from
https://ies.ed.gov/ncee/wwc/Docs/InterventionReports/wwc_leveledliteracy_091917.pdf
Waldera, J. (2017). What is differentiated instruction? Examples of how to differentiate
instruction in the classroom. Retrieved from https://mdsoar.org/handle/11603/3909
Weselby, C. (2014, October 1). What is differentiated instruction? Examples of how to
differentiate instruction in the classroom. Retrieved from https://education.cuportland.edu/blog/classroom-resources/examples-of-differentiated-instruction/
Young, C. (2018). Increased frequency and planning: A more effective approach to guided
reading in Grade 2. The Journal of Educational Research, 112(1), 121–130. doi:
10.1080/00220671.2018.1451814
105
APPENDIX A
California University of Pennsylvania Institutional Review Board Approval
106
Institutional Review Board
California University of Pennsylvania
Morgan Hall, 310
250 University Avenue
California, PA 15419
instreviewboard@calu.edu
Melissa Sovak, Ph.D.
Dear Daniel,
Please consider this email as official notification that your proposal titled
“Primary Elementary Interventions for Students” (Proposal #18-093) has
been approved by the California University of Pennsylvania Institutional
Review Board as submitted.
The effective date of approval is 9/19/19 and the expiration date is 9/18/20.
These dates must appear on the consent form.
Please note that Federal Policy requires that you notify the IRB promptly
regarding any of the following:
(1) Any additions or changes in procedures you might wish for your study
(additions or changes must be approved by the IRB before they are
implemented)
(2) Any events that affect the safety or well-being of subjects
(3) Any modifications of your study or other responses that are
necessitated by any events reported in (2).
(4) To continue your research beyond the approval expiration date of
9/18/20 you must file additional information to be considered for continuing
review. Please contact instreviewboard@calu.edu
Please notify the Board when data collection is complete.
Regards,
Melissa Sovak, PhD.
Chair, Institutional Review Board
107
APPENDIX B
Bellefonte Area School District Data Request Letter
108
August 5, 2019
Dr. Michelle Saylor, Superintendent
Bellefonte Area School District
318 North Allegheny Street
Bellefonte, PA 16823
Dear Dr. Saylor,
As an administrator with Bellefonte, I have seen the school district experience little growth, or
even a decline, in student English Language Arts (ELA) scores over time at the elementary
level. The district has also identified a lack of consistency and/or low scores in our student
growth indicators. These struggles can be traced back to possible issues with inconsistencies in
student data use, implementation of ELA curriculum, and how teachers implement instructional
strategies and interventions. For the past year I have been completing coursework as a doctoral
student with the California University of Pennsylvania. I am working on completing my action
research project to answer the following questions:
a.
What are the factors that are leading to the district’s struggle with low growth in ELA for
our students?
b.
What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
c.
What external factors are present that can aid the students in their ELA growth or hinder
their progress?
d.
What professional learning opportunities do teachers need to insure more consistent use
of data protocols and appropriate intervention strategies.
I am writing to request the collection and use of student date for an action research project I am
working to complete. I would like to utilize the Aimsweb data as well as student running records
for this year’s second grade class. This data is collected at least three times a year for all
elementary level students. I would like to get the data from the 2017-2018, 2018-2019, and
2019-2020 school years for the research project. Please know that students will not be
interviewed or surveyed as part of my research project.
As part of the research project I would like to identify instructional practices and intervention
strategies that the teachers are using across the district. I would also like to request permission to
survey the elementary teaching staff for kindergarten, first, and second grades. The surveys will
be completely optional and their responses will be kept confidential. My hope is to be able to
identify which instructional practices aided the students in achieving significant gains in their
reading fluency and comprehension. Once those instructional strategies are identified, I plan on
working with the teachers and ELA coaches to provide professional learning for all elementary
professional staff members.
Please let me know if you have any questions about my action research project and how I plan to
utilize the data that I am requesting to collect. I am hopeful that we will be able to expand on the
findings of the research project and offer all teachers of the school district strategies to engage
109
our students and enrich their learning. If you have any questions please contact me at 814-5710702 or bes0123@calu.edu. Thank you for your time and consideration.
Sincerely,
Daniel Besch, Jr.
Doctoral Student, California University of PA
110
APPENDIX C
Bellefonte Area School District Data Request Approval
111
112
APPENDIX D
Bellefonte Area School District Survey Invitations to Teachers
113
March 20, 2020
To the Teachers of Kindergarten Students at BASD,
Over the past several years Bellefonte Area School District has experienced little growth, or even
a decline, in student English Language Arts (ELA) scores over time at the elementary level. For
the past year I have been completing coursework as a doctoral student with the California
University of Pennsylvania. I am working on completing my action research project to answer
the following questions:
a.
What are the factors that are leading to the district’s struggle with low growth in ELA for
our students?
b.
What instructional strategies are teachers using across the district to strengthen student
reading fluency and comprehension?
c.
What external factors are present that can aid the students in their ELA growth or hinder
their progress?
d.
What professional learning opportunities do teachers need to insure more consistent use
of data protocols and appropriate intervention strategies.
As part of the research project I would like to identify instructional practices and intervention
strategies that the teachers are using across the district. My hope is to be able to identify which
instructional practices aided the students in achieving significant gains in their reading fluency
and comprehension. Once those instructional strategies are identified, I plan on working with the
teachers and ELA coaches to provide professional learning for all elementary professional staff
members.
I am writing to invite you to participate in a survey that will help to identify your use of data and
instructional practices in regards to reading fluency and reading comprehension. Please know
that the survey is voluntary and you may withdraw from the survey at anytime. All answers to
the survey will be kept confidential and only used as part of this research project. Names will
not be collected as part of the surveys at this time. I would expect the survey to take
approximately fifteen (15) minutes to complete. The research project has been approved by the
California University of Pennsylvania Institutional Review Board. This approval is effective
09/01/19 and expires 09/01/20.
Please let me know if you have any questions about my action research project and how I plan to
utilize the data that I am asking you to provide. I am hopeful that we will be able to expand on
the findings of the research project and offer all teachers of the school district strategies to
engage our students and enrich their learning. If you have any questions please contact me at
814-571-0702 or bes0123@calu.edu. Thank you in advance for your time and consideration.
Sincerely,
Daniel Besch, Jr.
Doctoral Student, California University of PA
114
March 20, 2020
To the Teachers of First Grade Students at BASD,
Over the past several years Bellefonte Area School District has experienced little growth, or even
a decline, in student English Language Arts (ELA) scores over time at the elementary level. For
the past year I have been completing coursework as a doctoral student with the California
University of Pennsylvania. I am working on completing my action research project to answer
the following questions:
What are the factors that are leading to the district’s struggle with low growth in ELA for our
students?
What instructional strategies are teachers using across the district to strengthen student reading
fluency and comprehension?
What external factors are present that can aid the students in their ELA growth or hinder their
progress?
What professional learning opportunities do teachers need to insure more consistent use of data
protocols and appropriate intervention strategies.
As part of the research project I would like to identify instructional practices and intervention
strategies that the teachers are using across the district. My hope is to be able to identify which
instructional practices aided the students in achieving significant gains in their reading fluency
and comprehension. Once those instructional strategies are identified, I plan on working with the
teachers and ELA coaches to provide professional learning for all elementary professional staff
members.
I am writing to invite you to participate in a survey that will help to identify your use of data and
instructional practices in regards to reading fluency and reading comprehension. Please know
that the survey is voluntary and you may withdraw from the survey at anytime. All answers to
the survey will be kept confidential and only used as part of this research project. Names will
not be collected as part of the surveys at this time. I would expect the survey to take
approximately fifteen (15) minutes to complete. The research project has been approved by the
California University of Pennsylvania Institutional Review Board. This approval is effective
09/01/19 and expires 09/01/20.
Please let me know if you have any questions about my action research project and how I plan to
utilize the data that I am asking you to provide. I am hopeful that we will be able to expand on
the findings of the research project and offer all teachers of the school district strategies to
engage our students and enrich their learning. If you have any questions please contact me at
814-571-0702 or bes0123@calu.edu. Thank you in advance for your time and consideration.
Sincerely,
Daniel Besch, Jr.
Doctoral Student, California University of PA
115
March 20, 2020
To the Teachers of Second Grade Students at BASD,
Over the past several years Bellefonte Area School District has experienced little growth, or even
a decline, in student English Language Arts (ELA) scores over time at the elementary level. For
the past year I have been completing coursework as a doctoral student with the California
University of Pennsylvania. I am working on completing my action research project to answer
the following questions:
What are the factors that are leading to the district’s struggle with low growth in ELA for our
students?
What instructional strategies are teachers using across the district to strengthen student reading
fluency and comprehension?
What external factors are present that can aid the students in their ELA growth or hinder their
progress?
What professional learning opportunities do teachers need to insure more consistent use of data
protocols and appropriate intervention strategies.
As part of the research project I would like to identify instructional practices and intervention
strategies that the teachers are using across the district. My hope is to be able to identify which
instructional practices aided the students in achieving significant gains in their reading fluency
and comprehension. Once those instructional strategies are identified, I plan on working with the
teachers and ELA coaches to provide professional learning for all elementary professional staff
members.
I am writing to invite you to participate in a survey that will help to identify your use of data and
instructional practices in regards to reading fluency and reading comprehension. Please know
that the survey is voluntary and you may withdraw from the survey at anytime. All answers to
the survey will be kept confidential and only used as part of this research project. Names will
not be collected as part of the surveys at this time. I would expect the survey to take
approximately fifteen (15) minutes to complete. The research project has been approved by the
California University of Pennsylvania Institutional Review Board. This approval is effective
09/01/19 and expires 09/01/20.
Please let me know if you have any questions about my action research project and how I plan to
utilize the data that I am asking you to provide. I am hopeful that we will be able to expand on
the findings of the research project and offer all teachers of the school district strategies to
engage our students and enrich their learning. If you have any questions please contact me at
814-571-0702 or bes0123@calu.edu. Thank you in advance for your time and consideration.
Sincerely,
Daniel Besch, Jr.
Doctoral Student, California University of PA
116
APPENDIX E
Bellefonte Area School District Primary Elementary Teacher Survey
117
Primary Elementary Interventions Survey
This survey is designed to collect your ideas and instructional practices that you are
utilizing in the classroom with students. The survey is completely optional and all
responses will be kept confidential. We hope to be able to utilize instructional practices
that are proving to increase student growth in reading fluency and comprehension across
all areas of the district. Your information will help to provide professional learning
opportunities for your peers.
* Required
1. Email address *
2.
Please use provide your current elementary building assignment. *
Mark only one oval.
Bellefonte Elementary
Benner Elementary
Marion Walker Elementary
Pleasant Gap Elementary
3.
Please provide the grade level you currently are teaching. *
Mark only one oval.
Kindergarten
First Grade
Second Grade
4.
How many minutes a day do you spend teaching ELA to your students?
Mark only one oval.
90 minutes
100 minutes
110 minutes
120 minutes
More than 120 minutes
5.
What data are you utilizing to inform your instruction? *
6.
How many times a week do you review data to inform your instruction? *
Mark only one oval.
1 to 2 times
2 to 3 times
3 to 4 times Each Day
7.
How effective do you feel your data analysis process is in informing your
instruction.
Mark only one oval.
118
1
2
3
Not Very Effective
8.
4
5
Very Effective
How many times a cycle do you meet with each guided reading group for
students that are Approaching or Not Yet Meeting grade level expectations?
*Mark only one oval.
2 to 3 times
3 to 4 times
4 to 5 times
5 or more times
9.
How do you feel about the effectiveness of your differentiated instruction
for guided reading?
Mark only one oval.
1
2
3
4
5
Not Very Effective
Very Effective
10. What components of the Fountas and Pinnell Classroom (FPC) program are
you using daily in your instruction? Check all that apply. *
Check all that apply.
Interactive Read Aloud - IRA
Shared Reading - SR
Reading Mini Lesson - RML
Phonics Word Study - PWS
Guided Reading - GR
Independent Reading - IR
Book Clubs - BC
11.
In your opinion, which component of FPC has the strongest impact on
student learning? *
12.
Why? *
13. In your opinion, which component of FPC has the weakest impact on
student learning? *
14.
Why? *
119
15.
What are your impressions of the strengths and weaknesses of FPC? *
16. What supplemental resources are you using with students that are outside of
the of the FPC program? Please indicate how often you utilize the strategy. *
17. How do you differentiate for your students when they are not receiving direct
instruction?
18.
What reading comprehension interventions or strategies are you using with
your students that you have found to be successful in promoting student
growth? *
19. What reading fluency interventions or strategies are you using with your students
that you have found to be successful in promoting student growth? *
20.
What professional learning opportunities do you feel would be beneficial to
you and the other staff members of the Bellefonte School District?