Data-Based Decisions and School Accountability (FTCE School Psychologist PK-12)
FTCE School Psychologist PK-12 (036) is an 80-item multiple-choice examination scheduled for 150 minutes.
- It covers research and data use, development, academic and mental-health intervention, safety, consultation, ethics and education law.
- For data-based decisions and school accountability, use relevant evidence and professional procedures.
- Check FDOE for current scoring and certification guidance.
On this page7 sections
Define the problem before choosing data
Data-based decision making begins with a question that is specific enough to guide collection. ‘The student is failing’ does not identify the skill, setting or conditions. A stronger question might ask whether a student’s independent written responses improve when the assignment is chunked and a planning organizer is modeled. Define the outcome, context and time period before selecting measures. Section 36 asks candidates to analyze checklists, records, assessments, interviews, observation and curriculum-based measures as parts of comprehensive problem solving.
A useful process separates problem identification, analysis, intervention planning, implementation and evaluation. First describe the discrepancy using observable data. Then examine why it may occur by reviewing instruction, environment, student strengths, skills and relevant context. Select an intervention that addresses a plausible cause, define who will do what, and specify how the team will measure implementation and response. If the student does not improve, revisit the hypothesis instead of repeating the same action indefinitely.
Example: A student completes 40 percent of independent math problems in class. Before labeling motivation as the cause, compare assignments across subjects, observe task initiation, review work accuracy, ask the student about the task, and confirm that directions and materials are available. The problem may involve prerequisite skill, unclear directions, attention, avoidance of a specific task or environmental distraction. The collected evidence should discriminate among plausible explanations.
Select methods and informants strategically
Each data source has strengths and limits. Records provide history but may use inconsistent definitions. Interviews reveal perspectives but depend on recall and question wording. Direct observations show behavior in context but sample limited moments. Standardized tests support comparison under defined conditions, while curriculum-based measures can reflect performance on taught content. Checklists can organize reports, but rater expectations and opportunity to observe affect results. Combine sources because each adds a different view, not simply to accumulate documents.
Choose informants who know the relevant setting and behavior. If the concern occurs in science class, a teacher from another grade may have little direct evidence. Student voice can clarify effort, safety, belonging or understanding. Family input can describe development and behavior outside school. Differences between informants may be meaningful: a student could succeed in a quiet small group and struggle in a crowded transition. Rather than average conflicting ratings automatically, investigate conditions that could explain them.
For a behavior that occurs during transitions, observe several transitions, record the antecedent, operationally defined behavior and consequence, and avoid interpreting motive from the description. ‘Left the line after a peer called his name’ is more informative than ‘was defiant.’ Include nonoccurrence and comparison conditions when feasible. This makes the data useful for identifying patterns and testing supports.
Use multiple measures without confusing them
Multiple methods means selecting measures that answer complementary questions. It does not mean treating every result as equally precise or combining scores mechanically. A standardized academic measure may help describe performance compared with norms; a work sample shows what the learner produced in a current unit; progress monitoring indicates change on a defined target. When the results differ, examine the constructs and conditions rather than declaring one source correct by default.
A student’s standardized reading score may be low while class assignments are mostly complete. The classroom assignments might have been read aloud, completed with peer help or drawn from a practiced unit. Those differences do not invalidate either source. The team should document supports and determine whether the question concerns independent decoding, comprehension, grade-level access or class performance. Recommendations must align to the intended educational decision.
Assessment of specialized populations requires attention to access and interpretation. Consider the student’s age, communication, sensory or motor needs, language experience, culture, and the validity of the measure for the intended population. Consult qualified professionals and follow applicable procedures. A test that cannot be accessed as designed may not provide interpretable evidence. Avoid changing administration casually; document modifications and know how they affect interpretation.
Move from data to a recommendation
A recommendation should name the target, the support, the context, the responsible person and the progress indicator. ‘Provide support’ is too vague. A more useful plan might teach a specific prerequisite skill in a small group, provide guided practice during the target assignment, and review accuracy and independence weekly. The measure should be sensitive to the expected change and collected consistently. Set a review date appropriate to the intervention and school process rather than inventing a universal timeline.
At the review, check both fidelity and response. If the planned lessons did not occur or the measure was administered differently, outcome data are hard to interpret. If implementation was consistent but progress remains limited, reconsider whether the hypothesized barrier and intervention match. If progress is adequate, decide whether to continue, generalize, or fade support based on evidence and team judgment. Document the reason for the decision.
For school-level accountability, aggregate data can reveal patterns across grades, programs or groups, but protect privacy and avoid reducing students to metrics. Define the denominator, subgroup and time period. Examine access and opportunity alongside outcomes. A changing enrollment or reporting practice can change a rate without reflecting instruction. Use data to improve services and identify questions, not to assign blame from a single chart.
Consider culture, language and marginalization
Data collection should be sensitive to cultural, ethnic and linguistic differences and to the risk of marginalization. Ask whether assessment language matches the student’s language experience, whether norms are appropriate, and whether the referral reflects unequal opportunity or biased expectations. Review instruction and access before attributing a difference to an individual deficit. Include family and student perspectives in ways that support accurate interpretation and respectful communication.
Suppose a multilingual student is referred for limited classroom participation. Observe participation across settings, identify the language demands, invite the student to respond in multiple formats when appropriate, and learn how the student communicates in familiar contexts. A quiet response in a large English-only group does not prove low knowledge or a social disorder. The team should distinguish language development, opportunity, familiarity, anxiety and academic understanding through relevant evidence.
Fairness is not achieved by ignoring group patterns. If a school’s data show that one group is referred for discipline at higher rates, examine referral criteria, classroom context, access to support and consistency of implementation. Avoid inferring individual cause from group-level data, but use the pattern to guide further review. State conclusions precisely and include uncertainty.
Worked case and accountability review
A school wants to evaluate a tutoring program because benchmark performance appears flat. Start by defining participation and the target outcome. Check whether students attended, whether sessions addressed the skills identified by the assessment, whether instructors used the planned materials, and whether benchmark forms and testing conditions were comparable. Examine student work and progress measures between benchmark periods. A stable school average could hide improvement in one group and no change in another.
If implementation varied, the first decision may be to improve consistency and monitor again. If students received the intended support and a matched skill measure remains flat, the team should review intervention fit, instructional intensity and assessment sensitivity. Compare outcomes with access, attendance and prior instruction. Do not claim the program failed solely because an overall average did not move, and do not declare it successful based only on satisfaction surveys.
A final report should distinguish process findings, outcome findings and limitations. Explain what the evidence supports, what remains unknown, and what the next cycle will test. This structure protects credibility and makes accountability useful for learning. On FTCE items, the best response usually makes the decision process explicit and uses more than one appropriate source to evaluate student or program needs.
Add detail on measurement of outcomes
Before comparing outcomes, define the numerator, denominator, population, period and data source. A count of referrals differs from a rate per student; a rate can still conceal differences in attendance, exposure or reporting. A school-level average can hide individual variation. State whether missing observations are excluded and whether the measure changed. These details determine what a graph or table can legitimately show.
For student progress, align the probe with the skill and use consistent conditions. A broad annual score may be useful for overall achievement but too insensitive for short-cycle intervention decisions. Curriculum-based measurement can show repeated performance on a specific target, while work samples explain errors. Use both when they answer complementary questions.
For accountability, disaggregate cautiously and protect confidentiality. A group pattern can identify inequity or a service gap, but it does not diagnose an individual. Use the pattern to ask better questions and assess system practices.
Common questions
Should a team average conflicting informant ratings?
Not automatically. Investigate setting, opportunity to observe, task demands and behavior definitions to understand why reports differ.
Is a screening result a diagnosis?
No. Screening identifies possible need for follow-up; it does not by itself establish a cause, diagnosis or eligibility decision.