Best Practices, Too?
Designers of monitoring programs should consider whether to measure only compliance with statutory and regulatory requirements or whether to also gauge implementation of best practices that are not mandated by law. The U.S. Department of Education has permitted flexibility in incorporating standards that drive educational best practices, because increased student achievement is the ultimate goal of ESSA. That permits schools to align standards to the strategic vision of the school system, using compliance monitoring as only one component in its realization.
Effective program implementation begins by setting standards, followed by training on the standards, then implementing the standards, followed by testing their implementation, and retraining and retooling on the standards based on gaps identified during reviews.
Thus, the standards selected for monitoring can roll into a larger vision. However, it is important to distinguish in the monitoring report which standards are strictly measures of compliance and which are based only on effective practices. In the latter case, schools should not be held accountable or be required to create Corrective Action Plans for standards not mandated by law. The essential purpose of those reviews is to provide technical assistance.
How Quantitative to Be?
Will your program be quantitative or qualitative - or both? A quantitative approach permits data visualization of trends in compliance, including strengths and weaknesses. Data can be graphically displayed in heat maps and charts. Quantitative check-the-box approaches are easier to implement because they do not require development of lengthy, individualized reports. However, qualitative approaches are often more effective in changing behavior. They thoughtfully report challenges to educating students, tailor them to each school’s challenges, chronicle best practices and exemplary programs, and better address root causes of non-compliance or poor performance. Qualitative reports can be more principled-based. For example, in a fiscal review, a principled-based approach might gauge whether funds drove improved student achievement, whereas a rule-based approach asks whether a school complied with allowable uses of funds under the law.
Fiscal or Educational?
Because protecting taxpayer money from loss or abuse is a stated objective of ESSA, monitoring should include reviews of how program funds are spent. Not only can fiscal reviews include examinations of expenditures to ensure they are permitted under the law, but they can also document the components of a program's financial management system. But how to combine fiscal reviews with monitoring of educational best practices – such as differentiation of instruction, library programs, or programs for English Language Learners – is a choice designers of the monitoring program make.
Should ESSA monitoring be combined with other types of educational monitoring? Some districts incorporate mandated monitoring for other statutes such as the Individuals with Disabilities Education Act. This requires a multi-disciplinary monitoring team but significantly reduces the burden on schools from multiple visits.
Weakness in the System?
How will trends be identified? Ideally, monitors will have a mechanism to identify systemic weaknesses, ranging from backlogged software orders to delays in background investigations preventing the hiring of teachers.
ESSA states that monitoring must include technical assistance. This reflects a "soft" approach to monitoring. Unlike compliance monitoring in more highly regulated industries, its aim is to enhance compliance in a non-punitive way. Providing technical assistance in monitoring is required by law, but how much and what type of technical assistance is left to the monitoring design team.
When to Begin?
Stakeholder buy-in to a monitoring program dramatically increases when the standards to be monitored are discussed, selected, and communicated well in advance of the monitoring visits. Planning ahead is a matter of fairness. It also enhances compliance, because it gives schools and program leaders time to implement the activities being measured. It also provides time for training, an important part of the program implementation continuum. Furthermore, since the monitoring standards reflect the system's priorities, setting them early moves the school or system closer to realization of its strategic vision as reflected in the school or district plan. Therefore, the ideal time to plan a monitoring program is after the spending plan - whether for school improvement or otherwise - has been approved and while implementation is underway.
Who Will Monitor?
Related to budget is who will conduct the compliance reviews. Naturally, monitors should be detail oriented, accurate, knowledgeable on school operations, and well trained to provide technical assistance when gaps are found during monitoring visits. But monitors should also be independent. Line officers held responsible for performance of a pool of schools or individuals developing the programs to be monitored may be challenged in providing objective, independent reports. Why? Because honestly describing school challenges may reflect negatively on their performance. Although unrealistically positive reviews make an organization look good on the surface, they do little to improve education. The selected monitoring team should also have ample time to conduct the reviews or they will not be completed.
How to Train Monitors?
How will monitors be trained to ensure reports are standardized and reviews are completed with consistency, accuracy, and thoroughness? Tools can include pre-visit training, electronic monitoring tools, knowledge management sites, and collaboration software to address frequently asked questions, re-emphasize training points based on weaknesses identified on school visits or in reports, and a library of the original sources of all standards. These include statutes, regulations, Executive Orders and Guidance, state policies, or effective practices being monitored.
Scheduling will run most smoothly by contacting each school in the monitoring plan for the year and mapping out breaks, holidays, Tribal celebrations (if applicable), administrative retreats, and testing times. Each is entered into a master schedule before visit dates are finalized.
What Size Budget?
Once an agency has determined what monitoring it should undertake, it must develop a budget. Factors to consider include the amount of time needed to design the program, the number of site visits, the number of days per a site visit, travel expenses, equipment needed, report-writing time, number of desk/document reviews, scope of technical assistance, and time needed to develop communication tools such as Intranets, software, and collaboration sites. Time to develop monthly status reports and monitor training should also be considered.
The size of your monitoring program is based on both available funds and the importance of the monitoring program to the realization of state or systemic strategic goals. Logically, when there are challenges such as misspent funds or chronically low student achievement, monitoring budgets should rise. Likewise, the greater the number of schools or programs being monitored, the larger the monitoring budgets required.
The level of existing oversight and the scope of responsibilities of those charged with oversight also plays a role. If schools rarely receive management visits, monitoring can fill an important gap in gaining critical information from the front lines to fuel strategies for improvement and technical assistance.
Find Something Serious?
Monitoring programs should include escalation and resolution protocols in the rare instances when monitors encounter situations in which children are in danger or taxpayer funds are being improperly diverted. Missing in many monitoring programs is an "intensive review" function for areas requiring further and extensive investigation or consequences when something serious occurs.
Let Us Help.
Designing a monitoring program is a complex task. Rely on us to guide your team through the process and develop a monitoring program customized to your needs.
4725 N. Sheridan Road, 1-S
Chicago, IL 60640
South Holland Office
16103 LaSalle Street
South Holland, IL 60473
975 South Durkin, Suite 201
Springfield, IL 62704