Monitoring and Evaluation Section: Guiding Questions

Next Steps


Drafting will begin 01/29/07.

Suggested Action Steps and Guiding Questions (p. 46-48)

CDE Educational Technology Planning Guide

Needs and Resource Assessment


Review the implementation monitoring process included under each component of the plan.

• How will the timelines and benchmarks included in each component of the plan be used to create an overall system for measuring the successful implementation of the plan?

The district will utilize the various monitoring and evaluation tools, strategies and timelines identified in each section (Curriculum, Prof. Dev., Infrastrucutre and Budget) to measure levels of success.

• How will the level of technology used be determined over time?
Technology will be integrated through the curriculum as standardized curriculum and benchmarks are developed. District level directors, coordinators, and site administrators will be kept up-to-date on district and state assessments throughout the school year. Teachers are able to keep student records and attendance online and an evaluation of this system is ongoing.
What data will be collected? A variety of student assessments are collected throughout the school year. As data is reviewed it will be analyzed to determine the impact of technology on the curricular program. Data will be valuable for planning the use and implemention of technology to assist in areas where students are not meeting district curriculum goals.
What are the data collection intervals? The data will be collected throughout the school year through teacher records, report cards, district, state, and through standardized tests. The information obtained through the monitoring and evaluation process will be used to update the technology plan and to inform decision makers and stakeholders so that decisions in funding, training, and support can be made.

• How will data be collected and analyzed to ensure that equity and access issues for students, as well as for teachers and administrators, are monitored on an ongoing basis?
In order to maintain the accuracy and relevance of our Education Technology Plan, it is essential to monitor and if necessary revise each component of this plan on an ongoing basis. Ongoing collection of data and the use of that data to inform decision-making is embedded into each objective in our tech plan components under the monitoring and evaluation sections in our plan Criteria components 3, 4, & 5.

Determine how to evaluate the impact of technology on student learning.

What criteria will be used to measure success (e.g., test scores, student portfolios, percentage of students attaining grade-level content standards, attendance, dropout rate, matriculation to college, or full-time employment)? Are they the same criteria established for measuring success in the school district’s compre-
hensive local improvement plan?

Impact on student learning will be monitoring using STAR data and district benchmarks. This is the same criteria that is used for measuring success in the school district's comprehensive local improvement plan.

• How will the evaluation treat special populations to determine not only the overall effect of the use of technology but also its effect on targeted populations, such as lower socioeconomic students, high-achieving students, special education students, and so forth?

District and school Professional Learning Communities (PLCs) will analyze STAR data and district benchmarks and the progress of at-risk students.

• How will the evaluation take into account different levels of access and type of use?

Teacher and student surveys will include questions to identify and analyze levels of access and types of use.

• Have teachers and site administrators been consulted in determining the criteria that will be used to measure success?

Yes - the teachers and administrators had input in determining the criteria. This was further explained at staff meetins by each site administrator to ensure that all teachers knew what benchmarks were being utilized to measure success.

Research and consider monitoring and evaluation tools provided at little or no cost to the school district.

• Has the CTAP regional representative been contacted for guidance and assistance?

No, the CTAP regional representative has not been contacted yet.

• Have institutions of higher education with expertise in education technology been contacted for guidance and assistance?

No, higher education has not been involved in this process but it is a future goal.

• Are there nearby members of industry that may be willing to partner in the evaluation process?

Yes, higher education will be invited to participate as well as local advisory council members, site base council representatives, and the Coachella Valley Economic Partnership (CVEP)

• What resources from government, nonprofit agencies, and/or industry would be useful?

Resources from The Coachella Valley Economic Partnership (CVEP), reserach based documents, staff development information, conference information, business and advisory groups would all be helpful.

• Have other district technology and library media coordinators been contacted regarding recommendations for evaluation design
and/or instruments?

Yes, both Fullerton Unified School District and Newport-Mesa Unified School District have been contacted.

Design a schedule for evaluating the effect of plan implementation while realizing that infusing technology into daily school
operations is an evolving process. (A sample management chart and implementation timeline are provided in Section IV, “Technol-
ogy Planning Toolkit.”)

• How often will plan implementation be evaluated and who will evaluate the effect of the plan on teaching and learning?

An educational committee will meet quarterly to review the process and plan's effectiveness. This will include the Director of Educational Technology, the Senior Directors of Elementary and Secondary Education, the DIrector of Assessment and Accountability, the Director of State and Federal Programs, the DIrector of English Language Learners, the Coordinator of Staff Development, site administrators and others as needed.

• How will data be collected and analyzed to ensure that equity and access issues for students, as well as teachers and administrators,
are evaluated on an ongoing basis?

Questions will be inserted into existing teacher and student surveys to elicit responses regarding equity and access issues for students, teachers and administrators.

• Have teachers and site administrators been consulted in designing the data collection method?

The above directors and coordinators will meet with teachers and site administrators to develop a data collection method..

• Is there an open line of communication for teachers, parents, and other stakeholders to provide their suggestions and opinions in
the evaluation process?

As the evaluation process begins, focus groups will include teachers, parents, students and other stakeholders. In addition to attending meetings, stakeholders will be able to e-mail their suggestions, meet with administrators at the site or district level, and participate in school site council meetings.

• What will be the frequency of reporting evaluation results? Will reporting be done at least yearly?

District and state assessment data and survey data regarding the implementation of the district technology plan will be presented to the Board of Education once annually.

Determine how and when the results of the monitoring process and evaluation will be used.

• How often will the status of plan implementation be reported to the district superintendent? To the local governing board? To other
stakeholders?

The Superintendent will attend quarterly committee meetings to receive updates on implementation of the technology plan.

• If necessary, what process will be used to make mid-course corrections as a result of the monitoring effort or the evaluation?

The use of all technologies including video, probeware, multimedia and handhelds will be included in the monitoring process to make any necessary mid-course corrections. The use of new technolgies being tested by select teachers and/or schools will be monitored and evaluated as to impact on student achievement.

• How will strategies that have had a positive effect on teaching and learning be communicated to others so that they can be replicated?

Information that is gathered will be presented to all principals and administrators at monthly meetings during the year. Principals will review the data about technology integration with teachers and stakeholders at the sites and share this information with School Site Councils so that modifications can be made to the technology plan for the next school year.

• How will technology success stories be documented and publicized?

Through district website, quarterly report to the community, local media coverage, monthly school/principal newsletters.


Goals


As per the PSUSD mission statement, it is important that the implementation of the technology plan ensures that each child can obtain high levels of achievement in order to reach their full potential; that student learning is the first responsibility; and that the technology plans develops procedures that are fair and equitable for all students.

NOTE: Until curriculum and PD goals are established, please work with those groups on establishing their goals.
Also, be sure to revisit the committee's intial visions and the district mission statement.


Monitoring and Evaluation

(Note: Each section has a monitoring and evaluation component, in addition to the overall monitoring and evaluation section.)

NOTE: For the December 11th meeting, please split up and work with the Curriculum, PD, and Infrastructure groups as they answer the guiding questions for the Moniroting and Evaluation portion of their section of the plan.