Mace Mentch's Assessment Blog http://blog.case.edu/mwm13/ An online journal about assessment of technology in education. en-us Fri, 28 Mar 2008 12:44:41 EST Fri, 28 Mar 2008 12:44:41 EST mace.mentch@case.edu mace.mentch@case.edu http://blogs.law.harvard.edu/tech/rss Movable Type v3.121 Welcome to my assessment blog! http://blog.case.edu/mwm13/2007/09/06/welcome_to_my_assessment_blog Joni Spurlin, University Director of Assessment and Associate Director of University Planning and Analysis at North Carolina University reminds us... http://blog.case.edu/mwm13/2007/09/06/welcome_to_my_assessment_blog Intro Thu, 06 Sep 2007 14:59:25 EST Joni Spurlin, University Director of Assessment and Associate Director of University Planning and Analysis at North Carolina University reminds us that assessment is one word with many definitions. Depending on who is defining it, and more importantly, for what purpose, assessment can have an array of interpretations. For some, it focuses on student learning and performance, some look to assessment for program or process improvement, others assess resource needs, and still others focus on assessment for meeting regional accreditation. All these diverse interpretations make the topic of assessment complex and confusing. My own interpretation of assessment is quite simple, we assess technology to determine its effect on student learning and performance. This is not to say that the other components of assessment are not necessary or important, but that the primary emphasis should be on student learning. In this journal I will cover many aspects of the assessment process including needs assessment, formative evaluation, reaction evaluation, impact/summative evaluation, and metrics, but I will strive to relate all of it back to student learning and performance. Hopefully once a clear model emerges, we will be able to look at some specific examples and results from the Case Western Reserve community. I invite all out there to participate in my exploration of this very timely and extremely important topic. Stay tuned for more.

]]> What's happening with assessment: latest news http://blog.case.edu/mwm13/2008/01/03/whats_happening_with_assessment_latest_news ITAC has initiated a series of mini surveys to provide us with just in time information regarding use of Courseware.... http://blog.case.edu/mwm13/2008/01/03/whats_happening_with_assessment_latest_news Thu, 03 Jan 2008 15:04:48 EST ITAC has initiated a series of mini surveys to provide us with just in time information regarding use of Courseware. Our first mini survey asked the students if they want to have the lectures available for download load onto a video ipod. Results obtained from 392 students indicated that 42% of the respondents, who had ipods, would like to have them available for download. Additionally, 31% of the students, who said that they didn't have a video ipod "yet", said that they also would like to have the lectures available for download on a video ipod device.

Our second mini survey held the week before finals, asked the students if they would be using Courseware to review and study for finals.

]]> Courseware Student Survey: latest results http://blog.case.edu/mwm13/2008/01/03/courseware_student_survey_latest_results Our latest Courseware Student Survey was completed on December 11, 2007. Results were obtained from 600 student participants. From our... http://blog.case.edu/mwm13/2008/01/03/courseware_student_survey_latest_results Thu, 03 Jan 2008 15:37:15 EST Our latest Courseware Student Survey was completed on December 11, 2007. Results were obtained from 600 student participants. From our previous investigations and conversations we have learned that the number one issue with video taped class lectures is attendance, but we are seeing learning effects that go beyond just this concern. While the students readily admit that they use Courseware as a substitute for going to class for "cold, early morning classes", this has not become the main motivation according to our results. For example, approximately 50% of the students who responded to the survey indicated that the the frequency of missing class is about the same as it is for classes that aren't using Courseware. Of course, faculty differ in their opinions on class attendance. Some want students to attend every class and make it a requirement and give or take away points based on it. Others feel that if the student can succeed without coming to class, this is fine with them. When students are asked about the primary use of Courseware, while some do indicate it as a substitute for going to class, many more indicate that they are using it for study and review, to clarify and add to notes, and to understand the content better.

The learning effects of Courseware are impressive. Students reported that they did better in their classes because the videos were available for study and review, that they could manage their time more effectively, that they retained more, and that they could learn at their own pace. These outcomes are significant in providing students a tool that enhances their academic success.

Do students like Courseware? Well, 97% of the students who responded said that, overall they are satisfied with Courseware and 97% would recommend Courseware to others. I think they like it.

]]> Courseware Student Mini Surveys Latest Results http://blog.case.edu/mwm13/2008/02/28/courseware_student_mini_surveys_latest_results Here are the results to date of the Courseware Student Mini Surveys. What are mini surveys? These are short, one... http://blog.case.edu/mwm13/2008/02/28/courseware_student_mini_surveys_latest_results Thu, 28 Feb 2008 12:18:13 EST Here are the results to date of the Courseware Student Mini Surveys. What are mini surveys? These are short, one question surveys that allow us to look at our service level, consider features to be added from the students' perspective, look at usage, and explore learning effects. You can look at the results by clicking on the link below.

Mini Survey pdf

]]> Technology Enhanced Classroom Faculty Survey http://blog.case.edu/mwm13/2008/03/28/technology_enhanced_classroom_faculty_survey Here you will find the results of the Technology Enhanced Classroom Faculty Survey that was completed in mid-February. Participants included... http://blog.case.edu/mwm13/2008/03/28/technology_enhanced_classroom_faculty_survey Fri, 28 Mar 2008 12:44:41 EST Here you will find the results of the Technology Enhanced Classroom Faculty Survey that was completed in mid-February. Participants included 183 faculty whose classes take place in a TEC. The survey's purpose included three elements. First, we wanted to garner support for refresh and maintenance of these classrooms. The classroom enhancements were initiated in 2002 and at this point some equipment warranties are running out and these devices are beginning to show their age. Second, we wanted the gage our support levels for the classrooms in order to make any necessary adjustments. Finally, we were interested in perceived teaching and learning effects of the technology from the faculty perspective.

The survey produced 21 pages of written comments, clarifications, and explanations based on the the information in the survey questions. As a result of this level of response, it took somewhat longer to analyze. Summaries, in rank order, are included in the slides. It was suggested that a general comments section be made available to provide an opportunity for feedback on issues not directly addressed in the survey questions. This will be included in any future TEC surveys.

You may access the survey here:

Download TEC Survey

In addition to the results presented here, there will be a white paper coming out that will provide a more specific summary of what is included in the slides.

]]>