Thanks Matt! or the conundrum of grading: PART II

24 04 2009

I thought of putting this as a comment but realized it was bigger than that and wanted to give it its own post.

It is interesting that Matt mentioned performance art grading as a model because as some of you may know I have a theatre background. Furthermore I often think about the grading models I was subject to in that theatrical work when I think about IT grading and often find them useful analogues, so here is a little explanation of how it works and why it is quite relevant:

When I was an undergrad at Swarthmore the grading methodology in my theatre and art classes was very different from any other types of classes.  That was in no small part due to the fact that the deliverables were drastically different because rather than papers and tests we were creating drawing, models, paintings and performances.  Both models worked quite well and ultimately I think both of them have had an influence on how I grade online as well as in the classroom.

The one model that was practiced in my theatre courses was that the bar for completion of wark was set very high, that is they gave us a ton of work to complete within the semester.  It could be designing or performing or directing, no matter what it was it always bordered on the edge of not humanly possible to complete.  The program responded to that by noting how hard you worked to complete the assigned goals and your grade was mostly if not completely based on that accomplishment rather than any subjective evaluation of the quality of your work.  That was very important considering that there are so many variables in theatrical work, such as working with other people and differences in artistic style and preference.  So it wasn’t about how good your design looked or how well you acted a scene, but that you showed that you put effort into your work and were dedicated to the class. In the end the grade served as a reward for hard work and persistence and there was a sense of satisfaction at getting a good grade at the end of a semester.

A similar model was applied for art classes.  Grades in these classes were often based on the progress made in improving your work over the course of a semester.  This balanced out the different levels of artistic capability in the class by focusing more on whether students were really working to push themselves to new level of artistic exploration and invest themselves in increasing their technical skill and ability to think more creatively.  Once again it was not about how “good” your work was but more about how much commitment you showed to improving yourself over the course of the semester.  I even remember one semester where I was at first surprised that I received a low grade by a professor who I had already taken a course with.  Then when I thought about it outside of my haze of frustration, I came to realize that the grades for the two classes really were directly proportional to the amount I had worked towards evolving those two semesters.  It was a powerful moment because rather than having failed at executing a specific task or memorizing certain information I had received a lower grade because I hadn’t completely embraced an opportunity to make myself better.  What better way to employ grades to teach a student life lessons.

So, when Matt mentioned performance art grading it reminded me that these two models have really affected how I grade certain aspects of online coursework.  In particular I think of them when I am grading assignments in discussion and blog formats because I place a premium on participation in these types of spaces.  The reason I place this premium on participation is that I have found that as online conversations evolve (whether in discussion boards or through blog comments or another model) there is a certain point where the students through the communication and conversation inevitablly find their own path through the material to insightful, thoughtful conclusions that are often exactly where I was hoping they would go.  Sometimes they even exceed those expectations.  For me this becomes kind of like the theatre grading model in that if you get them working hard enough and force them to really work the material, they will ultimately find their own path of learning and I would prefer that any day to me telling them what they should know and how to reach a conclusion.  I have seen this in the discussion forums in my Online BA course and I have seen it when my students get into blogging in my courses at Marymount and Cooper and the more I see it when it works the more convinced I am that it works and it does so by putting the process of learning into their own hands. So by building a grading structure based on participation, and repeatedly making it clear that it will affect their grade, I am trying to get them to that space as much as possible because the more they contribute the more likely they are to not only learn the material but also have a powerful role in shaping how they are learning alongside their fellow students; which is what was so great about doing theatre after all.

As far as the art grading structure goes that is actually really valuable for considering how to grade students when learning about these tools IS the content and the tools are not simply a method for teaching materials. When I teach about blogs and wikis it is often the first time that many of the students have used the tools, while some have experience commenting or even authoring their own blogs.  In this environment I try to consider how each student is embracing the assignment of say, writing in your personal blog twice a week or contributing to a wiki entry.  Since these are usually multiple stage assignments I try to trace the path each student is taking and when I think about how they are participating in the experience, I also think about where they have come from and how much they have really worked at it each step of the way.  It is a great way to reflect on how someone is interacting with a new tool and really takes into consideration that so many of our students start at a different place when entering the world of online education or the Internet as a whole.

Hope these little musings and recollections have helped someone out there or just stirred up some ideas.  Also sorry for the length.  Ironic that I tell students to try to keep blog posts short and this one cleared 1100 words UGH!



How much is too much, How much is enough, and What is expected?

23 04 2009

I use wikis in all of my classes because they are really easy ways to provide simple editing functions for students.  It allows them to have a little experience with online content creation and web design no matter what the content, and I think that in the end they dig that.  I also use the wikis because it makes it really simple for me to gather all the different resources/documents I will use to teach a class.  Links are a cinch, as well as posting readings, and attaching videos or audio.  It also makes it easy to maintain a dynamic syllabus and course description that students can go back to (no re-handing out of syllabi or qorries about lost papers).

There is a problem with wikis however in that they are endlessly expandable. Creating a new page is just as easy (if not easier) than any kind of content addition and the site can grow and grow. The reason that this is a problem is that there really isn’t any kind of artificial boundary to creation that can reign in your expectations of what you should be doing for a class.  This means that (sigh) we have to determine when providing all this extra content is a good thing and when it just becomes too much for students as well as teachers.

Since teachers have started using IT and teaching online there has always been the question of how much labor should be diverted to the use of these tools.  Some of the concern has been that using these tools takes time and if extra work is required should that labor be considered in addition to or replace the amount of work done in preparing for classes without tech.  This has real life ramifications in particular considering that often the amount of labor goes up while the pay stays the same.

But my question here is less about money and more about the value to the teaching/learning experience of spending large amounts of extra time building websites/wikis and adding endless amounts of material for the students because it is easy and because we can.  I think it is important to constantly keep in mind how much is too much and when information or experiential overload can actually detract from the learning experience.  Sometimes I have to remind myself that just because I can post links to numerous sites/readings/videos/images all in one space doesn’t necessary mean that I should do as many as are physically possible.  What seems like a bounty of quality can actually be overwhelming to students (especially if they are grappling with working the tool as it is) and they are often likely to be turned off to all the materials.  This is particularly important when I have a group of students with differing levels of facility with IT tools and and different levels of fluency with digital reading comprehension with the less experienced users becoming more easily overwhelmed by masses of material.  In the end I am trying to be more selective with how the course materials build up from week to week or semester to semester so that there is a logic and comfortable flow to the different types of content they are presented.  It takes a lot of thought however to recognize that as a course site becomes larger and larger that I should practice the same lessons about concision and composition in creating my own pegadogical landscapes as I use in teaching students how to write.  I try and remember that I am not creating an encylopedic resource collection but rather designing a composed course site where materials are clearly organized, well curated, and pointedly relevant to the specific scope of the class.

There is more to this that I want to cover in other posts, like a more detailed analysis of what expectation there is for faculty teaching online and using IT tools from administration and what kind of expectations we set up for ourselves in creating online spaces, but for now I think I am going to stop. Any thoughts, comments, common experiences?  I’d love to hear how people determine where to draw the line with materials.



The conundrum of grading in an IT age

15 04 2009

I went to finish grading one of my classes assignments and lo and behold half of the grading I had done had gotten wiped out in a file corruption problem. (I had been using a word processor called Scrivener which I think I’ll write about more in the future)  Now the file corruption wasn’t a ITP issue but it reminded me of an issue I have dealing with online submissions and how to grade and provide feedback for my students(who are oftenequally confused as to how they will be getting their grades if not back on a piece of paper.  Having students submit work as blog posts or on wikis makes it harder to do the traditional editorial marks that make grading a paper easier.  This means I often have to go to longer lengths to provide an explanation of the location of a grammatical or stylistic problem then provide a lot of the detail that the editorial mark could have provide.  Not to mention that sending them an email with feedback and a grade means they have to bounce back and forth between two different types of e-objects and hopefully something doesn’t get lost.  Things like notation in Word and using discussion pages are options, but they are unelegant with questions of layout and public availability arising.  Right now I am going with this model

1. First of all make sure to do a careful reading, this has nothing to do with IT but relates to good pedagogy in general so worth including

2. Once I have found those things I want to comment on I do one of two things.  I either copy the text I am commenting on and paste into the document where I am recording grade (usually an email or word processing document) or I take note of the paragraph and/or page and where in that section the area I want to comment on is and write that down in the email or document.

3. Next I provide as detailed as possible/or necessary an explanation of why I selected the particular section and what was notable or incorrect.

4. I then provide an equally detailed explanation of what the student could have done differently either grammatically, stylistically or with the content they have chosen to write about.

5. Finally I gather my general perception of the piece and provide them with the number or letter grade I believe they deserve.

This might seem all a little banal but the whole idea of grading IT projects becomes more complex and I will continue to deal with it because in some environments (such as complete online courses) there is so much that is recorded and you have to decide how you should be grading different materials and how you want to grade high stakes and low stakes writing differently.  No matter what though, I think that in the end the benefit of these new methods of handing in materials definitely outweigh the challenges of provding good grading for the students to reflect on.



Random babblings and divergent meanderings

15 04 2009

This is not my first blog and it probably won’t be my last.  Despite having taught with and about blogs, wikis and other Web 2.0-ish tools, I can’t find my way to post regularly on a blog. Maybe it has to do with insecurity about what I write, fear of logorrhea, not quite enough vanity, or the fear that no one will ever read it, but for whatever reason it’s been a no go to this point.

Now thought the time seems ripe to try again.  With the Academic Commons blooming, the tools readily at my disposal, and a developed background of experience teaching with and about interactive technology in educational (ITP, short for Interactive Technology and Pedagogy from here on out) settings it seemed like I should try to share my experiences and see if anyone cares.  So, this blog will be going here and there in pursuit of some kind of . . . well something to be determined.  What I intend to do is muse on how the way I plan my classes is influenced by technology and how the implementation of that technology fails or succeeds on a general basis and with specific examples.  Since I have three classes going full bore right now that are all using blogs/wikis/etc. there should be some good stuff.

I hope that you join me in my (mis)adventures and that you can provide me with feedback about what makes sense, what doesn’t, what you would borrow, and what you wouldn’t do and why.  See you in the ether.






Skip to toolbar