Dear fellow seminaristianites,
I ask students to give peer feedback on short arguments submitted by their fellow students, in which they score them from 1 to 5 on four different aspects, and then explain their score and make suggestions. The rubric I developed for this describes what should be expected for each score. Typically what happens is that students mostly give each other fours and fives, with threes being reserved for the barely coherent.
In the fall, I plan to ask students to collaborate to develop their own rubric. I will ask them what sorts of things they think would be important to evaluate for a good bit of argumentative writing, and what would qualify something as below, above, or at average for each of those criteria. I would probably do this as a think/pair/share, before opening it up to a class-wide discussion in which I would write down and organize their suggestions.
The fact that students have a personal interest in what standard they will be judged by, as well as it being a low-stakes situation for sharing their ideas, should lead to a high level of participation, and I hope a greater commitment to the resulting assignments that the rubric will be applied to.
I am unlikely to have decided to try this without the example and feedback from Kyllikki Rytov in my group, who has successfully used this approach in her own classes.
The remaining issues I need to decide before implementing this are:
- How much guidance to give the students:
- e.g.
- Should I decree that the rubric scale will be 1-5, or let them decide?
- Should I tell them the four characteristics/dimensions I have used before (rational persuasiveness, accuracy, writing mechanics, and originality), or let them come up with their own?
- e.g.
- How much time to allot to each step of this in class.
- Whether to break it up into more steps or fewer.
- How to make the instructions as clear and unintimidating and potentially fun as possible.
If anyone has advice or suggestions, I’d love to hear it!
The Artifact in Progress:
Instructions
For four weeks of the term, you will be asked to submit a short argument in which you take and defend a position regarding an issue covered in recent class readings and discussion. In the week after submitting an argument, you will also be asked to read and evaluate some of your fellow students’ arguments. Today’s task is to create the rubric for how you will score (or be scored) for these arguments.
[Give quick example of a basic rubric, e.g. “Handwriting” – 1=completely illegible, 2=can only be read with effort, 3=legible, 4=easy to read, 5=easy to read and beautiful to look at]
[Three minutes]
Take a few minutes now and think about what is needed, generally, in a good piece of argumentative writing.
Write these down.
If you have time, see if you can identify broad categories that could organize the items in your list. Draw lines, mark with colors, or put a symbol to mark things that you think belong to the same category.
[10 minutes]
Next, get together with a classmate or two and compare lists. Establish which of you will share them with the class.
See if you can identify and agree on four or five broad categories that cover the items in your lists (e.g. ‘good grammar,’ ‘correct spelling,’ ‘enjoyable to read,’ and so on might all fall under a category like “clear writing” or “good communication of ideas”). These would be the ‘Dimensions’ in the left-hand column of the rubric. Write these down.
Discuss what you believe should count as a 1 (lowest), 2, 3, 4, and 5 (highest) for each of these dimensions on the rubric. Take notes on what you think the criteria should be for each score that could be given on the rubric. That is, if a “3” is given for a particular Dimension, what specifically does that mean, in terms of that Dimension? If you were given a 4, how should you understand it, or if you give a 2, how should the student receiving that score understand it?
[15 minutes]
Get together as a class and share your ideas. I will write down all of the suggestions, then consolidate and edit them to make the rubric you will be using for the Evaluations portion of this assignment.
Short Argument Evaluation Rubric
Dimensions | 1 | 2 | 3 | 4 | 5 |
5 replies on “Rubric ruminations”
Well, first, *thank you* for the credit–I learned this from my brilliant WPA in grad school, so it’s not original to me. ????
Second, you really break this down well in the explanation, and I commend you for that because I feel like I can never type out the directions that I used to give orally. Good luck with this!
It’s not the originality so much as the real-world experience that you brought to the idea!
Thanks for the compliment. I had the funny experience today of reading student evaluations of my own writing (I gave them a make-up assignment, and not enough arguments had been submitted by students to the folder, so I added some of my own, trying to disguise them and make them sound student-y) – anyway, long story short, at least one student was quite severe about how hard one of mine was to follow! I was given a B+! 🙂
When you’ve done this, do you ask them to give the dimensions/categories to evaluate, or do you just ask them to fill the rubric for categories you suggest?
Hmm. Together, we parse key concepts/goals that students want to be evaluated on, and that generally translates into categories that I kind of steer them towards if they’re not already getting there. For example, in a writing and editing course, I needed to be able to evaluate students on the technical aspects of their compositions, so, if students didn’t articulate anything like “genre conventions” or “technical quality” or something along those lines, I’d point at something like “genre” and ask, “Thinking about genre, how am I going to evaluate you on how realistic or logical your text is?” Does this make any sense, lol?
Hi Amy, You’re structuring a unique opportunity for student interaction and immediate feedback on their class focal points. Teaching Research Literature refers to this technique as “Peer Assessment”. I was inspired by your well done application, so I took a dive into – “The Reseaech”. The good news supports the methology and it also comments on the “benefits” to the assessor(s), team assessment, anonymity to foster “more honest feedback” Research further mentions the careful monitoring of “social factors”. On that note, there may also be variations in student responces to the “Artifact” based on culture/diversity.
As per rubric/instruction concerns – I like the tactic – “keep it simple” and progressively expand new perspective for students to consider, analyse and “Grade”. Thank You for sharing this interesting Artifact. Sincerely, Roger