My review of everything

[OMSCS/OMSA] Peer grading is prisoner's dilemma



There are a few classes in both OMSCS & OMSA (especially for OMSA) where homework assignments are peer graded (also known as "peer review" or "peer feedback"). Typically, three (anonymized) class mates are randomly picked to grade your homework, while you also (anonymously) grade three other (also randomly selected) students. The median score among the three peer reviewers becomes your final homework score.

The rationale given by the instructor/TA for this activity is "you can learn from studying your peer's work !"
While I understand the spirit of it, fundamentally, the incentive structure for peer grading is flawed. Because almost every class decides the overall course grade as quantile (aka "a curve"), e.g. Top 30% students get A, next 30% gets B, so on.
Then as a student, it is in your advantage to give the lowest possible score in peer grading. It's a textbook example of prisoner's dilemma. I don't want to give extremely harsh grading to my peers at all, but because I know they are forced by prisoner's dilemma, I'm also forced.

I believe some courses like KBAI (CS 7637) and DMSL (ISYE 7406) give students an opportunity to see peer's submission. But the grading is still done by TAs. I think that's the best way to realize the "learn from peer's work" philosophy.

If the instructor/TA wants to use peer grading to reduce their workload, then communicate it as such, instead of sugar coating it. I will accept it. Realistically, Every class has several hundred students enrolled, and peer grading is the only way to keep the tuition affordable. Because the alternative is to hire an army of TAs, which would then drive up the cost. Hopefully, soon enough, we will have an AI/LLM based auto grader who is immune to prisoner's dilemma.

Note: peer grading homework is different from peer grading the contribution in group projects. I think peer grading in group projects incentivizes students to contribute better and be a good team mate in general, although group project is another controversial subject..

Note: In case I sounded critical, I don't mean to spread a negative vibe about OMSCS/OMSA. It's still an amazing program. It's just constructive criticism.