MacInsiders Logo

Similar Threads
Thread Thread Starter Forum Replies Last Post
To all the cheaters out there, I know who you are. I am coming for you. No more!! jim1 Academics 6 05-30-2013 01:14 AM
Is it possible to get multiple TA position offers? chryslad Academics 1 08-01-2012 12:54 PM
Multiple choice exams and midterms !? luxhydrus Academics 4 09-12-2010 06:08 PM
Multiple Degrees Goce Academics 9 07-11-2009 09:04 PM
Question about multiple choice exams in engineering Oilers Academics 13 05-02-2009 11:14 PM

Finding cheaters using multiple-choice comparisons post

 
Old 04-25-2016 at 08:22 PM   #1
Bigmacfatpack
Senior Member
Join Date: Jan 2013
Posts: 175

Thanked: 6 Times
Liked: 13 Times




Finding cheaters using multiple-choice comparisons post
This incident happened a few years ago I believe in Dushoff's 3rd year biology class...any thoughts on his post? (The plot he made that's he's referring to can be found below in the source).

Source: http://jd-mathbio.blogspot.ca/2015/0...le-choice.html

Summary
An interesting method by which I found out that people were cheating on my final exam.
Background
I use different versions of midterm examinations to discourage cheating in my population biology class (~200 students). When the course started, I used to do the same thing for the final exam, but it was a little more complicated, because the final exam is administered by the registrar's office, not by me and my teaching team.
At some point, somebody advised me not to bother with versions: the registrar's office is supposed to be professional about administration, and they usually mix people who are taking different exams in the same room, so I stopped bothering with different versions for the final exam for a year or two. I do it again now, and you'll see why.
The incident
In the year in question, my exam was given in two separate medium-sized rooms. My class was alone in these two rooms. I received a report from the invigilators in Room 1 about suspicious behaviour. They had warned a couple of students for acting strangely, and then warned them again. They weren't prepared to say that they were sure that the students were cheating, but wanted me to compare their answer slates. In retrospect, they should have left the students alone until they were ready to sign a complaint against them (or until they had cheated enough to have it proved against them).
My response
The final is entirely multiple choice. I got the results files from the scantron office. I figured that I wouldn't quite know what to do with a comparison just between these two kids (unless the tests were identical), and that it would be just about as easy (and far more informative) to compare everybody to everybody else. It's still kind of hard for me to get used to the fact that we have computers now and can really do stuff like this. I calculated the number of identical right answers and the number of identical wrong answers for each pair of students (~18K pairs), and plotted it out.
(cplot.Rout-0.png)
The line corresponds to forty total shared answers (two students having identical test papers). This did not happen. But there were four points near the line that looked like clear outliers to me:
(cplot.Rout-1.png)
The follow up
I wasn't sure what to do next, but the registrar's office knew. They make seating maps during exams. They didn't offer to help out, but I was allowed to go and examine the maps.
The results were amazing.
All four of the identified pairs were seated adjacent (three pairs were side by side, and the fourth pair had one student behind the other). The probability that this might have happened by chance is beyond ridiculous.
None of the four identified pairs were seated in the room where the alert invigilators hassled the pair of cheaters. This might have been by chance, but I doubt it. Likely the invigilators in the other room were visibly less alert.
I talked to the academic integrity office, and various experts, and figured out that it really was impossible to be sure who had cheated in the side-by-side pairs. I did put all 6 of them through a bit of an ordeal, though, and at least half of them deserved it. I was also unable to convict the person in front of the front-back pair (although it's hard to see how that one would have worked without collusion). The person in the back of the front-back pair denied all knowledge, but received a zero for the exam grade plus a confidential, temporary notation of my finding at the integrity office (the strongest punishment I was allowed to give). They promised to fight it, but never did.
Postscript
I now use versioning, but I'm starting to discover that this does not necessarily prevent cheating, either. I may have more adventures to report, soon.
I definitely get the feeling that the person I caught cheated their way through Mac. The initial response to my call was pretty relaxed. They did get an F in my class (I couldn't give an automatic F for the class, but the exam zero was sufficient). They retook the class and passed, expunging the F, and graduating presumably with a clean record.
I have heard a lot of anecdotal reports of people dealing with cheating informally (or not at all). It's kind of depressing. My impression is that Mac has a cheating problem, and we need to fight back.
Code

The code used to produce these plots in R is shown here.

Last edited by Bigmacfatpack : 04-25-2016 at 08:27 PM.
Old 04-25-2016 at 11:30 PM   #2
justicebeaver
Senior Member
Join Date: Apr 2015
Posts: 174

Thanked: 22 Times
Liked: 9 Times




I heard about something similar in at least one course. I would assume this is common practice regardless of whether the prof says so or not (again, just an assumption).

And the method does point out statistical outliers, very, very odd than two people sitting adjacent to each other have a very similar number of incorrect/correct answers.



Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



McMaster University News and Information, Student-run Community, with topics ranging from Student Life, Advice, News, Events, and General Help.
Notice: The views and opinions expressed in this page are strictly those of the student(s) who authored the content. The contents of this page have not been reviewed or approved by McMaster University or the MSU (McMaster Students Union). Being a student-run community, all articles and discussion posts on MacInsiders are unofficial and it is therefore always recommended that you visit the official McMaster website for the most accurate up-to-date information.

Copyright © MacInsiders.com All Rights Reserved. No content can be re-used or re-published without permission. MacInsiders is a service of Fullerton Media Inc. | Created by Chad
Originally Powered by vBulletin®, Copyright © 2019 MH Sub I, LLC dba vBulletin. All rights reserved. | Privacy | Terms