Saturday, March 14, 2009

False Positives

Inside HigherEd reports on a plagiarism detection track at a large writing conference in San Francisco. Two important points from the article
  • One paper, given by a team from Texas Tech University, described an experiment in which they ran 400 papers (apparently of unknown plagiarism degree) through turnitin and SafeAssign. They discovered that the systems returned different values for degree of plagiarism (no suprise to me, as we almost never see identical values in our tests) and flagged many innocent bits as being potential plagiarisms. I cannot find a link to their paper, but the team is listed on the conference site as having given the session "Plagiarism Detection Technology: From the roundtable to the grail—deconstructing Turnitin and Safe Assignment" by Susan Lang, Laura Palmer, Monica Norris, and Kathleen Gillis.
  • Much more troubling was the discussion in this article about how iParadigms, the company that sells turnitin, paid for the travel of some researchers who were giving (positive) talks about turnitin. Shouldn't a researcher, who perhaps has no travel money, at least tell the audience listening who paid for the travel? I realize this is rather like the company purchasing an ad on the first slide, but isn't it more transparent than a speaker saying nothing?
There are some good discussion posts at the end of the article (and a kind comment on this blog).

1 comment:

  1. Debra:

    I'm at that conference. i didn't attend that session, but I was at a meeting of the intellectual property caucus and there was a representative from Iparadigms arguing that turnitin.com is not a plagiarism detection device but a tool for helping students with their writing. the caucus is very hostile to the use of plagiarism detection sites, so we all felt she was very brave to come to this meeting. I went to their booth later and they never mentioned plagiarism at all but stressed a variety of programs they also had to help students with their writing. They also passed out cookies and a letter opener.

    ReplyDelete

Please note that I moderate comments. Any comments that I consider unscientific will not be published.