Harvard/MIT Nonprofit Creates Software for Grading Essays
April 5, 2013 3:19 PM
comment(s) - last by
The software learns how to do so from human professors
Short answer and essay questions on exams could one day be graded by computer software, but many educators aren't happy about it.
EdX, a nonprofit enterprise started by Harvard University and the Massachusetts Institute of Technology (MIT), has created
a software system
that is capable of learning how to grade the way a human teacher would and then grades both short answer and essay questions based on this method.
The major benefit is that students will receive a grade instantly rather than waiting days or weeks. Not only that, but students could use this software to keep rewriting essays until they reach a desired grade (since the grading process is instant), helping them to learn rather than just accept a grade and move on.
“There is a huge value in learning with instant feedback,” said Dr. Anant Agarwal, an electrical engineer who is president of EdX. “Students are telling us they learn much better with instant feedback.
"This is machine learning and there is a long way to go, but it’s good enough and the upside is huge. "We found that the quality of the grading is similar to the variation you find from instructor to instructor.”
The EdX software allows a human teacher to grade about 100 essays first while it observes the grading technique. From there, the tool learns how to grade and does so on its own.
While this software could help students learn faster and free up some of the professor's time to tend to other things, it has been criticized in the education sector. Les Perelman, a retired director of writing and a current researcher at MIT, said that software can never compare to a human professor. Perelman has written fake essays with bogus "facts" in it and tricked computer software into giving him a decent grade.
“My first and greatest objection to the research is that they did not have any valid statistical test comparing the software directly to human graders,” said Perelman.
While software for grading basic tests like multiple choice are widely adopted, it is yet to be seen whether the same will happen for essays and more detailed tests, which require the knowledge of a professor to score accurately.
The New York Times
This article is over a month old, voting and posting comments is disabled
4/6/2013 4:14:07 PM
it all depends on execution.
on the plus side, all the pretty girls won't automatically score highly on coursework.
the flipside is that if the software is not particulary smart it will be figured out by students fairly quickly and they will realise what type of formulaic garbage tends to score highly.
also i imagine that a really good candidate displaying higher level analytical thinking may write in a way that requires more effort to comprehend than simple plain unambiguous statements. there would be instances where it could be difficult for an algorithm to differentiate a real high flying candidate from one that just can't write properly.
i short unless this software has the comprehension and understanding of a teacher in the particular subject being marked then this will introduce a whole new layer of inaccuracy and error.
"And boy have we patented it!" -- Steve Jobs, Macworld 2007
Harvard Defends Snooping on Employee Emails to Find Source of Media Leaks
March 12, 2013, 11:19 AM
Report: Windows 8.2 Revives Start Menu, Runs Metro Apps in Desktop Mode
December 10, 2013, 2:56 PM
Quick Note: Pier Solar and the Great Architects Coming to the Wii U in HD
December 6, 2013, 4:56 PM
Microsoft Channels LittleBigPlanet and Minecraft With "Project Spark" Beta
December 4, 2013, 9:14 AM
Software Firm Apptricity Receives $50 Million in U.S. Army Piracy Lawsuit
November 29, 2013, 11:42 AM
EA and Tiger Woods Part ways, EA Sports Offers First Look at Next Gen Golf Game
October 29, 2013, 9:27 AM
Quick Note: Trial Versions of iWork, Aperture Updated for Free by Mac App Store
October 24, 2013, 12:53 PM
Most Popular Articles
Experts: Masturbation Prevents Cancer, Diabetes, Insomnia, and Depression
December 6, 2013, 2:01 PM
Hackers Nab 2 Million Login Credentials from Facebook, Gmail, Twitter
December 5, 2013, 1:00 PM
Thieves Steal Truck with Cobalt-60 Onboard in Mexico, Will Die "Without a Doubt" from Exposure
December 5, 2013, 12:04 PM
Man Arrested for Using 5 Cents Worth of Electricity to Charge Nissan Leaf at Middle School
December 4, 2013, 8:00 PM
U.S. Navy Fires "XFC" Drone from Underwater Submarine
December 6, 2013, 2:35 PM
Latest Blog Posts
Justice Leaks Details of Next HTC One Two Flagship Phone
Dec 5, 2013, 4:04 PM
Global Cyber Espionage Concerns Reveal Growing Cyber Armies
Nov 29, 2013, 11:04 AM
Is The Period Becoming an Expression of Anger?
Nov 26, 2013, 2:02 PM
NSA and Congress -- You Will Never Kill the Constitution, It's an Idea
Nov 10, 2013, 2:00 PM
AT&T Explores $100B+ USD Deal to Acquire Vodafone's European Operations
Nov 4, 2013, 7:34 AM
More Blog Posts
Copyright 2013 DailyTech LLC. -
Terms, Conditions & Privacy Information