{"id":1547,"date":"2013-04-05T14:41:08","date_gmt":"2013-04-05T14:41:08","guid":{"rendered":"http:\/\/disnaija.com\/nigeria-news\/report-software-that-can-grade-essays-emerges\/"},"modified":"2013-04-05T14:41:08","modified_gmt":"2013-04-05T14:41:08","slug":"report-software-that-can-grade-essays-emerges","status":"publish","type":"post","link":"https:\/\/disnaija.com\/report-software-that-can-grade-essays-emerges\/","title":{"rendered":"Report: Software that can grade essays emerges"},"content":{"rendered":"
<\/div>\n
<\/div>\n

<\/p>\n

Imagine taking a college exam, and, instead of handing in a blue book and getting a grade from a professor a few weeks later, clicking the \u201csend\u201d button when you are done and receiving a grade back instantly, your essay scored by a software program.<\/p>\n

And then, instead of being done with that exam, imagine that the system would immediately let you rewrite the test to try to improve your grade.<\/p>\n

EdX, the nonprofit enterprise founded by Harvard and the Massachusetts Institute of Technology to offer courses on the Internet, has just introduced such a system and will make its automated software available free on the Web to any institution that wants to use it. The software uses artificial intelligence to grade student essays and short written answers, freeing professors for other tasks.<\/p>\n

\"EDX- <\/p>\n

EDX- creator of the software<\/p>\n<\/p><\/div>\n

The new service will bring the educational consortium into a growing conflict over the role of automation in education. Although automated grading systems for multiple-choice and true-false tests are now widespread, the use of artificial intelligence technology to grade essay answers has not yet received widespread endorsement by educators and has many critics.<\/p>\n

Anant Agarwal, an electrical engineer who is president of EdX, predicted that the instant-grading software would be a useful pedagogical tool, enabling students to take tests and write essays over and over and improve the quality of their answers. He said the technology would offer distinct advantages over the traditional classroom system, where students often wait days or weeks for grades.<\/p>\n

\u201cThere is a huge value in learning with instant feedback,\u201d Dr. Agarwal said. \u201cStudents are telling us they learn much better with instant feedback.\u201d<\/p>\n

But skeptics say the automated system is no match for live teachers. One longtime critic, Les Perelman, has drawn national attention several times for putting together nonsense essays that have fooled software grading programs into giving high marks. He has also been highly critical of studies that purport to show that the software compares well to human graders.<\/p>\n

\u201cMy first and greatest objection to the research is that they did not have any valid statistical test comparing the software directly to human graders,\u201d said Mr. Perelman, a retired director of writing and a current researcher at M.I.T.<\/p>\n

He is among a group of educators who last month began circulating a petition opposing automated assessment software. The group, which calls itself Professionals Against Machine Scoring of Student Essays in High-Stakes Assessment, has collected nearly 2,000 signatures, including some from luminaries like Noam Chomsky.<\/p>\n

\u201cLet\u2019s face the realities of automatic essay scoring,\u201d the group\u2019s statement reads in part. \u201cComputers cannot \u2018read.\u2019 They cannot measure the essentials of effective written communication: accuracy, reasoning, adequacy of evidence, good sense, ethical stance, convincing argument, meaningful organization, clarity, and veracity, among others.\u201d<\/p>\n

But EdX expects its software to be adopted widely by schools and universities. EdX offers free online classes from Harvard, M.I.T. and the University of California, Berkeley; this fall, it will add classes from Wellesley, Georgetown and the University of Texas. In all, 12 universities participate in EdX, which offers certificates for course completion and has said that it plans to continue to expand next year, including adding international schools.<\/p>\n

The EdX assessment tool requires human teachers, or graders, to first grade 100 essays or essay questions. The system then uses a variety of machine-learning techniques to train itself to be able to grade any number of essays or answers automatically and almost instantaneously.<\/p>\n

The software will assign a grade depending on the scoring system created by the teacher, whether it is a letter grade or numerical rank. It will also provide general feedback, like telling a student whether an answer was on topic or not.<\/p>\n

Dr. Agarwal said he believed that the software was nearing the capability of human grading.<\/p>\n

\u201cThis is machine learning and there is a long way to go, but it\u2019s good enough and the upside is huge,\u201d he said. \u201cWe found that the quality of the grading is similar to the variation you find from instructor to instructor.\u201d<\/p>\n

EdX is not the first to use automated assessment technology, which dates to early mainframe computers in the 1960s. There is now a range of companies offering commercial programs to grade written test answers, and four states \u2014 Louisiana, North Dakota, Utah and West Virginia \u2014 are using some form of the technology in secondary schools. A fifth, Indiana, has experimented with it. In some cases the software is used as a \u201csecond reader,\u201d to check the reliability of the human graders.<\/p>\n

But the growing influence of the EdX consortium to set standards is likely to give the technology a boost. On Tuesday, Stanford announced that it would work with EdX to develop a joint educational system that will incorporate the automated assessment technology.<\/p>\n

Two start-ups, Coursera and Udacity, recently founded by Stanford faculty members to create \u201cmassive open online courses,\u201d or MOOCs, are also committed to automated assessment systems because of the value of instant feedback.<\/p>\n

\u201cIt allows students to get immediate feedback on their work, so that learning turns into a game, with students naturally gravitating toward resubmitting the work until they get it right,\u201d said Daphne Koller, a computer scientist and a founder of Coursera.<\/p>\n

Last year the Hewlett Foundation, a grant-making organization set up by one of the Hewlett-Packard founders and his wife, sponsored two $ 100,000 prizes aimed at improving software that grades essays and short answers. More than 150 teams entered each category. A winner of one of the Hewlett contests, Vik Paruchuri, was hired by EdX to help design its assessment software.<\/p>\n

\u201cOne of our focuses is to help kids learn how to think critically,\u201d said Victor Vuchic, a program officer at the Hewlett Foundation. \u201cIt\u2019s probably impossible to do that with multiple-choice tests. The challenge is that this requires human graders, and so they cost a lot more and they take a lot more time.\u201d<\/p>\n

Mark D. Shermis, a professor at the University of Akron in Ohio, supervised the Hewlett Foundation\u2019s contest on automated essay scoring and wrote a paper about the experiment. In his view, the technology \u2014 though imperfect \u2014 has a place in educational settings.<\/p>\n

With increasingly large classes, it is impossible for most teachers to give students meaningful feedback on writing assignments, he said. Plus, he noted, critics of the technology have tended to come from the nation\u2019s best universities, where the level of pedagogy is much better than at most schools.<\/p>\n

\u201cOften they come from very prestigious institutions where, in fact, they do a much better job of providing feedback than a machine ever could,\u201d Dr. Shermis said. \u201cThere seems to be a lack of appreciation of what is actually going on in the real world.\u201d<\/p>\n

.Culled from New York Times.
For more click<\/p>\n

<\/img> <\/img> <\/img> <\/img> <\/div>\n

——————————————————————————————————————————————-
Posted in Nigeria News. <\/a>A DisNaija.Com<\/a> network.<\/p>\n

Source: PM News<\/p>\n

DisNaija.Com<\/b> publishes regular posts on Nigeria News,<\/a> Nigerian Newspapers,<\/a> Online Nigeria Gist.<\/a><\/p>\n

Follow us on Twitter<\/a> and Facebook<\/a>.<\/p>\n

<\/div>\n
<\/div>\n

Follow @Dis_Naija<\/a>
\n