publications: - title: "A singular choice for multiple choice" author: - name: "Gudmund Skovbjerg Frandsen" link: "https://researchr.org/alias/gudmund-skovbjerg-frandsen" - name: "Michael I. Schwartzbach" link: "http://www.brics.dk/~mis/" year: "2006" doi: "http://doi.acm.org/10.1145/1189136.1189164" abstract: "How should multiple choice tests be scored and graded, in particular when students are allowed to check several boxes to convey partial knowledge? Many strategies may seem reasonable, but we demonstrate that five self-evident axioms are sufficient to determine completely the correct strategy. We also discuss how to measure robustness of the obtained grades. Our results have practical advantages and also suggest criteria for designing multiple choice questions. " links: doi: "http://doi.acm.org/10.1145/1189136.1189164" tags: - "testing" researchr: "https://researchr.org/publication/FrandsenS06" cites: 0 citedby: 0 journal: "ACM SIGCSE Bulletin" volume: "38" number: "4" pages: "34-38" kind: "article" key: "FrandsenS06" - title: "How shall we assess this?" author: - name: "Janet Carter" link: "https://researchr.org/alias/janet-carter" - name: "Kirsti Ala-Mutka" link: "https://researchr.org/alias/kirsti-ala-mutka" - name: "Ursula Fuller" link: "https://researchr.org/alias/ursula-fuller" - name: "Martin Dick" link: "https://researchr.org/alias/martin-dick" - name: "John English" link: "https://researchr.org/alias/john-english" - name: "William Fone" link: "https://researchr.org/alias/william-fone" - name: "Judy Sheard" link: "https://researchr.org/alias/judy-sheard" year: "2003" doi: "http://doi.acm.org/10.1145/960492.960539" abstract: "Increased class sizes are forcing academics to reconsider approaches to setting and marking assessments for their students. Distributed and distance learning are creating some of the biggest changes. Some educators are embracing new technologies but others are more wary of what they do not know. In order to address this issue it is first necessary to investigate the types of assessment currently in use and the perceptions that are held by academics with and without experience of the new technologies that are becoming available.In this paper we present the findings of an international survey of Computer Science academics teaching a variety of topics within the discipline. The findings are split into two sections: a snapshot of current assessment practices and an analysis of respondents' perceptions of Computer Aided Assessment (CAA). Academics' opinions about the advantages and disadvantages of CAA are split in line with level of experience of using such techniques. Those with no experience of CAA suggest that it cannot be used to test higher-order learning outcomes and that the quality of the immediate feedback is poor; these negative opinions diminish as experience is gained. " links: doi: "http://doi.acm.org/10.1145/960492.960539" tags: - "testing" - "analysis" - "survey" - "e-science" - "teaching" - "systematic-approach" researchr: "https://researchr.org/publication/CarterAFDEFS03" cites: 0 citedby: 0 journal: "ACM SIGCSE Bulletin" volume: "35" number: "4" pages: "107-123" kind: "article" key: "CarterAFDEFS03" - title: "A heuristic for multiple choice programming" author: - name: "Suk-Gwon Chang" link: "https://researchr.org/alias/suk-gwon-chang" - name: "Dong-wan Tcha" link: "https://researchr.org/alias/dong-wan-tcha" year: "1985" doi: "http://dx.doi.org/10.1016/0305-0548(85)90004-8" links: doi: "http://dx.doi.org/10.1016/0305-0548(85)90004-8" tags: - "programming" researchr: "https://researchr.org/publication/ChangT85" cites: 0 citedby: 0 journal: "Computers & OR" volume: "12" number: "1" pages: "25-37" kind: "article" key: "ChangT85" - title: "Multiple Choice Questions Not Considered Harmful" author: - name: "Karyn Woodford" link: "https://researchr.org/alias/karyn-woodford" - name: "Peter Bancroft" link: "https://researchr.org/alias/peter-bancroft" year: "2005" doi: "http://crpit.com/confpapers/CRPITV42Woodford.pdf" abstract: "Increasingly, academics are confronted with issues associated with assessment in large classes, arising from a combination of factors including higher student enrolments and the introduction of a trimester of study in many universities. The resulting increased time pressures on marking are causing many academics to search for alternative forms of assessment. University teachers are making more frequent use of multiple choice questions as a matter of expediency and in some cases, the quality of the assessment is being neglected. This describes the current situation in Information Technology. The aim of this paper is to provide practical guidelines in the form of a checklist for lecturers who wish to write tests containing multiple choice questions. Some of the points raised may be considered common knowledge for those teachers with a background in Education, however not all Information Technology lecturers would fall into this category. While the intended users of the checklist are Information Technology lecturers who, in general, are unlikely to be familiar with many of the matters discussed, teachers in other disciplines may find it a useful reference. In addition to the checklist, this paper also discusses the major criticism of multiple choice questions (that they do not test anything more than just straight recall of facts) and examines ways of overcoming this misconception. " links: doi: "http://crpit.com/confpapers/CRPITV42Woodford.pdf" tags: - "case study" - "testing" - "search" researchr: "https://researchr.org/publication/WoodfordB05" cites: 0 citedby: 0 pages: "109-116" booktitle: "Seventh Australasian Computing Education Conference (ACE 2005), Newcastle, NSW, Australia, January/February 2005" editor: - name: "Alison Young" link: "https://researchr.org/alias/alison-young" - name: "Denise Tolhurst" link: "https://researchr.org/alias/denise-tolhurst" volume: "42" series: "CRPIT" publisher: "Australian Computer Society" isbn: "1-920682-24-4" kind: "inproceedings" key: "WoodfordB05"