UNIVERSITY OF HERTFORDSHIRE COMPUTER SCIENCE RESEARCH COLLOQUIUM presents "How Computers can Adapt to User Knowledge (II): A Comparison between Computerised-Adaptive Testing and Other Assessment Methods" speaker: Mariana Lilley Computer Science Department University of Hertfordshire (joint work with Dr. Trevor Barker) 29 October 2003 (Wednesday) Lecture Theatre E350 Hatfield, College Lane Campus 3 - 4 pm Coffee/tea and biscuits will be available. Everyone is Welcome to Attend Abstract: The ability to configure a computer interface according to the individual user is an important goal for many software developers. This is especially true in complex educational software systems, and this talk focuses on computer-assisted assessments. We are going to present our ideas on how a computer-adaptive test (CAT) can dynamically individualise its interface presentation based on ability and skills of each test-taker. We are also going to present the main findings from two empirical studies we performed on the use of computerised-adaptive tests. In our first study, a prototype of a computer-adaptive test was designed, developed and evaluated. The adaptive algorithm was based on the Three-Parameter Logistic Model from Item Response Theory. As for the evaluation, this involved a wide range of techniques, such as Heuristic evaluation and focus group. Findings from this first empirical study were taken to indicate that the adaptive approach did not negatively affect test-taker performance. An enhanced version of this prototype was then used in two sessions of summative assessment of 133 students enrolled in a programming module at UH. The results obtained by these students in four different types of assessment were subjected to statistical analysis. Findings from this second study suggest that (1) CATs were a fair assessment method; (2) CATs have the potential to offer a more consistent and accurate measurement of stude It is hoped that this talk will be of relevance for those interested in computer-assisted assessments, human-computer interaction and adaptive systems. --- Colloquium Schedule & Abstracts: http://homepages.feis.herts.ac.uk/~nehaniv/colloq/