Last modified: 31 May 2022 13:05
Artificial intelligence has helped solve complex practical problems such as driving a car, translating text from/to different languages, understanding and answering questions, and playing games such as chess and Go. This course will provide students of our MSc in AI with knowledge of core evaluation concepts, approaches, tools, techniques and technologies.
| Study Type | Postgraduate | Level | 5 |
|---|---|---|---|
| Term | First Term | Credit Points | 15 credits (7.5 ECTS credits) |
| Campus | Aberdeen | Sustained Study | No |
| Co-ordinators |
|
||
The course will cover concepts, methods, techniques and tools/technologies for evaluating AI systems. Students will be equipped with knowledge on statistical analysis (e.g., variance, correlations and regression) and learn to use software/tools for statistical analysis. The course will introduce criteria for the evaluation of AI systems (e.g., usability, accessibility and learnability), and the theoretical evaluation of AI systems (e.g., guarantees regarding correctness, completeness, complexity, admissibility of heuristics, and so on). The course will provide a comprehensive exposition to issues pertaining to the empirical evaluation of AI Systems, including the design of experiments (to address specific criteria/issues), human-driven experiments (including the design of forms and questionnaires, interviews, “talk-aloud” experiments, logging/filming, etc.), systems with optimal behaviours vs. (sub-optimal) human-like behaviour, crowd-sourcing of experiments (including Amazon’s “Mechanic Turk” and others), evaluation through gaming, and other related topics.
Information on contact teaching time is available from the course guide.
| Assessment Type | Summative | Weighting | 50 | |
|---|---|---|---|---|
| Assessment Weeks | Feedback Weeks | |||
| Feedback | ||||
| Knowledge Level | Thinking Skill | Outcome |
|---|---|---|
|
|
||
| Assessment Type | Summative | Weighting | 50 | |
|---|---|---|---|---|
| Assessment Weeks | Feedback Weeks | |||
| Feedback | ||||
| Knowledge Level | Thinking Skill | Outcome |
|---|---|---|
|
|
||
There are no assessments for this course.
| Assessment Type | Summative | Weighting | 50 | |
|---|---|---|---|---|
| Assessment Weeks | Feedback Weeks | |||
| Feedback | ||||
| Knowledge Level | Thinking Skill | Outcome |
|---|---|---|
|
|
||
| Assessment Type | Summative | Weighting | 50 | |
|---|---|---|---|---|
| Assessment Weeks | Feedback Weeks | |||
| Feedback | ||||
| Knowledge Level | Thinking Skill | Outcome |
|---|---|---|
|
|
||
| Knowledge Level | Thinking Skill | Outcome |
|---|---|---|
| Factual | Remember | ILO’s for this course are available in the course guide. |
We have detected that you are have compatibility mode enabled or are using an old version of Internet Explorer. You either need to switch off compatibility mode for this site or upgrade your browser.
