Professor Ehud Reiter | The University of Aberdeen

Professor Ehud Reiter

Chair in Computing Science

Email Address: e.reiter@abdn.ac.uk
Telephone Number: +44 (0)1224 273443
Office Address: Meston 243
Department of Computing Science
University of Aberdeen
King's College
Aberdeen
AB24 3UE
School/Department: School of Natural and Computing Sciences

Biography

I have taught computing science and done research in Natural Language Generation at Aberdeen since 1995. I expect to retire in 2026 or 2027. For more information about me, please see my personal webpage ehudreiter.com

Internal Memberships

Research ethics

Research

Research Overview

Current Interests

Natural language generation
Data-to-text
Medical applications

Current Research Students

Nikolai Babakov (Santiago de Compostela)
Jawwad Baig
Giulia Pucci
Adarsa Sivaprasad
Mengxuan Sun
Barkavi Sundararajan
Iniakpokeikiye Thompson

Current Postdocs

David Howcroft

Past Research Students

See my blog for a list of past research students I have supervised.

CLAN

The CLAN (Computational Linguistics at Aberdeen) resesarch group meets at 4PM every Wednesday. Every week we discuss a research paper, idea, proposal, etc. CLAN meetings are open to everyone, contact me for more information or to be put on the mailing list.

I sometimes tweet CLAN information on @EhudReiter. Feel free to subscribe, most of my tweets are relevant to NLG research. Similarly my blog (ehudreiter.com) is mostly about NLG research.

Current Research

My current research focuses on (A) evaluation of natural language generation and (B) using AI and NLG to support patients, especially in their homes.

Funding and Grants

Philhumans (EU) (2019-2023) - Using AI to support personal health apps.
NL4XAI (EU) (2019-2024) - Explaining AI reasoning in natural language
ReproHum (EPSRC) (2021-2024) - Investigating Reproducibility of Human Evaluations in Natural Language Processing
ASICA (Cancer Research UK) (2024-2026): Achieving Self-directed Integrated Cancer Aftercare (ASICA) in melanoma
Al-ʿĀmīyah (Colloquial Arabic) and generative AI (Royal Society Edinburgh) (2024-2025)– a snapshot of its emerging text-to-text abilities

Teaching

Teaching Responsibilities

Publications

Page 1 of 7 Results 1 to 25 of 162

Ask the experts: sourcing a high-quality nutrition counseling dataset through Human-AI collaboration
2024 - Published
Balloccu, S., Reiter, E., Li, K. J., Sargsyan, R., Kumar, V., Reforgiato, D., Riboni, D., Dusek, O.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] DOI: https://doi.org/10.18653/v1/2024.findings-emnlp.674
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/24685/1/Balloccu_etal_ACL_Ask_The_Experts_VoR.pdf
Natural Language Generation
2024 - Published
Reiter, E.
Springer. 202 pages
Books and Reports: Books
- [ONLINE] DOI: https://doi.org/10.1007/978-3-031-68582-8
Improving Factual Accuracy of Neural Table-to-Text Output by Addressing Input Problems in ToTTo
2024 - Published
Sundararajan, B., Sripada, S., Reiter, E.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] https://aclanthology.org/2024.naacl-long.408.pdf
- [ONLINE] View publication in Scopus
Common Flaws in Running Human Evaluation Experiments in NLP
2024 - Published
Thomson, C., Reiter, E., Belz, A.
Computational Linguistics, vol. 50, no. 2, pp. 795–805
Contributions to Journals: Articles
- [ONLINE] DOI: https://doi.org/10.1162/coli_a_00508
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/23764/1/Thomson_etal_CL_Common_Flaws_in_VOR.pdf
- [ONLINE] https://abdn.elsevierpure.com/en/publications/bdae6575-848e-4639-ae80-0a7f6dbe0f02
Linguistically Communicating Uncertainty in Patient-Facing Risk Prediction Models
2024 - Published
Sivaprasad, A., Reiter, E.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] https://aclanthology.org/2024.uncertainlp-1.0.pdf
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/23386/1/Sivaprasad_etReiter_UNLP_Linguistically_Comunicating_Uncertainty_VOR.pdf
- [ONLINE] View publication in Scopus
Smartphone-based extendable telematic data collection app
2024 - Published
Peter, T. I., Reiter, E., Yi, D.
Software Impacts, vol. 19, 100601
Contributions to Journals: Articles
- [ONLINE] DOI: https://doi.org/10.1016/j.simpa.2023.100601
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/22510/1/Thompson_etal_SI_Smartphone_based_extendable_VOR.pdf
- [ONLINE] View publication in Scopus
Evaluation of Human-Understandability of Global Model Explanations Using Decision Tree
2024 - Published
Sivaprasad, A., Reiter, E., Tintarev, N., Oren, N.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] DOI: https://doi.org/10.1007/978-3-031-50396-2_3
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/22828/1/Sivaprasad_etal_ECAI_Evaluation_of_Human_VOR.pdf
- [ONLINE] View publication in Scopus
- [ONLINE] https://ecai2023.eu/
- [ONLINE] https://xai3ecai2023.github.io/
Evaluation of Human-Understandability of Global Model Explanations using Decision Tree
2023 - Published
Sivaprasad, A., Reiter, E., Oren, N., Tintarev, N.
Working Papers: Preprint Papers
- [ONLINE] http://arxiv.org/abs/2309.09917v1
- [ONLINE] https://ecai2023.eu/
- [ONLINE] https://xai3ecai2023.github.io/
Enhancing Factualness and Controllability of Data-to-Text Generation via Data Views and Constraints
2023 - Published
Thomson, C., Rebuffel, C., Reiter, E., Soulier, L., Sripada, S., Gallinari, P.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] DOI: https://doi.org/10.18653/v1/2023.inlg-main.16
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/24018/1/Thomson_etal_INLG_Enhancing_Factualness_And_VoR.pdf
- [ONLINE] https://inlg2023.github.io/index.html
- [ONLINE] https://sigdialinlg2023.github.io/paper_inlg97.html
Smart Selection of Useful Insights from Wearables
2023 - Published
Susaiyah, A., Harma, A., Balloccu, S., Reiter, E., Petkovic, M.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] DOI: https://doi.org/10.1109/ICASSPW59220.2023.10193140
- [ONLINE] View publication in Scopus
Non-Repeatable Experiments and Non-Reproducible Results: The Reproducibility Crisis in Human Evaluation in NLP
2023 - Published
Belz, A., Thomson, C., Reiter, E., Mille, S.
Findings of the Association for Computational Linguistics: ACL 2023. Rogers, A., Boyd-Graber, J., Okazaki, N. (eds.). Association for Computational Linguistics, pp. 3676-3687, 12 pages
Chapters in Books, Reports and Conference Proceedings: Chapters
- [ONLINE] DOI: https://doi.org/10.18653/v1/2023.findings-acl.226
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/21800/1/Belz_etal_ACL_Non-repetable_Experiments_And_VoR.pdf
Influence of context on users’ views about explanations for decision-tree predictions
2023 - Published
Maruf, S., Zukerman, I., Reiter, E., Haffari, G.
Computer Speech & Language, vol. 81, 101483
Contributions to Journals: Articles
- [ONLINE] DOI: https://doi.org/10.1016/j.csl.2023.101483
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/22500/1/Maruf_etal_CSL_Influence_Context_Users_AAM.pdf
Evaluating factual accuracy in complex data-to-text
2023 - Published
Thomson, C., Reiter, E., Sundararajan, B.
Computer Speech & Language, vol. 80, 101482
Contributions to Journals: Articles
- [ONLINE] https://www.sciencedirect.com/science/article/pii/S0885230823000013
- [ONLINE] DOI: https://doi.org/10.1016/j.csl.2023.101482
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/22498/1/Thomson_etal_CSL_Evaluating_factual_accuracy_AAM.pdf
Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP
2023 - Published
Belz, A., Thomson, C., Reiter, E., Abercrombie, G., Alonso Moral, J. M., Arvan, M., Cheung, J., Cieliebak, M., Clark, E., van Deemter, K., Dinkar, T., Dušek, O., Eger, S., Fang, Q., Gatt, A., Gkatzia, D., González Corbelle, J., Hovy, D., Hürlimann, M., Ito, T., Kelleher, J. D., Klubicka, F., Lai, H., van der Lee, C., van Miltenburg, E., Li, Y., Mahamood, S., Mieskes, M., Nissim, M., Parde, N., Plátek, O., Rieser, V., Mosteiro Romero, P., Tetreault, J., Toral, A., Wang, X., Wanner, L., Watson, L., Yang, D.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] DOI: https://doi.org/10.18653/v1/2023.insights-1.1
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/21801/1/Belz_etal_ACL_Missing_Information_Unresposive_VoR.pdf
Are Experts Needed?: On Human Evaluation of Counselling Reflection Generation
2023 - Published
Wu, Z., Balloccu, S., Reiter, E., Helaoui, R., Reforgiato Recupero, D., Riboni, D.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] DOI: https://doi.org/10.18653/v1/2023.acl-long.382
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/21799/1/Wu_etal_ACL_Are_Experts_Needed_VoR.pdf
Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation
2022 - Published
Savkov, A., Moramarco, F., Papadopoulos Korfiatis, A., Perera, M., Belz, A., Reiter, E.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] https://aclanthology.org/2022.emnlp-industry.10
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/20382/1/Savkov_etal_ACL_Consultation_Checklists_Standardising_VoR.pdf
Error Analysis of ToTTo Table-to-Text Neural NLG Models
2022 - Published
Sundararajan, B., Sripada, S., Reiter, E.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] https://aclanthology.org/2022.gem-1.43
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/20383/1/Sundararajan_etal_ACL_Error_Analysis_ToTTo_VoR.pdf
User-Driven Research of Medical Note Generation Software
2022 - Published
Knoll, T., Moramarco, F., Papadopoulos Korfiatis, A., Young, R., Ruffini, C., Perera, M., Perstl, C., Reiter, E., Belz, A., Savkov, A.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] DOI: https://doi.org/10.18653/v1/2022.naacl-main.29
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/23853/1/Knoll_etal_ACLA_User_Driven_Research_VoR.pdf
Comparing informativeness of an NLG chatbot vs graphical app in diet-information domain
2022 - Published
Balloccu, S., Reiter, E.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] https://aclanthology.org/2022.inlg-main.13
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/20385/1/Balloccu_etal_ACL_Comparing_Informativesess_Of_VoR.pdf
DrivingBeacon: Driving Behaviour Change Support System Considering Mobile Use and Geo-information
2022 - Published
Baig, J., Chen, G., Lin, C., Reiter, E.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] https://aclanthology.org/2022.nlg4health-1.1
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/20380/1/Baig_ACL_Driving_Beacon_Driving_VoR.pdf
The 2022 ReproGen Shared Task on Reproducibility of Evaluations in NLG: Overview and Results
2022 - Published
Belz, A., Shimorina, A., Popović, M., Reiter, E.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] https://aclanthology.org/2022.inlg-genchal.8
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/20381/1/Belz_etal_ACL_The_2022_ReproGen_VoR.pdf
The Accuracy Evaluation Shared Task as a Retrospective Reproduction Study
2022 - Published
Thomson, C., Reiter, E.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] https://aclanthology.org/2022.inlg-genchal.11
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/20384/1/Thomson_etal_ACL_The_Accuracy_Evaluation_VoR.pdf
Beyond calories: evaluating how tailored communication reduces emotional load in diet-coaching
2022 - Published
Balloccu, S., Reiter, E.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] DOI: https://doi.org/10.18653/v1/2022.humeval-1.5
Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation
2022 - Published
Moramarco, F., Korfiatis, A. P., Perera, M., Juric, D., Flann, J., Reiter, E., Savkov, A., Belz, A.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] DOI: https://doi.org/10.18653/v1/2022.acl-long.394
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/20151/1/Moramarco_etal_ACL_Human_Evaluation_And_VoR.pdf
- [ONLINE] https://deepai.org/publication/human-evaluation-and-correlation-with-automatic-metrics-in-consultation-note-generation
Anno-Mi: A dataset of expert- annotated counselling dialogues
2022 - Published
Wu, Z., Balloccu, S., Kumar, V., Helaoui, R., Reiter, E., Reforgiato Recupero, D., Riboni, D.
Chapters in Books, Reports and Conference Proceedings: Conference Proceedings
- [ONLINE] DOI: https://doi.org/10.1109/ICASSP43922.2022.9746035
- [OPEN ACCESS] http://aura.abdn.ac.uk/bitstream/2164/23092/1/Wu_etal_Anno_Mi_A_AAM.pdf
- [ONLINE] https://paperswithcode.com/paper/anno-mi-a-dataset-of-expert-annotated

Show 10 | 25 | 50 | 100 results per page

Update

Biography

Internal Memberships

Research Overview

Current Interests

Current Research Students

Current Postdocs

Past Research Students

CLAN

Current Research

Funding and Grants

Teaching Responsibilities

Ask the experts: sourcing a high-quality nutrition counseling dataset through Human-AI collaboration

Natural Language Generation

Improving Factual Accuracy of Neural Table-to-Text Output by Addressing Input Problems in ToTTo

Common Flaws in Running Human Evaluation Experiments in NLP

Linguistically Communicating Uncertainty in Patient-Facing Risk Prediction Models

Smartphone-based extendable telematic data collection app

Evaluation of Human-Understandability of Global Model Explanations Using Decision Tree

Evaluation of Human-Understandability of Global Model Explanations using Decision Tree

Enhancing Factualness and Controllability of Data-to-Text Generation via Data Views and Constraints

Smart Selection of Useful Insights from Wearables

Non-Repeatable Experiments and Non-Reproducible Results: The Reproducibility Crisis in Human Evaluation in NLP

Influence of context on users’ views about explanations for decision-tree predictions

Evaluating factual accuracy in complex data-to-text

Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP

Are Experts Needed?: On Human Evaluation of Counselling Reflection Generation

Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation

Error Analysis of ToTTo Table-to-Text Neural NLG Models

User-Driven Research of Medical Note Generation Software

Comparing informativeness of an NLG chatbot vs graphical app in diet-information domain

DrivingBeacon: Driving Behaviour Change Support System Considering Mobile Use and Geo-information

The 2022 ReproGen Shared Task on Reproducibility of Evaluations in NLG: Overview and Results

The Accuracy Evaluation Shared Task as a Retrospective Reproduction Study

Beyond calories: evaluating how tailored communication reduces emotional load in diet-coaching

Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation

Anno-Mi: A dataset of expert- annotated counselling dialogues

Refine

Books and Reports

Chapters in Books, Reports and Conference Proceedings

Contributions to Conferences

Contributions to Journals

Working Papers