UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

An Investigation Into ChatGPT Generated Assessments: Can We Tell the Difference?

Nweke, Mauryn C; Banner, Matthew; Chaib, Manal; (2023) An Investigation Into ChatGPT Generated Assessments: Can We Tell the Difference? In: The Barcelona Conference on Education 2023: Official Conference Proceedings. (pp. pp. 1-6). The International Academic Forum(IAFOR) Green open access

[thumbnail of BCE2023_73733-ChatGPT.pdf]
Preview
Text
BCE2023_73733-ChatGPT.pdf - Other

Download (186kB) | Preview

Abstract

The impact of ChatGPT has been revolutionary in many capacities however institutions are beginning to see the gradual increase in students passing off AI generated work as their own. This has negative impacts for student learning and academic integrity. One way to help combat this is to understand if we can tell the difference between AI generated assignments and original pieces of work. This will help those involved in assessing to distinguish between AI generated work compared to original work. In the initial phase of this study, we use ChatGPT to generate assessments for 3 modules in the department of Biochemical Engineering, UCL. These assignments capture the interdisciplinary nature of Biochemical Engineering as well as the diversity in assignment complexity and include mathematics, business and bioprocess validation and quality control. We then convene academic leads and marking staff to assess scripts, compare them to previous cohorts through use of peer-observation to find out what indicators there are of generated work. Results so far have shown that out of the 3modules, 2 modules receive a pass mark with minimal prompts and only 1 module lead was able provide indicators to identify generated work. Results also show that ChatGPT was unable to provide solutions for complex mathematical problems, bioprocess piping and instrumentation technical drawings and critical analysis required for M-level bioprocess quality control. Subsequent phases of the study will expand the number of modules tested on ChatGPT, embed its use into the engineering curriculum and upskill academics on the use of AI tools.

Type: Proceedings paper
Title: An Investigation Into ChatGPT Generated Assessments: Can We Tell the Difference?
Event: The Barcelona Conference on Education 2023
Open access status: An open access version is available from UCL Discovery
DOI: 10.22492/issn.2435-9467.2023.54
Publisher version: https://doi.org/10.22492/issn.2435-9467.2023.54
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Biochemical Engineering
URI: https://discovery.ucl.ac.uk/id/eprint/10182481
Downloads since deposit
18Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item