Nweke, Mauryn C;
Banner, Matthew;
Chaib, Manal;
(2023)
An Investigation Into ChatGPT Generated Assessments: Can We Tell the Difference?
In:
The Barcelona Conference on Education 2023: Official Conference Proceedings.
(pp. pp. 1-6).
The International Academic Forum(IAFOR)
Preview |
Text
BCE2023_73733-ChatGPT.pdf - Other Download (186kB) | Preview |
Abstract
The impact of ChatGPT has been revolutionary in many capacities however institutions are beginning to see the gradual increase in students passing off AI generated work as their own. This has negative impacts for student learning and academic integrity. One way to help combat this is to understand if we can tell the difference between AI generated assignments and original pieces of work. This will help those involved in assessing to distinguish between AI generated work compared to original work. In the initial phase of this study, we use ChatGPT to generate assessments for 3 modules in the department of Biochemical Engineering, UCL. These assignments capture the interdisciplinary nature of Biochemical Engineering as well as the diversity in assignment complexity and include mathematics, business and bioprocess validation and quality control. We then convene academic leads and marking staff to assess scripts, compare them to previous cohorts through use of peer-observation to find out what indicators there are of generated work. Results so far have shown that out of the 3modules, 2 modules receive a pass mark with minimal prompts and only 1 module lead was able provide indicators to identify generated work. Results also show that ChatGPT was unable to provide solutions for complex mathematical problems, bioprocess piping and instrumentation technical drawings and critical analysis required for M-level bioprocess quality control. Subsequent phases of the study will expand the number of modules tested on ChatGPT, embed its use into the engineering curriculum and upskill academics on the use of AI tools.
| Type: | Proceedings paper |
|---|---|
| Title: | An Investigation Into ChatGPT Generated Assessments: Can We Tell the Difference? |
| Event: | The Barcelona Conference on Education 2023 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.22492/issn.2435-9467.2023.54 |
| Publisher version: | https://doi.org/10.22492/issn.2435-9467.2023.54 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Biochemical Engineering |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10182481 |
Archive Staff Only
 |
View Item |
