Towards the Integration of Large Language Models and Automatic Assessment Tools: Enhancing Student Support in Programming Assignments

Bruno Pereira Cipriano; Miguel Silva; Rodrigo Correia; Pedro Alves

doi:10.1145/3699538.3699588

Towards the Integration of Large Language Models and Automatic Assessment Tools: Enhancing Student Support in Programming Assignments

Bruno Pereira Cipriano
, Miguel Silva
, Rodrigo Correia
, Pedro Alves

Lusófona University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Citations (Scopus)

Abstract

The rise of Large Language Models (LLMs) has sparked discussion in Computer Science Education (CSE) due to their ability to generate code from text prompts. Students may rely on these tools, neglecting core skills like computational thinking and program design. Thus, it’s crucial to responsibly integrate them into computer science courses. To address this, we integrated an open-source Automatic Assessment Tool with GPT, enabling students to receive LLM assistance on their programming assignments. This tool can be adopted and improved by educators, promoting more responsible integration of LLMs in CSE.

Original language	English
Title of host publication	Proceedings of 24th International Conference on Computing Education Research, Koli Calling 2024
Publisher	Association for Computing Machinery
ISBN (Electronic)	9798400710384
DOIs	https://doi.org/10.1145/3699538.3699588
Publication status	Published - 13 Nov 2024
Event	24th International Conference on Computing Education Research, Koli Calling 2024 - Koli, Finland Duration: 14 Nov 2024 → 17 Nov 2024

Publication series

Name	ACM International Conference Proceeding Series

Conference

Conference	24th International Conference on Computing Education Research, Koli Calling 2024
Country/Territory	Finland
City	Koli
Period	14/11/24 → 17/11/24

Bibliographical note

Publisher Copyright:
© 2024 Copyright held by the owner/author(s).

Keywords

automatic assessment tools
feedback
large language models

Access to Document

10.1145/3699538.3699588

Cite this

Cipriano, B. P., Silva, M., Correia, R., & Alves, P. (2024). Towards the Integration of Large Language Models and Automatic Assessment Tools: Enhancing Student Support in Programming Assignments. In Proceedings of 24th International Conference on Computing Education Research, Koli Calling 2024 Article 52 (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3699538.3699588

Cipriano, Bruno Pereira ; Silva, Miguel ; Correia, Rodrigo et al. / Towards the Integration of Large Language Models and Automatic Assessment Tools : Enhancing Student Support in Programming Assignments. Proceedings of 24th International Conference on Computing Education Research, Koli Calling 2024. Association for Computing Machinery, 2024. (ACM International Conference Proceeding Series).

@inproceedings{fab4b762d5d34107bc4c0286948d4f2c,

title = "Towards the Integration of Large Language Models and Automatic Assessment Tools: Enhancing Student Support in Programming Assignments",

abstract = "The rise of Large Language Models (LLMs) has sparked discussion in Computer Science Education (CSE) due to their ability to generate code from text prompts. Students may rely on these tools, neglecting core skills like computational thinking and program design. Thus, it{\textquoteright}s crucial to responsibly integrate them into computer science courses. To address this, we integrated an open-source Automatic Assessment Tool with GPT, enabling students to receive LLM assistance on their programming assignments. This tool can be adopted and improved by educators, promoting more responsible integration of LLMs in CSE.",

keywords = "automatic assessment tools, feedback, large language models",

author = "Cipriano, \{Bruno Pereira\} and Miguel Silva and Rodrigo Correia and Pedro Alves",

note = "Publisher Copyright: {\textcopyright} 2024 Copyright held by the owner/author(s).; 24th International Conference on Computing Education Research, Koli Calling 2024 ; Conference date: 14-11-2024 Through 17-11-2024",

year = "2024",

month = nov,

day = "13",

doi = "10.1145/3699538.3699588",

language = "English",

series = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery",

booktitle = "Proceedings of 24th International Conference on Computing Education Research, Koli Calling 2024",

address = "United States",

}

Cipriano, BP, Silva, M, Correia, R & Alves, P 2024, Towards the Integration of Large Language Models and Automatic Assessment Tools: Enhancing Student Support in Programming Assignments. in Proceedings of 24th International Conference on Computing Education Research, Koli Calling 2024., 52, ACM International Conference Proceeding Series, Association for Computing Machinery, 24th International Conference on Computing Education Research, Koli Calling 2024, Koli, Finland, 14/11/24. https://doi.org/10.1145/3699538.3699588

Towards the Integration of Large Language Models and Automatic Assessment Tools: Enhancing Student Support in Programming Assignments. / Cipriano, Bruno Pereira; Silva, Miguel; Correia, Rodrigo et al.
Proceedings of 24th International Conference on Computing Education Research, Koli Calling 2024. Association for Computing Machinery, 2024. 52 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Towards the Integration of Large Language Models and Automatic Assessment Tools

T2 - 24th International Conference on Computing Education Research, Koli Calling 2024

AU - Cipriano, Bruno Pereira

AU - Silva, Miguel

AU - Correia, Rodrigo

AU - Alves, Pedro

PY - 2024/11/13

Y1 - 2024/11/13

N2 - The rise of Large Language Models (LLMs) has sparked discussion in Computer Science Education (CSE) due to their ability to generate code from text prompts. Students may rely on these tools, neglecting core skills like computational thinking and program design. Thus, it’s crucial to responsibly integrate them into computer science courses. To address this, we integrated an open-source Automatic Assessment Tool with GPT, enabling students to receive LLM assistance on their programming assignments. This tool can be adopted and improved by educators, promoting more responsible integration of LLMs in CSE.

AB - The rise of Large Language Models (LLMs) has sparked discussion in Computer Science Education (CSE) due to their ability to generate code from text prompts. Students may rely on these tools, neglecting core skills like computational thinking and program design. Thus, it’s crucial to responsibly integrate them into computer science courses. To address this, we integrated an open-source Automatic Assessment Tool with GPT, enabling students to receive LLM assistance on their programming assignments. This tool can be adopted and improved by educators, promoting more responsible integration of LLMs in CSE.

KW - automatic assessment tools

KW - feedback

KW - large language models

UR - https://www.scopus.com/pages/publications/85215530271

U2 - 10.1145/3699538.3699588

DO - 10.1145/3699538.3699588

M3 - Conference contribution

AN - SCOPUS:85215530271

T3 - ACM International Conference Proceeding Series

BT - Proceedings of 24th International Conference on Computing Education Research, Koli Calling 2024

PB - Association for Computing Machinery

Y2 - 14 November 2024 through 17 November 2024

ER -

Cipriano BP, Silva M, Correia R, Alves P. Towards the Integration of Large Language Models and Automatic Assessment Tools: Enhancing Student Support in Programming Assignments. In Proceedings of 24th International Conference on Computing Education Research, Koli Calling 2024. Association for Computing Machinery. 2024. 52. (ACM International Conference Proceeding Series). doi: 10.1145/3699538.3699588

Towards the Integration of Large Language Models and Automatic Assessment Tools: Enhancing Student Support in Programming Assignments

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this