Bridging the Gap between Project-Oriented and Exercise-Oriented Automatic Assessment Tools

Bruno Pereira Cipriano; Bernardo Baltazar; Nuno Fachada; Athanasios Vourvopoulos; Pedro Alves

doi:10.3390/computers13070162

Bridging the Gap between Project-Oriented and Exercise-Oriented Automatic Assessment Tools

Bruno Pereira Cipriano, Bernardo Baltazar, Nuno Fachada, Athanasios Vourvopoulos, Pedro Alves

Research output: Contribution to journal › Article › peer-review

2 Citations (Scopus)

Abstract

In this study, we present the DP Plugin for IntelliJ IDEA, designed to extend the Drop Project (DP) Automatic Assessment Tool (AAT) by making it more suitable for handling small exercises in exercise-based learning environments. Our aim was to address the limitations of DP in supporting small assignments while retaining its strengths in project-based learning. The plugin leverages DP’s REST API to streamline the submission process, integrating assignment instructions and feedback directly within the IDE. A student survey conducted during the 2022/23 academic year revealed a positive reception, highlighting benefits such as time efficiency and ease of use. Students also provided valuable feedback, leading to various improvements that have since been integrated into the plugin. Despite these promising results, the study is limited by the relatively small percentage of survey respondents. Our findings suggest that an IDE plugin can significantly improve the usability of project-oriented AATs for small exercises, informing the development of future educational tools suitable for mixed project-based and exercise-based learning environments.

Original language	English
Article number	7
Pages (from-to)	162
Number of pages	1
Journal	Computers
Volume	13
Issue number	7
DOIs	https://doi.org/10.3390/computers13070162
Publication status	Published - 30 Jun 2024

Bibliographical note

DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.

Funding

This research was funded by the Funda\u00E7\u00E3o para a Ci\u00EAncia e a Tecnologia (FCT) through the LARSyS\u2014FCT Project (DOI: 10.54499/LA/P/0083/2020, 10.54499/UIDP/50009/2020, and 10.54499/UIDB/50009/2020) and COPELABS\u2014FCT Project (DOI: 10.54499/UIDB/04111/2020). Author Nuno Fachada acknowledges his FCT grant (DOI: 10.54499/CEECINST/00002/2021/CP2788/CT0001).

Funders	Funder number
Fundação para a Ciência e a Tecnologia
Fundação para a Ciência e a Tecnologia

Keywords

IntelliJ IDEA
automated assessment
computer science education
hci
programming education

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.3390/computers13070162

Cite this

@article{82299a8f9290498cb71508577d18e333,

title = "Bridging the Gap between Project-Oriented and Exercise-Oriented Automatic Assessment Tools",

abstract = "In this study, we present the DP Plugin for IntelliJ IDEA, designed to extend the Drop Project (DP) Automatic Assessment Tool (AAT) by making it more suitable for handling small exercises in exercise-based learning environments. Our aim was to address the limitations of DP in supporting small assignments while retaining its strengths in project-based learning. The plugin leverages DP{\textquoteright}s REST API to streamline the submission process, integrating assignment instructions and feedback directly within the IDE. A student survey conducted during the 2022/23 academic year revealed a positive reception, highlighting benefits such as time efficiency and ease of use. Students also provided valuable feedback, leading to various improvements that have since been integrated into the plugin. Despite these promising results, the study is limited by the relatively small percentage of survey respondents. Our findings suggest that an IDE plugin can significantly improve the usability of project-oriented AATs for small exercises, informing the development of future educational tools suitable for mixed project-based and exercise-based learning environments.",

keywords = "IntelliJ IDEA, automated assessment, computer science education, hci, programming education",

author = "Cipriano, {Bruno Pereira} and Bernardo Baltazar and Nuno Fachada and Athanasios Vourvopoulos and Pedro Alves",

note = "DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.",

year = "2024",

month = jun,

day = "30",

doi = "10.3390/computers13070162",

language = "English",

volume = "13",

pages = "162",

journal = "Computers",

issn = "2073-431X",

publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",

number = "7",

}

TY - JOUR

T1 - Bridging the Gap between Project-Oriented and Exercise-Oriented Automatic Assessment Tools

AU - Cipriano, Bruno Pereira

AU - Baltazar, Bernardo

AU - Fachada, Nuno

AU - Vourvopoulos, Athanasios

AU - Alves, Pedro

N1 - DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.

PY - 2024/6/30

Y1 - 2024/6/30

N2 - In this study, we present the DP Plugin for IntelliJ IDEA, designed to extend the Drop Project (DP) Automatic Assessment Tool (AAT) by making it more suitable for handling small exercises in exercise-based learning environments. Our aim was to address the limitations of DP in supporting small assignments while retaining its strengths in project-based learning. The plugin leverages DP’s REST API to streamline the submission process, integrating assignment instructions and feedback directly within the IDE. A student survey conducted during the 2022/23 academic year revealed a positive reception, highlighting benefits such as time efficiency and ease of use. Students also provided valuable feedback, leading to various improvements that have since been integrated into the plugin. Despite these promising results, the study is limited by the relatively small percentage of survey respondents. Our findings suggest that an IDE plugin can significantly improve the usability of project-oriented AATs for small exercises, informing the development of future educational tools suitable for mixed project-based and exercise-based learning environments.

AB - In this study, we present the DP Plugin for IntelliJ IDEA, designed to extend the Drop Project (DP) Automatic Assessment Tool (AAT) by making it more suitable for handling small exercises in exercise-based learning environments. Our aim was to address the limitations of DP in supporting small assignments while retaining its strengths in project-based learning. The plugin leverages DP’s REST API to streamline the submission process, integrating assignment instructions and feedback directly within the IDE. A student survey conducted during the 2022/23 academic year revealed a positive reception, highlighting benefits such as time efficiency and ease of use. Students also provided valuable feedback, leading to various improvements that have since been integrated into the plugin. Despite these promising results, the study is limited by the relatively small percentage of survey respondents. Our findings suggest that an IDE plugin can significantly improve the usability of project-oriented AATs for small exercises, informing the development of future educational tools suitable for mixed project-based and exercise-based learning environments.

KW - IntelliJ IDEA

KW - automated assessment

KW - computer science education

KW - hci

KW - programming education

UR - http://www.scopus.com/inward/record.url?scp=85199595900&partnerID=8YFLogxK

U2 - 10.3390/computers13070162

DO - 10.3390/computers13070162

M3 - Article

AN - SCOPUS:85199595900

SN - 2073-431X

VL - 13

SP - 162

JO - Computers

JF - Computers

IS - 7

M1 - 7

ER -

Bridging the Gap between Project-Oriented and Exercise-Oriented Automatic Assessment Tools

Abstract

Bibliographical note

Funding

Keywords

UN SDGs

Access to Document

Other files and links

Fingerprint

Researcher at Lusofona University Has Published New Study Findings on Computer Science (Bridging the Gap between Project-Oriented and Exercise-Oriented Automatic Assessment Tools)

Cite this

Bridging the Gap between Project-Oriented and Exercise-Oriented Automatic Assessment Tools

Abstract

Bibliographical note

Funding

Keywords

UN SDGs

Access to Document

Other files and links

Fingerprint

Press/Media

Researcher at Lusofona University Has Published New Study Findings on Computer Science (Bridging the Gap between Project-Oriented and Exercise-Oriented Automatic Assessment Tools)

Cite this