publications
2024
-
On the Opportunities of Large Language Models for Programming Process DataarXiv preprint arXiv:2411.00414 2024
-
Post Primary Teachers’ Perspectives on Machine Learning and Artificial Intelligence in the Leaving Certificate Computer Science CurriculumIn Proceedings of the 24th Koli Calling International Conference on Computing Education Research 2024
-
Howzat? Appealing to Expert Judgement for Evaluating Human and AI Next-Step Hints for Novice ProgrammersarXiv preprint arXiv:2411.18151 2024
-
Integrating Natural Language Prompting Tasks in Introductory Programming CoursesarXiv preprint arXiv:2410.03063 2024
-
-
Synthetic Students: A Comparative Study of Bug Distribution Between Large Language Models and Computing StudentsarXiv preprint arXiv:2410.09193 2024
-
The Widening Gap: The Benefits and Harms of Generative AI for Novice ProgrammersIn Proceedings of the 2024 ACM Conference on International Computing Education Research - Volume 1 2024
-
Evaluating Contextually Personalized Programming Exercises Created with Generative AIIn Proceedings of the 2024 ACM Conference on International Computing Education Research - Volume 1 2024
-
Open Source Language Models Can Provide Feedback: Evaluating LLMs’ Ability to Help Students Using GPT-4-As-A-JudgeIn Proceedings of the 2024 on Innovation and Technology in Computer Science Education V. 1 2024
-
"Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students using Large Language ModelsIn Proceedings of the 2024 on Innovation and Technology in Computer Science Education V. 1 2024
-
Explaining Code with a Purpose: An Integrated Approach for Developing Code Comprehension and Prompting SkillsIn Proceedings of the 2024 on Innovation and Technology in Computer Science Education V. 1 2024
-
Self-Regulation, Self-Efficacy, and Fear of Failure Interactions with How Novices Use LLMs to Solve Programming ProblemsIn Proceedings of the 2024 on Innovation and Technology in Computer Science Education V. 1 2024
-
Evaluating Language Models for Generating and Judging Programming FeedbackarXiv preprint arXiv:2407.04873 2024
-
How Instructors Incorporate Generative AI into Teaching ComputingIn Proceedings of the 2024 on Innovation and Technology in Computer Science Education V. 2 2024
-
Analyzing Students’ Preferences for LLM-Generated AnalogiesIn Proceedings of the 2024 on Innovation and Technology in Computer Science Education V. 2 2024
-
-
Experiences from Integrating Large Language Model Chatbots into the ClassroomarXiv preprint arXiv:2406.04817 2024
-
On the comprehensibility of functional decomposition: An empirical studyIn Proceedings of the 32nd IEEE/ACM International Conference on Program Comprehension 2024
-
Exploring Iterative Enhancement for Improving Learnersourced Multiple-Choice Question Explanations with Large Language ModelsIn ICLR 2024 Workshop: How Far Are We From AGI 2024
-
"Sometimes You Just Gotta Risk It for the Biscuit": A Portrait of Student Risk-TakingarXiv preprint arXiv:2405.01477 2024
-
-
-
Prompt Problems: A New Programming Exercise for the Generative AI EraIn Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1 2024
-
Detecting ChatGPT-Generated Code Submissions in a CS1 Course Using Machine Learning ModelsIn Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1 2024
-
Instructor Perceptions of AI Code Generation Tools – A Multi-Institutional Interview StudyIn Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1 2024
-
Solving Proof Block Problems Using Large Language ModelsIn Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1 2024
-
Using Large Language Models for Teaching ComputingIn Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 2 2024
-
Discussing the Changing Landscape of Generative AI in Computing EducationIn Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 2 2024
-
AI in Computing Education from Research to PracticeIn Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 2 2024
-
Decoding Logic Errors: A Comparative Study on Bug Detection by Students and Large Language ModelsIn Proceedings of the 26th Australasian Computing Education Conference 2024
-
Evaluating LLM-generated Worked Examples in an Introductory Programming CourseIn Proceedings of the 26th Australasian Computing Education Conference 2024Best paper award
-
Interactions with Prompt Problems: A New Way to Teach Programming with Large Language ModelsarXiv preprint arXiv:2401.10759 2024
-
2023
-
Benchmarking Educational Program RepairIn NeurIPS’23 Workshop on Generative AI for Education (GAIED) 2023
-
-
-
Leveraging Large Language Models for Analysis of Student Course FeedbackIn Proceedings of the 16th Annual ACM India Compute Conference 2023
-
Understanding Student Evaluation of Teaching in Computer Science CoursesIn Proceedings of the 16th Annual ACM India Compute Conference 2023
-
The Forum Factor: Exploring the Link between Online Discourse and Student Achievement in Higher EducationIn Proceedings of the 16th Annual ACM India Compute Conference 2023
-
Could ChatGPT Be Used for Reviewing Learnersourced Exercises?In Proceedings of the 23rd Koli Calling International Conference on Computing Education Research 2023
-
Exploring the Interplay of Achievement Goals, Self-Efficacy, Prior Experience and Course AchievementIn The United Kingdom and Ireland Computing Education Research (UKICER) conference (UKICER 2023) 2023Best paper award
-
"It’s Weird That it Knows What I Want": Usability and Interactions with Copilot for Novice ProgrammersACM Transactions on Computer-Human Interaction 2023
-
Exploring the Responses of Large Language Models to Beginner Programmers’ Help RequestsIn Proceedings of the 2023 ACM Conference on International Computing Education Research - Volume 1 2023
-
Evaluating Distance Measures for Program RepairIn Proceedings of the 2023 ACM Conference on International Computing Education Research-Volume 1 2023
-
Comparing Code Explanations Created by Students and Large Language ModelsIn Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1 2023
-
Transformed by Transformers: Navigating the AI Coding Revolution for Computing Education: An ITiCSE Working Group Conducted by HumansIn Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 2 2023
-
Chat Overflow: Artificially Intelligent Models for Computing Education-renAIssance or apocAIypse?In Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1 2023
-
Seeing Program Output Improves Novice Learning GainsIn Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1 2023
-
Evaluating the Performance of Code Generation Models for Solving Parsons Problems With Small Prompt VariationsIn Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1 2023
-
Promptly: Using Prompt Problems to Teach Learners How to Effectively Utilize AI Code GeneratorsarXiv preprint arXiv:2307.16364 2023
-
Detecting ChatGPT-Generated Code in a CS1 CourseIn AIED2023 Empowering Education with LLMs - the Next-Gen Interface and Content Generation Workshop 2023
-
Can We Trust AI-Generated Educational Content? Comparative Analysis of Human and AI-Generated Learning ResourcesarXiv preprint arXiv:2306.10509 2023
-
Automated Program Repair Using Generative Models for Code InfillingIn International Conference on Artificial Intelligence in Education 2023
-
Factors Affecting Compilable State at Each Keystroke in CS1In 2023 IEEE/ACM 45th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET) 2023
-
Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-BookIn Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1 2023
-
G is for Generalisation: Predicting Student Success from KeystrokesIn Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1 2023
-
Using Large Language Models to Enhance Programming Error MessagesIn Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1 2023
-
Automatically Generating CS Learning Materials with Large Language ModelsIn Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 2 2023
-
Computing Education Postdocs and Beyond: Building a Postdoc Space for Community and CollaborationIn Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 2 2023
-
The Implications of Large Language Models for CS Teachers and StudentsIn Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 2 2023
-
-
Introduction to the Special Issue on EDM in Computer Science Education (CSEDM)Journal of Educational Data Mining 2023
-
Experiences from Learnersourcing SQL Exercises: Do They Cover Course Topics and Do Students Use Them?In Proceedings of the 25th Australasian Computing Education Conference 2023
-
Automated Questionnaires About Students’ JavaScript Programs: Towards Gauging Novice Programming ProcessesIn Proceedings of the 25th Australasian Computing Education Conference 2023Best practitioner paper award
2022
-
Parsons Problems and Beyond: Systematic Literature Review and Empirical Study DesignsProceedings of the 2022 Working Group Reports on Innovation and Technology in Computer Science Education 2022
-
Robosourcing Educational Resources–Leveraging Large Language Models for LearnersourcingarXiv preprint arXiv:2211.04715 2022
-
Trends From Computing Education Research Conferences: Increasing Submissions and Decreasing Acceptance RatesIn Proceedings of the 22nd Koli Calling International Conference on Computing Education Research 2022
-
Finding Significant p in Coffee or Tea: Mildly DistastefulIn Proceedings of the 22nd Koli Calling International Conference on Computing Education Research 2022
-
Experiences With and Lessons Learned on Deadlines and Submission BehaviorIn Proceedings of the 22nd Koli Calling International Conference on Computing Education Research 2022
-
Empirical Evaluation of Deep Learning Models for Knowledge Tracing: Of Hyperparameters and Metrics on Performance and ReplicabilityJournal of Educational Data Mining 2022
-
Piloting Natural Language Generation for Personalized Progress FeedbackIn 2022 IEEE Frontiers in Education Conference (FIE) 2022
-
Speeding Up Automated Assessment of Programming ExercisesIn Proceedings of the 2022 Conference on United Kingdom & Ireland Computing Education Research 2022
-
Automatic Generation of Programming Exercises and Code Explanations Using Large Language ModelsIn Proceedings of the 2022 ACM Conference on International Computing Education Research V. 1 2022Best paper award
-
Planning a Multi-institutional and Multi-national Study of the Effectiveness of Parsons ProblemsIn Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 2 2022
-
Can Students Review Their Peers? Comparison of Peer and Instructor ReviewsIn Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1 2022
-
Who Continues in a Series of Lifelong Learning Courses?In Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1 2022
-
Open IDE Action Log Dataset from a CS1 MOOCIn 6th Educational Data Mining in Computer Science Education (CSEDM) Workshop 2022
-
Digital Education for All: Multi-University Study of Increasing Competent Student Admissions at ScaleIn L@S’22: Proceedings of the Ninth ACM Conference on Learning @ Scale 2022
-
Coverage of Course Topics in Learnersourced SQL ExercisesIn Learnersourcing: Student-Generated Content @ Scale: Workshop as Part of the Learning @ Scale Conference 2022
-
-
Seeking Flow From Fine-Grained Log DataIn 2022 IEEE/ACM 44th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET) 2022
-
Pausing While Programming: Insights From Keystroke AnalysisIn 2022 IEEE/ACM 44th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET) 2022
-
Digitalisaation vaikutus oppimiseen, oppimistilanteisiin ja oppimistuloksiin: DigiVOO-hankkeen väliraportti 20222022
-
Time-on-Task Metrics for Predicting PerformanceIn Proceedings of the 53rd ACM Technical Symposium on Computer Science Education V. 1 2022Best paper award
-
A Comparison of Immediate and Scheduled Feedback in Introductory Programming ProjectsIn Proceedings of the 53rd ACM Technical Symposium on Computer Science Education V. 1 2022
-
CodeProcess Charts: Visualizing the Process of Writing CodeIn Australasian Computing Education Conference 2022
-
Methodological Considerations for Predicting At-risk StudentsIn Australasian Computing Education Conference 2022
2021
-
Facilitating API lookup for novices learning data wrangling using thumbnail graphicsFoundations of Data Science 2021
-
Visual Recipes for Slicing and Dicing Data: Teaching Data Wrangling Using Subgoal GraphicsIn 21st Koli Calling International Conference on Computing Education Research 2021
-
Persistence of Time Management Behavior of Students and Its Relationship with Performance in Software ProjectsIn Proceedings of the 17th ACM Conference on International Computing Education Research 2021
-
Digital Education For All: Better Students Through Open Doors?In Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1 2021
-
Does the Early Bird Catch the Worm? Earliness of Students’ Work and its Relationship with Course OutcomesIn Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1 2021
-
Fine-Grained Versus Coarse-Grained Data for Estimating Time-on-Task in Learning ProgrammingIn Educational Data Mining 2021 2021
-
Morning or Evening? An Examination of Circadian Rhythms of CS1 StudentsIn 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET) 2021
-
Exploring Personalization of Gamification in an Introductory Programming CourseIn Proceedings of the 52nd ACM Technical Symposium on Computer Science Education 2021
-
Exploring the Complexity of Crowdsourced Programming AssignmentsIn CS Education Infrastructure for All III: From Ideas to Practice: Seventh SPLICE Project Workshop 2021
-
Analyzing Fine-Grained Material Usage BehaviorIn CS Education Infrastructure for All III: From Ideas to Practice: Seventh SPLICE Project Workshop 2021
-
Exploring the Effects of Contextualized Problem Descriptions on Problem SolvingIn Australasian Computing Education Conference 2021Best paper award
-
Promoting Early Engagement with Programming Assignments Using Scheduled Automated FeedbackIn Australasian Computing Education Conference 2021
2020
-
-
Students’ Preferences Between Traditional and Video Lectures: Profiles and Study SuccessIn Koli Calling’20: Proceedings of the 20th Koli Calling International Conference on Computing Education Research 2020
-
Programming Versus Natural Language: On the Effect of Context on Typing in CS1In Proceedings of the 2020 ACM Conference on International Computing Education Research 2020
-
Selection of Code Segments for Exclusion from Code Similarity DetectionIn Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education 2020
-
Crowdsourcing Content Creation for SQL PracticeIn Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education 2020
-
A Study of Keystroke Data in Two Contexts: Written Language and Programming Language Influence Predictability of Learning OutcomesIn Proceedings of the 51st ACM Technical Symposium on Computer Science Education 2020
2019
-
-
-
Experimenting With Model Solutions as a Support MechanismIn Proceedings of the 1st UK & Ireland Computing Education Research Conference 2019
-
Integrating CrowdSorcerer: Lessons LearnedIn Proceedings of SPLICE 2019 Workshop Computing Science Education Infrastructure From Tools to Data at 15th ACM International Computing Education Research Conference 2019
-
Non-restricted Access to Model Solutions: A Good Idea?In Proceedings of the 2019 ACM Conference on Innovation and Technology in Computer Science Education 2019
-
Pass Rates in STEM Disciplines Including ComputingIn Proceedings of the 2019 ACM Conference on Innovation and Technology in Computer Science Education 2019
-
Admitting Students Through an Open Online Course in Programming: A Multi-Year Analysis of Study SuccessIn Proceedings of the 2019 ACM Conference on International Computing Education Research 2019
-
Does Creating Programming Assignments With Tests Lead to Improved Performance in Writing Unit Tests?In Proceedings of the ACM Conference on Global Computing Education 2019
-
Exploring the Applicability of Simple Syntax Writing Practice for Learning ProgrammingIn Proceedings of the 50th ACM Technical Symposium on Computer Science Education 2019
2018
-
Analysis of Students’ Peer Reviews to Crowdsourced Programming AssignmentsIn Proceedings of the 18th Koli Calling International Conference on Computing Education Research 2018
-
Taxonomizing Features and Methods for Identifying At-Risk Students in Computing CoursesIn Proceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education 2018
-
Crowdsourcing Programming Assignments With CrowdSorcererIn Proceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education 2018
-
Predicting Academic Performance: A Systematic Literature ReviewIn Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education 2018
-
A Study of Pair Programming Enjoyment and Attendance Using Study Motivation and Strategy MetricsIn Proceedings of the 49th ACM Technical Symposium on Computer Science Education 2018
-
Supporting Self-Regulated Learning With Visualizations in Online Learning EnvironmentsIn Proceedings of the 49th ACM Technical Symposium on Computer Science Education 2018
2017
-
Tracking Students’ Internet Browsing in a Machine ExamIn Proceedings of the 6th Computer Science Education Research Conference 2017
-
Adolescent and Adult Student Attitudes Towards Progress VisualizationsIn International Conference on Informatics in Schools: Situation, Evolution, and Perspectives 2017
-
Thought Crimes and Profanities Whilst ProgrammingIn Proceedings of the 17th Koli Calling International Conference on Computing Education Research 2017Best presentation award
-
Identification Based on Typing Patterns Between Programming and Free TextIn Proceedings of the 17th Koli Calling International Conference on Computing Education Research 2017
-
Predicting Academic Success Based on Learning Material UsageIn Proceedings of the 18th Annual Conference on Information Technology Education 2017
-
Comparison of Time Metrics in ProgrammingIn Proceedings of the 2017 ACM Conference on International Computing Education Research 2017
-
Student Modeling Based on Fine-Grained Programming Process SnapshotsIn Proceedings of the 2017 ACM Conference on International Computing Education Research 2017
-
Plagiarism in Take-Home Exams: Help-Seeking, Collaboration, and Systematic CheatingIn Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education 2017
-
Using and Collecting Fine-Grained Usage Data to Improve Online Learning MaterialsIn 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering Education and Training Track (ICSE-SEET) 2017
-
Preventing Keystroke Based Identification in Open Data SetsIn Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale 2017
-
-
Performance and Consistency in Learning to ProgramIn Proceedings of the Nineteenth Australasian Computing Education Conference 2017Best student paper award
2016
-
Pauses and Spacing in Learning to ProgramIn Proceedings of the 16th Koli Calling International Conference on Computing Education Research 2016
-
Typing Patterns and Authentication in Practical Programming ExamsIn Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education 2016
-
-
Automatic Inference of Programming Performance and Experience From Typing PatternsIn Proceedings of the 47th ACM Technical Symposium on Computing Science Education 2016
2015
-
Identification of Programmers From Typing PatternsIn Proceedings of the 15th Koli Calling Conference on Computing Education Research 2015Best paper award