Enhancing Procedural Writing Through Personalized Example Retrieval: A Case Study on Cooking Recipes
Version
Published
Date Issued
2024
Author(s)
Mejia-Domenzain, Paola
Frej, Jibril
Neshaei, Seyed Parsa
Mouchel, Luca
Nazaretsky, Tanya
Bosselut, Antoine
Käser, Tanja
Type
Article
Language
English
Subjects
Abstract
Writing high-quality procedural texts is a challenging task for many learners. While example-based learning has shown promise as a feedback approach, a limitation arises when all learners receive the same content without considering their individual input or prior knowledge. Consequently, some learners struggle to grasp or relate to the feedback, finding it redundant and unhelpful. To address this issue, we present RELEX, an adaptive learning system designed to enhance procedural writing through personalized example-based learning. The core of our system is a multi-step example retrieval pipeline that selects a higher quality and contextually relevant example for each learner based on their unique input. We instantiate our system in the domain of cooking recipes. Specifically, we leverage a fine-tuned Large Language Model to predict the quality score of the learner’s cooking recipe. Using this score, we retrieve recipes with higher quality from a vast database of over 180,000 recipes. Next, we apply BM25 to select the semantically most similar recipe in real-time. Finally, we use domain knowledge and regular expressions to enrich the selected example recipe with personalized instructional explanations. We evaluate RELEX in a 2x2 controlled study (personalized vs. non-personalized examples, reflective prompts vs. none) with 200 participants. Our results show that providing tailored examples contributes to better writing performance and user experience.
Subjects
L Education (General)
T Technology (General)
Publisher DOI
Journal or Serie
International Journal of Artificial Intelligence in Education
ISSN
1560-4292
Organization
Publisher
Springer
Citation apa
Mejia-Domenzain, P., Frej, J., Neshaei, S. P., Mouchel, L., Nazaretsky, T., Wambsganss, T., Bosselut, A., & Käser, T. (2024). Enhancing Procedural Writing Through Personalized Example Retrieval: A Case Study on Cooking Recipes. In International Journal of Artificial Intelligence in Education (pp. 1–37). Springer. https://doi.org/10.24451/arbor.22095
File(s)![Thumbnail Image]()
Loading...
open access
Name
s40593-024-00405-1.pdf
License
Attribution 4.0 International
Version
published
Size
1.81 MB
Format
Adobe PDF
Checksum (MD5)
f172cdfca64f0e1b65d91891cb138353
