2025 /research/ai-institute/ en Multimodal Situational Awareness: Neuro-Symbolic AI for Real-Time HCI in the Classroom /research/ai-institute/2025/05/02/multimodal-situational-awareness-neuro-symbolic-ai-real-time-hci-classroom <span>Multimodal Situational Awareness: Neuro-Symbolic AI for Real-Time HCI in the Classroom</span> <span><span>Amy Corbitt</span></span> <span><time datetime="2025-05-02T15:15:06-06:00" title="Friday, May 2, 2025 - 15:15">Fri, 05/02/2025 - 15:15</time> </span> <div role="contentinfo" class="container ucb-article-categories" itemprop="about"> <span class="visually-hidden">Categories:</span> <div class="ucb-article-category-icon" aria-hidden="true"> <i class="fa-solid fa-folder-open"></i> </div> <a href="/research/ai-institute/taxonomy/term/127"> Publications </a> </div> <div role="contentinfo" class="container ucb-article-tags" itemprop="keywords"> <span class="visually-hidden">Tags:</span> <div class="ucb-article-tag-icon" aria-hidden="true"> <i class="fa-solid fa-tags"></i> </div> <a href="/research/ai-institute/taxonomy/term/226" hreflang="en">2025</a> <a href="/research/ai-institute/taxonomy/term/202" hreflang="en">Conference Proceedings</a> <a href="/research/ai-institute/taxonomy/term/193" hreflang="en">Strand 1</a> </div> <div class="ucb-article-content ucb-striped-content"> <div class="container"> <div class="paragraph paragraph--type--article-content paragraph--view-mode--default"> <div class="ucb-article-text" itemprop="articleBody"> <div><p>Multimodal Situational Awareness: Neuro-Symbolic AI for Real-Time HCI in the Classroom</p><p>Authors: Zhu, Y., Khebour, I., Lai, K., Verhagen, M., Krishnaswamy, N., and Pustejovsky, J.</p><p>Publication Date: 2025</p><p>Publication Type: International Conference on Human-Computer Interaction (HCII). Springer.</p></div> </div> </div> </div> </div> <h2> <div class="paragraph paragraph--type--ucb-related-articles-block paragraph--view-mode--default"> <div>Off</div> </div> </h2> <div>Traditional</div> <div>0</div> <div>On</div> <div>White</div> Fri, 02 May 2025 21:15:06 +0000 Amy Corbitt 910 at /research/ai-institute TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues /research/ai-institute/2025/05/02/trace-real-time-multimodal-common-ground-tracking-situated-collaborative-dialogues <span>TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues</span> <span><span>Amy Corbitt</span></span> <span><time datetime="2025-05-02T15:06:34-06:00" title="Friday, May 2, 2025 - 15:06">Fri, 05/02/2025 - 15:06</time> </span> <div role="contentinfo" class="container ucb-article-categories" itemprop="about"> <span class="visually-hidden">Categories:</span> <div class="ucb-article-category-icon" aria-hidden="true"> <i class="fa-solid fa-folder-open"></i> </div> <a href="/research/ai-institute/taxonomy/term/127"> Publications </a> </div> <div role="contentinfo" class="container ucb-article-tags" itemprop="keywords"> <span class="visually-hidden">Tags:</span> <div class="ucb-article-tag-icon" aria-hidden="true"> <i class="fa-solid fa-tags"></i> </div> <a href="/research/ai-institute/taxonomy/term/226" hreflang="en">2025</a> <a href="/research/ai-institute/taxonomy/term/202" hreflang="en">Conference Proceedings</a> <a href="/research/ai-institute/taxonomy/term/193" hreflang="en">Strand 1</a> </div> <div class="ucb-article-content ucb-striped-content"> <div class="container"> <div class="paragraph paragraph--type--article-content paragraph--view-mode--default"> <div class="ucb-article-text" itemprop="articleBody"> <div><p>TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues</p><p>Authors: VanderHoeven, H., Bhalla, B., Khebour, I., Youngren, A., Venkatesha, V., Bradford, M., Fitzgerald, J., Mabrey, C., Tu, J., Zhu, Y., Lai, K., Jung, C., Pustejovsky, J., &amp; Krishnaswamy, N.</p><p>Publication Date: 2025</p><p>Publication Type: In Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL).</p></div> </div> </div> </div> </div> <h2> <div class="paragraph paragraph--type--ucb-related-articles-block paragraph--view-mode--default"> <div>Off</div> </div> </h2> <div>Traditional</div> <div>0</div> <div>On</div> <div>White</div> Fri, 02 May 2025 21:06:34 +0000 Amy Corbitt 909 at /research/ai-institute The Relationship between Collaborative Problem-Solving Skills and Group-to Individual Learning Transfer in a Game-based Learning Environment /research/ai-institute/2025/05/01/relationship-between-collaborative-problem-solving-skills-and-group-individual-learning <span>The Relationship between Collaborative Problem-Solving Skills and Group-to Individual Learning Transfer in a Game-based Learning Environment</span> <span><span>Amy Corbitt</span></span> <span><time datetime="2025-05-01T12:02:37-06:00" title="Thursday, May 1, 2025 - 12:02">Thu, 05/01/2025 - 12:02</time> </span> <div role="contentinfo" class="container ucb-article-categories" itemprop="about"> <span class="visually-hidden">Categories:</span> <div class="ucb-article-category-icon" aria-hidden="true"> <i class="fa-solid fa-folder-open"></i> </div> <a href="/research/ai-institute/taxonomy/term/127"> Publications </a> </div> <div role="contentinfo" class="container ucb-article-tags" itemprop="keywords"> <span class="visually-hidden">Tags:</span> <div class="ucb-article-tag-icon" aria-hidden="true"> <i class="fa-solid fa-tags"></i> </div> <a href="/research/ai-institute/taxonomy/term/226" hreflang="en">2025</a> <a href="/research/ai-institute/taxonomy/term/202" hreflang="en">Conference Proceedings</a> <a href="/research/ai-institute/taxonomy/term/194" hreflang="en">Institute-Wide</a> </div> <div class="ucb-article-content ucb-striped-content"> <div class="container"> <div class="paragraph paragraph--type--article-content paragraph--view-mode--default"> <div class="ucb-article-text" itemprop="articleBody"> <div><p>The Relationship between Collaborative Problem-Solving Skills and Group to Individual Learning Transfer in a Game-based Learning Environment</p><p>Authors: Sun, C., Shute, V., Stewart, A., &amp; D’Mello, S. K.</p><p>Publication Date: 2025</p><p>Publication Type: In Proceedings of the 2025 International Conference on Learning Analytics &amp; Knowledge (LAK25) ACM.</p></div> </div> </div> </div> </div> <h2> <div class="paragraph paragraph--type--ucb-related-articles-block paragraph--view-mode--default"> <div>Off</div> </div> </h2> <div>Traditional</div> <div>0</div> <div>On</div> <div>White</div> Thu, 01 May 2025 18:02:37 +0000 Amy Corbitt 905 at /research/ai-institute Improving Tutor Discourse Practices via AI-Enhanced Coaching: A Piecewise Latent Growth Curve Modeling Approach /research/ai-institute/2025/05/01/improving-tutor-discourse-practices-ai-enhanced-coaching-piecewise-latent-growth-curve <span>Improving Tutor Discourse Practices via AI-Enhanced Coaching: A Piecewise Latent Growth Curve Modeling Approach</span> <span><span>Amy Corbitt</span></span> <span><time datetime="2025-05-01T11:58:51-06:00" title="Thursday, May 1, 2025 - 11:58">Thu, 05/01/2025 - 11:58</time> </span> <div role="contentinfo" class="container ucb-article-categories" itemprop="about"> <span class="visually-hidden">Categories:</span> <div class="ucb-article-category-icon" aria-hidden="true"> <i class="fa-solid fa-folder-open"></i> </div> <a href="/research/ai-institute/taxonomy/term/127"> Publications </a> </div> <div role="contentinfo" class="container ucb-article-tags" itemprop="keywords"> <span class="visually-hidden">Tags:</span> <div class="ucb-article-tag-icon" aria-hidden="true"> <i class="fa-solid fa-tags"></i> </div> <a href="/research/ai-institute/taxonomy/term/226" hreflang="en">2025</a> <a href="/research/ai-institute/taxonomy/term/202" hreflang="en">Conference Proceedings</a> <a href="/research/ai-institute/taxonomy/term/194" hreflang="en">Institute-Wide</a> </div> <div class="ucb-article-content ucb-striped-content"> <div class="container"> <div class="paragraph paragraph--type--article-content paragraph--view-mode--default"> <div class="ucb-article-text" itemprop="articleBody"> <div><p>Improving Tutor Discourse Practices via AI-Enhanced Coaching: A Piecewise Latent Growth Curve Modeling Approach</p><p>Authors: Sawaya, S., Jacobs, J., Moulder, R., Milne, B., Fischaber, T., D'Mello, S. K.</p><p>Publication Date: 2025</p><p>Publication Type: 26th International Conference on Artificial Intelligence in Education (AIED 2025).</p></div> </div> </div> </div> </div> <h2> <div class="paragraph paragraph--type--ucb-related-articles-block paragraph--view-mode--default"> <div>Off</div> </div> </h2> <div>Traditional</div> <div>0</div> <div>On</div> <div>White</div> Thu, 01 May 2025 17:58:51 +0000 Amy Corbitt 903 at /research/ai-institute Frictive Policy Optimization for LLM Agent Interactions /research/ai-institute/2025/05/01/frictive-policy-optimization-llm-agent-interactions <span>Frictive Policy Optimization for LLM Agent Interactions</span> <span><span>Amy Corbitt</span></span> <span><time datetime="2025-05-01T10:44:52-06:00" title="Thursday, May 1, 2025 - 10:44">Thu, 05/01/2025 - 10:44</time> </span> <div role="contentinfo" class="container ucb-article-categories" itemprop="about"> <span class="visually-hidden">Categories:</span> <div class="ucb-article-category-icon" aria-hidden="true"> <i class="fa-solid fa-folder-open"></i> </div> <a href="/research/ai-institute/taxonomy/term/127"> Publications </a> </div> <div role="contentinfo" class="container ucb-article-tags" itemprop="keywords"> <span class="visually-hidden">Tags:</span> <div class="ucb-article-tag-icon" aria-hidden="true"> <i class="fa-solid fa-tags"></i> </div> <a href="/research/ai-institute/taxonomy/term/226" hreflang="en">2025</a> <a href="/research/ai-institute/taxonomy/term/202" hreflang="en">Conference Proceedings</a> <a href="/research/ai-institute/taxonomy/term/193" hreflang="en">Strand 1</a> </div> <div class="ucb-article-content ucb-striped-content"> <div class="container"> <div class="paragraph paragraph--type--article-content paragraph--view-mode--default"> <div class="ucb-article-text" itemprop="articleBody"> <div><p>Frictive Policy Optimization for LLM Agent Interactions</p><p>Authors: Pustejovsky, J., &amp; Krishnaswamy, N.</p><p>Publication Date: 2025</p><p>Publication Type: RAD-AI Workshop at <span>The 24th International Conference on Autonomous Agents and Multiagent Systems (</span>AAMAS 2025).</p></div> </div> </div> </div> </div> <h2> <div class="paragraph paragraph--type--ucb-related-articles-block paragraph--view-mode--default"> <div>Off</div> </div> </h2> <div>Traditional</div> <div>0</div> <div>On</div> <div>White</div> Thu, 01 May 2025 16:44:52 +0000 Amy Corbitt 901 at /research/ai-institute Understanding Collaborative Learning Processes and Outcomes Through Student Discourse Dynamics /research/ai-institute/2025/05/01/understanding-collaborative-learning-processes-and-outcomes-through-student-discourse <span>Understanding Collaborative Learning Processes and Outcomes Through Student Discourse Dynamics</span> <span><span>Amy Corbitt</span></span> <span><time datetime="2025-05-01T10:40:54-06:00" title="Thursday, May 1, 2025 - 10:40">Thu, 05/01/2025 - 10:40</time> </span> <div role="contentinfo" class="container ucb-article-categories" itemprop="about"> <span class="visually-hidden">Categories:</span> <div class="ucb-article-category-icon" aria-hidden="true"> <i class="fa-solid fa-folder-open"></i> </div> <a href="/research/ai-institute/taxonomy/term/127"> Publications </a> </div> <div role="contentinfo" class="container ucb-article-tags" itemprop="keywords"> <span class="visually-hidden">Tags:</span> <div class="ucb-article-tag-icon" aria-hidden="true"> <i class="fa-solid fa-tags"></i> </div> <a href="/research/ai-institute/taxonomy/term/226" hreflang="en">2025</a> <a href="/research/ai-institute/taxonomy/term/202" hreflang="en">Conference Proceedings</a> <a href="/research/ai-institute/taxonomy/term/194" hreflang="en">Institute-Wide</a> </div> <div class="ucb-article-content ucb-striped-content"> <div class="container"> <div class="paragraph paragraph--type--article-content paragraph--view-mode--default"> <div class="ucb-article-text" itemprop="articleBody"> <div><p>Understanding Collaborative Learning Processes and Outcomes Through Student Discourse Dynamics</p><p>Authors: Park, S., Nixon, N., D'Mello, S. K., Shariff, D., &amp; Choi, J.</p><p>Publication Date: 2025</p><p>Publication Type: Proceedings of the 15th International Learning Analytics and Knowledge Conference (LAK 2025).</p></div> </div> </div> </div> </div> <h2> <div class="paragraph paragraph--type--ucb-related-articles-block paragraph--view-mode--default"> <div>Off</div> </div> </h2> <div>Traditional</div> <div>0</div> <div>On</div> <div>White</div> Thu, 01 May 2025 16:40:54 +0000 Amy Corbitt 899 at /research/ai-institute Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement /research/ai-institute/2025/05/01/speech-not-enough-interpreting-nonverbal-indicators-common-knowledge-and-engagement <span>Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement</span> <span><span>Amy Corbitt</span></span> <span><time datetime="2025-05-01T10:34:59-06:00" title="Thursday, May 1, 2025 - 10:34">Thu, 05/01/2025 - 10:34</time> </span> <div role="contentinfo" class="container ucb-article-categories" itemprop="about"> <span class="visually-hidden">Categories:</span> <div class="ucb-article-category-icon" aria-hidden="true"> <i class="fa-solid fa-folder-open"></i> </div> <a href="/research/ai-institute/taxonomy/term/127"> Publications </a> </div> <div role="contentinfo" class="container ucb-article-tags" itemprop="keywords"> <span class="visually-hidden">Tags:</span> <div class="ucb-article-tag-icon" aria-hidden="true"> <i class="fa-solid fa-tags"></i> </div> <a href="/research/ai-institute/taxonomy/term/226" hreflang="en">2025</a> <a href="/research/ai-institute/taxonomy/term/202" hreflang="en">Conference Proceedings</a> <a href="/research/ai-institute/taxonomy/term/193" hreflang="en">Strand 1</a> </div> <div class="ucb-article-content ucb-striped-content"> <div class="container"> <div class="paragraph paragraph--type--article-content paragraph--view-mode--default"> <div class="ucb-article-text" itemprop="articleBody"> <div><p>Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement</p><p>Authors: Palmer, D., Zhu, Y., Lai, K., VanderHoeven, H., Bradford, M., Khebour, I., Mabrey, C., Fitzgerald, J., Zilong Li, Krishnaswamy, N., Palmer, M., and Pustejovsky, J.</p><p>Publication Date: 2025</p><p>Publication Type: In AAAI Conference on Artificial Intelligence (AAAI): Demos Program. AAAI.</p></div> </div> </div> </div> </div> <h2> <div class="paragraph paragraph--type--ucb-related-articles-block paragraph--view-mode--default"> <div>Off</div> </div> </h2> <div>Traditional</div> <div>0</div> <div>On</div> <div>White</div> Thu, 01 May 2025 16:34:59 +0000 Amy Corbitt 898 at /research/ai-institute Efficacy of a Computer Tutor that Models Expert Human Tutors /research/ai-institute/2025/05/01/efficacy-computer-tutor-models-expert-human-tutors <span>Efficacy of a Computer Tutor that Models Expert Human Tutors</span> <span><span>Amy Corbitt</span></span> <span><time datetime="2025-05-01T10:28:56-06:00" title="Thursday, May 1, 2025 - 10:28">Thu, 05/01/2025 - 10:28</time> </span> <div role="contentinfo" class="container ucb-article-categories" itemprop="about"> <span class="visually-hidden">Categories:</span> <div class="ucb-article-category-icon" aria-hidden="true"> <i class="fa-solid fa-folder-open"></i> </div> <a href="/research/ai-institute/taxonomy/term/127"> Publications </a> </div> <div role="contentinfo" class="container ucb-article-tags" itemprop="keywords"> <span class="visually-hidden">Tags:</span> <div class="ucb-article-tag-icon" aria-hidden="true"> <i class="fa-solid fa-tags"></i> </div> <a href="/research/ai-institute/taxonomy/term/226" hreflang="en">2025</a> <a href="/research/ai-institute/taxonomy/term/202" hreflang="en">Conference Proceedings</a> <a href="/research/ai-institute/taxonomy/term/194" hreflang="en">Institute-Wide</a> </div> <div class="ucb-article-content ucb-striped-content"> <div class="container"> <div class="paragraph paragraph--type--article-content paragraph--view-mode--default"> <div class="ucb-article-text" itemprop="articleBody"> <div><p>Efficacy of a Computer Tutor that Models Expert Human Tutors</p><p>Authors: Olney, A., D'Mello, S. K., Person, N., Cade, W., Hays, P., Dempsey, C., Lehman, B., Sanders, B., &amp; Graesser, A.</p><p>Publication Date: 2025</p><p>Publication Type: 26th International Conference on Artificial Intelligence in Education (AIED 2025).</p></div> </div> </div> </div> </div> <h2> <div class="paragraph paragraph--type--ucb-related-articles-block paragraph--view-mode--default"> <div>Off</div> </div> </h2> <div>Traditional</div> <div>0</div> <div>On</div> <div>White</div> Thu, 01 May 2025 16:28:56 +0000 Amy Corbitt 896 at /research/ai-institute Feature Contributions to Multimodal Interpretation of Meaning /research/ai-institute/2025/04/30/feature-contributions-multimodal-interpretation-meaning <span>Feature Contributions to Multimodal Interpretation of Meaning</span> <span><span>Amy Corbitt</span></span> <span><time datetime="2025-04-30T19:29:52-06:00" title="Wednesday, April 30, 2025 - 19:29">Wed, 04/30/2025 - 19:29</time> </span> <div role="contentinfo" class="container ucb-article-categories" itemprop="about"> <span class="visually-hidden">Categories:</span> <div class="ucb-article-category-icon" aria-hidden="true"> <i class="fa-solid fa-folder-open"></i> </div> <a href="/research/ai-institute/taxonomy/term/127"> Publications </a> </div> <div role="contentinfo" class="container ucb-article-tags" itemprop="keywords"> <span class="visually-hidden">Tags:</span> <div class="ucb-article-tag-icon" aria-hidden="true"> <i class="fa-solid fa-tags"></i> </div> <a href="/research/ai-institute/taxonomy/term/226" hreflang="en">2025</a> <a href="/research/ai-institute/taxonomy/term/202" hreflang="en">Conference Proceedings</a> <a href="/research/ai-institute/taxonomy/term/193" hreflang="en">Strand 1</a> </div> <div class="ucb-article-content ucb-striped-content"> <div class="container"> <div class="paragraph paragraph--type--article-content paragraph--view-mode--default"> <div class="ucb-article-text" itemprop="articleBody"> <div><p>Feature Contributions to Multimodal Interpretation of Meaning</p><p>Authors: Khebour, I., Jung, C., Fitzgerald, J., Jamil, H., and Krishnaswamy, N.</p><p>Publication Date: 2025</p><p>Publication Type: International Conference on Human-Computer Interaction (HCII). Springer.</p></div> </div> </div> </div> </div> <h2> <div class="paragraph paragraph--type--ucb-related-articles-block paragraph--view-mode--default"> <div>Off</div> </div> </h2> <div>Traditional</div> <div>0</div> <div>On</div> <div>White</div> Thu, 01 May 2025 01:29:52 +0000 Amy Corbitt 886 at /research/ai-institute Multi-modal Speech Transformer Decoders: When Do Multiple Modalities Improve Accuracy? /research/ai-institute/2025/04/30/multi-modal-speech-transformer-decoders-when-do-multiple-modalities-improve-accuracy <span>Multi-modal Speech Transformer Decoders: When Do Multiple Modalities Improve Accuracy?</span> <span><span>Amy Corbitt</span></span> <span><time datetime="2025-04-30T18:58:41-06:00" title="Wednesday, April 30, 2025 - 18:58">Wed, 04/30/2025 - 18:58</time> </span> <div role="contentinfo" class="container ucb-article-categories" itemprop="about"> <span class="visually-hidden">Categories:</span> <div class="ucb-article-category-icon" aria-hidden="true"> <i class="fa-solid fa-folder-open"></i> </div> <a href="/research/ai-institute/taxonomy/term/127"> Publications </a> </div> <div role="contentinfo" class="container ucb-article-tags" itemprop="keywords"> <span class="visually-hidden">Tags:</span> <div class="ucb-article-tag-icon" aria-hidden="true"> <i class="fa-solid fa-tags"></i> </div> <a href="/research/ai-institute/taxonomy/term/226" hreflang="en">2025</a> <a href="/research/ai-institute/taxonomy/term/202" hreflang="en">Conference Proceedings</a> <a href="/research/ai-institute/taxonomy/term/193" hreflang="en">Strand 1</a> </div> <div class="ucb-article-content ucb-striped-content"> <div class="container"> <div class="paragraph paragraph--type--article-content paragraph--view-mode--default"> <div class="ucb-article-text" itemprop="articleBody"> <div><p>Multi-modal Speech Transformer Decoders: When Do Multiple Modalities Improve Accuracy?</p><p>Authors: Guan, Y., Trinh, V.A., Voleti, V., and Whitehill, J.</p><p>Publication Date: 2025</p><p>Publication Type: IEEE International Conference on Multimedia &amp; Expo<br>(ICME 2025).&nbsp;</p></div> </div> </div> </div> </div> <h2> <div class="paragraph paragraph--type--ucb-related-articles-block paragraph--view-mode--default"> <div>Off</div> </div> </h2> <div>Traditional</div> <div>0</div> <div>On</div> <div>White</div> Thu, 01 May 2025 00:58:41 +0000 Amy Corbitt 882 at /research/ai-institute