LAK25 at Dublin – Publications and Reflections

It was great to reconnect with the Learning Analytics community at LAK25 in Dublin (before coming straight back to a busy teaching semester). LAK15 was the first conference I ever attended, and I have fond memories of this first scholarly experience. I went down memory lane after 10 years, reflecting on how it is probably the reason why I chose to do a PhD and stay in academia. My publications at LAK25 are discussed below, but also check out the full UTS line-up from the Connected Intelligence Centre (CIC) website! 

In the writing analytics workshop I co-organised, our discussions spanned new methods that can inform and use generative AI for writing (tools and analytics), but we also asked some fundamental questions on the nature and evolving role of writing itself.

Rianne Conijn, Antonette Shibani, Laura Allen, Simon Buckingham Shum & Cerstin Mahlow (2025) Writing Analytics in the age of Large Language Models: Expanding horizons for assessing and designing writing with AI. In companion proceedings of the 15th International Conference on Learning Analytics & Knowledge (LAK25) pg 436-439.

Abstracts of the presented papers are on the workshop website, and you can access the organiser slides and the shared notes as well. As someone who values writing quite a bit (I’ve always found academic writing really helpful for my thinking, which enhances my own ideas as they evolve in my head), the diminishing role of writing especially for student assessments worries me (and many other folks I know, we had a great question on it at the workshop). But, having heard Prof. Rupert Wegerif talk about dialogic theory and education servicing technologies (Yes, that’s right!), I’ve come to peace with other ways of thinking. While writing is still important, it may become less essential; and maybe that’s okay. Because people think differently, writing is not the only medium for it (for example, Indigenous Knowledges have been around for centuries in various other forms). For those who prefer writing, it can continue to be of significant value, and I agree, the college essay is not dead (manifesto), we just need better, more relevant ones. I believe that we should still teach students how to write well, especially in finding their voice and being authentic (with text starting to sound very similar everywhere, I’ve personally started craving for more originality in tone of writing; Sounding professional is great, but looks like I could only take so many AI-generated emails)!

I was invited to take part in the full day Grand Challenges workshop, where workshop participants had a lot of fun identifying and voting for the grand challenges that the field of Learning Analytics should tackle in the next decade. Thanks, Sasha for the shoutout on LinkedIn.

The workshop had interesting follow-up events: an interactive poster, and an interactive panel session (keynote 3), and Prof. Simon Buckingham Shum was able to convince most (voted #1 challenge in the workshop), or me atleast, that LA should prioritize the soceity’s most pressing challenges. I’ve asked Simon how exactly we can make this happen (I can draw basic connections between learning analytics empowering learners to tackle skill challenges but I cannot extend it to how it can help save the world in this polycrisis!). He promised that he would write about it in detail, so I’m looking forward to reading it. Sidenote: I was reading Tomitsch (Head of School, TD School, UTS) and Baty’s Designing Tomorrow book and all about the climate challenges during my flight to Dublin, so it made sense – highly recommended read; it completely changed how I view Human-centred design!

Another challenge around defining core principles for LA in the rapidly changing GenAI context was something I contributed to quite a bit (stemming from the many conversations at LAK around futures and past failures of LA). There’s a lot happening around GenAI pretty quickly; its affordances are rapidly improving – but this is all the more the reason to be mindful and cautious in what we research and implement in education. We’ve contributed to some starter discussions in an upcoming editorial for the JLA Special Section on Generative AI and Learning Analytics – look out for this in the coming weeks!

At another workshop From Data to Discovery: LLMs for Qualitative Analysis in Education, Lisa did a fabulous job of presenting our team’s work (unfortunately, it conflicted with my writing analytics workshop, so I couldn’t make it). The title is self-explanatory, and the full paper has all the details:

Aneesha Bakharia, Antonette Shibani, Lisa-Angelique Lim, Trish McCluskey and Simon Buckingham Shum (2025) From Transcripts to Themes: A Trustworthy Workflow for Qualitative Analysis Using Large Language Models. In CEUR proceedings of the workshop ‘From Data to Discovery: LLMs for Qualitative Analysis in Education’. Companion proceedings of the 15th International Learning Analytics & Knowledge Conference (LAK ’25).

There’s another detailed blog post on this work, so I’ll add its link here:

We also presented a poster that expands analytics on writing for potential feedback on AI-human collaboration (student work, extended from CoauthorViz):

Antonette Shibani, Vishal Raj and Simon Buckingham Shum (2025). Towards Analytics for Self-regulated Human-AI Collaboration in Writing. In Companion proceedings of the 15th International Learning Analytics & Knowledge Conference (LAK25) pg 120-122.

There are ongoing discussions at LAK and beyond on the use of the term “collaboration” to denote human-AI partnerships (and “partnerships” as a term, too but we mean partners in cognition like this 1991 paper). Various disciplines have always interpreted terminologies differently (especially computer science, which makes loose analogies with human psychology – e.g., hallucinations), and it is an open question if we can even agree on how we must perceive terms. Maybe we need better definitions for what we mean by regulation, hybrid, augmenting, or just human-AI interaction? More on this is likely to come later!

I also chaired two sessions at LAK (one where the best papers from sister conferences were invited to present, and another on learning design). The Q&A parts were super interesting there and throughout LAK. We could really see the diversity of the audience’s backgrounds here – the constant switch between statistics, practitioners, LA, and LLMs is mind-boggling!

And more photo dumps because… why not 🙂

Team UTS

The Long Room

Book of Kells Experience

Generative AI – Rethinking Learning Futures Forum

In July, I was invited to speak at an Australia India InnovEd Forum on Generative AI – Rethinking Learning Futures hosted by the Australia India Institute.

Speakers for the Australia India InnovEd Forum on Generative AI

The forum ran as an online webinar where speakers from India and Australia shared their thoughts on the evolving role of generative AI tools such as ChatGPT in higher education. The full recording of the session is below, and a transcript is also available. As part of the InnovEd series, a detailed report was also published, summarising insights from all the events held during the year.

I am delighted to see emerging initiatives that promote and foster collaboration between India and Australia, and I’m glad to be a small part of it. I was also previously selected as one of the AIRS Fellows in the Australia India Research Students Fellowship program that supported short-term research exchange of scholars between the two countries, and have published with Indian colleagues. I hope to continue my research collaboration with colleagues from various institutions in India on related topics.

CHI’24 research publications

I attended the prestigious Human-Computer Interaction (HCI) conference CHI’24 at Hawaii, Honolulu in May 2024. While I’m quite familiar with the field of HCI, it was my first time attending the conference because it is much wider than my main area of research (Learning Analytics, AI in education, and Writing Analytics). The sheer scale of the conference (~2K to 3K attendees) and the broad range of topics it covers (check out this full program) is almost impossible to fully grasp!

TLDR; Go to the end for the list of paper from CHI’24.

My personal highlight was the Intelligent Writing Assistants Workshop, which was running for the third time at CHI, organized by a bunch of fun people who are all super keen about researching the use of AI to assist writing. Picture from our workshop below (thanks, Theimo, for the LinkedIn post)

Pictured: Participants of the Intelligent Writing Assistants CHI’24 workshop at the end of the session

The workshop had many mini presentations on the overall theme of Dark Sides: Envisioning, Understanding, and Preventing Harmful Effects of Writing Assistants. I presented my work with Prof. Simon Buckingham Shum on AI-Assisted Writing in Education: Ecosystem Risks and Mitigations, where we examined key factors (in the broader socio-technical ecosystem which are often hidden) that need consideration for implementing AI writing assistants at scale in educational contexts.


This was actually a deep dive into the Ecosystem aspect of a larger piece of work we presented at CHI on A Design Space for Intelligent and Interactive Writing Assistants. The full design space from our full paper mapped the space of intelligent writing assistants reviewing 115 papers from HCI and NLP, with a team of 36 authors, led by Mina Lee.

Figure: Design space for intelligent and interactive writing assistants consisting of five key aspects—task, user, technology, interaction, and ecosystem from our full paper.

An interactive tool is also presented to explore the literature in detail.


I also had a late-breaking work poster presentation on Critical Interaction with AI on Written Assessment (I have a seperate post about it!) where we explored how students engaged with generative AI tools like ChatGPT for their writing tasks, and if they were able to navigate this interaction critically.

A cherished memory to hold on to was also the time I spent with my friend Vanessa, who is currently a Research Fellow at Monash university during this trip in Hawaii. Vanessa and I started our PhD together at th Connected Intelligence Centre at UTS ~8 years ago, and it was really nice to catch up after a long time (along with few others). I had also just visited Monash university’s CoLAM a week before for a talk and meeting fellow Learning Analytics researchers, hosted by her and Roberto. The group do interesting work in Learning Analytics that is worth checking out.

6 years apart… On the left: Vanessa and I in 2018 while attending AIED/ ICLS 2018 in London; On the right: Us while attending CHI in 2024 in Hawaii.


TLDR -> Research publications:

Here are all the papers from the work we presented at CHI’24:

Mina Lee, Katy Ilonka Gero, John Joon Young Chung, Simon Buckingham Shum, Vipul Raheja, Hua Shen, Subhashini Venugopalan, Thiemo Wambsganss, David Zhou, Emad A. Alghamdi, Tal August, Avinash Bhat, Madiha Zahrah Choksi, Senjuti Dutta, Jin L.C. Guo, Md Naimul Hoque, Yewon Kim, Simon Knight, Seyed Parsa Neshaei, Agnia Sergeyuk, Antonette Shibani, Disha Shrivastava, Lila Shroff, Jessi Stark, Sarah Sterman, Sitong Wang, Antoine Bosselut, Daniel Buschek, Joseph Chee Chang, Sherol Chen, Max Kreminski, Joonsuk Park, and Roy Pea, Eugenia H. Rho, Shannon Zejiang Shen, Pao Siangliulue. 2024. A Design Space for Intelligent and Interactive Writing Assistants. In Proceedings
of the CHI Conference on Human Factors in Computing Systems (CHI ’24),
May 11–16, 2024, Honolulu, HI, USA. ACM, New York, NY, USA, 33 pages.
https://doi.org/10.1145/3613904.3642697

Antonette Shibani, Simon Knight, Kirsty Kitto, Ajanie Karunanayake, Simon Buckingham Shum (2024). Untangling Critical Interaction with AI in Students’ Written Assessment. Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI ’24), May 11-16, 2024, Honolulu, HI, USA. doi.org/10.1145/3613905.3651083

Antonette Shibani & Simon Buckingham Shum (2024). AI-Assisted Writing in Education: Ecosystem Risks and Mitigations. In The Third Workshop on Intelligent and Interactive Writing Assistants @ CHI ’24, Honolulu, HI, USA. https://arxiv.org/abs/2404.10281

New publication: Untangling Critical Interaction with AI

I’ve had a longstanding interest in exploring how students engage critically with automated feedback and develop their AI literacy. In our LAK22 paper, we argued why it is so important that we develop these skills in learners. There is a heightened necessity in today’s educational landscape for learners in the age of generative AI (Gen AI) to engage with AI critically.

Our upcoming CHI publication investigates the fundamental question: Why do students engage with Gen AI for their writing tasks, and how can they navigate this interaction critically? In our paper, we define in concrete terms and stages how criticality can manifest when students write with ChatGPT support. We draw from theory and examples in empirical data (which are still unbelievably scarce in the literature) to understand and expand the notion of critical interaction with AI.

A pre-print version is available for download on Arxiv [PDF]. Full citation below:

Antonette Shibani, Simon Knight, Kirsty Kitto, Ajanie Karunanayake, Simon Buckingham Shum (2024). Untangling Critical Interaction with AI in Students’ Written Assessment. Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI ’24), May 11-16, 2024, Honolulu, HI, USA. Pre-print: https://arxiv.org/abs/2404.06955 

A short video presentation gives the gist of the paper [Follow along with the transcript]