What If? Counterfactual Questions in Machine Learning, from Prediction to Privacy

In his talk, Lars Kulik follows them through four questions, with a running example: wearables and personalised music for people living with dementia, where the body responds to every song in a way that a thumbs up never does:

1. Can we see it coming? Kulik discusses interpretable time-series features built from local summaries, and what it takes to evaluate early warning rather than detection when the labels come from care records that may be late or incomplete.
2. What should we do now? Kulik discusses why liking a song is not the same as being calmed by it, and, from our broader work on recommendation, how a learned kernel lets a compact model express two opposite tastes at once.
3. What if we had acted differently? Ongoing research on counterfactual forecasting asks what must stay the same between the history that happened and the one we imagine.
4. What if a person’s data had been left out? This is the same kind of question, asked about data, and differential privacy is a promise about its answer. Our work on language models separates recovering text from memorising it, and shows how a privacy guarantee bounds the training effect that any extraction or membership test can detect.

Across these questions, the comparisons we choose decide what our evidence can support: for the action we did not take, for the training data we did not use, and for the people whose data makes these systems work.
 

Participation

Participation via Zoom, no registration required: Zoom (Meeting ID: 660 7233 1307 \ Passcode: 524986)

About Lars Kulik

Lars Kulik is a Professor in the School of Computing and Information Systems at the University of Melbourne. Best known for his research in data privacy, he has increasingly focused on machine learning, with work on time-series analysis, recommendation, counterfactual reasoning and large language models. He also collaborates on interdisciplinary projects in health and ageing, including the use of wearables and personalised music in dementia care. He studies how models represent data and make predictions, and what their behaviour reveals about what they have learned.