Safer Digital Futures
How can citizens help shape safer online environments in an age of AI? AI increasingly determines what we see online, moderates content, recommends information and generates new forms of digital media. These developments create both opportunities and new forms of harm.
This challenge explores how citizens can play a meaningful role in designing, governing and evaluating AI systems that shape digital life.
Indicative potential partners
Illustrative research directions
- Online safety by design
- AI-enabled content moderation
- Misinformation and synthetic media
- Children’s online experiences
- Trustworthy recommender systems
- AI companions and social agents
- Digital regulation and governance
- Participatory approaches to online safety
Indicative reading
-
Collins Oguine, O., Alvarado Garcia, A., Muller, M., & Badillo-Urquiola, K. (2026). Who Gets to Define Safety? A Systematic Review of How Generative AI Research Addresses Youth Online Safety. In Proc of the 2026 CHI Conf on Human Factors in Computing Systems (CHI 2026). https://doi.org/10.1145/3772318.3791346
-
Holt, J., & Nicholson, J. (2026). Scaffolding Online Safety in Older Communities: Exploring the Relationship Between Digital Literacy and Cybersecurity. ACM Transactions on Computer-Human Interaction, 33(3), 1-56. https://doi.org/10.1145/3796705
-
Trengove, M., Kazim, E., Almeida, D., Hilliard, A., Zannone, S., & Lomas, E. (2022). A critical review of the Online Safety Bill. Patterns, 3(8). https://doi.org/10.1016/j.patter.2022.100544
-
Beres, N. A., Frommel, J., Reid, E., Mandryk, R. L., & Klarkowski, M. (2021, May). Don’t you know that you’re toxic: Normalization of toxicity in online gaming. In Proceedings of the 2021 CHI conference on human factors in computing systems (pp. 1-15). https://doi.org/10.1145/3411764.3445157
-
Frommel, J., Mandryk, R. L., & Johnson, D. (2026). The role of self-regulation and need satisfaction and frustration for predicting toxic behaviour in League of Legends. Computers in Human Behavior Reports, 101207. https://doi.org/10.1016/j.chbr.2026.101207
-
Petley, J., 2025. Porn and the OSA: what about the children?. Porn Studies, 12(3), pp.362-386. https://doi.org/10.1080/23268743.2025.2476961
CyberNorth CIC
Digital Safety CIC
Yoti