2023 Registered Publications

Publications are sourced from SFU's Research Expertise Engine.

A codesign study exploring needs, strategies, and opportunities for digital health platforms to address pandemic-related impacts on children and families
International Journal of Child-Computer Interaction
SIAT faculty authors: Antle, A.
Abstract: ... These were derived from the thematic analysis of a two-phase co-design study with children, their parents, and their teachers (Phase 1), and employees at our industry partner Curatio.me (Phase 2). Our thematic findings contribute understanding about the types of experiences children, families and educators have had, and open the conversation around designing digital health plat...
Publication link

A new acquisition protocol for conducting studies with children: The science camp research experience
PloS one
SIAT faculty authors: Moreno, S.
Abstract: ... However, collecting behavioral and neurophysiological data from children has specific challenges, such as high rates of data loss and participant dropout. We have developed a science camp method to collect data from children using the benefits of positive peer interactions and interactive and engaging activities, to allow researchers t...

About being an “influencer” or how to exploit the tool of the oppressor for our own expression
Book: Proceedings of the 2023 ACM Designing Interactive Systems Conference
Pages: 934-945
SIAT faculty authors: Wakkary, R.
Description: Surveillance is at the core of today's monitored society. Privacy is becoming a fluid regulatory process the values and expectations of which are being actively rewritten, deconstructed, reconstructed and negotiated as new technologies open up novel forms of social relations and identity construction opportunities. Our proposal is based..

Adding virtual plants leads to higher cognitive performance and psychological well-being in virtual reality
Scientific Reports
SIAT faculty authors: Riecke, B., Stuerzlinger, W.
Abstract: ... To investigate how such benefits might generalize to ever-more-prevalent virtual workplaces, we examined the effects of the absence or presence of virtual plants in an office environment in Virtual Reality (VR) on users’ cognitive performance and psychological well-being. The results of our user study with 39 participants show that in the presence of virtual plants, participants perform...more
Publication link

Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction
International Journal of Human Computer Studies
SIAT faculty authors: Stuerzlinger, W.
Abstract: ... A model-based method to quantify cumulative subjective fatigue for such interaction was recently introduced in HCI research. This model separates muscle units into three states: active (MA) fatigued (MF) or rested (MR) and defines transition rules between states. This method demonstrated promising accuracy in predicting subjective fatigue accumu...
Publication link

Art and the Artificial
Journal: Journal of Creativity
SIAT faculty authors: DiPaola, S.
Description: This paper explores the philosophical implications of machine learning text-to-image synthesis in a practice-based phenomenology of the computational poetics of a visual art process. It is hypothesized that artificial intelligence (AI) facilitated reflective image development fosters an anticipatory aesthetics in creative interactivity. The concept of...

Art creation as an emergent multimodal journey in Artificial Intelligence latent space
Book: International Cconference on Multimodal Interaction
Pages: 247-253
SIAT faculty authors: DiPaola, S.
Description: This research explores emergent creative processes that develop between artist (interactor) and generative artificially intelligent (AI) technology when an AI system is positioned as a latent space n-dimensional journeying tool or more semantically as an ontological other that the artist works through. The authors investigate a new artistic process, building a latent space journeying AI diffusion system, and with it examining a more...
Publication link

Associations of Research Questions, Analytical Techniques, and Learning Insight in Temporal Educational Research: A Systematic Mapping Study
Source: Journal of Learning Analytics
Pages: 1-17
SIAT faculty authors: Hatala, M. Neustaedter, C.
Description: Learning has a temporal characteristic in nature, which means that it occurs over the passage of time. The research on the temporal aspects of learning faces several challenges, one of which is utilizing appropriate analytical techniques to exploit the temporal data. There is no coherent guide to selecting certain temporal techniques to lead to...

Atypical Association between Functional Connectivity during Pragmatic and Semantic Language Processing and Cognitive Abilities in Children with Autism
Journal: Brain Sciences
SIAT faculty authors: Moreno, S.
Description: Autism Spectrum Disorder (ASD) is characterized by both atypical functional brain connectivity and cognitive challenges across multiple cognitive domains. The relationship between task-dependent brain connectivity and cognitive abilities, however, remains poorly understood. In this study, children with ASD and their typically developing (TD) peers engaged in semantic and pragmatic language tasks while their task-dependent brain connectivity...
Publication link

Awedyssey: Design Tensions in Eliciting Self-transcendent Emotions in Virtual Reality to Support Mental Well-being and Connection
Book: Proceedings of the 2023 ACM Designing Interactive Systems Conference
Pages: 189-211
SIAT faculty authors: Riecke, B.
Description: Access to nature and feeling connection is critical for mental health and well-being. These benefits may be mediated by self-transcendent emotions evoked by nature. We need to explore the capacity of technology to offer such experiences when we lack access to the restorative power of nature. Despite growing research validating this capacity,...

Baseline markers of cortical excitation and inhibition predict response to theta burst stimulation treatment for youth depression
Journal: Scientific Reports
SIAT faculty authors: Moreno, S.
Description: Theta burst stimulation (TBS), a specific form of repetitive transcranial magnetic stimulation (TMS), is a promising treatment for youth with Major Depressive Disorder (MDD) who do not respond to conventional therapies. However, given the variable response to TBS, a greater understanding of how baseline features relate to clinical response is...

Becoming solar
Publisher: Hogeschool van Amsterdam
SIAT faculty authors: Wakkary, R.
Description: In this article we examine the experiences of the first and second author who have changed themselves to become newly attuned to the sun, or who have “become solar”. Motivated by calls to approach solar design in novel, less technocratic ways, we reflect on their one-year journey to gain a new relationship with solar energy as an explicitly more-than-human design (MTHD) approach. We argue that their perception of solar energy progressively...
Publication link

Beyond Academic Publication: Alternative Outcomes of HCI Research
DIS 2023 Companion: Companion Publication of the 2023 ACM Designing Interactive Systems Conference
SIAT faculty authors: Odom, W.
Abstract: ... These include pictorial papers, video/audio documentaries, public exhibitions, posters and brochures, design fiction, comics, podcasts and many more. These alternative research outcomes play a critical role in explaining, disseminating, and translating valuable insights and knowledge from HCI research to people outside academic communities. We propose this workshop to initiate ...
Publication link

Beyond the Eye: Multisensory Contributions to the Sensation of Illusory Self-Motion (Vection)
Multisensory Research
SIAT faculty authors: Riecke, B.
Abstract: ... Vection can occur in real-life situations (e.g., train illusion ) and in virtual environments and simulators. The vast majority of vection research focuses on vection caused by visual stimulation. Even though visually induced vection is arguably the most compelling type of vection, the role of nonvisual sensory inputs, such as auditory, biomecha...
Publication link

Breath of Light: Towards Reclaiming Shared Breathing through a Meditative Installation
Journal: Leonardo
SIAT faculty authors: Riecke, B.
Description: Breath of Light is an immersive breath-responsive installation aiming to reclaim the connective nature of sharing breath in public spaces. During the exhibition at the 13th Shanghai Biennale in March 2021, the lead author observed and interviewed participants to better understand their experience. A subsequent follow-up interview was conducted in January 2023 to understand the long-term effect. This technological mediation of breathing...
Publication link

China’s Digital Civilization: Algorithms and Society
China’s Digital Civilization: Algorithms and Society
SIAT faculty authors: Filimowicz, M.
Abstract: ... Perhaps no country has gone further than China in setting up overt systematic tracking, surveillance and constant computational evaluation of its citizens. Everyday life is saturated with a pervasive digitization that affects social mobility, economic opportunities and personal freedoms. Global organizations operating in China have to take ac...

Co-Designing a Virtual Reality Intervention for Supporting Cognitive Reappraisal Skills Development with Youth
Proceedings of IDC 2023 - 22nd Annual ACM Interaction Design and Children Conference: Rediscovering Childhood
SIAT faculty authors: Antle, A.
Abstract: ... While it has been well theorized psychologically and many therapeutic approaches exist, youth still struggle to develop these skills. We explore the design space of using virtual reality to create technologically-mediated cognitive reappraisal supports for youth. We developed four VR prototypes that we used as prompts for feedback in a ten-session co-design workshop with nine y...
Publication link

Combining Artificial Intelligence, Bio-Sensing and Multimodal Control for Bio-Responsive Interactives
Book: International Cconference on Multimodal Interaction
Pages: 318-322
SIAT faculty authors: DiPaola, S.
Description: We present framework and prototype process for combining affective bio-sensing, natural multimodal control, and artificial intelligence for bio-responsive interactives. The work explores a more affective, bio-responsive experience for users singularly or in multiuser environments in real-time and/or virtual reality (VR) interactives especially where mindfulness and wellness are a goal. The systems and framework can use EEG sensors, heart rate...
Publication link

Conceptualizing healthy cognitive aging: the role of time and variability
Frontiers in Human Neuroscience
SIAT faculty authors: Moreno, S.
Abstract: ... Researchers are interested in exploring how health can be promoted and cognitive decline mitigated when pathology is not present. Identifying the necessary strategies is crucial as the gradual accumulation of small declines can lead to negative effects on quality of life over time. However, the conceptualization of HCA is not agreed upon. In...
Publication link

Creation as Sensory Anthropology
Journal: The Routledge International Handbook of Sensory Ethnography
SIAT faculty authors: Hennessy, K.,  DiPaola, S.
Description: It’s a spring morning in Vancouver, Canada. We (Hennessy and Smith) are setting up a camera in a temporary studio in a warehouse exhibition space called “The Hangar” at the Centre for Digital Media. An exhibition of works in virtual reality (VR) has recently been torn down, leaving a storage room full of broken lumber and plywood, light tubes, and other discarded materials. We have been working with artificial intelligence (AI) scholar and artist...
Publication link

Data as a Material for Design: Alternative Narratives, Divergent Pathways, and Future Directions
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Odom, W.
Abstract: ... This workshop encourages the submission of design exemplars, i.e., physical or digital works (in progress), design processes, or provocative or controversial pieces on the topic of data as a design material. If we are to continue to explore what data means as a design material and how we will continue to co-exist with them in our everyday lives through new and exciting ways and mea...
Publication link

deformTable: A Design Inquiry and Long-Term Field Study into Creative and Contingent Appropriations of a Shape-Changing Artifact
International Journal of Design
SIAT faculty authors: Wakkary, R.
Abstract: ... We support this proposal by designing and deploying five deformTables to five households for approximately one year to gather empirical insights. deformTable is a shape-changing artifact that can go up with the change in weight or pressure applied to its top surface. Findings suggest that participants adopted the shape-changing artif...more

Designing AI interfaces for children with special needs in educational contexts
Proceedings of IDC 2023 - 22nd Annual ACM Interaction Design and Children Conference: Rediscovering Childhood
SIAT faculty authors: Yalcin, N.
Abstract: ... Nonetheless, little research has explored the research and design issues, rationale, challenges, and opportunities in this field. Therefore, we propose to host a half-day workshop to bring together researchers and practitioners from the Learning & Education, Accessibility, and Intelligent User Interfaces sub-fields to discuss and identify existing design issues, challenges, and collab...
Publication link

Designing for Ambiguity in Visual Analytics: Lessons from Risk Assessment and Prediction
Journal: IEEE Transactions on Visualization and Computer Graphics
SIAT faculty authors: Bartram, L.
Abstract: Ambiguity is pervasive in the complex sensemaking domains of risk assessment and prediction but there remains little research on how to design visual analytics tools to accommodate it. We report on findings from a qualitative study based on a conceptual framework of sensemaking processes to investigate how both new visual analytics designs and existing tools, primarily data tables, support the cognitive work demanded in avalanche forecasting. While both systems yielded similar analytic outcomes we observed differences in ambiguous sensemaking and the analytic actions either afforded. Our findings challenge conventional visualization design guidance in both perceptual and interaction design, highlighting the need for data interfaces that encourage reflection, provoke alternative interpretations, and support the inherently ambiguous nature of sensemaking in this critical application. We review how different...
Publication link

Designing for Emotion Regulation Interventions: An Agenda for HCI Theory and Research
ACM Transactions on Computer-Human Interaction
SIAT faculty authors: Antle, A.
Abstract: ... This interest stems in part from increased recognition that the ability to regulate emotions is critical to mental health, and that a lack of effective emotion regulation is a transdiagnostic factor for mental illness. However, the potential to combine innovative HCI designs with the theoretical grounding and state-of-the-art interventions from p...
Publication link

Designing Viewpoint Transition Techniques in Multiscale Virtual Environments
Proceedings - 2023 IEEE Conference Virtual Reality and 3D User Interfaces, VR 2023
SIAT faculty authors: Stuerzlinger, W.
Abstract: ... Previous work has investigated transitions in single-scale virtual environments, focusing on trajectories and continuity. We extend this work with an in-depth investigation of transition techniques in multiscale virtual environments (MVEs). We identify challenges in navigating MVEs with nested structures and assess how different ...

Designing with Biosignals: Challenges, Opportunities, and Future Directions for Integrating Physiological Signals in Human-Computer Interaction
DIS 2023 Companion: Companion Publication of the 2023 ACM Designing Interactive Systems Conference
SIAT faculty authors: Riecke, B., Antle, A.
Abstract: ... These sensor-based technologies measure physiological processes including heart rate, breathing, skin conductance, brain activity and more. Researchers are exploring biosensing from perspectives including: engineering, human-computer interaction, medicine, mental health, consumer products, and interactive art. These technologies can enhance our interactions allowing con...more
Publication link

Developing Participatory Methods to Consider the Ethics of Emerging Technologies for Children
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Antle, A.
Abstract: ... While the community has extensively debated on ethical issues, we have not had ample discussion of methods to study the ethical implications of emerging technologies. Consequently, we have been largely reactive and have not made significant contributions to public discussions on these topics, leaving these largely to experts from other fields. Our community is well-placed to contr...
Publication link

Digital music interventions for stress with bio-sensing: a survey
Frontiers in Computer Science
SIAT faculty authors: Pasquier, P.
Abstract: ... However, access to treatment is limited by the need for trained music therapists and the difficulty of quantitatively measuring efficacy in treatment. We present a survey of digital music systems that utilize biosensing for the purpose of reducing stress and anxiety with therapeutic use of music. The survey analyzes biosensing instruments fo...more

Digital Overconsumption and Waste: A Closer Look at the Impacts of Generative AI
Journal: Conference on Computer Vision and Pattern Recognition (CVPR)
SIAT faculty authors: DiPaola, S.
Description: Generative Artificial Intelligence (AI) systems currently contribute negatively to the production of digital waste, via the associated energy consumption and the related CO2 emissions. At this moment, a discussion is urgently needed on the replication of harmful consumer behavior, such as overconsumption, in the digital space. We outline our previous work on the climate implications of commercially available generative AI systems and the...
Publication link

DocuScope Write & Audit as an early feedback machine in genre-based writing: Topical progression and information focus in proposal writing
Studies in Corpus Linguistics
SIAT faculty authors: Geisler, C.
Abstract: ... This potential is examined in the context of proposal writing, a quintessential example of genre writing. Actual standards brought to bear on students’ drafts were developed from a longstanding proposal writing course and applied to a small, stratified sample of proposals in the Michigan Corpus of Upper-level Student Papers (MICUS...
Publication link

Does Repeatedly Typing the Same Phrase Provide a Good Estimate of Expert Text Entry Performance
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Stuerzlinger, W.
Abstract: ... To reduce this logistical bottleneck, a popular approach in the literature requires participants to type the same phrase repeatedly. However, it is still unknown whether this approach provides a good estimate of expert performance. To validate this method, we set up a study where participants were tasked with typing the same phrase 96 times for both OPTI and QWERTY. Results showed t...
Publication link

Doing things Differently: Re-Imaging Feminist Archives as Collaborative and Intergenerational Living Practices
Conference: CAA 2023 ANNUAL CONFERENCE
SIAT faculty authors: Aceves-Sepulveda, G.

Dr.'s Eye: The Design and Evaluation of a Video Conferencing System to Support Doctor Appointment in Home Settings
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Neustaedter, C., Stuerzlinger, W.
Abstract: ... Existing applications and off-the-shelf devices face challenges in dealing with capturing the correct view of patients' bodies and supporting ease of use. We created Dr.'s Eye, a video conferencing prototype to support varying types of body exams in home settings. With our prototype, we conducted a study with participants using mock appointments to understand the simultane...
Publication link

Editorial: Human spatial perception, cognition, and behaviour in extended reality
Frontiers in Virtual Reality
SIAT faculty authors: Riecke, B.

Embodied Telepresent Connection (ETC): Exploring Virtual Social Touch through Pseudohaptics
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Riecke, B.
Abstract: ... We developed ETC (Embodied Telepresent Connection), a prototype that allows two participants to interact remotely through pseudo-haptic touch via their abstract aura avatars. ETC consists of a set of interaction patterns aimed to elicit an illusion of interpersonal touch using embodied metaphors, simulated physics, integration of visuals and sounds, biosignal representation, and embe...more
Publication link

Envisioning and Understanding Orientations to Introspective AI: Exploring a Design Space with Meta.Aware
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Odom, W.
Abstract: ... It involves considering one's past experiences and asking questions about the present and future. Our work investigates how AI could open new possibilities for supporting introspective experiences. Adopting a design fiction approach, we created a fictional company called Meta.Aware to contextualize 4 different Introspective AI product concepts in the form of video sketches. We u...
Publication link

Evaluating Human-AI Interaction via Usability, User Experience and Acceptance Measures for MMM-C: A Creative AI System for Music Composition
IJCAI International Joint Conference on Artificial Intelligence
SIAT faculty authors: Pasquier, P.
Abstract: ... Now, the implications of such systems for musical practice are being investigated. We report on a thorough evaluation of the user adoption of the Multi-Track Music Machine (MMM) as a co-creative AI tool for music composers. To do this, we integrate MMM into Cubase, a popular Digital Audio Workstation (DAW) by Steinberg, by produ...

Evaluation of an Immersive COVID-19 Data Visualization
IEEE Computer Graphics and Applications
SIAT faculty authors: Stuerzlinger, W.
Abstract: ... However, these restrictions are necessary as they help reduce the spread of the virus. For the public to comply, easily comprehensible communication between decision makers and the public is thus crucial. To address this, we propose a novel 3-D visualization of COVID-19 data, which could increase the awareness of COVID-19 trends in the gener...
Publication link

Expectation vs. Reality: The Impact of Adaptation Gap on Avatars in Social VR Platforms
Book: International Cconference on Multimodal Interaction
Pages: 146-153
SIAT faculty authors: Yalcin, N., Ozge Nilay Yalcin, Steve Dipaola
Description: Online VR Platforms allow users to use different kinds of avatar controls including motion-tracked and automated-gesturing avatars. The avatar control might change users’ experience and impact immersion when exposed to different avatars simultaneously due to the differences in the quality of behavior generation. In this paper, we propose to measure the difference in participants’ expectations and perceptions of both avatars in the form of...
Publication link

Exploring Long-Term Mediated Relations with a Shape-Changing Thing: A Field Study of coMorphing Stool
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Wakkary, R.Odom, W.
Abstract: ... We deployed 5 coMorphing stools to 5 participants' homes over 9 months. As co-speculators, the participants reflected on their mediated relations with the coMorphing stool. Findings suggest that they perceived the subtle transformations of the coMorphing stool in the early days of the deployment. After becoming familiar with these features, they interpreted their daily entanglements ...
Publication link

Exploring Memory-Oriented Interactions with Digital Photos In and Across Time: A Field Study of Chronoscope
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Neustaedter, C., Odom, W.
Abstract: ... Chronoscope offers different temporal modalities for organizing one's personal digital photo archive, and for exploring possible connections in and across time, and among photos and memories. We deployed four Chronoscopes in four households for three months to understand participants' experiences over time. Our goals are to investigate the reflective potential of temporal ...more
Publication link

From Making to Moving: Co-Design Methods with Youth from Workshops on Biowearables and Virtual Reality
SIAT faculty authors: Antle, A.
Description: 2 WHAT CAN YOU CONTRIBUTE? First, we would share our research exploring the ethical issues of biowearables on children’s identity formation [2]. We used a critical making workshop methodology for supporting reflection and eliciting ethical discourse with children during the process of making biowearables [3]. Our approach was grounded in..

How Students' Emotion and Motivation Changes after Viewing Dashboards with Varied Social Comparison Group: A Qualitative Study
ACM International Conference Proceeding Series
SIAT faculty authors: Hatala, M.
Abstract: ... In order to study the impact of these dashboards on learners, various types of prototypes have been designed and deployed in different settings. Applying Weiner's attribution theory, our goal in this study was to understand the effect of dashboard information content on learners. We wanted to understand how elements of assignment grade, time spent...
Publication link

How to Repeat Hints: Improving AI-Driven Help in Open-Ended Learning Environments
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SIAT faculty authors: Yalcin, N.
Abstract: ... In this paper, we focus on how to effectively provide repeated hints in OELEs, when students repeat a sub-optimal behavior after receiving a hint on how to recover from the first occurrence of the behavior. We formally compare two repeated hint designs in UnityCT, an OELE that fosters Computational Thinking (CT) via free-form game desig...

Human spatial perception, cognition, and behaviour in extended reality
Journal: Frontiers in Virtual Reality
SIAT faculty authors: Riecke, B.
Description: The concept of eXtended Reality (XR) has recently become a staple of the mainstream discussion of technological innovation. XR is an umbrella term for digital technologies simulating sensory experiences in real or imagined environments, such as Augmented Reality (AR) and Virtual Reality (VR). These technologies replace or augment

Identifying Visualization Opportunities to Help Architects Manage the Complexity of Building Codes
IEEE Computer Graphics and Applications
SIAT faculty authors: Bartram, L.
Abstract: ... While visualizations have been used to support general architectural design exploration, existing computational solutions treat building codes as separate from, rather than part of, the design process, creating challenges for architects. Through a series of participatory design studies with professional architects, we found that interactive vi...

Incorporating rivalry in reinforcement learning for a competitive game
Neural Computing and Applications
SIAT faculty authors: Yalcin, N.
Abstract: ... However, most interactive scenarios do not have performance alone as an end-goal; instead, the social impact of these agents when interacting with humans is as important and largely unexplored. In this regard, this work proposes a novel reinforcement learning mechanism based on the social impact of rivalry behavior. Our proposed model aggregates objective and social perce...
Publication link

InExChange: Fostering Genuine Social Connection through Embodied Breath Sharing in Mixed Reality
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Riecke, B.
Abstract: ... The experience is composed of three acts in which the participants' breaths are transformed into metaphorical projected representations: expansive waves, flowing light trails, and growing tree branches. The inflatable wearable devices physically enact in near real-time the inhale/exhale pattern of the other person's breath, varying in intensity level to create an attention interplay between ...more
Publication link

Interactive Visual Analytics for Knowledge Integration and Decision Intelligence
Proceedings of the Annual Hawaii International Conference on System Sciences
SIAT faculty authors: Fisher, B.

Invisible Users: Uncovering End-Users' Requirements for Explainable AI via Explanation Forms and Goals
Journal: arXiv preprint arXiv:2302.06609
SIAT faculty authors: Pasquier, P.
Description: Non-technical end-users are silent and invisible users of the state-of-the-art explainable artificial intelligence (XAI) technologies. Their demands and requirements for AI explainability are not incorporated into the design and evaluation of XAI techniques, which are developed to explain the rationales of AI decisions to end-users and assist their...

Las mujeres se hacen visibles: Los feminismos en el arte y los nuevos regímenes mediáticos y la visibilidad en la Ciudad de México, 1971-2011
Publisher: UNAM, Centro de Investigaciones y Estudios de Género
SIAT faculty authors: Aceves-Sepulveda, G.
Description: El presente libro está dedicado a un grupo de mujeres que, como Mayer, generaron registros visuales y materiales de cuerpos femeninos, dándose a la tarea de crear y conservar representaciones visuales e información estadística sobre cómo se producen cuerpos marcados por el género, la clase, la raza y la sexualidad en el entorno del paisaje...

Learning-Based Interfaces Improve Simultaneous Locomotion and Oject Interaction in VR Compared to the Handheld Controller
Journal: IEEE Transactions on Visualization and Computer Graphics
SIAT faculty authors: Riecke, B.
Abstract: Physical walking is often considered the gold standard for VR travel whenever feasible. However, limited free-space walking areas in the real-world do not allow exploring larger-scale virtual environments by actual walking. Therefore, users often require handheld controllers for navigation, which can reduce believability, interfere with simultaneous interaction tasks, and exacerbate adverse effects such as motion sickness and disorientation...
Publication link

Living-with and Designing-with Plants
Interactions
SIAT faculty authors: Wakkary, R.
Publication link

Measuring the Effect of Stereo Deficiencies on Peripersonal Space Pointing
Proceedings - 2023 IEEE Conference Virtual Reality and 3D User Interfaces, VR 2023
SIAT faculty authors: Stuerzlinger, W.
Abstract: ... For objects away from the focal plane, such displays create a vergence-accommodation conflict (VAC), potentially degrading user interaction performance. In this paper, we study how the VAC affects pointing at targets within arm's reach with virtual hand and raycasting interaction in current stereo display systems. We use a previously prop...more

Memory Trace & Memory Compass: Investigating Personal Location Histories as a Design Material for Everyday Reminiscence
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Odom, W.
Abstract: ... Personal location history archives offer a potentially valuable and overlooked resource for supporting reminiscence and recollection of the past. Yet, little design research has explored how location histories can be used as a material in designing such experiences. To investigate this space, we engaged in a practice-based design research process that resulted in two design artifacts. M...
Publication link

Metamorphonic: A Reflective Design Inquiry into Human-Silkworm Relationship
Book: Proceedings of the 2023 ACM Designing Interactive Systems Conference
Pages: 808-819
SIAT faculty authors: Wakkary, R.
Description: This work explores an alternative human-silkworm relationship through crafting a triad of interactive research artifacts that serve as a temporary habitat for domestic silk moths, Bombyx mori. In the first part of the paper, we present the design journey from acquiring the eggs to harvesting movement in orchestrating the improvised ambient..

More-Than-Human Perspectives and Values in Human-Computer Interaction
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Wakkary, R.
Abstract: ... This design for and with more-than-human perspectives and values cover a range of fields and topics, and comes with unique design opportunities and challenges. In this SIG, we propose a forum for exchange of concrete experiences and a range of perspectives, and to facilitate reflective discussions and the identification of possible future paths.
Publication link

Moving Avatars and Agents in Social Extended Reality Environments
Journal: arXiv preprint arXiv:2306.14484
SIAT faculty authors: Riecke, B.
Description: Natural interaction between multiple users within a shared virtual environment (VE) relies on each other's awareness of the current position of the interaction partners. This, however, cannot be warranted when users employ noncontinuous locomotion techniques, such as teleportation, which may cause confusion among bystanders. In this paper,...

Multimodal Entertainment in Bio-Responsive Multi-User VR Interactives
Book: International Cconference on Multimodal Interaction
Pages: 66-70
SIAT faculty authors: DiPaola, S.
Description: We present our affective, bio-responsive virtual reality (VR) interactive framework that explores musical and visual forms of entrainment through amorphous nature-inspired phenomena that evolves and reacts to a tightly coupled real-virtual immersive space controlled through two users’ physiological data. Multiple layers of real-time sound and visuals inspired by nature phenomena are generated in 3D experiential VR space which is...
Publication link

Neuroimaging and machine learning for studying the pathways from mild cognitive impairment to alzheimer’s disease: a systematic review
BMC Neurology
SIAT faculty authors: DiPaola, S.Moreno
Abstract: ... Methods: We systematically searched PubMed, SCOPUS, and Web of Science databases following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) systematic review guidelines. Results: Our search returned 2572 articles, 56 of which met the criteria for inclusion in the final selection. The multimodality framework and deep learning techniques showed p...
Publication link

On the Effectiveness of Virtual Eye-Hand Coordination Training with Head Mounted Displays
Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
SIAT faculty authors: Stuerzlinger, W.
Abstract: ... Such systems have already been tested in Virtual Reality, and the results revealed that Head Mounted Display-based systems have the potential to improve the motor training. However, this was only investigated in an hour-long study. In the longitudinal study reported here, we analyzed the motor perfor

Pair Analytics in a Visual Analytics Context
Proceedings of the Annual Hawaii International Conference on System Sciences
SIAT faculty authors: Fisher, B.
Abstract: ... The hybrid research project itself was part of a larger research program approved for the Canadian government for their offset program and supported by Federal and Provincial research internships. As a real-world analysis approach, the pair analysis sessions conduced actionable causal chain analysis of aircraft safety. As a scientific method, pair analytics advanced our knowledge of the cognitive science of interpersonal communication in Joint Activities. The paper describes how aerospace researchers and cognitive scientists were able to design a research approach that met constraints from both areas. It concludes with discussion of the implications of this work for highly integrated basic and responsive research in other areas of visualization and analytics.

PhotoClock: Reliving Memories in Digital Photos as the Clock Ticks in the Present Moment
SIAT faculty authors: Odom, W., Neustaedter, C.
Description: As digital photos grow exponentially, people need new approaches to engage with their photos over time. We describe our study of PhotoClock, a mobile application that leverages the temporal metadata embedded in digital photos to encourage contemplation of memories bound up in one’s photo archive. PhotoClock uses the clock-time of the...

Predictors of the rate of cognitive decline in older adults using machine learning
PLoS ONE
SIAT faculty authors: DiPaola, S.
Abstract: ... Few studies have investigated the possibility of implementing prognostic models to predict cognitive changes with the combination of categorical and continuous data from multiple domains. Objective Implement a multivariate robust model to predict longitudinal cognitive changes over 12 years among older adults and to identify the most significant...
Publication link

PreGLAM: A Predictive, Gameplay-based Layered Affect Model
IEEE Transactions on Games
SIAT faculty authors: Pasquier, P.
Abstract: ... PreGLAM combines elements of real-time Player Experience Models, and Affective Non-Player-Character models to output real-time estimated values for a spectator's valence, arousal, and tension during gameplay. Because tension is related to prospective events, PreGLAM attempts to predict future gameplay events....more

Progression of students' SRL processes in subsequent programming problem-solving tasks and its association with tasks outcomes
Internet and Higher Education
SIAT faculty authors: Hatala, M.
Abstract: ... To learn to program means to master steps in the complex problem-solving activity. Previous research uncovered a rich set of domain-specific and generic cognitive and metacognitive strategies students use when they learn to program. The processes that problem-solving experts demonstrate are very similar to those studied by self-regulated le...
Publication link

Reimagining Assessment for Maker Education in Elementary Education: Findings from a Values-led Co-Design Workshop with Teachers
SIAT faculty authors: Antle, A.
Description: In maker education, traditional classroom assessments often fail to capture student learning. As of now, most assessment focus on the end product, are language-based, and are teacher-directed. Designing effective assessment processes requires resolving tensions between what teachers hope to accomplish and what they can do. This paper explores the values and tensions of elementary school teachers when it comes to designing..
Publication link

Re-investigating the Effect of the Vergence-Accommodation Conflict on 3D Pointing
Book: Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology
Pages: 1-10
SIAT faculty authors: Stuerzlinger, W.
Description: The vergence-accommodation conflict (VAC) limits user performance in current Virtual Reality (VR) systems. In this paper, we investigate the effects of the VAC in a single-focal VR system using three experimental conditions: with no VAC, with a constant VAC, and with a varying VAC. Previous work in this area had yielded conflicting results, so we decided to re-investigate this issue. Eighteen participants performed an...
Publication link

Remote Wavelength: Design and Evaluation of a System for Social Connectedness Through Distributed Tabletop Gameplay
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Neustaedter, C., Odom, W.
Abstract: ... Yet most systems for remote tabletop gaming lack support for tangible and social interaction, two important aspects of gameplay for most players. We are interested in how to better design systems for remote tangible gameplay that support social connection. We investigate this topic through the design and evaluation of a prototype system for playing the board game Wavelength acr...
Publication link

Searching for Human Bias Against AI-Composed Music
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SIAT faculty authors: Pasquier, P.
Abstract: ... We conducted an empirical study to investigate the hypotheses that human listeners hold a negative bias against computer-composed music. 163 participants were recruited from Amazon’s MTurk to fill out a survey asking participants to rank 5 computer-composed and 5 human-composed musical excerpts based on subjective musica...more

Sensing Their Presence: How Emerging Adults and Their Parents Connect After Moving Apart
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Neustaedter, C.
Abstract: ... In co-located homes, people often experience togetherness passively by sensing one another's presence in their environment. However, when no longer living together, methods of experiencing togetherness change. Thus, we conducted an interview and co-design study with 16 pairs of parents and emerging adults that explores this concept across distance. The study uncover...
Publication link

Structuring Collaboration in Programming Through Personal-Spaces
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Stuerzlinger, W.
Abstract: ... We explore an alternative collaboration paradigm that tackles this imbalance through Parsons problems: students are given fragments of code out of order and tasked with re-organizing them into the correct order. We then create an interdependence between students by assigning each to a different sub-problem in their own space, termed Personal-spaces - they must engage in dialog t...
Publication link

Supporting Diverse Research Methods for Observing Huge Variable Space in Empirical Studies for Visualization
Publisher: Springer International Publishing
Book: Visualization Psychology
SIAT faculty authors: Fisher, B.
Description: In each of the last 5 years, a few dozen empirical studies appeared in visualization journals and conferences. The existing empirical studies have already featured a large number of experimental variables. There are many more variables yet to be studied. While empirical studies enable us to obtain knowledge and insight about visualization...

TangiTeam: Supporting Social Regulation of Learning during Design-Based Learning
ACM International Conference Proceeding Series
SIAT faculty authors: Antle, A., Riecke, B.
Abstract: ... It requires students to leverage social regulation of learning. However, students in elementary education still need to develop these skills. Tangible User Interfaces might help students move up in the developmental trajectory through providing scaffolds and supporting positive interdependence. In this paper, we present the considerations and design of...
Publication link

The Flow of Trust: A Visualization Framework to Externalize, Explore, and Explain Trust in ML Applications
IEEE Computer Graphics and Applications
SIAT faculty authors: Fisher, B.
Abstract: ... Currently, trust in ML applications is an implicit process that takes place in the user-s mind. As such, there is no method of feedback or communication of trust that can be acted upon. Our framework will be instrumenta...
Publication link

The Future of Computational Approaches for Understanding and Adapting User Interfaces
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Stuerzlinger, W.
Abstract: ... Computational approaches for user interfaces have been used in adapting interfaces for different devices, modalities, and user preferences. Recent work has made significant progress in understanding and adapting user interfaces with traditional constraint/rule-based optimization and machine learning-based data-driven approaches; however, these two approaches remain separa...
Publication link

The perspective effect of awe in VR environments: a comparison of first-person and third-person perspectives
Publisher: OSF
SIAT faculty authors: Riecke, B.
Description: Nature scenes like landscapes have been used in several studies to evoke awe. Landscapes evoke awe due to their vastness and beauty, and they are an example of an awe-eliciting situation mentioned by many participants in several studies (Bai et al., 2017; Joye & Bolderdijk, 2015; Smalley & White, 2023). In Virtual Reality (VR) environments, the...

The theory of orchid and dandelion offers a new subtyping framework for cognitive aging
Aging
SIAT faculty authors: Moreno, S.
Description: Sylvain Moreno, Emma Rodrigues, Faranak Farzan www. aging-us. com 6628 AGING subtyping by extending the orchid and dandelion theory to the cognitive aging population and providing a new framework to understand cognitive aging [9]. The empirical evidence for investigating heterogeneity in cognitive aging has been growing, and the...
Publication link

Throughput and Effective Parameters in Crossing
Conference on Human Factors in Computing Systems - Proceedings
SIAT faculty authors: Stuerzlinger, W.
Abstract: ... Based on the calculation of effective parameters (width We and amplitude Ae), TP should be independent of the speed-accuracy tradeoff. To examine the validity of TP and effective parameters for crossing actions, we conducted two experiments using two established crossing tasks. Our results demonstrate that applying effective parameters to Fitts' law model improves the fit to the dat...
Publication link

Transmediating Sky Blanket: tensions with a digital jacquard loom
Book: Proceedings of the 2023 ACM Designing Interactive Systems Conference
Pages: 371-386
SIAT faculty authors: Hennessy, K.
Description: This pictorial presents an ongoing collaboration between a Haida/Kwakwaka'wakw/Irish artist and a multi-disciplinary team of settler researchers around Sky Blanket, a hybrid Yeil Koowu (Raven's Tail) and Naaxiin (Chilkat) style woven robe. We elaborate on our collaborative commitments that include a focus on materiality and particular team...

Turner Boxes and Bees: From Ambivalence to Diffraction
Book: Proceedings of the 2023 ACM Designing Interactive Systems Conference
Pages: 790-807
SIAT faculty authors: Wakkary, R.
Description: This paper is a Research through Design (RtD) investigation that deeply reflects on our ambivalence with three design choices we made while designing in a multispecies context. The ongoing RtD project, called Turner Boxes, aims to design a technological network to interact with wild bees in an urban environment. The design choices...

Visualization Psychology
Publisher: Springer Nature
SIAT faculty authors: Fisher, B.
Description: This book designates Visualization Psychology as an interdisciplinary subject. The book contains literature reviews and experimental works that exemplify a range of open questions at this critical intersection. It also includes discourses that envision how the subject may be developed in the coming years and decades. The field of visualization...

When to Intervene? Utilizing Two Facets of Temporality in Students' SRL Processes in a Programming Course
ACM International Conference Proceeding Series
SIAT faculty authors: Hatala, M.
Abstract: ... In the first aspect, which refers to the temporal order of Self-regulated learning (SRL) phases, we characterized four types of SRL processes based on phase transitions and the cyclical nature of SRL. The SRL types were mapped into the kinds of iterative behaviours over SRL phases which correspond to the theorized self-regulatory behaviours of stud...
Publication link