Voice Control System & Multiplatform Use

/
siri-iphone.jpg

How do users perceived their relationships with voice agents that embody and represent interaction with a device? And what kind of interaction would be best for users and voice agents in a multiplatform or multi-device environment? Would users prefer and respond more strongly to a single, consistent voice agent that follows users across platforms? Or would they prefer and trust specialist agents who “specialize” in their interaction with a particular platform. 

  • Researchers: Soyoung Jung, Kwanmin Lee, Frank Biocca
  • Funders: Sungkyunkwan University, Newhouse Endowment

Workload and Emotion

/

This project involves measuring workload and emotion while participants view music videos. Uses the DEAP dataset as stimuli and machine learning on cognitive data to develop classification models for new brain states.

  • Researchers: Danushka Bandara, Leanne Hirshfield, Mark Costa, Sarah Bratt, Mingyu Zhong
  • Funders: Newhouse Endowment

Auditory Presence & Neuroimaging

/

By using neuroimaging approach, this study investigates if presence as mental representation of reality  can be traced by neuroimaging by using 3D video and audio stimuli and fNIRS.

  • Researchers: Stephen Song, Mincheol Shin, Frank Biocca
  • Funder: Newhouse Endowment

Making Older Art Interactive: Media Modality effects on Aesthetic Experience and Visual Perception in the Narrative Interactive Museum

/

Theory: Museum as an Interactive System, Effects of media modalities, Aesthetic experience
Research Problem: Effect of media modality (specifically interactivity) on aesthetic experience and perception.
Design Art Simulation Software

  • Researchers: Hannah (Hye Jin) Kum, M.I.N.D. Lab (SKKU/Samsung, Syracuse University)
  • Funders: Newhouse Endowment, Konkuk University

Datamining Approach on Emotion

/

This project employed machine learning to see if using ECG/EDA with fNIRS data can successfully categorize human emotion. Result showed 93.39% accuracy. Currently submitted to HCI conference.

  • Researchers: Danushka Bandara, Stephen Song, Leanne Hirshfield
  • Funder: Newhouse Endowment

Projection Mapping

/

We examine the form of augmented or mixed reality called projection mapping also known as three-dimensional (3D) projection mapping and how it affects on cognition, emotions, and behaviors. This study is on the studies of psychological effect, cognitive perception, and behavior change of this new medium e.g., immersion, usability, emotion, attitude, memory, visuospatial perception, learning, and et cetra.

  • Researchers: Soyoung Jung, Daeun Lee, Frank Biocca
  • Funders: Newhouse Endowment, Sungkyunkwan University

Neuromarketing: Advertisement Experiment

/

This experiment asked: “Can we measure the brain activity of consumers watching advertisements?” The project explores correlating brain activity with user experience while viewing ads to predict product success and market-readiness with a new research modality, fNIRS.

  • Researchers: Leanne Hirshfield, Brian Sheehan, Joanne Barretto, Sarah Bratt, Danushka Bandara
  • Funder: Newhouse Endowment

Online Dating Interface Features Interact with Evolutions Gender Selection Biases

/

This study investigates the gender differences in online dating sites; how gender effects interplay with the user interface elements of online dating sites. Specifically, we explore how different interface modality features increase the sense of social presence of the prospective date including location-awareness, pictures, or video. 

  • Researchers: Soyoung Jung, Soojin Roh, Hyun Yang, Frank Biocca
  • Funder: Newhouse Endowment

Emoticon & Anthropomorphism

/

Understanding how people use IM on Smartphone is of crucial importance to this new technology trend of Smartphone rising. An online survey (N=110) examined how IM users use emoticons when they are chatting through IM based on cultural and gender difference. 

  • Researcher: Soyoung Jung, JunKyung Kim, Li Chen
  • Funder: Newhouse Endowment

3D Sound in Virtual Reality

/

The current project aims to examine the effects of three dimensional sound on presence and parasocial relationship. Our research team seeks to investigate the impact of virtually realistic sound (i.e., 3D sound) on the overall experience in virtual reality. We employ “head-tracking“ function to realize more natural sound. In addition, the design of the current project also comprises a temporal synchronicity dimension.

  • Researchers: Mincheol Shin, Stephen Song, Frank Biocca, Yeonhee Cho, Yuqian Ni
  • Funder: Newhouse Endowment

Interactive Advertising on Large Display

/

This study examines current research in the field of interactive advertising on a large public display with interactivity (gesture interaction) and self-representation (avatar self-presence). The core of this research is based on an interaction concept of a large display like digital signage.

  • Researchers: Soyoung Jung, Daeun Lee, Frank Biocca
  • Funder: Newhouse Endowment, Sungkyunkwan University

Sports Event & Advertisement Effectiveness

/

This independent study project found that sport involvement, team involvement, result of the game, watching with acquaintances, and usage of social media have effect on the effectiveness of the advertisement during a sport event.

  • Researchers: Stephen Song, Frank Biocca
  • Funder: Newhouse Endowment

Weight & Media Experience

/

This study intends to seek if the weight of a medium is related to perceived reality and seriousness of the news topic. The result of the study would imply how people can perceive given information differently when they are holding mobile devices; compared to heavier, older devices.

  • Researchers: Stephen Song, Mincheol Shin, Frank Biocca
  • Funder: Newhouse Endowment

EEG and Presidential Debates

/

Project measures EEG activity and GSR of a participant watching the democratic and republican debates. Pilot work was proposed to TEDx Syracuse to engage and seek collaboration with the local neuroscience and political community. Measurement of electrical dermal and brain activity is used to identify cognitive metaphors that characterize conservatives and liberals. 

  • Researchers: Sarah Bratt, Michael Hutchinson
  • Funder: Newhouse Endowment

Virality

/

My project measures brain states of individuals on Facebook who consider sharing trending digital media events. In a modification of Matthew Lieberman of UCLA’s experiment, this fNIRS project measures “buzz” in the brain when participants share or do not share viral or trending media.

  • Researchers: Sarah Bratt, Leanne Hirshfield, Jeff Hemsley
  • Funder: Newhouse Endowment

Biometrics

/

In a collaboration with electrical engineering and computer science post-doc and faculty, this project measures brain patterns elicited from mathematics and image-matching n-back tasks to identify  individuals on the basis of their “brain-print.” The study required participants to come into the lab multiple times to participate in EEG and fNIRS data collection.

  • Researchers: Vir Phoha, Abdul Serwadda, Sujit Poudel, Leanne Hirshfield
  • Funder: Newhouse Endowment

A Study of Danmaku: Social Presence, Transportation to Narrative, Attention, Enjoyment and Cognitive Workload

/

Project intends to examine people’s Danmaku video (videos with overlaid comments) watching experiences, with particular focus on their feeling of co-viewing with other people, transportation into the narrative, attention, enjoyment and cognitive workload.

  • Researchers: Yuqian Ni, Frank Biocca
  • Funder: Newhouse Endowment

Environmental News & Proximity

/

This project investigates if the proximity of the news topic is related to brain activity. It is expected that people are more likely to use different brain regions when they are exposed to news from geographically closer location compared to farther locations.

  • Researchers: Stephen Song, Sung Yoon Ri, Makana Chock

  • Funder: Newhouse Endowment

Investigation of Teen’s Perception & Credibility in Virtual Network

/

This study introduces a deviant group among youth that constantly consumes and shares information on virtual social networks in the cyberspace. this study will show the characteristics of this new type of group within virtual social networks using an empirical research approach. Also, youth who are in the early stages of brain development are likely to show brain plasticity within the framework of the theory of mind and feel unmediated social presence while they use mediated communication tools. It may result confusion on their perception for information credibility and also it cause another confusion on their decision making process by persuasive information from social media. 

  • Researcher: Soyoung Jung
  • Funder: Newhouse Endowment