research-article

Call to interact: communicating interactivity and affordances for contactless gesture controlled public displays

Author:

Hannah LimerickAuthors Info & Claims

PerDis '20: Proceedings of the 9TH ACM International Symposium on Pervasive Displays

Pages 63 - 70

https://doi.org/10.1145/3393712.3395338

Published: 04 June 2020 Publication History

Abstract

Interactive public displays are becoming increasingly commonplace. Two important challenges for these displays exist: 1) how interactivity is communicated to the passer-by and 2) once the audience have engaged, how the interactive affordances are communicated. We explore these challenges through the lens of a new emerging interaction modality - contactless mid-air gesture controlled public displays. This paper presents several solutions to the problems above, inspired by the findings existing within the related research on public displays. These solutions are deployed in an in-the-wild setting - a cinema for an 8 week duration - and evaluated through observational and quantitative research. The data forms a set of design guidelines for successfully attracting the passer-by and conveying the affordances of the contactless gestural public displays.

References

[1]

Christopher Ackad, Martin Tomitsch, and Judy Kay. 2016. Skeletons and silhouettes: Comparing user representations at a gesture-based large display. Conference on Human Factors in Computing Systems - Proceedings: 2343--2347.

Digital Library

[2]

Jorgos Coenen, Sandy Claes, and Andrew Vande Moere. 2017. The concurrent use of touch and mid-air gestures or floor mat interaction on a public display. PerDis 2017 - Proceedings: 6th ACM International Symposium on Pervasive Displays.

Digital Library

[3]

Loic Corenthy, Marcello Giordano, Richard Hayden, Daniel Griffiths, Craig Jeffrey, Hannah Limerick, Orestis Georgiou, Tom Carter, Jörg Müller, and Sriram Subramanian. 2018. Touchless tactile displays for digital signage: mid-air haptics meets large screens. Conference on Human Factors in Computing Systems - Proceedings 2018-April.

Digital Library

[4]

Nicholas S. Dalton, Emily Collins, and Paul Marshall. 2015. Display blindness? Looking again at the visibility of situated displays using eye tracking. Conference on Human Factors in Computing Systems - Proceedings 2015-April: 3889--3898.

Digital Library

[5]

Guiying Du, Lukas Lohoff, Jakub Krukar, and Sergey Mukhametov. 2016. Comparing two methods to overcome interaction blindness on public displays. PerDis 2016 - Proceedings of the 5th ACM International Symposium on Pervasive Displays, June: 243--244.

Digital Library

[6]

Mojgan Ghare, Marvin Pafla, Caroline Wong, James R. Wallace, and Stacey D. Scott. 2018. Increasing Passersby Engagement with Public Large Interactive Displays: A Study of Proxemics and Conation. ISS 2018 - Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces: 19--32.

Digital Library

[7]

Luke Hespanhol, Martin Tomitsch, Kazjon Grace, Anthony Collins, and Judy Kay. 2012. Investigating intuitiveness and effectiveness of gestures for free spatial interaction with large displays. ACM International Conference Proceeding Series, May 2014.

Digital Library

[8]

Elaine M. Huang, Anna Koster, and Jan Borchers. 2008. Overcoming assumptions and uncovering practices: When does the public really look at public displays? Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 5013 LNCS: 228--243.

Digital Library

[9]

Wendy Ju and David Sirkin. 2010. Animate Objects : How Physical Motion Encourages Public Interaction 1 Introduction 2 Related Work. Persuasive Technology. Lecture Notes in Computer Science. 6137: pp 40--51.

Digital Library

[10]

Mohamed Khamis, Christian Becker, Andreas Bulling, and Florian Alt. 2018. Which one is me? Identifying oneself on public displays. Conference on Human Factors in Computing Systems - Proceedings 2018-April, October: 21--26.

Digital Library

[11]

Hannu Kukka, Heidi Oja, Vassilis Kostakos, Jorge Goncalves, and Timo Ojala. 2013. What makes you click: Exploring visual signals to entice interaction on public displays. Conference on Human Factors in Computing Systems - Proceedings: 1699--1708.

Digital Library

[12]

Noko Kuratomo, Kazuki Yamada, Soh Masuko, Toshimasa Yamanaka, and Keiichi Zempo. 2019. Effect of Attention Adaptive Personal Audio Deliverable System on Digital Signage. 118--121.

Digital Library

[13]

Hannah Limerick, Richard Hayden, David Beattie, Orestis Georgiou, and Jörg Müller. 2019. User engagement for mid-air haptic interactions with digital signage. Proceedings - Pervasive Displays 2019 - 8th ACM International Symposium on Pervasive Displays, PerDis 2019.

Digital Library

[14]

Elliot Maras. 2019. Touchscreen sanitation is a top concern for customers. Digital Signage Today.

[15]

Jörg Müller, Florian Alt, Albrecht Schmidt, and Daniel Michelis. 2010. Requirements and design space for interactive public displays. MM'10 - Proceedings of the ACM Multimedia 2010 International Conference: 1285--1294.

Digital Library

[16]

Jörg Müller, Robert Walter, Gilles Bailly, Michael Nischt, and Florian Alt. 2012. Looking glass: A field study on noticing interactivity of a shop window. Conference on Human Factors in Computing Systems - Proceedings: 297--306.

Digital Library

[17]

Jorg Muller, Dennis Wilmsmann, Exeler Juliane, Buzeck Markus, Albrecht Schmidt, Jay Tim, and Kruger Antonio. 2009. Display Blindness: The Effect of Expectations on Attention towards Digital Signage. International Conference on Pervasive Computing, May: 1--8.

[18]

Donald Norman. 2002. Design of everyday things. Basic Books, Inc. Division of HarperCollins 10 E. 53rd St. New York, NY United States.

[19]

Timo Ojala, Vassilis Kostakos, Hannu Kukka, Tommi Heikkinen, Marko Jurmu, Simo Hosio, Fabio Kruger, and Daniele Zanni. 2012. Three Years Later. 42--49.

[20]

Marvin Pafla, Caroline Wong, Daniel Gillis, Ulrike Pfeil, and Stacey D. Scott. 2019. Jumping on the bandwagon: Overcoming social barriers to public display use. Proceedings - Graphics Interface 2019-May.

[21]

Daniel Vogel and Ravin Balakrishnan. 2004. Interactive public ambient displays: Transitioning from implicit to explicit, public to personal, interaction with multiple users. UIST: Proceedings of the Annual ACM Symposium on User Interface Softaware and Technology 6, 2: 137--146.

Digital Library

[22]

Robert Walter, Gilles Bailly, and Jörg Müller. 2013. StrikeAPose: Revealing mid-air gestures on public displays. Conference on Human Factors in Computing Systems - Proceedings: 841--850.

Digital Library

[23]

Robert Walter, Gilles Bailly, Nina Valkanova, and Jörg Müller. 2014. Cuenesics: Using mid-air gestures to select items on interactive public displays. MobileHCI 2014 - Proceedings of the 16th ACM International Conference on Human-Computer Interaction with Mobile Devices and Services: 299--308.

Digital Library

[24]

Niels Wouters, John Downs, Mitchell Harrop, Travis Cox, Eduardo Oliveira, Sarah Webber, Frank Vetere, and Andrew Vande Moere. 2016. Uncovering the honeypot effect: How audiences engage with public interactive systems. DIS 2016 - Proceedings of the 2016 ACM Conference on Designing Interactive Systems: Fuse, June: 5--16.

Digital Library

Cited By

Tanaka KOkafuji YIwamoto T(2024)Popping-Up Poster: A Pin-Based Promotional Poster Device for Engaging Customers through Physical Shape TransformationProceedings of the ACM on Human-Computer Interaction10.1145/36981388:ISS(283-300)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698138
Sheremetieva ARomanovych IFrish SMaksymenko MGeorgiou O(2023)What’s my future: a Multisensory and Multimodal Digital Human Agent Interactive ExperienceProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596161(40-46)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596161
Shen ZVasudevan MKučera JObrist MMartinez Plasencia D(2023)Multi-point STM: Effects of Drawing Speed and Number of Focal Points on Users’ Responses using Ultrasonic Mid-Air HapticsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580641(1-11)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580641
Show More Cited By

Index Terms

Call to interact: communicating interactivity and affordances for contactless gesture controlled public displays
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Field studies
      2. User studies

Recommendations

MirrorTouch: combining touch and mid-air gestures for public displays
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

In this paper we present a series of three field studies on the integration of multiple modalities (touch and mid-air gestures) in a public display. We analyze our field studies using Conversion Diagrams, an approach to model and evaluate usage of ...
Cuenesics: using mid-air gestures to select items on interactive public displays
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

Most of today's public displays only show predefined contents that passers-by are not able to change. We argue that interactive public displays would benefit from immediately usable mid-air techniques for choosing options, expressing opinions or more ...
Pocket Transfers: Interaction Techniques for Transferring Content from Situated Displays to Mobile Devices
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

We present Pocket Transfers: interaction techniques that allow users to transfer content from situated displays to a personal mobile device while keeping the device in a pocket or bag. Existing content transfer solutions require direct manipulation of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

PerDis '20: Proceedings of the 9TH ACM International Symposium on Pervasive Displays

June 2020

104 pages

ISBN:9781450379861

DOI:10.1145/3393712

Conference Chairs:
Vanessa Cobus
OFFIS - Institute for Information Technology Oldenburg, Germany
,
Sarah Prange
Universität der Bundeswehr München, Germany
,
General Chair:
Sarah Clinch
University of Manchester, United Kingdom
,
Program Chairs:
Enrico Rukzio
Ulm University, Germany
,
Jan Gugenheimer
Institut Polytechnique de Paris, France

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 June 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

PerDis '20

Sponsor:

SIGMOBILE

PerDis '20: The 9th ACM International Symposium on Pervasive Displays

June 4 - 5, 2020

Manchester, United Kingdom

Acceptance Rates

PerDis '20 Paper Acceptance Rate 12 of 21 submissions, 57%;

Overall Acceptance Rate 213 of 384 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
334
Total Downloads

Downloads (Last 12 months)43
Downloads (Last 6 weeks)4

Reflects downloads up to 11 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tanaka KOkafuji YIwamoto T(2024)Popping-Up Poster: A Pin-Based Promotional Poster Device for Engaging Customers through Physical Shape TransformationProceedings of the ACM on Human-Computer Interaction10.1145/36981388:ISS(283-300)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698138
Sheremetieva ARomanovych IFrish SMaksymenko MGeorgiou O(2023)What’s my future: a Multisensory and Multimodal Digital Human Agent Interactive ExperienceProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596161(40-46)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596161
Shen ZVasudevan MKučera JObrist MMartinez Plasencia D(2023)Multi-point STM: Effects of Drawing Speed and Number of Focal Points on Users’ Responses using Ultrasonic Mid-Air HapticsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580641(1-11)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580641
Kuratomo NMiyakawa HEbihara TWakatsuki NMizutani KZempo K(2023)Attracting Effect of Pinpoint Auditory Glimpse on Digital SignageIEEE Access10.1109/ACCESS.2023.327090911(42779-42794)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3270909
Waugh KMcGill MFreeman E(2022)Push or Pinch? Exploring Slider Control Gestures for Touchless User InterfacesNordic Human-Computer Interaction Conference10.1145/3546155.3546702(1-10)Online publication date: 8-Oct-2022
https://dl.acm.org/doi/10.1145/3546155.3546702
Faridan MFriedel MSuzuki R(2022)UltraBots: Large-Area Mid-Air Haptics for VR with Robotically Actuated Ultrasound TransducersAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3561350(1-3)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526114.3561350
Cronin SFreeman EDoherty G(2022)Investigating Clutching Interactions for Touchless Medical Imaging SystemsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517512(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517512
Freeman E(2022)Ultrasound Haptic Feedback for Touchless User Interfaces: Design PatternsUltrasound Mid-Air Haptics for Touchless Interfaces10.1007/978-3-031-04043-6_3(71-98)Online publication date: 17-Sep-2022
https://doi.org/10.1007/978-3-031-04043-6_3
Georgiou OFrier WSchneider O(2022)User Experience and Mid-Air Haptics: Applications, Methods, and ChallengesUltrasound Mid-Air Haptics for Touchless Interfaces10.1007/978-3-031-04043-6_2(21-69)Online publication date: 17-Sep-2022
https://doi.org/10.1007/978-3-031-04043-6_2
Kwon HJeon YBaek B(2021)Solar Signage Business Model Design Using the EPSS FrameworkEnergies10.3390/en1421696014:21(6960)Online publication date: 22-Oct-2021
https://doi.org/10.3390/en14216960
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents