Posters @ #CHI2016 “Playing with the Artworks” & “3D virtual tracing”

After acouple of months, but better late than never

Klen Čopič Pucihar, Kljun Matjaž, Paul Coulton
Playing with the Artworks: Engaging with Art through an Augmented Reality Game CHI EA ’16 Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems
DOI | Download draft paper (PDF)

In the majority of cases our experiences of artworks in galleries and museums is as passive observers. While this is widely accepted practice in terms of preserving the artworks it limits the engagement potential with younger visitors. In this paper we present a way of using augmented reality (AR) technology to create engaging and personal art experience for such an audience. To achieve this, we built a prototype for a treasure hunt style game where players colour a contour drawing not knowing what exactly they are colouring. However, they are told that if this coloured drawing is placed correctly, it should wrap around a 3D object (statue) or overlay a 2D canvas (picture) somewhere in the gallery. In the paper we present an evaluation of the augmented colouring aspect of the proposed game with nine K-6 children.

Leo Gombač, Klen Čopič Pucihar, Matjaz Kljun, Paul Coulton, Jan Grbac
3D virtual tracing and depth perception problem on mobile AR CHI EA ’16 Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems
DOI | Download draft paper (PDF)

Mobile Augmented Reality (AR) is most commonly implemented using a camera and a flat screen. Such implementation removes binocular disparity from users’ observation. To compensate, people use alternative depth cues (e.g. depth ordering). However, these cues may also get distorted in certain AR implementations, creating depth distortion. One such example is virtual tracing — creating a physical sketch on a 2D or 3D object given a virtual image on a mobile device. When users’ hands and drawn contours are introduced to the scene, the rendering of the virtual contour with the correct depth order is difficult as it requires real time scene reconstruction. In this paper we explore how depth distortion affects 3D virtual tracing by implementing a first of its kind 3D virtual tracing prototype and run an observational study. Contrary to our initial expectations, drawing performance exceeded our expectations suggesting that the lack of visual depth cues, whilst 3D virtual tracing, is not as important as initially expected. We attributed this to the positive impact of proprioception on drawing performance enhanced by holding the object in hand while drawing. As soon as the participants were asked to hold the mobile device in their hands while drawing, their performance drastically decreased.