GestureLit


Following are references and brief summaries to literature Nic read at Christmas

Design Related

Agah, A 2001 Computers and Electrical Engineering 27 ( 2001 ) 71-107 Human interactions with intelligent systems: research taxonomy Interaction distance: Physically attached, same area/room, different rooms, earth/space

Challis Ben & Edwards Alistair Design Principles for Tactile Interaction Abstract only: preliminary principles for tactile interface design
link.springer.de/link/service/series/0558/bibs/2058/20580017.htm

Holmquist et al 1999 Token based Access to Digital information Roles of tangible user interfaces: containers, tokens, tools
www.viktoria.se/play/publications/2000/phd/leh/token.pdf

Nigay Contaz 1993 A design space for multimodal systems Method for classifying multi-modal systems. Integration of multiple communication modalities with an interactive system: Concurrency of processing. Fusion of data input/output

Tang, J C Leifer L J 1988 Proc. Conference Computer Supported Co-operative work A framework for understanding the workspace activity of design teams

Ullmer 2000 Emerging Frameworks for Tangible User Interfaces: Tangibles are integrated into tangible user interfaces in different and overlapping ways: spatial, constructive, relational, associative
www.research.ibm.com/journal/sj/393/part3/ullmer.pdf

Winograd, T 1999 Working paper for standford project on Interactive Workspaces Towards a human Centred Interaction Architecture: A key element of a design framework for interactive computing is a separately maintained action-perception coupling
graphics.stanford.edu/projects/iwork/papers/humcent/

Winograd, Terry Notes on Conceptual Models and Metaphors: basic metaphors for how we interact with things: manipulation, navigation, conversation
hci.stanford.edu/cs147/notes/models.html

Gestures

Ballard et al Dietic codes for embodiment in cognition: Deictic sensory motor primitives eg saccades are either fixating ( like grasping or pointing ) or attending ( like auditory localisation )
www.bbsonline.org/

Vygotsky The child's self-motion, his gestures, are what assign the function of sign to the object and give it meaning. Understanding is social in origin

Vygotsky Gestures come from attempts to interact with object

Wachsmuth, Ipke, Fr?hlich Martin ( Eds. )1997 Gesture and Sign-Language in Human-Computer Interaction Int. Gesture Workshop Bielefeld, Germany, September, 1997 Proceedings Table of contents only:
Includes: Research Challenges in Gesture: Open Issues and Unsolved Problems, Wexelblat Semiotics of Gesture and Movement: Movement Phases in Signs and Co-speech Gestures, and Their Transcription by Human Coder

Kita, Gijn, and van der Hulst; Classifying Two Dimensional Gestures in Interactive System

Kramer; Are Listeners Paying Attention to the Hand Gestures of an Anthropomorphic Agent?: An Evaluation Using a Gaze Tracking Method

Nobe, Hayamizu, Hasegawa, and Takahashi; Gesture-Based and Haptic Interaction for Human Skill Acquisition

Bordegoni and De Angelis Motion Analysis and Synthesis: Corpus of 3D Natural Movements and Sign Language Primitives of Movement

Gibet, Richardson, Lebourque, and Braffort Techniques for Multimodal Interfaces: Investigating the Role of Redundancy in Multimodal Input Systems

McKenzie Mills and Alty; Gesture Recognition of the Upper Limbs - From Signal to Symbol Frohlich and achsmuth

Hand use of objects

Iberall, T and MacKenzie,C.L. 1990 Opposition space and human prehension, Dextrous Robot Hands, eds. S.T. Venkataraman and T. Iberall, Springer-Verlag, 1990, pp. 3254. 144 Grasps divided into power and precision. Prehension is taking hold application of functionally effective forces by the hand to an object for a task. Prehension involves: Planning moving before contact and d
uring contact; Motor activity can be divided into: Epistemic and pragmatic actions

Neurophysiology

Jeannerod 1994 The representing brain: neural correlates of motor intention and imagery Objects as goals for action ( pragmatic ) or as basis for verbal descriptions( semantic )
www.bbsonline.org/

Creen et al 1998 Motor representations involved in Perceiving Tools Hand movement potential for action representations, not just semantic categories. Perception of any graspable object involves motor and object based representations
www.psych.utah.edu/~sc4002/creem_HBM2000.pdf

Graziano Sense of boundaries when driving a car. Neurons respond as if its is like part of their body

Object cognition

Harnad S 1999 Harnad, S. ( 1990 ) The Symbol Grounding Problem. Physica D 42: 335-346. Visual symbols are iconic or categorical representations. Over time an embodied object does from human perception based on fundamental senses to mental representation through reflection and discussion
www.cogsci.soton.ac.uk/~harnad/Papers/Harnad/harnad90.sgproblem.html

Hommel et al Theory of Event Coding Counters assumption that perception and action planning are isolated. Instead perceived and to-be-produced events are coded within a common representational medium. Compliments Suchman 87?
www.bbsonline.org/Preprints/Hommel/Hommel.pdf

Lakoff 1987 Women fire and dangerous things Human bodily movement, manipulation on of objects and perceptual interactions involve recurring patterns ( image schemata )
www.izhd.uni-hambudg.de/paginae/book/ch3/constructivism

Richardson et al

Seitz, J. A. 2000 New Ideas in Psychology: An International Journal of Innovative Theory in Psychology, 18( 1 ), 23-40 Bodily basis of thought 3 cognitive abilities for the bodily basis of thought: motor logic, kinaesthetic memory, kinaesthetic awareness
www.york.cuny.edu/~seitz/newideas.pdf

Basalou et al 1999 Perceptual Symobl Systems Abstract concepts are grounded in complex simulations of combined physical and introspective events. Perceptual states arise in the sensory motor system
www.bbsonline.org/

Semiotics

Chandler, D 2001 Semiotics for Beginners A complete review of practice and thought in semiotics
www.aber.ac.uk/media/Documents/S4B/sem01.html

Hammer Semantic domains referred to by discourse: Physical, social, mental, expressive. Each has different dynamics/causation

Hammer P 1999 Centre for Semiotics Semantic Domains 3 different kinds of interactions that humans participate in with their external worlds ( perception, expression, action ) + 1 internal interaction ( reflection ). 4 domains of human reality: physical, social, mental ,expressive

Mylov, P 1998 In: Virtual Interaction: Interaction in/with Virtual Inhabited 3D Worlds. Qvortrup, Lars ( ed ) Springer Verlag. Three types of multimedia Interaction and beyond Addends to Purchase's linear syntax: Enactive, mediated, performative
www.staging.dk/pdf/04_PM_v1.pdf

Sweetser 1990 From Etymology to Pragmatics: Metaphorical and cultural aspects of semantic structure The mind is a body: Thinking is moving, perceiving and object manipulation; Acquiring ides is eating;


[ListAllPages]