Wenjun Wang: /* Visualization */

==Perception==

* Colin Ware: Information Visualization: Perception for Design
:Insight into some of the theory of perception as it pertains to building visual interfaces (David)

* Some unindentified paper(s)/book(s) about Gestalt theories of perception and cognition [http://en.wikipedia.org/wiki/Gestalt_psychology wikipedia page]
:These theories, from the 40's inform visual design and may provide an analogy for integration of theory and practice. They describe some characteristics of perception that have been used as evaluative rules in UI design. (David)

* [http://vrlab.epfl.ch/~pglardon/VR05/papers/chi2004.pdf Feeling Bumps and Holes without a Haptic Interface: the Perception of Pseudo-Haptic Textures] Lecuyer-2004-FBH
: A cool technique on "hacking" human perception by modifying the control/display ratio of visible elements to simulate haptic feedback for the user. Strong analysis of which parts of haptic feedback are useful (e.g., vertical elements can be discarded). Pseudo-haptic feedback is implemented by combining the use of visible feedback with the changing sensitivity of a passive input device (e.g., a mouse). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=267474 Research issues in perception and user interfaces] Encarnacao-1994-RIP
: "The authors focus at on three things: presentation of information to best match human cognitive and perceptual capabilities, interactive tools and systems to facilitate creation and navigation of visualizations, and software system features to improve visualization tools." First and third points sound relevant. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=vnax4nN4Ws4C&oi=fnd&pg=PA703&dq=slanty+design&ots=P7G259hzJa&sig=vbYZmYkquwuA_ollOI6EgciNJjU The Uniqueness of Individual Perception] Whitehouse-1999-ID
: Focuses on the commonalities of perception. Rough overview of sensory mechanisms, and strong anecdotal support of not adapting completely to the user, but rather requiring the user to adapt as well. Identifies some common perceptual problems with particular groups of EUs (e.g., blind people). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.psychonomic.org/search/view.cgi?id=4180 Guided search 2. 0. A revised model of visual search] Wolfe-1994-GS2
: A theory of visual search that builds on the distinction between visual targets that you need to search for in a field of distractors and those that "pop out" at you. (Adam) 16:22, 26 January 2009 (UTC)

* [http://biologie.kappa.ro/Literature/Misc_cogsci/articole/dvp/scholl00.pdf Perceptual causality and animacy] [[Scholl-2000-PCA]]
: Discusses some of the automatic interpretation in our perception, focusing on inferring causal relations and animacy. 

* [http://www.cs.umd.edu/class/fall2002/cmsc434-0201/p79-gaver.pdf Technology Affordances] Gaver-1991-TAF
: Affordances are actions that are appropriate for an object and that come to mind when perceiving the object. (Adam) 16:22, 26 January 2009 (UTC)

* [http://portal.acm.org/ft_gateway.cfm?id=301168&type=pdf&coll=GUIDE&dl=GUIDE&CFID=19761061&CFTOKEN=10084975 Affordance, conventions, and design] Norman-1999-ACD
: How the original concept of affordances differs from how it has been used in HCI. (Adam) 16:22, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=DrhCCWmJpWUC&oi=fnd&pg=PA1&dq=ecological+approach+visual+perception&ots=TeE80z49Fr&sig=c0jHz0ucQUTFNvUM5ObQouQq_Oc The Ecological Approach to Visual Perception] Gibson-1986-EAV
: Outlines direct perception and the original theory of affordances. (Jon) 14:07, 3 February 2009.

* [http://ieeexplore.ieee.org/iel1/21/4054/00156574.pdf?tp=&arnumber=156574&isnumber=4054 Ecological interface design: Theoretical foundations] Vicente-1992-EID
: Theory of how interfaces can avoid forcing processing at a higher level than the task requires. (Jon) 14:56, 3 February 2009.

* [http://www.informaworld.com/smpp/ftinterface~content=a784403799~fulltext=713240930 The Ecology of Human-Machine Systems II: Mediating Direct Perception in Complex Work Domains] Vicente-2000-EHM
: Taking advantage of fast perceptual processes to reduce cognitive demands as applied to the design of a thermal-hydraulic system. (Jon) 14:56, 3 February 2009.

* [http://www.aaai.org/Papers/Workshops/1998/WS-98-09/WS98-09-020.pdf Acting on a visual world: The role of multimodal perception in HCI]. Wolff-1998-AVW.
: Experiment that has implications for gesture interpretation module development.

* [http://dl.acm.org/citation.cfm?id=1993063 Effects of motor scale, visual scale, and quantization on small target acquisition difficulty] Chapuis-2011-EMS
: In the first class, we talked about the problem with Windows Start menus -- how hard it is to navigate and select the right one. This study provides empirical evidence for this problem, confirming the difficulty of acquiring small-sized targets (like the menus) and identifying motor and visual sizes of the targets as limiting factors. ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://dl.acm.org/citation.cfm?id=1870080 Do predictions of visual perception aid design?] Rosenholtz-2011-DPV
: This paper asks the question: does the use cognitive and perceptual models actually help (in this case, the process of design)? They find that "the models can help, but in somewhat unexpected ways": ""goodness" values were not very useful" but it "seemed to facilitate communication ... about design goals and how to achieve those goals". ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://dl.acm.org/citation.cfm?id=1753357 Crowdsourcing Graphical Perception: Using Mechanical Turk to Assess Visual Design], Heer and Bostock, CHI '10
: This paper explores crowdsourcing as a viable method for conducting visualization perception evaluations. They replicate some results of Cleveland and McGill's 1984 graphical perception paper, and do some analysis on cost and performance of using MTurk for these studies on static, chart-type visualizations. ([[User:Steven Gomez|Steven Gomez]])

==Cognition==

* Colin Ware: Visual Thinking: For Design
:Insight into some of the theory of cognition as it pertains to building visual interfaces (David)

* [http://en.wikipedia.org/wiki/Seven_plus_or_minus_two Wikipedia's Seven Plus or Minus Two page]
:A clear description of one part of human thinking; will probably provide pointers to other things to read (David)

* [http://en.wikipedia.org/wiki/Hick%27s_law Wikipedia's Hick's Law page]
: Hick's law describes the relationship between the decision-making time and the number of possible choices. (Hua)

* [http://portal.acm.org/citation.cfm?id=108844.108865 A cognitive model for the perception and understanding of graphs] Lohse-1991-CMP
: Describes a computer program that predicts response time to a query from assumptions from eye-tracking, short-term memory capacity, and the amount of information that can be absorbed from the query in each "glance." Attempts to lay the foundation for explaining several steps of human cognition, including input, memory, and processing. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.informaworld.com/smpp/content~content=a784395566~db=all~order=page Cognitive load during problem solving: Effects on learning] John Swiller
: Older article but referenced in a lot of newer ones; looks at how conventional problem-solving is ineffective as a learning device. (lisajane)

* [http://web.ebscohost.com/ehost/pdf?vid=1&hid=4&sid=13a77fd7-bead-41ce-bfb1-38addb0dfa53%40sessionmgr7 Dimensional overlap: Cognitive basis for stimulus–response compatibility—A model and taxonomy] Kornblum-1990-DOC
: People are more effective at a task when the stimulus and response representations are compatible and they don't require "translation". (Adam) 16:22, 26 January 2009 (UTC)

* [http://vis.cs.brown.edu/~trevor/Papers/Iverson-TNR-ImPact.pdf Tracking Neuropsychological Recovery Following Concussion in Sport]
: This paper discusses the neurological basis for the ImPact test given to athletes after they've suffered a concussion. It provides testing and quantitative measures for verbal memory, visual memory, and reaction times. These simple measures of cognition may be useful to incorporate in an HCI study. (Trevor)

A Framework of Interaction Costs in Information Visualization
:ABSTRACT: Interaction cost is an important but poorly understood factor in visualization design. We propose a framework of interaction costs inspired by Norman’s Seven Stages of Action to facilitate study. From 484 papers, we collected 61 interaction-related usability problems reported in 32 user studies and placed them into our framework of seven costs: (1) Decision costs to form goals; (2) System-power costs to form system operations; (3) Multiple input mode costs to form physical sequences; (4) Physical-motion costs to execute sequences; (5) Visual-cluttering costs to perceive state; (6) View-change costs to interpret perception; (7) State-change costs to evaluate interpretation. We also suggested ways to narrow the gulfs of execution (2–4) and evaluation (5–7) based on collected reports. Our framework suggests a need to consider decision costs (1) as the gulf of goal formation.
: Includes some ideas for quantitatively evaluating information visualization interfaces (David)

*Distributed Cognition as a Theoretical Framework for HCI (1994) Christine A. Halverson [http://hci.ucsd.edu/cogsci/faculty_pubs/9403.ps]


* [http://consc.net/papers/extended.html The Extended Mind] Clark-1998-TEM
: Cognition can be thought to be distributable across mediums (outside of the skull). How might we off-load "cognitive" processes to computer systems? ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - Owner)
: I think that Ware gets into this in some of his writing about information visualization (or in his second book, thinking with visualization). We can build in external "caches" or other constructs to be part of our cognitive model. It seems like most of an analytical user interface is part of the external cognitive process. (David)


* [http://courses.csail.mit.edu/6.803/pdf/dualtask.pdf Sources of Flexibility in Human Cognition: Dual-Task Studies of Space and Language] HermerVazquez-1999-SFC
: Our use of language serves as a higher-order cognitive system which can be utilized as "scaffolding" in human thought, supporting goal-driven tasks. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.bcp.psych.ualberta.ca/~mike/Pearl_Street/PSYCO354/pdfstuff/Readings/Evans2.pdf In two minds: dual-process accounts of reasoning] Evans-2003-ITM
: It is hypothesized that there are two distinct systems of reasoning in the mind. System 1 is innate and fast, system 2 is controlled and slow. Knowledge of this might help us determine which tasks are candidates for one system or another. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6WJB-467J83F-3&_user=489286&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=316065013955ca22e9dde19df6a0f9b8 Priming against your will: How accessible alternatives affect goal pursuit] Shah-2002-PAY
: The authors demonstrate how priming the means to achieving a goal also primes the goal, but inhibits alternative means to achieving the same goal. It means that making the means of achieving a goal salient in an interface will make it more likely that people pursue that goal, and less likely that they will think of other means to pursue it. (Adam)

* [http://dl.acm.org/citation.cfm?id=1658355 Computational visual attention systems and their cognitive foundations: A survey] Frintrop-2010-CVA
: This paper "provides an extensive survey of the grounding psychological and biological research on visual attention as well as the current state of the art of computational systems". It should make for good background reading if we want to work with visual attention (detecting regions of interest in images). ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)
: Owner: [[User:Nathan Malkin|Nathan Malkin]]

* [http://dl.acm.org/citation.cfm?id=1518701.1518717&coll=DL&dl=GUIDE&CFID=42040751&CFTOKEN=34436229 Getting inspired!: understanding how and why examples are used in creative design practice] Herring-2009-GIU
: A user study on the use of examples to improve creativity. Results show that examples are very useful to inspire designers of new ideas. Surprisingly, inspiring examples are not limited to the ones in the design domain, but are expanded to other areas too.

*[http://www.sciencedirect.com/science?_ob=MiamiImageURL&_cid=271802&_user=489286&_pii=S0747563210002852&_check=y&_origin=&_coverDate=31-Jan-2011&view=c&wchp=dGLbVBA-zSkWA&md5=b7ee648939c3d41e25e3317f8be617dc/1-s2.0-S0747563210002852-main.pdf Contemporary cognitive load theory research: The good, the bad and the ugly] Kirschner-2010-CCL
: This review summarizes and critiques 16 papers on cognitive load theory (CLT) and its impact on learning and ability to navigate different environments. It also discusses the difficulties inherent to the study of cognitive and moves made to attack them. While the paper does not contribute directly to our research, it does provide background on some of the issues of usability and "tolerance" of HCI systems that we discussed last week. [[User:Clara Kliman-Silver|Clara Kliman-Silver]] 13:54, 18 September 2011 (EDT)

*[http://cacm.acm.org/magazines/2003/3/6879-models-of-attention-in-computing-and-communication/fulltext Models of attention in computing and communication: from principles to applications] Horvitz-2003-MAC
: [[User:Jenna Zeigen|Jenna Zeigen]] 10:50, 19 September 2011 (EDT)

==HCI==

* [http://portal.acm.org/citation.cfm?id=1357054.1357125&coll=portal&dl=ACM&type=series&idx=SERIES260&part=series&WantType=Proceedings&title=CHI&CFID=20781736&CFTOKEN=83176621 A diary study of mobile information needs]

:A detailed study into how people use mobile devices. '''(Andrew Bragdon - OWNER for Assignment 2)'''

* [http://portal.acm.org/citation.cfm?id=1357054.1357187&coll=Portal&dl=GUIDE&CFID=21136843&CFTOKEN=23841774 Feasibility and pragmatics of classifying working memory load with an electroencephalograph]

:Examines how practical it is to use electroencephelographs to measure cognitive load, and discusses domain-specific knowledge needed.

* [http://delivery.acm.org/10.1145/1250000/1240669/p271-hurst.pdf?key1=1240669&key2=6465483321&coll=GUIDE&dl=GUIDE&CFID=20565232&CFTOKEN=69614228 Dynamic Detection of Novice vs Skilled Use]

:Used a learning classifier, trained on low-level mouse and keyboard usage patterns, to identify novice and expert use dynamically with accuracies as high as 91%. This classifier was then used to provide differrent information and feedback to the user as appropriate.

* [http://portal.acm.org/citation.cfm?id=1054972.1055012&coll=GUIDE&dl=ACM&CFID=20565232&CFTOKEN=69614228 Bubble Cursor]

:Example of a paper which demonstrated a novel interaction technique still obeys Fitts's law.

* [http://tlaloc.sfsu.edu/~lank/research/appearing/FSS604LankE.pdf Sloppy Selection]

:Utilized a quantiative model of user performance which used curvature to predict the speed of a pen as it moved across a surface to help disambiguate target selection intent.

* [http://delivery.acm.org/10.1145/1250000/1240730/p677-iqbal.pdf?key1=1240730&key2=4525483321&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 Disruption and Recovery of Computing Tasks]

:Studied task disruption and recovery in a field study, and found that users often visited several applications as a result of an alert, such as a new email notification, and that 27% of task suspensions resulted in 2 hours or more of disruption. Users in the study said that losing context was a significant problem in switching tasks, and led in part to the length of some of these disruptions. This work hints at the importance of providing affordances to users to maintain and regain lost context during task switching.

* [http://portal.acm.org/citation.cfm?id=985692.985715&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 A diary study of task switching and interruptions]

:Showed that task complexity, task duration, length of absence, and number of interruptions all affected the users' own perceived diffuclty of switching tasks. (Andrew Bragdon)

* John M. Carroll: HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science

:A gargantuan book with chapters by many folks describing some of the models and theories from HCI that may relate back to cognition; may need to create individual (David)

* [http://portal.acm.org/citation.cfm?id=1461832&dl=&coll= Project ernestine: validating a GOMS analysis for predicting and explaining real-world task performance]

: A study in which the [http://en.wikipedia.org/wiki/GOMS#cite_note-CHI92-1 GOMS] method is used to correctly predict the performance of call center operators using a new workstation. Might be interesting because of the methodology used to decompose the task into basic cognitive and perceptual actions, and then measuring these actions to evaluate the new interface. (Eric) The CPM (Critical Path Modeling) aspect used handles the parallel nature of several human components of HCI and seems to very accurately model the low level tasks from this study. (David)

* [http://www.informaworld.com/smpp/content~content=a784766580~db=all The Growth of Cognitive Modeling in Human-Computer Interaction Since GOMS]

* [http://portal.acm.org/citation.cfm?id=169059.169426&coll=Portal&dl=GUIDE&CFID=19188713&CFTOKEN=13376420 The limits of expert performance using hierarchic marking menus]
: Marking menus naturally facillitate the transition from novice to expert performance for command invocation, and have been quite influential over the years to research into menu techniques. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/302979.303053 Manual and gaze input cascaded (MAGIC) pointing]

: This is a system which combines gaze input (coarse-grained) and mouse input (fine-grained) to quickly target items. This is important because it "kind of" gets around Fitt's law by using gaze input to "warp" the cursor to the general vicinity of what the user wants to work on. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/985692.985727 If not now, when?: the effects of interruption at different moments within task execution] Adamczyk-2004-INN
: Presents task models of user attention. (Andrew Bragdon) (Adam - owner; [http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - discussant) '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:58, 28 January 2009 (UTC)

* [http://hfs.sagepub.com/cgi/reprint/44/1/62.pdf Ecological Interface Design: Progress and challenges] Vicente-2002-EID
: Discusses the implications of Ecological Interface Design (EID), a theoretical HCI framework, for designing human-computer interfaces and compares performance of EID-informed designs to other comtemporary approaches. (Owner: Jon)

* [http://doi.acm.org/10.1145/985692.985707 "Constant, constant, multi-tasking craziness": managing multiple working spheres.] Gonzalez-2004-CCM
: Empirical study of how information workers spend their time. Puts forward a theory of how users organize small individual tasks into "working spheres." (Andrew Bragdon - OWNER; Adam Darlow - Discussant; Steven Ellis - Discussant)
: Any visualization which is used extensively by a user over a period of time will be used in the context of that user's daily workflow. It is therefore essential to understand this larger workflow context to design the visualization application appropriately to fit the needs of real world users. This paper studies in detail the daily workflow tasks and patterns of work of analysts, managers and software developers in a medium-sized software company. This paper provides strong empirical evidence that users, rather than working on discrete and well-defined tasks, in reality, switch tasks on average every two to three minutes, and instead, work on larger thematically connected units of work (working spheres). In addition, the study found that users switched between these larger working spheres on average every 12 minutes. Thus, it is strongly indicated by this paper that many information workers are in a constant state of rapid fire multi-tasking. This suggests that for a visualization to be relevant to any of these information workers, it would need to fit into, and support, this workflow. This is just a first step towards understanding how users interact with visualizations in particular, however; future work that studies how users interact with visualizations as part of their larger daily work patterns is warranted, and would be an important component of a broad theory of visualization.

* [http://www.eecs.berkeley.edu/Pubs/TechRpts/2000/CSD-00-1105.pdf The state of the art in automating usability evaluation of user interfaces] Ivory-2000-SAA
: Presents a new taxonomy for automating usability analysis. Advantages of automated evaluation are purported to be advantages linked to efficiency, such as comparing alternate designs, uncovering more errors more consistently, and predicting time/error costs across an entire design. Breaks down a taxonomy with individual benefits and drawbacks of each method, and checks observations against existing guidelines (e.g. Smith and Mosier guidelines, Motif style guidelines, etc). Introduces several visual tools. Looks extremely relevant as a comprehensive survey of existing techniques. '''OWNER''': [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC) '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC) Discussant: Steven Ellis

* [http://www.hpl.hp.com/techreports/91/HPL-91-03.pdf User Interface Evaluation in the Real World: A Comparison of Four Techniques] Jeffries-1991-UIE
: Overview of the four major UI evaluation methods: heuristic evaluation, usability testing, guidelines, and cognitive walkthrough, followed by a comparison in their application to a case study. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ics.colorado.edu/techpubs/pdf/91-01.pdf Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces] Polson-xxxx-CWM
: Presents the concept of performing a hand walkthrough of the cognitive process, based on another theory of "learning by exploration." Strong results for a limited evaluation timeframe and little or no time for formal instruction of the interface for the user. The reviewer considers each behavior of the interface and its resultant effect on the user, attempting to identify actions that would be difficult for the "average" user. Claims that a given step will ''not'' be difficult must be supported with empirical data or theory. The application of cognitive theory early in the design process seems useful in avoiding costly redesigns when problems are identified later. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=142834&coll= Finding usability problems through heuristic evaluation] Nielsen-1992-FUP
: Emphasis on heuristic evaluation. Shockingly, usability experts are found to be better at performing this type of evaluation. Usability problems relating to elements that are completely missing from the interface are difficult to identify with this method when evaluating unimplemented designs. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://delivery.acm.org/10.1145/130000/128728/p152-jacob.pdf?key1=128728&key2=7032992321&coll=GUIDE&dl=GUIDE&CFID=19735001&CFTOKEN=82907542 The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look at is What you Get] Jacob-1991-UEM
: One of the first research papers to introduce eye tracking as a viable HCI technique. (Trevor)

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=1221372&isnumber=27434 Real-Time Eye Tracking for Human Computer Interfaces] Amarnag-2003-RTE
: Technical details about the implementation of a recent real-time eye-tracking system. (Trevor)

* [http://www.ipgems.com/present/swui_chi_20070502.pdf Semantic Web HCI: Discussing Research Implications] Degler-2007-SWH
: A workshop discussion from CHI 2007 discussing the idea of a "semantic internet" and its relevance to the HCI community. Discusses things like adaptive web interfaces, mashups, dynamic interactions, etc. (Trevor)

* [http://www.springerlink.com/content/u3q14156h6r648h8/fulltext.pdf Implicit Human Computer Interaction Through Context] Schmidtt-2000-IHC
: A highly cited paper discussing the notion of implicit HCI, including semantic grouping of interactions, and some perceptual rules. ('''Trevor - OWNER'''; Andrew Bragdon - discussant; '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:57, 28 January 2009 (UTC))

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1903_1 Cognitive Strategies for the Visual Search of Hierarchical Computer Displays] Anthony J. Hornof
: This article investigates the cognitive strategies that people use to search computer displays. Several different visual layouts are examined. (lisajane)

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1904_9 Unseen and Unaware: Implications of Recent Research on Failures of Visual Awareness for Human-Computer Interface Design] D. Alexander Varakin; Daniel T. Levin; Roger Fidler
: This article reviews basic and applied research documenting failures of visual awareness and the related metacognitive failure and then discuss misplaced beliefs that could accentuate both in the context of the human-computer interface. (lisajane)

* Shneiderman, Plaisant: Designing the User Interface
: My textbook for an HCI class, has many good lists of guidelines. Especially Ch.2 pp 59-102. (lisajane)

* Robert Mack, Jakob Nielsen: Usability Inspection Methods (Ch. 1 Executive Summary)
: Provides an overview of main usability inspection methods, a fair introduction to the industrial applications, as well as certain costs and benefits, of the methods as well as suggestions for expansive research. (Steven)

* [http://portal.acm.org/citation.cfm?id=22950 Jock Mackinlay, Automating the design of graphical presentations of relational information], ACM Transactions on Graphics (TOG), 5(2):110-141, 1986. (Jian)
: The first paper talked about how to automatically generate *good* graphs.

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=04376133 Jock Mackinlay, Pat Hanrahan, Chris Stolte, Show Me: Automatic Presentation for Visual Analysis] IEEE TVCG 13(6): 1137-1144, Nov-Dec, 2007 (Jian)
: Extend their previous paper to analytics tasks.

* [http://www.win.tue.nl/~vanwijk/vov.pdf Jarke J. van Wjik, The value of visualization], IEEE visualization 2005. (Jian)
: discuss vis from a variety of angles as for art, science and technology and question and quantify the utility of visualization.

* [http://www.almaden.ibm.com/u/zhai/papers/steering/chi97.pdf Johnny Accot and Shumin Zhai, Beyond Fitts' law: models for trajectory-based HCI tasks], CHI 97. (Jian)
: Extend Fitts' to trajectory based tasks.

*[http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=01703371 Saraiya, P., North, C., Lam, V., and Duca, K.A, An Insight-Based Longitudinal Study of Visual Analytics], TVCG 12(6): 1511-1522, 2006.(Jian)
: the first paper that quantifies what insight is by comparing several infoVis tools for bioinformatics.

*[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1359732 David H. Laidlaw, Michael Kirby, Cullen Jackson, J. Scott Davidson, Timothy Miller, Marco DaSilva, William Warren, and Michael Tarr.Comparing 2D vector field visualization methods: A user study]. IEEE Transactions on Visualization and Computer Graphics, 11(1):59-70, 2005. (Jian)
: an application-specific comparison of visualization method. a cool paper.

* [http://web.mit.edu/rruth/www/Papers/RosenholtzEtAlCHI2005Clutter.pdf Rosenholtz, Li, Mansfield, and Jin, Feature Congestion: A Measure of Display Clutter], CHI 2005. (Jian)
: quantify visual complexity from a statistics point of view.

* [http://delivery.acm.org/10.1145/240000/236054/p320-john.pdf?key1=236054&key2=2285613321&coll=GUIDE&dl=GUIDE&CFID=19490404&CFTOKEN=25744022 The GOMS Family of User Interface Analysis Techniques: Comparison and Contrast] (Trevor)
: This paper offers an analysis of four types of GOMS (Goals, Objects, Methods and Selection) based interaction techniques. GOMS is a widely used UI paradigm, made popular by Card et al in The Psychology of Human-Computer Interaction (1983).

* [http://vis.cs.brown.edu/~trevor/Papers/Lisetti-2000-AFE.pdf Automatic Facial Expression Interpretation: Where Human-Computer Interaction, Artificial Intelligence and Cognitive Science Intersect] (Trevor)
: Using advanced computer vision/AI techniques, this work aims to discern and make use of users' emotions in UI design.

* [http://vis.cs.brown.edu/~trevor/Papers/weld-2003-APU.pdf Automatically Personalizing User Interfaces] (Trevor)
: Discusses some techniques and design decisions for constructing adaptable and customizable user interfaces. There are some useful references in the paper on using HMMs and RMMs (Relational Markov Models) for interaction prediction.

* [http://vis.cs.brown.edu/~trevor/Papers/Gajos-2006-.pdf Exploring the Design Space for Adaptive Graphical User Interfaces] (Trevor)
: This paper presents comparative evaluations of three methods for implementing adaptable user interfaces. The evaluation methodology gives rise to three key concepts that affect the performance of adaptable UIs: frequency of adaptation, accuracy of adaptation, and the impact of predictability.

* Conceptual Modeling for User Interface Development - David Benyon, Diana Bental, and Thomas Green
: Proposes a new set of terminology for describing and comparing existing and future cognitive models of HCI. (Steven)

* [http://homepage.ntlworld.com/greenery/workStuff/Papers/ERMIA-Skull.pdf The Skull beneath the Skin: Entity-Relationship Models of Information Artefacts] T. R. G. Green, D. R. Benyon
: A paper in form of prelude to the above, gives a good overview of the ERMIA method. (Steven)

* [http://delivery.acm.org/10.1145/1130000/1125552/p454-akers.pdf?ip=138.16.160.6&CFID=41848857&CFTOKEN=88172531&__acm__=1315781624_3f3ff7dffae48746685278b9f2b7dabb Wizard of Oz for Participatory Design: Inventing a Gestural Interface for 3D Selection of Neural Pathway Estimates], Akers-2006-WOP.
:Designs an interactive visualization interface for 3D selection of neural pathways of human brains. The mouse based interface helps neuroscientists to select neural pathways more efficiently and intuitively. (--- [[User:Chen Xu|Chen Xu]] 15:04, 13 September 2011 (EDT) -OWNER)

* [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.123.3761&rep=rep1&type=pdf Could I have the Menu Please? An Eye Tracking Study of Design Conventions] McCarthy-2003-CMP
: This article examines eye tracking techniques as they pertain to improving search performance in user interfaces. Specific attention is given to menu organization in the context of Web interfaces. Although substantial progress has been made in the past decade, the article draws attention to relevant design issues and concepts, especially as eye tracking methodologies continue continue to grow and improve. (Clara, 11 September 2011--OWNER; Chen -- Discussant)

* [http://www.research.ibm.com/AVSTG/icassp_pose.pdf Audio-Visual Intent-To-Speak Detection For Human-Computer Interaction], Cuetos-2000-ISD.
:Discusses a speech detection system that uses both auditory and visual cues to more accurately detect speech commands. It aims to recognize the user's intention to speak, and to ignore background noise, or speech recognized as not being directed at the system. Although it is fairly dated, this paper is relevant in that it discusses applications of cognition/perception to HCI. [[User:Michael Spector|Michael Spector]] 13:19, 13 September 2011 (EDT)

* [http://dl.acm.org/citation.cfm?id=1959023 An exploration of relations between visual appeal, trustworthiness and perceived usability of homepages] Lindgaard-2011-ERB
: This paper is interesting and relevant to cognition+HCI because it attempts to differentiate between "judgments differing in cognitive demands (visual appeal, perceived usability, trustworthiness)" and see whether those tasks with more cognitive demand have different results. (The paper includes a model to account for these.)
: Also, this is interesting to Steve and me in the context of some of our discussions this past spring. (Apparently, yes: "all three types of judgments [including, crucially, trustworthiness] are largely driven by visual appeal".) ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://www.comp.leeds.ac.uk/umuas/reading-group/kaptelinin-ch5.pdf Activity Theory: Implications for Human-Computer Interaction] Kaptelinin--1996-ATI
: This article discusses activity theory, an alterate to present theories surrounding HCI. In particular, it examines the principle differences between activity theory and cognitive theory, applies it to HCI, and suggests implications for the field. While not directly relevant to the proposal, it offers an alternate framework for some of the issues that we discuss. (Clara, 12 September 2011)

* [http://pages.cpsc.ucalgary.ca/~saul/wiki/uploads/HCIPapers/landauer-letsgetreal.pdf Let's Get Real: a Position Paper on the Role of Cognitive Psychology in the Design of Humanely Usable and Useful Systems] Landauer-1991-LGR
: Perhaps less useful, only because it's 20 years old, but an interesting read nonetheless: this paper questions the "modern" relevance of cognitive psychology to human-computer interaction design. The primary issue, it argues, is that human-computer systems are entirely unpredictable, and thus, some of the modern understanding of cognition (and, indeed, HCI theory) simply cannot apply given the erratic behavior of computer systems. Instead, he addresses some of the more "useful models," including Fitt's law and theories of visual perception, to define a new space for emerging research in HCI. (Clara, 12 September 2011)

* [http://dl.acm.org/citation.cfm?id=1978942.1978969&coll=DL&dl=GUIDE&CFID=42040751&CFTOKEN=34436229 Mid-air pan-and-zoom on wall-sized displays] Nancel-2011-MPZ
: The paper describes approaches to perform pan and zoom tasks in mid-air: bimanual & unimanual, linear & circular gestures.

* [http://dl.acm.org/citation.cfm?id=1978942.1979430&coll=DL&dl=GUIDE&CFID=42040751&CFTOKEN=34436229 LiquidText: a flexible, multitouch environment to support active reading] Tashman-2011-LER
: A technique utilizing multitouch to improve reading efficiency.

* [http://dl.acm.org/citation.cfm?id=1978942.1979392&coll=DL&dl=GUIDE&CFID=42040751&CFTOKEN=34436229 Rethinking 'multi-user': an in-the-wild study of how groups approach a walk-up-and-use tabletop interface] Marshall-2011-RMU
: An ethnographic study that explores how groups of users approach tabletop interfaces in real environments. Some results contradict existing findings.

* [http://research.microsoft.com/en-us/um/redmond/groups/cue/publications/CHI2008-EMG.pdf Demonstrating the Feasibility of Using Forearm Electromyography for Muscle-Computer Interfaces] Saponas-2008-DFU
: Discusses the merits of HCI (here called muCI, for muscle-computer interaction) by detection of forearm muscle activity rather than manipulation of an object such as a mouse or keyboard. [[User:Michael Spector|Michael Spector]] 13:19, 13 September 2011 (EDT)

*[http://courses.ischool.utexas.edu/rbias/2009/Spring/INF385P/files/annurev.psych.54.101601.pdf HUMAN-COMPUTER INTERACTION: Psychological Aspects of the Human Use of Computing] Olson-2003-HCI
: Overview of issues in psychology in HCI ([[User:Jenna Zeigen|Jenna Zeigen]], 9/12/11)

* [http://www.sciencedirect.com/science?_ob=MiamiImageURL&_cid=271802&_user=489286&_pii=S0747563210001718&_check=y&_origin=&_coverDate=30-Nov-2010&view=c&wchp=dGLzVlt-zSkzS&md5=06d9eeba2447db1d43abcf99d1d7e995/1-s2.0-S0747563210001718-main.pdf Integrating cognitive load theory and concepts of human–computer interaction] Hollender-2010-ICL
: This paper compares existing models of cognitive load theory as it applies to HCI, reviews present literature, and discusses current problems and potential advances. Relevant to our work but ventures into theory that is heavier than necessary given our purposes. ([[User:Clara Kliman-Silver|Clara Kliman-Silver]] 15:58, 18 September 2011 (EDT))

===Cognitive Modeling===

* [http://vis.cs.brown.edu/~trevor/Papers/Kaptelinin-1994-ATI.pdf Activity Theory: Implications for Human-Computer Interaction] (Trevor)
: Discusses the notion of Activity Theory as the basis for HCI research. The most interesting part of this paper for me was the introduction which expressed the need for a ''Theory of HCI''.

* [http://en.wikipedia.org/wiki/Seven_stages_of_action Norman's Seven stages of action]
: Presents Norman's seven stages of action, as well as his model of evaluation. (Steven)

* [http://vis.cs.brown.edu/~trevor/Papers/Wright-2000-AHC.pdf Analyzing Human-Computer Interaction as Distributed Cognition: The Resources Model] (Trevor)
: Creates a compelling argument for why distributed cognition research fits in with HCI, and what types of impacts it may have on the HCI community.

* [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.100.445&rep=rep1&type=pdf Eye Tracking in Human-Computer Interaction and Usability Research: Ready to Deliver the promises] Jacob-2003-ETH
: This paper (book chapter) looks beyond the relevance of eye tracking methodologies to HCI and instead addresses the data produced. It examines various approaches to analysis and the implications and conclusions that can be drawn. Given that eye tracking is often coupled with other inputs, such as a mouse or a keyboard, analysis is rarely clear-cut: other variables, such as error, saccades, and speed must be factored in. Moreover, eye movements are far less deliberate than mechanical (i.e. mouse) input, and so errors must be handled differently. The chapter discusses each of these issues and subsequently offers solutions. In general, the article argues for the importance of eye tracking, considering it as a central component of HCI methodology. (Clara, 11 September 2011)

* [http://sonify.psych.gatech.edu/~walkerb/classes/hci/extrareading/nardi.pdf Studying Context, A Comparison of Activity Theory, Situated Action Models, and Distributed Cognition] Bonnie A. Nardi
: Defines the task of the HCI specialist as the application of psychological and anthropological principles to specific design problems. It posits an inherent feud between the accurate study of relative contexts and the necessary, but more general, development of comparative models and results. Gives a coherent overview of activity theory, situated action models, and distributed cognition; finds that activity theory presents the best overall framework. There is little reason given for this ranking, however, and the description of activity theory is the most theoretical and least developed of the three.
: Having spent quite a bit of time studying Soviet psychology (from which came activity theory) last semester, I question the validity of the paper’s claim, as its description of activity theory bears the artifacts of the oppressive regulations which the Soviet government imposed on psychologists. Although the theory may sound more practical, it seems fairly weak as a basis for empirical design analysis.
: The paper’s strongest point is the criticisms which follow descriptions, in which theoretical shortcomings of each perspective are discussed. ('''Owner:''' Steven, '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC))

* [http://www.billbuxton.com/chunking.html Chunking and Phrasing and the Design of Human-Computer Dialogues]
: High-level theory of human-computer dialogues. (Andrew Bragdon)

* Polson, P. and Lewis, C. Theory-Based Design for Easily Learned Interfaces. Human-Computer Interaction, 5, 2 (June 1990), 191-220.
: This is a cognitive model of how users find and learn commands in an unfamiliar user interface. This could potentially be adapted to be a piece of a theory of visualization. (Andrew Bragdon)

* [http://www.syros.aegean.gr/users/tsp/conf_pub/C12/c12.pdf Activity Theory vs Cognitive Science in the Study of Human-Computer Interaction]
: Provides a brief history of Cognitive Science and HCI, then compares the effectiveness of the aforementioned theories in aiding design and development. (Owner - week 2 : Steven)

* [http://www.sciencedirect.com/science?_ob=PublicationURL&_tockey=%23TOC%236829%232001%23999449998%23287248%23FLP%23&_cdi=6829&_pubType=J&_auth=y&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=64b44ef6df77ae073d41a7367db866b5 International Journal of Human-Computer Studies - Special Issue on Cognitive Modeling]
:Articles all concerning various issues of cognitive modeling as relates to HCI. (Steven)

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6VDC-4811TNB-5&_user=10&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=259b5c105222437fc84990b7a1eaedee The role of cognitive theory in human–computer interface]. Chalmers, Patricia A, 2003.
:Was scared again, but no need to be. Touches only on a subset of cognitive theories (Schema theory, Cognitive load, and retention theories) and undertakes a survey of some software design theories, but does not attempt an explicit mapping between the two. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=26115.26124 Design Guidelines]. Marshall, Nelson, and Gardiner, 1987.
:Attempt to apply cognitive psychology to user-interface design. Here, the opposite problem is seen—the author's make no significant attempt to take existing heuristic guidelines into account. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://www.cognitivedesignsolutions.com/ Cognitive Design Solutions, Inc.]
:Training and consulting firm that claims to take advantage of Cognitive Design in making design and performance improvements. [[User:E J Kalafarski|E J Kalafarski]] 13:50, 20 February 2009 (UTC)

* [http://infolab.uvt.nl/research/lap2003/agerfalk.pdf Actability Principles in Theory and Practice]. Agerfalk, Par J, 2003.
:Presents a set of nine contemporary principles for the evaluation of IT systems ("social tools to perform communicative action") based explicitly on cognitive principles. Introduces a notion comparable to usability called ''actability''. Presents a mapping for some basic usability principles to some seminal sets of guidelines. [[User:E J Kalafarski|E J Kalafarski]] 14:29, 20 February 2009 (UTC)

* [http://en.wikipedia.org/wiki/ACT-R Wikipedia page for ACT-R]
:ACT-R is a cognitive architecture developed at CMU. It aims to define the basic cognitive and perceputal operations of human mind. (Hua)

* [http://en.wikipedia.org/wiki/Soar_%28cognitive_architecture%29 Wikipedia page for Soar]
:Soar is another cognitive architecture developed at CMU, now maintained in UMich. (Hua)

* [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.168.4719&rep=rep1&type=pdf Brain-Computer Interfaces and Human-Computer Interaction]
: (Not sure what heading this ought to go under!) Brain-Computer Interfaces (BCI) offer a neurological corollary to human-computer interfaces: users use their thoughts to signal to machines, instead of relying on physical movements. Thus, the areas activated are purely cognitive, not motor. The article provides an overview of the differences between HCI and BCI, the implications thereof, and the directions that their interaction may take. Relevant to some of the issues and concepts raised in the proposal, in addition to being a rather interesting idea! (Clara, 12 September 2011)

* [http://act-r.psy.cmu.edu/publications/pubinfo.php?id=101 Spanning Seven Orders of Magnitude: A Challenge for Cognitive Modeling], John Anderson, 2002
: The paper argues that high-level human behavior can be understood by analyzing the chain of fast, low level activity (from 10ms up) in the perceptual/cognitive bands that compose larger behaviors. It gives an intro to ACT-R and variants and some compelling examples for cognitive modeling and eye-tracking. ([[User:Steven Gomez|Steven Gomez]])

*[http://search.ebscohost.com.revproxy.brown.edu/login.aspx?direct=true&db=psyh&AN=2003-08881-009&site=ehost-live Cyberpsychology: A Human-Interaction Perspective Based on Cognitive Modeling] Emond-2003-CHI
:This paper talks about for the applicability of cognitive modeling to cyberpsychology, the study of the impact of computer and Internet interaction on humans. ([[User:Jenna Zeigen|Jenna Zeigen]], 9/12/11)

* [http://delivery.acm.org/10.1145/1980000/1978559/p62-modha.pdf?ip=138.16.160.6&CFID=41737444&CFTOKEN=92942121&__acm__=1315949230_6e20807eca999db6a25f54bcbf51ae6a Cognitive Computing], Modha-2011-CC
: Unite neuroscience, supercomputing, and nanotechnology to discover, demonstrate, and deliver the brain’s core algorithms. (--- [[User:Chen Xu|Chen Xu]] 17:25, 13 September 2011 (EDT) -OWNER)

* [http://rp-www.cs.usyd.edu.au/~whua5569/papers/infovis09.pdf Measuring effectiveness of graph visualizations: a cognitive load perspective] Huang-2009-JIV
: (This item can also go into the Evaluation category) This paper discusses the cognitive load theory and its application in measuring effectiveness of graph visualization. A model of user task performance, mental effort and cognitive load has been proposed and experiments have been conducted to refine the model. This seems to be an attempt along the line of defining quality metrics for visualization through cognitive modeling, which then closely relates to our proposal. (Hua)

* [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.123.4716&rep=rep1&type=pdf Supporting Collaboration and Distributed Cognition in Context-Aware Pervasive Computing Environments] Fischer-2004-SCD
: (Not exactly sure where this paper belongs.) The paper looks at several issues in HCI: 1) collaborative design (multiple users accessing, manipulating, and addressing information, in what they call "large computational spaces"), 2) mobile technology (mobile phones, wireless, etc.), and 3) smart objects (seems to be largely mobile phones and similar devices). This paper is dated and parts of it are very interesting but equally irrelevant. Nonetheless, it asks some important questions about how to deliver information to the user, how to manage search techniques and memory systems (particularly with searching) in HCI, and how to access information, all of which are crucial to "modern" HCI research. ([[User:Clara Kliman-Silver|Clara Kliman-Silver]] 17:15, 18 September 2011 (EDT))

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4154947 Gesture Recognition : A Survey] IEEE
: This article provides a survey on gesture recognition with particular emphasis on hand gestures and facial expressions. Applications involving hidden Markov models, particle filtering and condensation, finite-state machines, optical flow, skin color, and connectionist models are discussed in detail. ([[User:Wenjun Wang|Wenjun Wang]] , 18 September 2011 (EDT))

==Design==

* Wikipedia articles on [http://en.wikipedia.org/wiki/A_Pattern_Language "A Pattern Language"] and [http://en.wikipedia.org/wiki/Design_pattern "Design Pattern"]
:see summary for Alexander below (David)

* UI Design principles (feedback, etc -- find ref)

* Alexander: A Pattern Language: Towns, Buildings, Construction
:The original design pattern source; what makes a human space work, ineffable best practices, ~250 rules is enough to do communities and house-sized artifacts; could be a good metaphor for making; could be a good metaphor for making human virtual space work? (David)

* [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.113.5121&rep=rep1&type=pdf On tangible user interfaces, humans, and spatiality] Sharlin-2004-TUI
: Considers a range of user interfaces, ranging from the ordinary computer mouse to the cognitive cube, and the heuristics that underly their use. The article covers the logic that lies behind tactile user interfaces, with an eye to the cognitive systems and spatial relations involved. (Clara, 11 September 2011)

* [http://useraware.iict.ch/uploads/media/TangibleBits.pdf Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms] Ishii-1997-TBT
:A specific UI proposal, but has nice relevant discussion on how we perceive "foreground" items and "background" items and their relationship, taking advantage of this "parallel" processing of perception. Includes the use of visual metaphors, phicons, and a notion they invent called "digital shadows," in which the shadow projected by an object conveys some information on its contents. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://list.cs.brown.edu/courses/csci1900/2007/documents/restricted/beale.pdf Slanty Design] Beale-2007-SD
:Design method with emphasis on discouraging undesirable behavior, by perhaps forcing the user to adapt to the interface, giving equal weight to user goals, user "non-goals," and wider goals of stakeholders besides the immediate user. The important insight seems to be that these wider goals can enhance the user's experience with the larger system in the long run, if not in the immediate timeframe. Five major design steps. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.amazon.com/Designing-Interactions-Bill-Moggridge/dp/0262134748/ref=pd_bbs_sr_1?ie=UTF8&s=books&qid=1232989194&sr=8-1 Designing Interactions] by Bill Moggridge
: Really awesome book on the evolution of interactions with technology. (Trevor)

* [http://www.amazon.com/Sketching-User-Experiences-Interactive-Technologies/dp/0123740371/ref=sr_1_1?ie=UTF8&s=books&qid=1232989269&sr=1-1 Sketching User Experiences] by Bill Buxton
: Another great book on the practices of interaction design. (Trevor)

* [http://site.ebrary.com/lib/brown/docDetail.action?docID=10173678 The Laws of Simplicity] by John Maeda
: An interesting work on the efficiency of minimalist design. Quick read for those interested. (Steven)
: A set of design guidelines some of which we may be able to build on in automating interface evaluation; will certainly apply to manual evaluations [[User:David Laidlaw|David Laidlaw]]

* [http://www.cs.umd.edu/hcil/pubs/presentations/eyeshaveit/index.htm Ben Shneiderman, The Eyes Have It: User Interfaces for Information Visualization], UM, tech-report, CS-TR-3665. (Jian)
: the paper talks about visualization mantra.

* [http://hci.rwth-aachen.de/materials/publications/borchers2000a.pdf A pattern approach to interaction design] Borchers-2001-PAI
: A highly-cited work on the development of a language for defining design patterns for use in interface development, with an emphasis on communication between application developers and application domain experts. [[User:E J Kalafarski|E J Kalafarski]] 16:37, 3 February 2009 (UTC)

* [http://dl.acm.org/citation.cfm?id=1979100 Understanding Interaction Design Practices], Goodman et al., CHI '11 (Owner: Diem Tran - Steven, if you already own this, let me know)
: This is a position paper describing the disconnect between HCI research and real interaction design practices. It analyzes approaches for studying design practice (e.g., reported practice, anecdotal descriptions, first-person research), and argues a need for generative theories of design in order to address practice. ([[User:Steven Gomez|Steven Gomez]])

==Thinking, analysis, decision making==

* Morgan D. Jones: The Thinker's Toolkit: Fourteen Powerful Techniques for Problem Solving

:Set of methods for solving problems that might be incorporated into tools for thinking (David)

* Keim, Shazeer, Littman: Proverb: The Probabilistic Cruciverbalist

:An automatic crossword-puzzle solver; the software framework for building this program may be a metaphor for some thinking groupware with plug-in modules. (David)

* Thomas, Cook: Illuminating the Path

:a research agenda for tools for intelligence analysts; not sure of relevance (David)

* Richard Thaler, Cass Sunstein: Nudge - Improving Decisions About Wealth, Health, and Happiness
: A great, easy read for someone who isn't familiar with the psychological perspective. Focuses mainly on public policy issues, but certain sections (on developing a better social security website, for example) relate specifically to digital design. (Steven)

* [http://www.cs.brown.edu/people/trevor/Papers/Heer-2008-GraphicalHistories.pdf Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation] (InfoVis 2008)
: Work by Jeff Heer of Stanford (formerly Berkley) on using Graphical Interaction Histories within the Tableau InfoVis application. This is a great recent example of "workflow analysis" that we've been discussing in class. Though geared toward two-dimensional visualizations with clearly defined events, his work offers some very useful design guidelines for working with interaction histories, including evaluations from the deployment of his techniques within Tableau. (Trevor)

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Gotz-2008-CUV.pdf Characterizing Users' Visual Analytic Activity for Insight Provenance]
: The authors look into combining user triggered and automatically generated vis. histories.

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Isenberg-2008-ESV.pdf An exploratory Study on Visual Information Analysis]
: The authors run a user study to find the tasks involved in collaborative evidence aggregation

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Robinson-2008-CSV.pdf Collaborative Synthesis of Visual Analytic Results]
: Same as the previous one.

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Pirolli-2005-SPL.pdf The sensemaking process and leverage points for technology]
: The authors propose a model of analysis and identify leverage points for visualization.

==Visualization==

* [http://dl.acm.org/citation.cfm?id=1495824 Data, Information, and Knowledge in Visualization], Chen et al., CG&A Jan 09

* [http://dl.acm.org/citation.cfm?id=1658353 Volume composition and evaluation using eye-tracking data] Lu-2010-VCE
: Brain data sets are huge, and rendering all the information they contain (at the same time) is almost impossible. To deal with this problem, we could use the approach proposed in this paper (with different data): choosing rendering parameters based on where the user's attention is focused, using eye tracking data to determine that. ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://dl.acm.org/citation.cfm?id=1773971 Neural modeling of flow rendering effectiveness]
: This paper provides a comparison and discussion of "the relative strengths of different flow visualization methods for the task of visualizing advection pathways". This could be useful in selecting visualization methods for the brain circuits software. (As an added bonus, they cite Laidlaw et al.'s "advection task" right there in the abstract.) ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://dl.acm.org/citation.cfm?id=1399136 Toward a Perceptual Theory of Flow Visualization], Colin Ware, CG&A March 08
: This paper is a good entry point for Ware's other work on neural modeling for visualization. It describes how spatial receptor patterns in the visual cortex enable contour interpretation and related visualization tasks (e.g., particle advection in flow fields). There's also some good discussion about a perception-based approach to visualization, validating visual mappings with perceptual theories. ([[User:Steven Gomez|Steven Gomez]])

* [http://dl.acm.org/citation.cfm?id=1137505 An Approach to the Perceptual Optimization of Complex Visualizations], House, Bair, and Ware, TVCG, 2006
: This paper describes a humans-in-the-loop architecture for guiding layered visualizations with multiple visual parameters toward optimal tunings. They use a genetic algorithm to iteratively produce new "genomes" of visual parameters that are evaluated by humans (and either passed along or terminated in the genetic process). Finally they do some analysis on the surviving visualization space (though for me, this was less interesting than the generative visualization method using humans and the GA). ([[User:Steven Gomez|Steven Gomez]])

* [http://dl.acm.org/citation.cfm?id=1773970 Evaluating 2D and 3D visualizations of spatiotemporal information] Kjellin-2008-E23
: A frequent topic of interest to brain scientists is longitudinal data: how does the brain change over time? If the brain circuits software were to support answering this kind of question, we might evaluate different approaches to visualization using the methods in this paper. ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

*[http://ejournals.ebsco.com.revproxy.brown.edu/Direct.asp?AccessToken=6VFL2LL89KIIOIXL2I3O9IOHVIC28L2MMF&Show=Object Cognitive Models of the Influence of Color Scale on Data Visualization Tasks] -Breslow-2009-CMI
: Discusses the ways color scales and differences can be influential in the optimization of data visualization and analysis ([[User:Jenna Zeigen|Jenna Zeigen]], 9/12/11) -- '''Owner: Jenna Zeigen'''

* [http://delivery.acm.org/10.1145/1180000/1179816/p168-klein.pdf?ip=138.16.160.6&CFID=41737444&CFTOKEN=92942121&__acm__=1315948835_60407af6754ff14995331d7da5b2e5f2 Brain structure visualization using spectral fiber clustering] Klein-2006-BSV
: Present a novel algorithm that allows for visualizing white matter fiber tracts in real time. And the result is more accurate. This visualizing algorithm might be adopted in our proposal. ( --- [[User:Chen Xu|Chen Xu]] 17:21, 13 September 2011 (EDT) -OWNER)

* [http://delivery.acm.org/10.1145/570000/566646/p745-van_wijk.pdf?ip=138.16.160.6&CFID=45026276&CFTOKEN=25635165&__acm__=1316442526_0ba5fadd25f8f9e571d2e63ba88f17f9 Image Based Flow Visualization] van Wijk-2002-IBF
: Talked about a two-dimensional fluid flow visualization method which was based on advection and decay of dye. It was called IBFV, with IBFV, a wide variety of visualization techniques can be emulated. It can visualize flow, generate arrow plots, streamlines, particles and topological images, and handle unsteady flows.(Chen)

* [http://onlinelibrary.wiley.com/doi/10.1111/j.1467-8659.2004.00753.x/full The State of the Art in Flow Visualization: Dense and Texture-Based Techniques] Laramee-2004-SAF
: Discussed dense, texture-based flow visualization techniques. (Chen)

*[http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=1382909 Interactive Visualization of Small World Graphs] van Ham-2004-IVS
: [[User:Jenna Zeigen|Jenna Zeigen]] 11:03, 19 September 2011 (EDT)

*[http://books.google.com/books?hl=en&lr=&id=wdh2gqWfQmgC&oi=fnd&pg=PR13&dq=visualization&ots=olzI7xnGLy&sig=7F0m2_NpZcU-fr0V5CPzf99PpK4#v=onepage&q&f=false Readings in information visualization: using vision to think ] By Stuart K. Card, Jock D. Mackinlay, Ben Shneiderman.
( [[User: Wenjun Wang | Wenjun Wang]] 11:09, 19 September 2011 (EDT))

==Evaluation and Metrics==
* [http://dl.acm.org/citation.cfm?id=1640255 Creativity factor evaluation: towards a standardized survey metric for creativity support] Carroll-2009-CFE
: One alternative to evaluating visualizations and other tools based on the amount of time they save is evaluating them based on how much they help creativity. This paper presents a survey metric for creativity support tools. ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://dl.acm.org/citation.cfm?id=1970381 Measuring multitasking behavior with activity-based metrics] Bebunan-Fich-2011-MMB
: When designing interfaces for scientists, we must be mindful of the fact that (like all users) they will be multitasking -- both in terms of cognitive tasks (drawing from multiple sources, evaluating different hypotheses, etc.) and (if the interface allows it) tasks within the software. This paper proposes a definition of multitasking and provides a set of metrics for (computer-based) multitasking. ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://www2.iwr.uni-heidelberg.de/groups/CoVis/Data/Papers/euroVis10.pdf A Salience-based Quality Metric for Visualization] Jänicke1-Chen-2010
: This paper describes a method for defining quality metrics for visualization based on the distribution of salience over a visualization image. ([[User:Hua Guo|Hua]])

* [http://delivery.acm.org/10.1145/990000/989880/p109-plaisant.pdf?ip=138.16.160.6&CFID=41672001&CFTOKEN=81772969&__acm__=1315932639_76770a28b192503c5f3c0ac3f997a8f1 The Challenge of Information Visualization Evaluation] Plaisant-2004
: This paper surveys the field of information visualization evaluation - current practices, challenges and possible next steps. It is a relatively old article, though, so it may be replaced by a more concurrent survey. ([[User:Hua Guo|Hua]])

* [http://delivery.acm.org/10.1145/1170000/1168162/a9-zuk.pdf?ip=138.16.160.6&CFID=41672001&CFTOKEN=81772969&__acm__=1315932894_18cbcddc03c6ac39fc573f72790ea5d1 Heuristics for Information Visualization Evaluation] Zuk et al-2006
: This paper attempts to leverage some well-known heuristic evaluation used in HCI to Information Visualization. ([[User:Hua Guo|Hua]])

==Development==

* [http://dl.acm.org/citation.cfm?id=1879836 Parallel prototyping leads to better design results, more divergence, and increased self-efficacy] Dow-2010-PPL
: Not too relevant to the cognition aspects of the proposals, but provides some empirical support for "fast iteration" and related software design techniques, whose virtues are extolled in the proposals. The lesson: if we're going to prototype something for this class, and we want "better design results, more divergence, and increased self-efficacy", we should do it in parallel! ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://leadserv.u-bourgogne.fr/files/publications/000599-multi-label-classification-of-music-into-emotions.pdf MULTI-LABEL CLASSIFICATION OF MUSIC INTO EMOTIONS] ISMIR 2008
: Humans, by nature , are emotionally affected by music. This paper is an interdisciplinary one, which approaches towards automated emotion detection in music. Four algorithms are evaluated and compared in this task ([[User:Wenjun Wang|Wenjun Wang]], 19 September 2011)

CS295J/Literature

2011-09-19T15:10:36Z

Wenjun Wang: /* Visualization */

==Perception==

* Colin Ware: Information Visualization: Perception for Design
:Insight into some of the theory of perception as it pertains to building visual interfaces (David)

* Some unindentified paper(s)/book(s) about Gestalt theories of perception and cognition [http://en.wikipedia.org/wiki/Gestalt_psychology wikipedia page]
:These theories, from the 40's inform visual design and may provide an analogy for integration of theory and practice. They describe some characteristics of perception that have been used as evaluative rules in UI design. (David)

* [http://vrlab.epfl.ch/~pglardon/VR05/papers/chi2004.pdf Feeling Bumps and Holes without a Haptic Interface: the Perception of Pseudo-Haptic Textures] Lecuyer-2004-FBH
: A cool technique on "hacking" human perception by modifying the control/display ratio of visible elements to simulate haptic feedback for the user. Strong analysis of which parts of haptic feedback are useful (e.g., vertical elements can be discarded). Pseudo-haptic feedback is implemented by combining the use of visible feedback with the changing sensitivity of a passive input device (e.g., a mouse). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=267474 Research issues in perception and user interfaces] Encarnacao-1994-RIP
: "The authors focus at on three things: presentation of information to best match human cognitive and perceptual capabilities, interactive tools and systems to facilitate creation and navigation of visualizations, and software system features to improve visualization tools." First and third points sound relevant. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=vnax4nN4Ws4C&oi=fnd&pg=PA703&dq=slanty+design&ots=P7G259hzJa&sig=vbYZmYkquwuA_ollOI6EgciNJjU The Uniqueness of Individual Perception] Whitehouse-1999-ID
: Focuses on the commonalities of perception. Rough overview of sensory mechanisms, and strong anecdotal support of not adapting completely to the user, but rather requiring the user to adapt as well. Identifies some common perceptual problems with particular groups of EUs (e.g., blind people). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.psychonomic.org/search/view.cgi?id=4180 Guided search 2. 0. A revised model of visual search] Wolfe-1994-GS2
: A theory of visual search that builds on the distinction between visual targets that you need to search for in a field of distractors and those that "pop out" at you. (Adam) 16:22, 26 January 2009 (UTC)

* [http://biologie.kappa.ro/Literature/Misc_cogsci/articole/dvp/scholl00.pdf Perceptual causality and animacy] [[Scholl-2000-PCA]]
: Discusses some of the automatic interpretation in our perception, focusing on inferring causal relations and animacy. 

* [http://www.cs.umd.edu/class/fall2002/cmsc434-0201/p79-gaver.pdf Technology Affordances] Gaver-1991-TAF
: Affordances are actions that are appropriate for an object and that come to mind when perceiving the object. (Adam) 16:22, 26 January 2009 (UTC)

* [http://portal.acm.org/ft_gateway.cfm?id=301168&type=pdf&coll=GUIDE&dl=GUIDE&CFID=19761061&CFTOKEN=10084975 Affordance, conventions, and design] Norman-1999-ACD
: How the original concept of affordances differs from how it has been used in HCI. (Adam) 16:22, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=DrhCCWmJpWUC&oi=fnd&pg=PA1&dq=ecological+approach+visual+perception&ots=TeE80z49Fr&sig=c0jHz0ucQUTFNvUM5ObQouQq_Oc The Ecological Approach to Visual Perception] Gibson-1986-EAV
: Outlines direct perception and the original theory of affordances. (Jon) 14:07, 3 February 2009.

* [http://ieeexplore.ieee.org/iel1/21/4054/00156574.pdf?tp=&arnumber=156574&isnumber=4054 Ecological interface design: Theoretical foundations] Vicente-1992-EID
: Theory of how interfaces can avoid forcing processing at a higher level than the task requires. (Jon) 14:56, 3 February 2009.

* [http://www.informaworld.com/smpp/ftinterface~content=a784403799~fulltext=713240930 The Ecology of Human-Machine Systems II: Mediating Direct Perception in Complex Work Domains] Vicente-2000-EHM
: Taking advantage of fast perceptual processes to reduce cognitive demands as applied to the design of a thermal-hydraulic system. (Jon) 14:56, 3 February 2009.

* [http://www.aaai.org/Papers/Workshops/1998/WS-98-09/WS98-09-020.pdf Acting on a visual world: The role of multimodal perception in HCI]. Wolff-1998-AVW.
: Experiment that has implications for gesture interpretation module development.

* [http://dl.acm.org/citation.cfm?id=1993063 Effects of motor scale, visual scale, and quantization on small target acquisition difficulty] Chapuis-2011-EMS
: In the first class, we talked about the problem with Windows Start menus -- how hard it is to navigate and select the right one. This study provides empirical evidence for this problem, confirming the difficulty of acquiring small-sized targets (like the menus) and identifying motor and visual sizes of the targets as limiting factors. ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://dl.acm.org/citation.cfm?id=1870080 Do predictions of visual perception aid design?] Rosenholtz-2011-DPV
: This paper asks the question: does the use cognitive and perceptual models actually help (in this case, the process of design)? They find that "the models can help, but in somewhat unexpected ways": ""goodness" values were not very useful" but it "seemed to facilitate communication ... about design goals and how to achieve those goals". ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://dl.acm.org/citation.cfm?id=1753357 Crowdsourcing Graphical Perception: Using Mechanical Turk to Assess Visual Design], Heer and Bostock, CHI '10
: This paper explores crowdsourcing as a viable method for conducting visualization perception evaluations. They replicate some results of Cleveland and McGill's 1984 graphical perception paper, and do some analysis on cost and performance of using MTurk for these studies on static, chart-type visualizations. ([[User:Steven Gomez|Steven Gomez]])

==Cognition==

* Colin Ware: Visual Thinking: For Design
:Insight into some of the theory of cognition as it pertains to building visual interfaces (David)

* [http://en.wikipedia.org/wiki/Seven_plus_or_minus_two Wikipedia's Seven Plus or Minus Two page]
:A clear description of one part of human thinking; will probably provide pointers to other things to read (David)

* [http://en.wikipedia.org/wiki/Hick%27s_law Wikipedia's Hick's Law page]
: Hick's law describes the relationship between the decision-making time and the number of possible choices. (Hua)

* [http://portal.acm.org/citation.cfm?id=108844.108865 A cognitive model for the perception and understanding of graphs] Lohse-1991-CMP
: Describes a computer program that predicts response time to a query from assumptions from eye-tracking, short-term memory capacity, and the amount of information that can be absorbed from the query in each "glance." Attempts to lay the foundation for explaining several steps of human cognition, including input, memory, and processing. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.informaworld.com/smpp/content~content=a784395566~db=all~order=page Cognitive load during problem solving: Effects on learning] John Swiller
: Older article but referenced in a lot of newer ones; looks at how conventional problem-solving is ineffective as a learning device. (lisajane)

* [http://web.ebscohost.com/ehost/pdf?vid=1&hid=4&sid=13a77fd7-bead-41ce-bfb1-38addb0dfa53%40sessionmgr7 Dimensional overlap: Cognitive basis for stimulus–response compatibility—A model and taxonomy] Kornblum-1990-DOC
: People are more effective at a task when the stimulus and response representations are compatible and they don't require "translation". (Adam) 16:22, 26 January 2009 (UTC)

* [http://vis.cs.brown.edu/~trevor/Papers/Iverson-TNR-ImPact.pdf Tracking Neuropsychological Recovery Following Concussion in Sport]
: This paper discusses the neurological basis for the ImPact test given to athletes after they've suffered a concussion. It provides testing and quantitative measures for verbal memory, visual memory, and reaction times. These simple measures of cognition may be useful to incorporate in an HCI study. (Trevor)

A Framework of Interaction Costs in Information Visualization
:ABSTRACT: Interaction cost is an important but poorly understood factor in visualization design. We propose a framework of interaction costs inspired by Norman’s Seven Stages of Action to facilitate study. From 484 papers, we collected 61 interaction-related usability problems reported in 32 user studies and placed them into our framework of seven costs: (1) Decision costs to form goals; (2) System-power costs to form system operations; (3) Multiple input mode costs to form physical sequences; (4) Physical-motion costs to execute sequences; (5) Visual-cluttering costs to perceive state; (6) View-change costs to interpret perception; (7) State-change costs to evaluate interpretation. We also suggested ways to narrow the gulfs of execution (2–4) and evaluation (5–7) based on collected reports. Our framework suggests a need to consider decision costs (1) as the gulf of goal formation.
: Includes some ideas for quantitatively evaluating information visualization interfaces (David)

*Distributed Cognition as a Theoretical Framework for HCI (1994) Christine A. Halverson [http://hci.ucsd.edu/cogsci/faculty_pubs/9403.ps]


* [http://consc.net/papers/extended.html The Extended Mind] Clark-1998-TEM
: Cognition can be thought to be distributable across mediums (outside of the skull). How might we off-load "cognitive" processes to computer systems? ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - Owner)
: I think that Ware gets into this in some of his writing about information visualization (or in his second book, thinking with visualization). We can build in external "caches" or other constructs to be part of our cognitive model. It seems like most of an analytical user interface is part of the external cognitive process. (David)


* [http://courses.csail.mit.edu/6.803/pdf/dualtask.pdf Sources of Flexibility in Human Cognition: Dual-Task Studies of Space and Language] HermerVazquez-1999-SFC
: Our use of language serves as a higher-order cognitive system which can be utilized as "scaffolding" in human thought, supporting goal-driven tasks. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.bcp.psych.ualberta.ca/~mike/Pearl_Street/PSYCO354/pdfstuff/Readings/Evans2.pdf In two minds: dual-process accounts of reasoning] Evans-2003-ITM
: It is hypothesized that there are two distinct systems of reasoning in the mind. System 1 is innate and fast, system 2 is controlled and slow. Knowledge of this might help us determine which tasks are candidates for one system or another. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6WJB-467J83F-3&_user=489286&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=316065013955ca22e9dde19df6a0f9b8 Priming against your will: How accessible alternatives affect goal pursuit] Shah-2002-PAY
: The authors demonstrate how priming the means to achieving a goal also primes the goal, but inhibits alternative means to achieving the same goal. It means that making the means of achieving a goal salient in an interface will make it more likely that people pursue that goal, and less likely that they will think of other means to pursue it. (Adam)

* [http://dl.acm.org/citation.cfm?id=1658355 Computational visual attention systems and their cognitive foundations: A survey] Frintrop-2010-CVA
: This paper "provides an extensive survey of the grounding psychological and biological research on visual attention as well as the current state of the art of computational systems". It should make for good background reading if we want to work with visual attention (detecting regions of interest in images). ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)
: Owner: [[User:Nathan Malkin|Nathan Malkin]]

* [http://dl.acm.org/citation.cfm?id=1518701.1518717&coll=DL&dl=GUIDE&CFID=42040751&CFTOKEN=34436229 Getting inspired!: understanding how and why examples are used in creative design practice] Herring-2009-GIU
: A user study on the use of examples to improve creativity. Results show that examples are very useful to inspire designers of new ideas. Surprisingly, inspiring examples are not limited to the ones in the design domain, but are expanded to other areas too.

*[http://www.sciencedirect.com/science?_ob=MiamiImageURL&_cid=271802&_user=489286&_pii=S0747563210002852&_check=y&_origin=&_coverDate=31-Jan-2011&view=c&wchp=dGLbVBA-zSkWA&md5=b7ee648939c3d41e25e3317f8be617dc/1-s2.0-S0747563210002852-main.pdf Contemporary cognitive load theory research: The good, the bad and the ugly] Kirschner-2010-CCL
: This review summarizes and critiques 16 papers on cognitive load theory (CLT) and its impact on learning and ability to navigate different environments. It also discusses the difficulties inherent to the study of cognitive and moves made to attack them. While the paper does not contribute directly to our research, it does provide background on some of the issues of usability and "tolerance" of HCI systems that we discussed last week. [[User:Clara Kliman-Silver|Clara Kliman-Silver]] 13:54, 18 September 2011 (EDT)

*[http://cacm.acm.org/magazines/2003/3/6879-models-of-attention-in-computing-and-communication/fulltext Models of attention in computing and communication: from principles to applications] Horvitz-2003-MAC
: [[User:Jenna Zeigen|Jenna Zeigen]] 10:50, 19 September 2011 (EDT)

==HCI==

* [http://portal.acm.org/citation.cfm?id=1357054.1357125&coll=portal&dl=ACM&type=series&idx=SERIES260&part=series&WantType=Proceedings&title=CHI&CFID=20781736&CFTOKEN=83176621 A diary study of mobile information needs]

:A detailed study into how people use mobile devices. '''(Andrew Bragdon - OWNER for Assignment 2)'''

* [http://portal.acm.org/citation.cfm?id=1357054.1357187&coll=Portal&dl=GUIDE&CFID=21136843&CFTOKEN=23841774 Feasibility and pragmatics of classifying working memory load with an electroencephalograph]

:Examines how practical it is to use electroencephelographs to measure cognitive load, and discusses domain-specific knowledge needed.

* [http://delivery.acm.org/10.1145/1250000/1240669/p271-hurst.pdf?key1=1240669&key2=6465483321&coll=GUIDE&dl=GUIDE&CFID=20565232&CFTOKEN=69614228 Dynamic Detection of Novice vs Skilled Use]

:Used a learning classifier, trained on low-level mouse and keyboard usage patterns, to identify novice and expert use dynamically with accuracies as high as 91%. This classifier was then used to provide differrent information and feedback to the user as appropriate.

* [http://portal.acm.org/citation.cfm?id=1054972.1055012&coll=GUIDE&dl=ACM&CFID=20565232&CFTOKEN=69614228 Bubble Cursor]

:Example of a paper which demonstrated a novel interaction technique still obeys Fitts's law.

* [http://tlaloc.sfsu.edu/~lank/research/appearing/FSS604LankE.pdf Sloppy Selection]

:Utilized a quantiative model of user performance which used curvature to predict the speed of a pen as it moved across a surface to help disambiguate target selection intent.

* [http://delivery.acm.org/10.1145/1250000/1240730/p677-iqbal.pdf?key1=1240730&key2=4525483321&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 Disruption and Recovery of Computing Tasks]

:Studied task disruption and recovery in a field study, and found that users often visited several applications as a result of an alert, such as a new email notification, and that 27% of task suspensions resulted in 2 hours or more of disruption. Users in the study said that losing context was a significant problem in switching tasks, and led in part to the length of some of these disruptions. This work hints at the importance of providing affordances to users to maintain and regain lost context during task switching.

* [http://portal.acm.org/citation.cfm?id=985692.985715&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 A diary study of task switching and interruptions]

:Showed that task complexity, task duration, length of absence, and number of interruptions all affected the users' own perceived diffuclty of switching tasks. (Andrew Bragdon)

* John M. Carroll: HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science

:A gargantuan book with chapters by many folks describing some of the models and theories from HCI that may relate back to cognition; may need to create individual (David)

* [http://portal.acm.org/citation.cfm?id=1461832&dl=&coll= Project ernestine: validating a GOMS analysis for predicting and explaining real-world task performance]

: A study in which the [http://en.wikipedia.org/wiki/GOMS#cite_note-CHI92-1 GOMS] method is used to correctly predict the performance of call center operators using a new workstation. Might be interesting because of the methodology used to decompose the task into basic cognitive and perceptual actions, and then measuring these actions to evaluate the new interface. (Eric) The CPM (Critical Path Modeling) aspect used handles the parallel nature of several human components of HCI and seems to very accurately model the low level tasks from this study. (David)

* [http://www.informaworld.com/smpp/content~content=a784766580~db=all The Growth of Cognitive Modeling in Human-Computer Interaction Since GOMS]

* [http://portal.acm.org/citation.cfm?id=169059.169426&coll=Portal&dl=GUIDE&CFID=19188713&CFTOKEN=13376420 The limits of expert performance using hierarchic marking menus]
: Marking menus naturally facillitate the transition from novice to expert performance for command invocation, and have been quite influential over the years to research into menu techniques. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/302979.303053 Manual and gaze input cascaded (MAGIC) pointing]

: This is a system which combines gaze input (coarse-grained) and mouse input (fine-grained) to quickly target items. This is important because it "kind of" gets around Fitt's law by using gaze input to "warp" the cursor to the general vicinity of what the user wants to work on. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/985692.985727 If not now, when?: the effects of interruption at different moments within task execution] Adamczyk-2004-INN
: Presents task models of user attention. (Andrew Bragdon) (Adam - owner; [http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - discussant) '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:58, 28 January 2009 (UTC)

* [http://hfs.sagepub.com/cgi/reprint/44/1/62.pdf Ecological Interface Design: Progress and challenges] Vicente-2002-EID
: Discusses the implications of Ecological Interface Design (EID), a theoretical HCI framework, for designing human-computer interfaces and compares performance of EID-informed designs to other comtemporary approaches. (Owner: Jon)

* [http://doi.acm.org/10.1145/985692.985707 "Constant, constant, multi-tasking craziness": managing multiple working spheres.] Gonzalez-2004-CCM
: Empirical study of how information workers spend their time. Puts forward a theory of how users organize small individual tasks into "working spheres." (Andrew Bragdon - OWNER; Adam Darlow - Discussant; Steven Ellis - Discussant)
: Any visualization which is used extensively by a user over a period of time will be used in the context of that user's daily workflow. It is therefore essential to understand this larger workflow context to design the visualization application appropriately to fit the needs of real world users. This paper studies in detail the daily workflow tasks and patterns of work of analysts, managers and software developers in a medium-sized software company. This paper provides strong empirical evidence that users, rather than working on discrete and well-defined tasks, in reality, switch tasks on average every two to three minutes, and instead, work on larger thematically connected units of work (working spheres). In addition, the study found that users switched between these larger working spheres on average every 12 minutes. Thus, it is strongly indicated by this paper that many information workers are in a constant state of rapid fire multi-tasking. This suggests that for a visualization to be relevant to any of these information workers, it would need to fit into, and support, this workflow. This is just a first step towards understanding how users interact with visualizations in particular, however; future work that studies how users interact with visualizations as part of their larger daily work patterns is warranted, and would be an important component of a broad theory of visualization.

* [http://www.eecs.berkeley.edu/Pubs/TechRpts/2000/CSD-00-1105.pdf The state of the art in automating usability evaluation of user interfaces] Ivory-2000-SAA
: Presents a new taxonomy for automating usability analysis. Advantages of automated evaluation are purported to be advantages linked to efficiency, such as comparing alternate designs, uncovering more errors more consistently, and predicting time/error costs across an entire design. Breaks down a taxonomy with individual benefits and drawbacks of each method, and checks observations against existing guidelines (e.g. Smith and Mosier guidelines, Motif style guidelines, etc). Introduces several visual tools. Looks extremely relevant as a comprehensive survey of existing techniques. '''OWNER''': [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC) '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC) Discussant: Steven Ellis

* [http://www.hpl.hp.com/techreports/91/HPL-91-03.pdf User Interface Evaluation in the Real World: A Comparison of Four Techniques] Jeffries-1991-UIE
: Overview of the four major UI evaluation methods: heuristic evaluation, usability testing, guidelines, and cognitive walkthrough, followed by a comparison in their application to a case study. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ics.colorado.edu/techpubs/pdf/91-01.pdf Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces] Polson-xxxx-CWM
: Presents the concept of performing a hand walkthrough of the cognitive process, based on another theory of "learning by exploration." Strong results for a limited evaluation timeframe and little or no time for formal instruction of the interface for the user. The reviewer considers each behavior of the interface and its resultant effect on the user, attempting to identify actions that would be difficult for the "average" user. Claims that a given step will ''not'' be difficult must be supported with empirical data or theory. The application of cognitive theory early in the design process seems useful in avoiding costly redesigns when problems are identified later. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=142834&coll= Finding usability problems through heuristic evaluation] Nielsen-1992-FUP
: Emphasis on heuristic evaluation. Shockingly, usability experts are found to be better at performing this type of evaluation. Usability problems relating to elements that are completely missing from the interface are difficult to identify with this method when evaluating unimplemented designs. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://delivery.acm.org/10.1145/130000/128728/p152-jacob.pdf?key1=128728&key2=7032992321&coll=GUIDE&dl=GUIDE&CFID=19735001&CFTOKEN=82907542 The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look at is What you Get] Jacob-1991-UEM
: One of the first research papers to introduce eye tracking as a viable HCI technique. (Trevor)

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=1221372&isnumber=27434 Real-Time Eye Tracking for Human Computer Interfaces] Amarnag-2003-RTE
: Technical details about the implementation of a recent real-time eye-tracking system. (Trevor)

* [http://www.ipgems.com/present/swui_chi_20070502.pdf Semantic Web HCI: Discussing Research Implications] Degler-2007-SWH
: A workshop discussion from CHI 2007 discussing the idea of a "semantic internet" and its relevance to the HCI community. Discusses things like adaptive web interfaces, mashups, dynamic interactions, etc. (Trevor)

* [http://www.springerlink.com/content/u3q14156h6r648h8/fulltext.pdf Implicit Human Computer Interaction Through Context] Schmidtt-2000-IHC
: A highly cited paper discussing the notion of implicit HCI, including semantic grouping of interactions, and some perceptual rules. ('''Trevor - OWNER'''; Andrew Bragdon - discussant; '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:57, 28 January 2009 (UTC))

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1903_1 Cognitive Strategies for the Visual Search of Hierarchical Computer Displays] Anthony J. Hornof
: This article investigates the cognitive strategies that people use to search computer displays. Several different visual layouts are examined. (lisajane)

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1904_9 Unseen and Unaware: Implications of Recent Research on Failures of Visual Awareness for Human-Computer Interface Design] D. Alexander Varakin; Daniel T. Levin; Roger Fidler
: This article reviews basic and applied research documenting failures of visual awareness and the related metacognitive failure and then discuss misplaced beliefs that could accentuate both in the context of the human-computer interface. (lisajane)

* Shneiderman, Plaisant: Designing the User Interface
: My textbook for an HCI class, has many good lists of guidelines. Especially Ch.2 pp 59-102. (lisajane)

* Robert Mack, Jakob Nielsen: Usability Inspection Methods (Ch. 1 Executive Summary)
: Provides an overview of main usability inspection methods, a fair introduction to the industrial applications, as well as certain costs and benefits, of the methods as well as suggestions for expansive research. (Steven)

* [http://portal.acm.org/citation.cfm?id=22950 Jock Mackinlay, Automating the design of graphical presentations of relational information], ACM Transactions on Graphics (TOG), 5(2):110-141, 1986. (Jian)
: The first paper talked about how to automatically generate *good* graphs.

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=04376133 Jock Mackinlay, Pat Hanrahan, Chris Stolte, Show Me: Automatic Presentation for Visual Analysis] IEEE TVCG 13(6): 1137-1144, Nov-Dec, 2007 (Jian)
: Extend their previous paper to analytics tasks.

* [http://www.win.tue.nl/~vanwijk/vov.pdf Jarke J. van Wjik, The value of visualization], IEEE visualization 2005. (Jian)
: discuss vis from a variety of angles as for art, science and technology and question and quantify the utility of visualization.

* [http://www.almaden.ibm.com/u/zhai/papers/steering/chi97.pdf Johnny Accot and Shumin Zhai, Beyond Fitts' law: models for trajectory-based HCI tasks], CHI 97. (Jian)
: Extend Fitts' to trajectory based tasks.

*[http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=01703371 Saraiya, P., North, C., Lam, V., and Duca, K.A, An Insight-Based Longitudinal Study of Visual Analytics], TVCG 12(6): 1511-1522, 2006.(Jian)
: the first paper that quantifies what insight is by comparing several infoVis tools for bioinformatics.

*[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1359732 David H. Laidlaw, Michael Kirby, Cullen Jackson, J. Scott Davidson, Timothy Miller, Marco DaSilva, William Warren, and Michael Tarr.Comparing 2D vector field visualization methods: A user study]. IEEE Transactions on Visualization and Computer Graphics, 11(1):59-70, 2005. (Jian)
: an application-specific comparison of visualization method. a cool paper.

* [http://web.mit.edu/rruth/www/Papers/RosenholtzEtAlCHI2005Clutter.pdf Rosenholtz, Li, Mansfield, and Jin, Feature Congestion: A Measure of Display Clutter], CHI 2005. (Jian)
: quantify visual complexity from a statistics point of view.

* [http://delivery.acm.org/10.1145/240000/236054/p320-john.pdf?key1=236054&key2=2285613321&coll=GUIDE&dl=GUIDE&CFID=19490404&CFTOKEN=25744022 The GOMS Family of User Interface Analysis Techniques: Comparison and Contrast] (Trevor)
: This paper offers an analysis of four types of GOMS (Goals, Objects, Methods and Selection) based interaction techniques. GOMS is a widely used UI paradigm, made popular by Card et al in The Psychology of Human-Computer Interaction (1983).

* [http://vis.cs.brown.edu/~trevor/Papers/Lisetti-2000-AFE.pdf Automatic Facial Expression Interpretation: Where Human-Computer Interaction, Artificial Intelligence and Cognitive Science Intersect] (Trevor)
: Using advanced computer vision/AI techniques, this work aims to discern and make use of users' emotions in UI design.

* [http://vis.cs.brown.edu/~trevor/Papers/weld-2003-APU.pdf Automatically Personalizing User Interfaces] (Trevor)
: Discusses some techniques and design decisions for constructing adaptable and customizable user interfaces. There are some useful references in the paper on using HMMs and RMMs (Relational Markov Models) for interaction prediction.

* [http://vis.cs.brown.edu/~trevor/Papers/Gajos-2006-.pdf Exploring the Design Space for Adaptive Graphical User Interfaces] (Trevor)
: This paper presents comparative evaluations of three methods for implementing adaptable user interfaces. The evaluation methodology gives rise to three key concepts that affect the performance of adaptable UIs: frequency of adaptation, accuracy of adaptation, and the impact of predictability.

* Conceptual Modeling for User Interface Development - David Benyon, Diana Bental, and Thomas Green
: Proposes a new set of terminology for describing and comparing existing and future cognitive models of HCI. (Steven)

* [http://homepage.ntlworld.com/greenery/workStuff/Papers/ERMIA-Skull.pdf The Skull beneath the Skin: Entity-Relationship Models of Information Artefacts] T. R. G. Green, D. R. Benyon
: A paper in form of prelude to the above, gives a good overview of the ERMIA method. (Steven)

* [http://delivery.acm.org/10.1145/1130000/1125552/p454-akers.pdf?ip=138.16.160.6&CFID=41848857&CFTOKEN=88172531&__acm__=1315781624_3f3ff7dffae48746685278b9f2b7dabb Wizard of Oz for Participatory Design: Inventing a Gestural Interface for 3D Selection of Neural Pathway Estimates], Akers-2006-WOP.
:Designs an interactive visualization interface for 3D selection of neural pathways of human brains. The mouse based interface helps neuroscientists to select neural pathways more efficiently and intuitively. (--- [[User:Chen Xu|Chen Xu]] 15:04, 13 September 2011 (EDT) -OWNER)

* [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.123.3761&rep=rep1&type=pdf Could I have the Menu Please? An Eye Tracking Study of Design Conventions] McCarthy-2003-CMP
: This article examines eye tracking techniques as they pertain to improving search performance in user interfaces. Specific attention is given to menu organization in the context of Web interfaces. Although substantial progress has been made in the past decade, the article draws attention to relevant design issues and concepts, especially as eye tracking methodologies continue continue to grow and improve. (Clara, 11 September 2011--OWNER; Chen -- Discussant)

* [http://www.research.ibm.com/AVSTG/icassp_pose.pdf Audio-Visual Intent-To-Speak Detection For Human-Computer Interaction], Cuetos-2000-ISD.
:Discusses a speech detection system that uses both auditory and visual cues to more accurately detect speech commands. It aims to recognize the user's intention to speak, and to ignore background noise, or speech recognized as not being directed at the system. Although it is fairly dated, this paper is relevant in that it discusses applications of cognition/perception to HCI. [[User:Michael Spector|Michael Spector]] 13:19, 13 September 2011 (EDT)

* [http://dl.acm.org/citation.cfm?id=1959023 An exploration of relations between visual appeal, trustworthiness and perceived usability of homepages] Lindgaard-2011-ERB
: This paper is interesting and relevant to cognition+HCI because it attempts to differentiate between "judgments differing in cognitive demands (visual appeal, perceived usability, trustworthiness)" and see whether those tasks with more cognitive demand have different results. (The paper includes a model to account for these.)
: Also, this is interesting to Steve and me in the context of some of our discussions this past spring. (Apparently, yes: "all three types of judgments [including, crucially, trustworthiness] are largely driven by visual appeal".) ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://www.comp.leeds.ac.uk/umuas/reading-group/kaptelinin-ch5.pdf Activity Theory: Implications for Human-Computer Interaction] Kaptelinin--1996-ATI
: This article discusses activity theory, an alterate to present theories surrounding HCI. In particular, it examines the principle differences between activity theory and cognitive theory, applies it to HCI, and suggests implications for the field. While not directly relevant to the proposal, it offers an alternate framework for some of the issues that we discuss. (Clara, 12 September 2011)

* [http://pages.cpsc.ucalgary.ca/~saul/wiki/uploads/HCIPapers/landauer-letsgetreal.pdf Let's Get Real: a Position Paper on the Role of Cognitive Psychology in the Design of Humanely Usable and Useful Systems] Landauer-1991-LGR
: Perhaps less useful, only because it's 20 years old, but an interesting read nonetheless: this paper questions the "modern" relevance of cognitive psychology to human-computer interaction design. The primary issue, it argues, is that human-computer systems are entirely unpredictable, and thus, some of the modern understanding of cognition (and, indeed, HCI theory) simply cannot apply given the erratic behavior of computer systems. Instead, he addresses some of the more "useful models," including Fitt's law and theories of visual perception, to define a new space for emerging research in HCI. (Clara, 12 September 2011)

* [http://dl.acm.org/citation.cfm?id=1978942.1978969&coll=DL&dl=GUIDE&CFID=42040751&CFTOKEN=34436229 Mid-air pan-and-zoom on wall-sized displays] Nancel-2011-MPZ
: The paper describes approaches to perform pan and zoom tasks in mid-air: bimanual & unimanual, linear & circular gestures.

* [http://dl.acm.org/citation.cfm?id=1978942.1979430&coll=DL&dl=GUIDE&CFID=42040751&CFTOKEN=34436229 LiquidText: a flexible, multitouch environment to support active reading] Tashman-2011-LER
: A technique utilizing multitouch to improve reading efficiency.

* [http://dl.acm.org/citation.cfm?id=1978942.1979392&coll=DL&dl=GUIDE&CFID=42040751&CFTOKEN=34436229 Rethinking 'multi-user': an in-the-wild study of how groups approach a walk-up-and-use tabletop interface] Marshall-2011-RMU
: An ethnographic study that explores how groups of users approach tabletop interfaces in real environments. Some results contradict existing findings.

* [http://research.microsoft.com/en-us/um/redmond/groups/cue/publications/CHI2008-EMG.pdf Demonstrating the Feasibility of Using Forearm Electromyography for Muscle-Computer Interfaces] Saponas-2008-DFU
: Discusses the merits of HCI (here called muCI, for muscle-computer interaction) by detection of forearm muscle activity rather than manipulation of an object such as a mouse or keyboard. [[User:Michael Spector|Michael Spector]] 13:19, 13 September 2011 (EDT)

*[http://courses.ischool.utexas.edu/rbias/2009/Spring/INF385P/files/annurev.psych.54.101601.pdf HUMAN-COMPUTER INTERACTION: Psychological Aspects of the Human Use of Computing] Olson-2003-HCI
: Overview of issues in psychology in HCI ([[User:Jenna Zeigen|Jenna Zeigen]], 9/12/11)

* [http://www.sciencedirect.com/science?_ob=MiamiImageURL&_cid=271802&_user=489286&_pii=S0747563210001718&_check=y&_origin=&_coverDate=30-Nov-2010&view=c&wchp=dGLzVlt-zSkzS&md5=06d9eeba2447db1d43abcf99d1d7e995/1-s2.0-S0747563210001718-main.pdf Integrating cognitive load theory and concepts of human–computer interaction] Hollender-2010-ICL
: This paper compares existing models of cognitive load theory as it applies to HCI, reviews present literature, and discusses current problems and potential advances. Relevant to our work but ventures into theory that is heavier than necessary given our purposes. ([[User:Clara Kliman-Silver|Clara Kliman-Silver]] 15:58, 18 September 2011 (EDT))

===Cognitive Modeling===

* [http://vis.cs.brown.edu/~trevor/Papers/Kaptelinin-1994-ATI.pdf Activity Theory: Implications for Human-Computer Interaction] (Trevor)
: Discusses the notion of Activity Theory as the basis for HCI research. The most interesting part of this paper for me was the introduction which expressed the need for a ''Theory of HCI''.

* [http://en.wikipedia.org/wiki/Seven_stages_of_action Norman's Seven stages of action]
: Presents Norman's seven stages of action, as well as his model of evaluation. (Steven)

* [http://vis.cs.brown.edu/~trevor/Papers/Wright-2000-AHC.pdf Analyzing Human-Computer Interaction as Distributed Cognition: The Resources Model] (Trevor)
: Creates a compelling argument for why distributed cognition research fits in with HCI, and what types of impacts it may have on the HCI community.

* [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.100.445&rep=rep1&type=pdf Eye Tracking in Human-Computer Interaction and Usability Research: Ready to Deliver the promises] Jacob-2003-ETH
: This paper (book chapter) looks beyond the relevance of eye tracking methodologies to HCI and instead addresses the data produced. It examines various approaches to analysis and the implications and conclusions that can be drawn. Given that eye tracking is often coupled with other inputs, such as a mouse or a keyboard, analysis is rarely clear-cut: other variables, such as error, saccades, and speed must be factored in. Moreover, eye movements are far less deliberate than mechanical (i.e. mouse) input, and so errors must be handled differently. The chapter discusses each of these issues and subsequently offers solutions. In general, the article argues for the importance of eye tracking, considering it as a central component of HCI methodology. (Clara, 11 September 2011)

* [http://sonify.psych.gatech.edu/~walkerb/classes/hci/extrareading/nardi.pdf Studying Context, A Comparison of Activity Theory, Situated Action Models, and Distributed Cognition] Bonnie A. Nardi
: Defines the task of the HCI specialist as the application of psychological and anthropological principles to specific design problems. It posits an inherent feud between the accurate study of relative contexts and the necessary, but more general, development of comparative models and results. Gives a coherent overview of activity theory, situated action models, and distributed cognition; finds that activity theory presents the best overall framework. There is little reason given for this ranking, however, and the description of activity theory is the most theoretical and least developed of the three.
: Having spent quite a bit of time studying Soviet psychology (from which came activity theory) last semester, I question the validity of the paper’s claim, as its description of activity theory bears the artifacts of the oppressive regulations which the Soviet government imposed on psychologists. Although the theory may sound more practical, it seems fairly weak as a basis for empirical design analysis.
: The paper’s strongest point is the criticisms which follow descriptions, in which theoretical shortcomings of each perspective are discussed. ('''Owner:''' Steven, '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC))

* [http://www.billbuxton.com/chunking.html Chunking and Phrasing and the Design of Human-Computer Dialogues]
: High-level theory of human-computer dialogues. (Andrew Bragdon)

* Polson, P. and Lewis, C. Theory-Based Design for Easily Learned Interfaces. Human-Computer Interaction, 5, 2 (June 1990), 191-220.
: This is a cognitive model of how users find and learn commands in an unfamiliar user interface. This could potentially be adapted to be a piece of a theory of visualization. (Andrew Bragdon)

* [http://www.syros.aegean.gr/users/tsp/conf_pub/C12/c12.pdf Activity Theory vs Cognitive Science in the Study of Human-Computer Interaction]
: Provides a brief history of Cognitive Science and HCI, then compares the effectiveness of the aforementioned theories in aiding design and development. (Owner - week 2 : Steven)

* [http://www.sciencedirect.com/science?_ob=PublicationURL&_tockey=%23TOC%236829%232001%23999449998%23287248%23FLP%23&_cdi=6829&_pubType=J&_auth=y&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=64b44ef6df77ae073d41a7367db866b5 International Journal of Human-Computer Studies - Special Issue on Cognitive Modeling]
:Articles all concerning various issues of cognitive modeling as relates to HCI. (Steven)

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6VDC-4811TNB-5&_user=10&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=259b5c105222437fc84990b7a1eaedee The role of cognitive theory in human–computer interface]. Chalmers, Patricia A, 2003.
:Was scared again, but no need to be. Touches only on a subset of cognitive theories (Schema theory, Cognitive load, and retention theories) and undertakes a survey of some software design theories, but does not attempt an explicit mapping between the two. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=26115.26124 Design Guidelines]. Marshall, Nelson, and Gardiner, 1987.
:Attempt to apply cognitive psychology to user-interface design. Here, the opposite problem is seen—the author's make no significant attempt to take existing heuristic guidelines into account. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://www.cognitivedesignsolutions.com/ Cognitive Design Solutions, Inc.]
:Training and consulting firm that claims to take advantage of Cognitive Design in making design and performance improvements. [[User:E J Kalafarski|E J Kalafarski]] 13:50, 20 February 2009 (UTC)

* [http://infolab.uvt.nl/research/lap2003/agerfalk.pdf Actability Principles in Theory and Practice]. Agerfalk, Par J, 2003.
:Presents a set of nine contemporary principles for the evaluation of IT systems ("social tools to perform communicative action") based explicitly on cognitive principles. Introduces a notion comparable to usability called ''actability''. Presents a mapping for some basic usability principles to some seminal sets of guidelines. [[User:E J Kalafarski|E J Kalafarski]] 14:29, 20 February 2009 (UTC)

* [http://en.wikipedia.org/wiki/ACT-R Wikipedia page for ACT-R]
:ACT-R is a cognitive architecture developed at CMU. It aims to define the basic cognitive and perceputal operations of human mind. (Hua)

* [http://en.wikipedia.org/wiki/Soar_%28cognitive_architecture%29 Wikipedia page for Soar]
:Soar is another cognitive architecture developed at CMU, now maintained in UMich. (Hua)

* [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.168.4719&rep=rep1&type=pdf Brain-Computer Interfaces and Human-Computer Interaction]
: (Not sure what heading this ought to go under!) Brain-Computer Interfaces (BCI) offer a neurological corollary to human-computer interfaces: users use their thoughts to signal to machines, instead of relying on physical movements. Thus, the areas activated are purely cognitive, not motor. The article provides an overview of the differences between HCI and BCI, the implications thereof, and the directions that their interaction may take. Relevant to some of the issues and concepts raised in the proposal, in addition to being a rather interesting idea! (Clara, 12 September 2011)

* [http://act-r.psy.cmu.edu/publications/pubinfo.php?id=101 Spanning Seven Orders of Magnitude: A Challenge for Cognitive Modeling], John Anderson, 2002
: The paper argues that high-level human behavior can be understood by analyzing the chain of fast, low level activity (from 10ms up) in the perceptual/cognitive bands that compose larger behaviors. It gives an intro to ACT-R and variants and some compelling examples for cognitive modeling and eye-tracking. ([[User:Steven Gomez|Steven Gomez]])

*[http://search.ebscohost.com.revproxy.brown.edu/login.aspx?direct=true&db=psyh&AN=2003-08881-009&site=ehost-live Cyberpsychology: A Human-Interaction Perspective Based on Cognitive Modeling] Emond-2003-CHI
:This paper talks about for the applicability of cognitive modeling to cyberpsychology, the study of the impact of computer and Internet interaction on humans. ([[User:Jenna Zeigen|Jenna Zeigen]], 9/12/11)

* [http://delivery.acm.org/10.1145/1980000/1978559/p62-modha.pdf?ip=138.16.160.6&CFID=41737444&CFTOKEN=92942121&__acm__=1315949230_6e20807eca999db6a25f54bcbf51ae6a Cognitive Computing], Modha-2011-CC
: Unite neuroscience, supercomputing, and nanotechnology to discover, demonstrate, and deliver the brain’s core algorithms. (--- [[User:Chen Xu|Chen Xu]] 17:25, 13 September 2011 (EDT) -OWNER)

* [http://rp-www.cs.usyd.edu.au/~whua5569/papers/infovis09.pdf Measuring effectiveness of graph visualizations: a cognitive load perspective] Huang-2009-JIV
: (This item can also go into the Evaluation category) This paper discusses the cognitive load theory and its application in measuring effectiveness of graph visualization. A model of user task performance, mental effort and cognitive load has been proposed and experiments have been conducted to refine the model. This seems to be an attempt along the line of defining quality metrics for visualization through cognitive modeling, which then closely relates to our proposal. (Hua)

* [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.123.4716&rep=rep1&type=pdf Supporting Collaboration and Distributed Cognition in Context-Aware Pervasive Computing Environments] Fischer-2004-SCD
: (Not exactly sure where this paper belongs.) The paper looks at several issues in HCI: 1) collaborative design (multiple users accessing, manipulating, and addressing information, in what they call "large computational spaces"), 2) mobile technology (mobile phones, wireless, etc.), and 3) smart objects (seems to be largely mobile phones and similar devices). This paper is dated and parts of it are very interesting but equally irrelevant. Nonetheless, it asks some important questions about how to deliver information to the user, how to manage search techniques and memory systems (particularly with searching) in HCI, and how to access information, all of which are crucial to "modern" HCI research. ([[User:Clara Kliman-Silver|Clara Kliman-Silver]] 17:15, 18 September 2011 (EDT))

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4154947 Gesture Recognition : A Survey] IEEE
: This article provides a survey on gesture recognition with particular emphasis on hand gestures and facial expressions. Applications involving hidden Markov models, particle filtering and condensation, finite-state machines, optical flow, skin color, and connectionist models are discussed in detail. ([[User:Wenjun Wang|Wenjun Wang]] , 18 September 2011 (EDT))

==Design==

* Wikipedia articles on [http://en.wikipedia.org/wiki/A_Pattern_Language "A Pattern Language"] and [http://en.wikipedia.org/wiki/Design_pattern "Design Pattern"]
:see summary for Alexander below (David)

* UI Design principles (feedback, etc -- find ref)

* Alexander: A Pattern Language: Towns, Buildings, Construction
:The original design pattern source; what makes a human space work, ineffable best practices, ~250 rules is enough to do communities and house-sized artifacts; could be a good metaphor for making; could be a good metaphor for making human virtual space work? (David)

* [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.113.5121&rep=rep1&type=pdf On tangible user interfaces, humans, and spatiality] Sharlin-2004-TUI
: Considers a range of user interfaces, ranging from the ordinary computer mouse to the cognitive cube, and the heuristics that underly their use. The article covers the logic that lies behind tactile user interfaces, with an eye to the cognitive systems and spatial relations involved. (Clara, 11 September 2011)

* [http://useraware.iict.ch/uploads/media/TangibleBits.pdf Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms] Ishii-1997-TBT
:A specific UI proposal, but has nice relevant discussion on how we perceive "foreground" items and "background" items and their relationship, taking advantage of this "parallel" processing of perception. Includes the use of visual metaphors, phicons, and a notion they invent called "digital shadows," in which the shadow projected by an object conveys some information on its contents. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://list.cs.brown.edu/courses/csci1900/2007/documents/restricted/beale.pdf Slanty Design] Beale-2007-SD
:Design method with emphasis on discouraging undesirable behavior, by perhaps forcing the user to adapt to the interface, giving equal weight to user goals, user "non-goals," and wider goals of stakeholders besides the immediate user. The important insight seems to be that these wider goals can enhance the user's experience with the larger system in the long run, if not in the immediate timeframe. Five major design steps. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.amazon.com/Designing-Interactions-Bill-Moggridge/dp/0262134748/ref=pd_bbs_sr_1?ie=UTF8&s=books&qid=1232989194&sr=8-1 Designing Interactions] by Bill Moggridge
: Really awesome book on the evolution of interactions with technology. (Trevor)

* [http://www.amazon.com/Sketching-User-Experiences-Interactive-Technologies/dp/0123740371/ref=sr_1_1?ie=UTF8&s=books&qid=1232989269&sr=1-1 Sketching User Experiences] by Bill Buxton
: Another great book on the practices of interaction design. (Trevor)

* [http://site.ebrary.com/lib/brown/docDetail.action?docID=10173678 The Laws of Simplicity] by John Maeda
: An interesting work on the efficiency of minimalist design. Quick read for those interested. (Steven)
: A set of design guidelines some of which we may be able to build on in automating interface evaluation; will certainly apply to manual evaluations [[User:David Laidlaw|David Laidlaw]]

* [http://www.cs.umd.edu/hcil/pubs/presentations/eyeshaveit/index.htm Ben Shneiderman, The Eyes Have It: User Interfaces for Information Visualization], UM, tech-report, CS-TR-3665. (Jian)
: the paper talks about visualization mantra.

* [http://hci.rwth-aachen.de/materials/publications/borchers2000a.pdf A pattern approach to interaction design] Borchers-2001-PAI
: A highly-cited work on the development of a language for defining design patterns for use in interface development, with an emphasis on communication between application developers and application domain experts. [[User:E J Kalafarski|E J Kalafarski]] 16:37, 3 February 2009 (UTC)

* [http://dl.acm.org/citation.cfm?id=1979100 Understanding Interaction Design Practices], Goodman et al., CHI '11 (Owner: Diem Tran - Steven, if you already own this, let me know)
: This is a position paper describing the disconnect between HCI research and real interaction design practices. It analyzes approaches for studying design practice (e.g., reported practice, anecdotal descriptions, first-person research), and argues a need for generative theories of design in order to address practice. ([[User:Steven Gomez|Steven Gomez]])

==Thinking, analysis, decision making==

* Morgan D. Jones: The Thinker's Toolkit: Fourteen Powerful Techniques for Problem Solving

:Set of methods for solving problems that might be incorporated into tools for thinking (David)

* Keim, Shazeer, Littman: Proverb: The Probabilistic Cruciverbalist

:An automatic crossword-puzzle solver; the software framework for building this program may be a metaphor for some thinking groupware with plug-in modules. (David)

* Thomas, Cook: Illuminating the Path

:a research agenda for tools for intelligence analysts; not sure of relevance (David)

* Richard Thaler, Cass Sunstein: Nudge - Improving Decisions About Wealth, Health, and Happiness
: A great, easy read for someone who isn't familiar with the psychological perspective. Focuses mainly on public policy issues, but certain sections (on developing a better social security website, for example) relate specifically to digital design. (Steven)

* [http://www.cs.brown.edu/people/trevor/Papers/Heer-2008-GraphicalHistories.pdf Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation] (InfoVis 2008)
: Work by Jeff Heer of Stanford (formerly Berkley) on using Graphical Interaction Histories within the Tableau InfoVis application. This is a great recent example of "workflow analysis" that we've been discussing in class. Though geared toward two-dimensional visualizations with clearly defined events, his work offers some very useful design guidelines for working with interaction histories, including evaluations from the deployment of his techniques within Tableau. (Trevor)

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Gotz-2008-CUV.pdf Characterizing Users' Visual Analytic Activity for Insight Provenance]
: The authors look into combining user triggered and automatically generated vis. histories.

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Isenberg-2008-ESV.pdf An exploratory Study on Visual Information Analysis]
: The authors run a user study to find the tasks involved in collaborative evidence aggregation

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Robinson-2008-CSV.pdf Collaborative Synthesis of Visual Analytic Results]
: Same as the previous one.

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Pirolli-2005-SPL.pdf The sensemaking process and leverage points for technology]
: The authors propose a model of analysis and identify leverage points for visualization.

==Visualization==

* [http://dl.acm.org/citation.cfm?id=1495824 Data, Information, and Knowledge in Visualization], Chen et al., CG&A Jan 09

* [http://dl.acm.org/citation.cfm?id=1658353 Volume composition and evaluation using eye-tracking data] Lu-2010-VCE
: Brain data sets are huge, and rendering all the information they contain (at the same time) is almost impossible. To deal with this problem, we could use the approach proposed in this paper (with different data): choosing rendering parameters based on where the user's attention is focused, using eye tracking data to determine that. ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://dl.acm.org/citation.cfm?id=1773971 Neural modeling of flow rendering effectiveness]
: This paper provides a comparison and discussion of "the relative strengths of different flow visualization methods for the task of visualizing advection pathways". This could be useful in selecting visualization methods for the brain circuits software. (As an added bonus, they cite Laidlaw et al.'s "advection task" right there in the abstract.) ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://dl.acm.org/citation.cfm?id=1399136 Toward a Perceptual Theory of Flow Visualization], Colin Ware, CG&A March 08
: This paper is a good entry point for Ware's other work on neural modeling for visualization. It describes how spatial receptor patterns in the visual cortex enable contour interpretation and related visualization tasks (e.g., particle advection in flow fields). There's also some good discussion about a perception-based approach to visualization, validating visual mappings with perceptual theories. ([[User:Steven Gomez|Steven Gomez]])

* [http://dl.acm.org/citation.cfm?id=1137505 An Approach to the Perceptual Optimization of Complex Visualizations], House, Bair, and Ware, TVCG, 2006
: This paper describes a humans-in-the-loop architecture for guiding layered visualizations with multiple visual parameters toward optimal tunings. They use a genetic algorithm to iteratively produce new "genomes" of visual parameters that are evaluated by humans (and either passed along or terminated in the genetic process). Finally they do some analysis on the surviving visualization space (though for me, this was less interesting than the generative visualization method using humans and the GA). ([[User:Steven Gomez|Steven Gomez]])

* [http://dl.acm.org/citation.cfm?id=1773970 Evaluating 2D and 3D visualizations of spatiotemporal information] Kjellin-2008-E23
: A frequent topic of interest to brain scientists is longitudinal data: how does the brain change over time? If the brain circuits software were to support answering this kind of question, we might evaluate different approaches to visualization using the methods in this paper. ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

*[http://ejournals.ebsco.com.revproxy.brown.edu/Direct.asp?AccessToken=6VFL2LL89KIIOIXL2I3O9IOHVIC28L2MMF&Show=Object Cognitive Models of the Influence of Color Scale on Data Visualization Tasks] -Breslow-2009-CMI
: Discusses the ways color scales and differences can be influential in the optimization of data visualization and analysis ([[User:Jenna Zeigen|Jenna Zeigen]], 9/12/11) -- '''Owner: Jenna Zeigen'''

* [http://delivery.acm.org/10.1145/1180000/1179816/p168-klein.pdf?ip=138.16.160.6&CFID=41737444&CFTOKEN=92942121&__acm__=1315948835_60407af6754ff14995331d7da5b2e5f2 Brain structure visualization using spectral fiber clustering] Klein-2006-BSV
: Present a novel algorithm that allows for visualizing white matter fiber tracts in real time. And the result is more accurate. This visualizing algorithm might be adopted in our proposal. ( --- [[User:Chen Xu|Chen Xu]] 17:21, 13 September 2011 (EDT) -OWNER)

* [http://delivery.acm.org/10.1145/570000/566646/p745-van_wijk.pdf?ip=138.16.160.6&CFID=45026276&CFTOKEN=25635165&__acm__=1316442526_0ba5fadd25f8f9e571d2e63ba88f17f9 Image Based Flow Visualization] van Wijk-2002-IBF
: Talked about a two-dimensional fluid flow visualization method which was based on advection and decay of dye. It was called IBFV, with IBFV, a wide variety of visualization techniques can be emulated. It can visualize flow, generate arrow plots, streamlines, particles and topological images, and handle unsteady flows.(Chen)

* [http://onlinelibrary.wiley.com/doi/10.1111/j.1467-8659.2004.00753.x/full The State of the Art in Flow Visualization: Dense and Texture-Based Techniques] Laramee-2004-SAF
: Discussed dense, texture-based flow visualization techniques. (Chen)

*[http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=1382909 Interactive Visualization of Small World Graphs] van Ham-2004-IVS
: [[User:Jenna Zeigen|Jenna Zeigen]] 11:03, 19 September 2011 (EDT)

*[http://books.google.com/books?hl=en&lr=&id=wdh2gqWfQmgC&oi=fnd&pg=PR13&dq=visualization&ots=olzI7xnGLy&sig=7F0m2_NpZcU-fr0V5CPzf99PpK4#v=onepage&q&f=false Readings in information visualization: using vision to think ] By Stuart K. Card, Jock D. Mackinlay, Ben Shneiderman: [[User: Wenjun Wang | Wenjun Wang]] 11:09, 19 September 2011 (EDT)

==Evaluation and Metrics==
* [http://dl.acm.org/citation.cfm?id=1640255 Creativity factor evaluation: towards a standardized survey metric for creativity support] Carroll-2009-CFE
: One alternative to evaluating visualizations and other tools based on the amount of time they save is evaluating them based on how much they help creativity. This paper presents a survey metric for creativity support tools. ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://dl.acm.org/citation.cfm?id=1970381 Measuring multitasking behavior with activity-based metrics] Bebunan-Fich-2011-MMB
: When designing interfaces for scientists, we must be mindful of the fact that (like all users) they will be multitasking -- both in terms of cognitive tasks (drawing from multiple sources, evaluating different hypotheses, etc.) and (if the interface allows it) tasks within the software. This paper proposes a definition of multitasking and provides a set of metrics for (computer-based) multitasking. ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://www2.iwr.uni-heidelberg.de/groups/CoVis/Data/Papers/euroVis10.pdf A Salience-based Quality Metric for Visualization] Jänicke1-Chen-2010
: This paper describes a method for defining quality metrics for visualization based on the distribution of salience over a visualization image. ([[User:Hua Guo|Hua]])

* [http://delivery.acm.org/10.1145/990000/989880/p109-plaisant.pdf?ip=138.16.160.6&CFID=41672001&CFTOKEN=81772969&__acm__=1315932639_76770a28b192503c5f3c0ac3f997a8f1 The Challenge of Information Visualization Evaluation] Plaisant-2004
: This paper surveys the field of information visualization evaluation - current practices, challenges and possible next steps. It is a relatively old article, though, so it may be replaced by a more concurrent survey. ([[User:Hua Guo|Hua]])

* [http://delivery.acm.org/10.1145/1170000/1168162/a9-zuk.pdf?ip=138.16.160.6&CFID=41672001&CFTOKEN=81772969&__acm__=1315932894_18cbcddc03c6ac39fc573f72790ea5d1 Heuristics for Information Visualization Evaluation] Zuk et al-2006
: This paper attempts to leverage some well-known heuristic evaluation used in HCI to Information Visualization. ([[User:Hua Guo|Hua]])

==Development==

* [http://dl.acm.org/citation.cfm?id=1879836 Parallel prototyping leads to better design results, more divergence, and increased self-efficacy] Dow-2010-PPL
: Not too relevant to the cognition aspects of the proposals, but provides some empirical support for "fast iteration" and related software design techniques, whose virtues are extolled in the proposals. The lesson: if we're going to prototype something for this class, and we want "better design results, more divergence, and increased self-efficacy", we should do it in parallel! ([[User:Nathan Malkin|Nathan Malkin]], 12 September 2011)

* [http://leadserv.u-bourgogne.fr/files/publications/000599-multi-label-classification-of-music-into-emotions.pdf MULTI-LABEL CLASSIFICATION OF MUSIC INTO EMOTIONS] ISMIR 2008
: Humans, by nature , are emotionally affected by music. This paper is an interdisciplinary one, which approaches towards automated emotion detection in music. Four algorithms are evaluated and compared in this task ([[User:Wenjun Wang|Wenjun Wang]], 19 September 2011)