VrlWiki - User contributions [en]

Plans and Goals

2012-01-24T14:04:53Z

Radu Jianu: /* Radu */

Plans and Goals

2011-09-22T22:07:06Z

Radu Jianu: /* Radu */

Plans and Goals

2011-06-20T19:48:17Z

Radu Jianu: /* Radu */

Plans and Goals

2011-01-17T14:48:15Z

Radu Jianu: /* Radu */

Plans and Goals

2011-01-17T14:42:35Z

Radu Jianu: /* David */

Plans and Goals

2010-05-18T09:18:41Z

Radu Jianu:

Plans and Goals

2010-01-31T13:46:11Z

Radu Jianu:

On this page the members of the [[VRL]] record and refine their goals for the current semester. This is a living document in which [[dhl]] will provide feedback. See the bottom of the page for links to past plans & goals documents.

== Current Schedule ==
Meetings are on Tuesdays.

* 1:50 - jadrian
* 2:00 - wenjin
* 2:10 - eni
* 2:20 - jadrian
* 2:30 - bb
* 2:40 - dtr
* 2:50 - trevor
* 3:00 - cad
* 3:10 - steve
* 3:20 - radu

== Current Plans and Goals (Spring '10) ==

=== [[User:Brad Berg|Brad]] ===

Projects

* Support the ongoing projects including collaborators. Active projects are wrist, brain, adviser, and protein.

* Assist Radu to integrate a test and any recent code.

* Contribute to the design and development of the new cave. This includes integrating g3d, vrpn and hosting vrg3d. Once the software is running simplify the configuration and provide a quick start path for student projects.

* Set up a distribution of diffusion imaging data.

Infrastructure

* Continue to write Wiki entries as needed.

* Continue setting up external software for students to use. Current imported packages are: blitz, cg, g3d, qt, camino, dtk, vrpn, glut, and sdl.

* Finish extending make files for local installs and kits for source and binary distributions.

* Continue to make improvements to the make files so they are easier to use.

* Upgrade migrated Linux code to work with gcc 4.3.

* Continue to integrate any new tests written by students into nightly test runs.

* Finish integrating the new version of the Nag libraries.

Knowledge

* Learn more about the cave; particularly vrg3d software development.

* Meet (SciVis talk) with students to address any integration issues.

* Learn how to manage a project using Source Forge.

----
=== David ===
#get diffusion normals, one library, and one executable distributed
#wrist proposal submission (check with Trey?)
#support 5 phd students' + trevor's progress
#write a plan for HCI modeling work
#minimize professional service

----
=== [[Jadrian]] ===

* [[:Image:Jadrian Miles PhD Proposal original 2009-06-22.pdf‎|Initial thesis proposal, submitted 2009-06-22]]
* [[:Image:Jadrian Miles PhD Proposal rev2 2009-10-15.pdf|Proposal second revision, prepared 2009-10-15]]

# Further refine the thesis proposal in response to new information
# Create a list of papers to spawn from the proposal
# Present the proposal formally to the department
# Implement a macrostructure model and derive it from diffusion data (by clustering or otherwise, with possible manual adjustment)
# Create a 3D surface rendering of a macrostructure model instance
# Continue working with Ed Walsh, et al. to settle on some HARDI parameters
# Take at least one HARDI scan, even if parameters have not been finalized
# Get preliminary histological data of some kind, either by doing it in-house, working with collaborators, or outsourcing
# Continue working with DifSim/MCell developers to get source access and a working install here
# Derive a minimal set of microstructure measurements from histological data
# Make a plan for a future summer industry or academic internship
# Make a plan for completing the outside minor requirements



----
=== Radu ===
#deploy my current work (as application or google maps) to: Christophe, Hardy, Art, and Neuroscience
#gather structured feedback from the above mentioned labs
#write "Related Work" section of dissertation and updated thesis proposal.
#submit to Vis:
#*one paper on large map-like visualizations to InfoVis (100% submission probability),
#*one on comparing clusterings to VAST (50% submission probability)
#*one on 2D brain visualizations with Cagatay to Vis (25%).
#finalize my course requirements

----

=== [[User:Steven Gomez|Steve]] ===
# Staying on track for candidacy
## Complete programming comp (late January)
## Complete research comp proposal and presentation to committee (mid April)
## Do well in courses
# Research goals
## Explore current research in HCI related to creativity, and user interaction modeling
## Identify significant, well-scoped research project in this area for the research comp proposal
## Develop research skills, including paper reading/analysis and learning to communicate effectively
# Other academic goals
## Work on collaboration skills (finding and communicating with colleagues in or outside of CS)
## Work on time management and project planning
## Learn what working with DHL is like, his expectations, etc.
## Plan for the summer
----

=== [[User:Trevor O'Brien|Trevor]] ===

# I3D poster & demo
## Revised abstract: January 29
## Conference: February 19th (poster complete by February 17)
# Vis Papers - Iterate often
## Abstract: March 21
## Full paper: March 31
### Gene visualization paper
### Confocal microscopy paper
# Genome Research paper
# Grad TA for CS224
# Paper with Paul Kulesa
## Define goals contributions from Vis perspective
# Look for themes between work with Paul, Trey, and maybe Ben
## Coordinate spaces? (Tensor invariances?)
## Morphometrics? (Non-dimensionalization)
## Other feature detection?
# Organize code, papers, tools, other resources to be backed up, handed off

----

=== Wenjin ===
# Submit to MICCAI (March 11th) + good collaboration with Matt
# Prepare histology data - do homework about the right path to choose, acquire, and prepare the tissue
# Derive and test optimal double-PGSE imaging on Brown 3T scanner
# Propose by 10/15
# Submit MRM/TMI journal paper

== Current Plans and Goals (Fall '09) ==

=== Çağatay ===
# Incorporate feedback from the committee into the[[:Image:Çağatay's_thesis_ideas.pdf | proposal]]
# Start working realizing the finalized proposal.
# Submit the histogram embedding work to ISMRM.
# Submit the surface deformation work to SIGGRAPH.
----

=== [[User:Andy Forsberg|Andy]] ===
# mri/wrist
## tools
### registration, classification, distance-field calculation, bone proximity calc.
### graphical visualization/verification?
## modeling?
# $G (nightly tests, architecture, outside test-case = ADVISER)
# future funding candidates
## volume data visualization/analysis
## flow visualization w/ leopold/GK
## other?

----

=== [[User:Brad Berg|Brad]] ===

Projects

* Support the ongoing projects including collaborators. Active projects are wrist, brainapp, adviser, and protein.

* Assist Radu to integrate a test and any recent code.

* Contribute to the design of the new cave.

Infrastructure

* Continue to write Wiki entries as needed.

* Continue setting up external software for students to use. Current imported packages are: blitz, cg, g3d, qt, and xerces

* Extend make files for local installs and kits for source and binary distributions.

* Continue to make improvements to the make files so they are easier to use and to provide Windows support.

* Upgrade migrated Linux code to work with gcc 4.3.

* Continue to integrate any new tests written by students into nightly test runs.

* Integrate the new version of the Nag libraries.

Knowledge

* Learn more about the cave; particularly software development.

* Meet (SciVis talk) with students to address any integration issues.

----

=== Çağatay ===
# Incorporate feedback from the committee into the[[:Image:Çağatay's_thesis_ideas.pdf | proposal]]
# Start working realizing the finalized proposal.
# Submit the histogram embedding work to ISMRM.
# Submit the surface deformation work to SIGGRAPH.
----

=== David ===
#figure out software and data dissemination and get implemented with bb's help [some progress, more next semester]
#wrist proposal submission [not sure where this went with Trey]
#harvard stuff moving; read Janeway? [good meeting in Boston]
#support 6 phd students' progress [all proposals done!]
#write a plan for HCI modeling work (draft by 10/23, rev by 11/20) [not enough structure]
#minimize professional service [less successful than hoped]
#vis2011 sited, early committee defined after Vis by 10/16 [contract signed, delaying committee]
----

=== Eni ===

*submit tract integrity vs. cognitive tests abstract and histograms abstract to ismrm
*possibly write a paper on the wrist comparison study (old/new subjects)
*while working on different wrist problems, think of a problem I might want to focus on
*do well in the courses I'm taking

----

=== [[User:Jadrian Miles|Jadrian]] ===
[[:Image:Jadrian Miles PhD Proposal original 2009-06-22.pdf‎|Initial thesis proposal, submitted 2009-06-22]]

# Incorporate committee's comments into my proposal by 2009-10-15
#* Revision complete 2009-10-15
# Make a list of papers to spawn from the proposal by 2009-10-15
#* {{red|Incomplete}}
# Decide with dhl on the role of animal models in the proposal
#* Histological "wetwork" will play an important role in the research; significant planning and collaboration-building took place this semester
# Finish clustering code sufficient for an initial version of the backsolving system
#* {{red|Incomplete}}
# Find or build implementations of a more sophisticated tractography technique (Q-ball or Gordon's multi-tensor)
#* DTK & Trackvis installed and working with current data as of 2009-11-04
# Work with Ed Walsh, dhl, and wzhou to settle on some HARDI parameters
#* {{red|Scan parameters have not been decided}} but ongoing work with Steve's group is teaching us all more about parameter tradeoffs
# Take one HARDI scan by 2009-11-24
#* {{red|No new scan was acquired this fall}}, pending a decision about scan parameters
# Get DifSim (the MCell-based UCSD diffusion simulator) installed and working here
#* {{red|Not installed}} due to ongoing license issues, but I'm in communication with the developers and confident that it'll work out

----

=== Radu ===
# Deploy existing visualization tools by Oct 15 (in Labs and in CVS - Protein-version2, Clustering apps)
# Migrate BrainApp functionality to the new framework by Nov 1 (help from Cagatay and Eni)
# Test usefulness of the QT vis framework (on Cagatay); if useful deploy by Nov 1
# Advance Immgen
## Write report for next year
## Daphne-data vis prototype by Nov 1
## Genome-google maps operation by Oct1
## Broad display operational
## Paper on analyzing and disseminating large visualizations?
# Gather vis tools usage data
# Proposal
## Gather, read and summarize cogsci and linked visualization literature
# 2D interaction on stream-tubes study? Paper?
# Successful Vis talk
# Proposal is [http://cs.brown.edu/people/jr/proposal_jr.pdf here]

----

=== Trevor ===

# Research comps!
# Review and address EuroVis reviews for cell paper.
## Submit to PacVis?
# Research comps work --> i3d submission.
# Narrow long term focus.
# Foster collaborations:
## Paul Kulesa
## Trey Crisco
## Sharon Swartz
# Finish course requirements.

----

=== Wenjin ===

* Finalize [http://cs.brown.edu/~wzhou/proposal_wzhou.pdf Proposal]: incorporate feedback from committee in NIH format
* Survive NEUR 1650
* Analytical model tested on simulation data to accomplish 1-2 of the following (based on current limitations):
** estimate axon parameter for unknown fiber direction
** recover small axon radii < 4 micrometer
** estimation with clinically achievable acquisitions
** build and evaluate 4-compartment model with water exchange vs. 2-compartment
* Derive and test optimal imaging parameters on Brown 3T scanner
* submit to ISMRM (Nov. 10th) or MICCAI in March
* prepare for MRM/TMI journal submission

=== [[User:Steven Gomez|Steve]] ===

Course work
* Explore courses that may be relevant to research interests, or may help me think more outside-the-box
* Use project classes to explore interests in graphics, vis, hci

Research
* Draft R&R plan for spring semester by 11/15
* Start thinking about research comp ideas and proposal by 11/15
* Contribute to the VRL however I can
* Search through past ideas/projects worth investigating more by 10/1
** Online raytracing with voronoi diagrams?
** Interfaces that learn?

Personal
* Get adjusted to Brown, Providence, graduate school
** Work on time management, organization
* Pass programming comp in January

== Past Plans and Goals ==
* [[/Summer 2009|Summer '09]]
* [[/Spring 2009|Spring '09]]
* [[/Fall 2008|Fall '08]]
* [http://sites.google.com/a/vis.cs.brown.edu/collaboravis/Home/summer-08-group-goals Summer '08]

[[Category:VRL]]

Plans and Goals

2009-09-28T16:59:51Z

Radu Jianu: /* Radu */

Plans and Goals

2009-09-28T16:55:52Z

Radu Jianu: /* Radu */

Plans and Goals

2009-09-28T16:54:55Z

Radu Jianu: /* Radu */

Plans and Goals

2009-09-14T16:04:06Z

Radu Jianu: /* Radu */

Plans and Goals

2009-06-01T17:34:38Z

Radu Jianu:

CS295J/Literature to read for class 12

2009-04-16T22:36:19Z

Radu Jianu:

* Salvucci, D. D., Taatgen, N. A., and Borst, J. P. 2009. Toward a unified theory of the multitasking continuum: from concurrent performance to task switching, interruption, and resumption. In Proceedings of the 27th international Conference on Human Factors in Computing Systems (Boston, MA, USA, April 04 - 09, 2009). CHI '09. ACM, New York, NY, 1819-1828. DOI= http://doi.acm.org/10.1145/1518701.1518981
* John, et. al, 2002. [http://portal.acm.org/citation.cfm?id=503376.503404 Automating CPM-GOMS] (Eric)
* Smith, et al. [http://hfs.sagepub.com/cgi/reprint/43/3/366 Monitoring task loading with multivariate EEG measures during complex forms of human-computer interaction] (Jon)
* Robinson et al. 2008 [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Robinson-2008-CSV.pdf Collaborative Synthesis of Visual Analytic Results] (Radu)

CS295J/Literature

2009-04-14T19:43:52Z

Radu Jianu: /* Thinking, analysis, decision making */

==Perception==

* Colin Ware: Information Visualization: Perception for Design
:Insight into some of the theory of perception as it pertains to building visual interfaces (David)

* Some unindentified paper(s)/book(s) about Gestalt theories of perception and cognition [http://en.wikipedia.org/wiki/Gestalt_psychology wikipedia page]
:These theories, from the 40's inform visual design and may provide an analogy for integration of theory and practice. They describe some characteristics of perception that have been used as evaluative rules in UI design. (David)

* [http://vrlab.epfl.ch/~pglardon/VR05/papers/chi2004.pdf Feeling Bumps and Holes without a Haptic Interface: the Perception of Pseudo-Haptic Textures] Lecuyer-2004-FBH
: A cool technique on "hacking" human perception by modifying the control/display ratio of visible elements to simulate haptic feedback for the user. Strong analysis of which parts of haptic feedback are useful (e.g., vertical elements can be discarded). Pseudo-haptic feedback is implemented by combining the use of visible feedback with the changing sensitivity of a passive input device (e.g., a mouse). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=267474 Research issues in perception and user interfaces] Encarnacao-1994-RIP
: "The authors focus at on three things: presentation of information to best match human cognitive and perceptual capabilities, interactive tools and systems to facilitate creation and navigation of visualizations, and software system features to improve visualization tools." First and third points sound relevant. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=vnax4nN4Ws4C&oi=fnd&pg=PA703&dq=slanty+design&ots=P7G259hzJa&sig=vbYZmYkquwuA_ollOI6EgciNJjU The Uniqueness of Individual Perception] Whitehouse-1999-ID
: Focuses on the commonalities of perception. Rough overview of sensory mechanisms, and strong anecdotal support of not adapting completely to the user, but rather requiring the user to adapt as well. Identifies some common perceptual problems with particular groups of EUs (e.g., blind people). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.psychonomic.org/search/view.cgi?id=4180 Guided search 2. 0. A revised model of visual search] Wolfe-1994-GS2
: A theory of visual search that builds on the distinction between visual targets that you need to search for in a field of distractors and those that "pop out" at you. (Adam) 16:22, 26 January 2009 (UTC)

* [http://biologie.kappa.ro/Literature/Misc_cogsci/articole/dvp/scholl00.pdf Perceptual causality and animacy] [[Scholl-2000-PCA]]
: Discusses some of the automatic interpretation in our perception, focusing on inferring causal relations and animacy. 

* [http://www.cs.umd.edu/class/fall2002/cmsc434-0201/p79-gaver.pdf Technology Affordances] Gaver-1991-TAF
: Affordances are actions that are appropriate for an object and that come to mind when perceiving the object. (Adam) 16:22, 26 January 2009 (UTC)

* [http://portal.acm.org/ft_gateway.cfm?id=301168&type=pdf&coll=GUIDE&dl=GUIDE&CFID=19761061&CFTOKEN=10084975 Affordance, conventions, and design] Norman-1999-ACD
: How the original concept of affordances differs from how it has been used in HCI. (Adam) 16:22, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=DrhCCWmJpWUC&oi=fnd&pg=PA1&dq=ecological+approach+visual+perception&ots=TeE80z49Fr&sig=c0jHz0ucQUTFNvUM5ObQouQq_Oc The Ecological Approach to Visual Perception] Gibson-1986-EAV
: Outlines direct perception and the original theory of affordances. (Jon) 14:07, 3 February 2009.

* [http://ieeexplore.ieee.org/iel1/21/4054/00156574.pdf?tp=&arnumber=156574&isnumber=4054 Ecological interface design: Theoretical foundations] Vicente-1992-EID
: Theory of how interfaces can avoid forcing processing at a higher level than the task requires. (Jon) 14:56, 3 February 2009.

* [http://www.informaworld.com/smpp/ftinterface~content=a784403799~fulltext=713240930 The Ecology of Human-Machine Systems II: Mediating Direct Perception in Complex Work Domains] Vicente-2000-EHM
: Taking advantage of fast perceptual processes to reduce cognitive demands as applied to the design of a thermal-hydraulic system. (Jon) 14:56, 3 February 2009.

* [http://www.aaai.org/Papers/Workshops/1998/WS-98-09/WS98-09-020.pdf Acting on a visual world: The role of multimodal perception in HCI]. Wolff-1998-AVW.
: Experiment that has implications for gesture interpretation module development.

==Cognition==

* Colin Ware: Visual Thinking: For Design
:Insight into some of the theory of cognition as it pertains to building visual interfaces (David)

* [http://en.wikipedia.org/wiki/Seven_plus_or_minus_two Wikipedia's Seven Plus or Minus Two page]
:A clear description of one part of human thinking; will probably provide pointers to other things to read (David)

* [http://portal.acm.org/citation.cfm?id=108844.108865 A cognitive model for the perception and understanding of graphs] Lohse-1991-CMP
: Describes a computer program that predicts response time to a query from assumptions from eye-tracking, short-term memory capacity, and the amount of information that can be absorbed from the query in each "glance." Attempts to lay the foundation for explaining several steps of human cognition, including input, memory, and processing. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.informaworld.com/smpp/content~content=a784395566~db=all~order=page Cognitive load during problem solving: Effects on learning] John Swiller
: Older article but referenced in a lot of newer ones; looks at how conventional problem-solving is ineffective as a learning device. (lisajane)

* [http://web.ebscohost.com/ehost/pdf?vid=1&hid=4&sid=13a77fd7-bead-41ce-bfb1-38addb0dfa53%40sessionmgr7 Dimensional overlap: Cognitive basis for stimulus–response compatibility—A model and taxonomy] Kornblum-1990-DOC
: People are more effective at a task when the stimulus and response representations are compatible and they don't require "translation". (Adam) 16:22, 26 January 2009 (UTC)

* [http://vis.cs.brown.edu/~trevor/Papers/Iverson-TNR-ImPact.pdf Tracking Neuropsychological Recovery Following Concussion in Sport]
: This paper discusses the neurological basis for the ImPact test given to athletes after they've suffered a concussion. It provides testing and quantitative measures for verbal memory, visual memory, and reaction times. These simple measures of cognition may be useful to incorporate in an HCI study. (Trevor)

A Framework of Interaction Costs in Information Visualization
:ABSTRACT: Interaction cost is an important but poorly understood factor in visualization design. We propose a framework of interaction costs inspired by Norman’s Seven Stages of Action to facilitate study. From 484 papers, we collected 61 interaction-related usability problems reported in 32 user studies and placed them into our framework of seven costs: (1) Decision costs to form goals; (2) System-power costs to form system operations; (3) Multiple input mode costs to form physical sequences; (4) Physical-motion costs to execute sequences; (5) Visual-cluttering costs to perceive state; (6) View-change costs to interpret perception; (7) State-change costs to evaluate interpretation. We also suggested ways to narrow the gulfs of execution (2–4) and evaluation (5–7) based on collected reports. Our framework suggests a need to consider decision costs (1) as the gulf of goal formation.
: Includes some ideas for quantitatively evaluating information visualization interfaces (David)

*Distributed Cognition as a Theoretical Framework for HCI (1994) Christine A. Halverson [http://hci.ucsd.edu/cogsci/faculty_pubs/9403.ps]


* [http://consc.net/papers/extended.html The Extended Mind] Clark-1998-TEM
: Cognition can be thought to be distributable across mediums (outside of the skull). How might we off-load "cognitive" processes to computer systems? ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - Owner)
: I think that Ware gets into this in some of his writing about information visualization (or in his second book, thinking with visualization). We can build in external "caches" or other constructs to be part of our cognitive model. It seems like most of an analytical user interface is part of the external cognitive process. (David)


* [http://courses.csail.mit.edu/6.803/pdf/dualtask.pdf Sources of Flexibility in Human Cognition: Dual-Task Studies of Space and Language] HermerVazquez-1999-SFC
: Our use of language serves as a higher-order cognitive system which can be utilized as "scaffolding" in human thought, supporting goal-driven tasks. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.sjdm.org/mail-archive/jdm-society/attachments/20060401/963b50da/attachment-0003.pdf In two minds: dual-process accounts of reasoning] Evans-2003-ITM
: It is hypothesized that there are two distinct systems of reasoning in the mind. System 1 is innate and fast, system 2 is controlled and slow. Knowledge of this might help us determine which tasks are candidates for one system or another. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6WJB-467J83F-3&_user=489286&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=316065013955ca22e9dde19df6a0f9b8 Priming against your will: How accessible alternatives affect goal pursuit] Shah-2002-PAY
: The authors demonstrate how priming the means to achieving a goal also primes the goal, but inhibits alternative means to achieving the same goal. It means that making the means of achieving a goal salient in an interface will make it more likely that people pursue that goal, and less likely that they will think of other means to pursue it. (Adam)

==HCI==

* [http://portal.acm.org/citation.cfm?id=1357054.1357125&coll=portal&dl=ACM&type=series&idx=SERIES260&part=series&WantType=Proceedings&title=CHI&CFID=20781736&CFTOKEN=83176621 A diary study of mobile information needs]

:A detailed study into how people use mobile devices. '''(Andrew Bragdon - OWNER for Assignment 2)'''

* [http://portal.acm.org/citation.cfm?id=1357054.1357187&coll=Portal&dl=GUIDE&CFID=21136843&CFTOKEN=23841774 Feasibility and pragmatics of classifying working memory load with an electroencephalograph]

:Examines how practical it is to use electroencephelographs to measure cognitive load, and discusses domain-specific knowledge needed.

* [http://delivery.acm.org/10.1145/1250000/1240669/p271-hurst.pdf?key1=1240669&key2=6465483321&coll=GUIDE&dl=GUIDE&CFID=20565232&CFTOKEN=69614228 Dynamic Detection of Novice vs Skilled Use]

:Used a learning classifier, trained on low-level mouse and keyboard usage patterns, to identify novice and expert use dynamically with accuracies as high as 91%. This classifier was then used to provide differrent information and feedback to the user as appropriate.

* [http://portal.acm.org/citation.cfm?id=1054972.1055012&coll=GUIDE&dl=ACM&CFID=20565232&CFTOKEN=69614228 Bubble Cursor]

:Example of a paper which demonstrated a novel interaction technique still obeys Fitts's law.

* [http://tlaloc.sfsu.edu/~lank/research/appearing/FSS604LankE.pdf Sloppy Selection]

:Utilized a quantiative model of user performance which used curvature to predict the speed of a pen as it moved across a surface to help disambiguate target selection intent.

* [http://delivery.acm.org/10.1145/1250000/1240730/p677-iqbal.pdf?key1=1240730&key2=4525483321&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 Disruption and Recovery of Computing Tasks]

:Studied task disruption and recovery in a field study, and found that users often visited several applications as a result of an alert, such as a new email notification, and that 27% of task suspensions resulted in 2 hours or more of disruption. Users in the study said that losing context was a significant problem in switching tasks, and led in part to the length of some of these disruptions. This work hints at the importance of providing affordances to users to maintain and regain lost context during task switching.

* [http://portal.acm.org/citation.cfm?id=985692.985715&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 A diary study of task switching and interruptions]

:Showed that task complexity, task duration, length of absence, and number of interruptions all affected the users' own perceived diffuclty of switching tasks. (Andrew Bragdon)

* John M. Carroll: HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science

:A gargantuan book with chapters by many folks describing some of the models and theories from HCI that may relate back to cognition; may need to create individual (David)

* [http://portal.acm.org/citation.cfm?id=1461832&dl=&coll= Project ernestine: validating a GOMS analysis for predicting and explaining real-world task performance]

: A study in which the [http://en.wikipedia.org/wiki/GOMS#cite_note-CHI92-1 GOMS] method is used to correctly predict the performance of call center operators using a new workstation. Might be interesting because of the methodology used to decompose the task into basic cognitive and perceptual actions, and then measuring these actions to evaluate the new interface. (Eric) The CPM (Critical Path Modeling) aspect used handles the parallel nature of several human components of HCI and seems to very accurately model the low level tasks from this study. (David)

* [http://www.informaworld.com/smpp/content~content=a784766580~db=all The Growth of Cognitive Modeling in Human-Computer Interaction Since GOMS]

* [http://portal.acm.org/citation.cfm?id=169059.169426&coll=Portal&dl=GUIDE&CFID=19188713&CFTOKEN=13376420 The limits of expert performance using hierarchic marking menus]
Marking menus naturally facillitate the transition from novice to expert performance for command invocation, and have been quite influential over the years to research into menu techniques. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/302979.303053 Manual and gaze input cascaded (MAGIC) pointing]

This is a system which combines gaze input (coarse-grained) and mouse input (fine-grained) to quickly target items. This is important because it "kind of" gets around Fitt's law by using gaze input to "warp" the cursor to the general vicinity of what the user wants to work on. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/985692.985727 If not now, when?: the effects of interruption at different moments within task execution] Adamczyk-2004-INN

Presents task models of user attention. (Andrew Bragdon) (Adam - owner; [http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - discussant) '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:58, 28 January 2009 (UTC)


* [http://hfs.sagepub.com/cgi/reprint/44/1/62.pdf Ecological Interface Design: Progress and challenges] Vicente-2002-EID
: Discusses the implications of Ecological Interface Design (EID), a theoretical HCI framework, for designing human-computer interfaces and compares performance of EID-informed designs to other comtemporary approaches. (Owner: Jon)

* [http://doi.acm.org/10.1145/985692.985707 "Constant, constant, multi-tasking craziness": managing multiple working spheres.] Gonzalez-2004-CCM

Empirical study of how information workers spend their time. Puts forward a theory of how users organize small individual tasks into "working spheres." (Andrew Bragdon - OWNER; Adam Darlow - Discussant; Steven Ellis - Discussant)

'''250-word summary and relevance statement''' (Andrew Bragdon)

Any visualization which is used extensively by a user over a period of time will be used in the context of that user's daily workflow. It is therefore essential to understand this larger workflow context to design the visualization application appropriately to fit the needs of real world users. This paper studies in detail the daily workflow tasks and patterns of work of analysts, managers and software developers in a medium-sized software company. This paper provides strong empirical evidence that users, rather than working on discrete and well-defined tasks, in reality, switch tasks on average every two to three minutes, and instead, work on larger thematically connected units of work (working spheres). In addition, the study found that users switched between these larger working spheres on average every 12 minutes. Thus, it is strongly indicated by this paper that many information workers are in a constant state of rapid fire multi-tasking. This suggests that for a visualization to be relevant to any of these information workers, it would need to fit into, and support, this workflow. This is just a first step towards understanding how users interact with visualizations in particular, however; future work that studies how users interact with visualizations as part of their larger daily work patterns is warranted, and would be an important component of a broad theory of visualization.

* [http://www.eecs.berkeley.edu/Pubs/TechRpts/2000/CSD-00-1105.pdf The state of the art in automating usability evaluation of user interfaces] Ivory-2000-SAA
: Presents a new taxonomy for automating usability analysis. Advantages of automated evaluation are purported to be advantages linked to efficiency, such as comparing alternate designs, uncovering more errors more consistently, and predicting time/error costs across an entire design. Breaks down a taxonomy with individual benefits and drawbacks of each method, and checks observations against existing guidelines (e.g. Smith and Mosier guidelines, Motif style guidelines, etc). Introduces several visual tools. Looks extremely relevant as a comprehensive survey of existing techniques. '''OWNER''': [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC) '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC) Discussant: Steven Ellis

* [http://www.hpl.hp.com/techreports/91/HPL-91-03.pdf User Interface Evaluation in the Real World: A Comparison of Four Techniques] Jeffries-1991-UIE
: Overview of the four major UI evaluation methods: heuristic evaluation, usability testing, guidelines, and cognitive walkthrough, followed by a comparison in their application to a case study. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ics.colorado.edu/techpubs/pdf/91-01.pdf Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces] Polson-xxxx-CWM
: Presents the concept of performing a hand walkthrough of the cognitive process, based on another theory of "learning by exploration." Strong results for a limited evaluation timeframe and little or no time for formal instruction of the interface for the user. The reviewer considers each behavior of the interface and its resultant effect on the user, attempting to identify actions that would be difficult for the "average" user. Claims that a given step will ''not'' be difficult must be supported with empirical data or theory. The application of cognitive theory early in the design process seems useful in avoiding costly redesigns when problems are identified later. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=142834&coll= Finding usability problems through heuristic evaluation] Nielsen-1992-FUP
: Emphasis on heuristic evaluation. Shockingly, usability experts are found to be better at performing this type of evaluation. Usability problems relating to elements that are completely missing from the interface are difficult to identify with this method when evaluating unimplemented designs. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://delivery.acm.org/10.1145/130000/128728/p152-jacob.pdf?key1=128728&key2=7032992321&coll=GUIDE&dl=GUIDE&CFID=19735001&CFTOKEN=82907542 The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look at is What you Get] Jacob-1991-UEM
: One of the first research papers to introduce eye tracking as a viable HCI technique. (Trevor)

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=1221372&isnumber=27434 Real-Time Eye Tracking for Human Computer Interfaces] Amarnag-2003-RTE
: Technical details about the implementation of a recent real-time eye-tracking system. (Trevor)

* [http://www.ipgems.com/present/swui_chi_20070502.pdf Semantic Web HCI: Discussing Research Implications] Degler-2007-SWH
: A workshop discussion from CHI 2007 discussing the idea of a "semantic internet" and its relevance to the HCI community. Discusses things like adaptive web interfaces, mashups, dynamic interactions, etc. (Trevor)

* [http://www.springerlink.com/content/u3q14156h6r648h8/fulltext.pdf Implicit Human Computer Interaction Through Context] Schmidtt-2000-IHC
: A highly cited paper discussing the notion of implicit HCI, including semantic grouping of interactions, and some perceptual rules. ('''Trevor - OWNER'''; Andrew Bragdon - discussant; '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:57, 28 January 2009 (UTC))

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1903_1 Cognitive Strategies for the Visual Search of Hierarchical Computer Displays] Anthony J. Hornof
: This article investigates the cognitive strategies that people use to search computer displays. Several different visual layouts are examined. (lisajane)

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1904_9 Unseen and Unaware: Implications of Recent Research on Failures of Visual Awareness for Human-Computer Interface Design] D. Alexander Varakin; Daniel T. Levin; Roger Fidler
: This article reviews basic and applied research documenting failures of visual awareness and the related metacognitive failure and then discuss misplaced beliefs that could accentuate both in the context of the human-computer interface. (lisajane)

* Shneiderman, Plaisant: Designing the User Interface
: My textbook for an HCI class, has many good lists of guidelines. Especially Ch.2 pp 59-102. (lisajane)

* Robert Mack, Jakob Nielsen: Usability Inspection Methods (Ch. 1 Executive Summary)
: Provides an overview of main usability inspection methods, a fair introduction to the industrial applications, as well as certain costs and benefits, of the methods as well as suggestions for expansive research. (Steven)

* [http://portal.acm.org/citation.cfm?id=22950 Jock Mackinlay, Automating the design of graphical presentations of relational information], ACM Transactions on Graphics (TOG),
5(2):110-141, 1986. (Jian)
: The first paper talked about how to automatically generate *good* graphs.

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=04376133 Jock Mackinlay, Pat Hanrahan, Chris Stolte, Show Me: Automatic Presentation for Visual Analysis] IEEE TVCG 13(6): 1137-1144, Nov-Dec, 2007 (Jian)
: Extend their previous paper to analytics tasks.

* [http://www.win.tue.nl/~vanwijk/vov.pdf Jarke J. van Wjik, The value of visualization], IEEE visualization 2005. (Jian)
: discuss vis from a variety of angles as for art, science and technology and question and quantify the utility of visualization.

* [http://www.almaden.ibm.com/u/zhai/papers/steering/chi97.pdf Johnny Accot and Shumin Zhai, Beyond Fitts' law: models for trajectory-based HCI tasks], CHI 97. (Jian)
: Extend Fitts' to trajectory based tasks.

*[http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=01703371 Saraiya, P., North, C., Lam, V., and Duca, K.A, An Insight-Based Longitudinal Study of Visual Analytics], TVCG 12(6): 1511-1522, 2006.(Jian)
* the first paper that quantifies what insight is by comparing several infoVis tools for bioinformatics.

*[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1359732 David H. Laidlaw, Michael Kirby, Cullen Jackson, J. Scott Davidson, Timothy Miller, Marco DaSilva, William Warren, and Michael Tarr.Comparing 2D vector field visualization methods: A user study]. IEEE Transactions on Visualization and Computer Graphics, 11(1):59-70, 2005. (Jian)
: an application-specific comparison of visualization method. a cool paper.

* [http://web.mit.edu/rruth/www/Papers/RosenholtzEtAlCHI2005Clutter.pdf Rosenholtz, Li, Mansfield, and Jin, Feature Congestion: A Measure of Display Clutter], CHI 2005. (Jian)
: quantify visual complexity from a statistics point of view.

* [http://delivery.acm.org/10.1145/240000/236054/p320-john.pdf?key1=236054&key2=2285613321&coll=GUIDE&dl=GUIDE&CFID=19490404&CFTOKEN=25744022 The GOMS Family of User Interface Analysis Techniques: Comparison and Contrast] (Trevor)
: This paper offers an analysis of four types of GOMS (Goals, Objects, Methods and Selection) based interaction techniques. GOMS is a widely used UI paradigm, made popular by Card et al in The Psychology of Human-Computer Interaction (1983).

* [http://vis.cs.brown.edu/~trevor/Papers/Lisetti-2000-AFE.pdf Automatic Facial Expression Interpretation: Where Human-Computer Interaction, Artificial Intelligence and Cognitive Science Intersect] (Trevor)
: Using advanced computer vision/AI techniques, this work aims to discern and make use of users' emotions in UI design.

* [http://vis.cs.brown.edu/~trevor/Papers/weld-2003-APU.pdf Automatically Personalizing User Interfaces] (Trevor)
: Discusses some techniques and design decisions for constructing adaptable and customizable user interfaces. There are some useful references in the paper on using HMMs and RMMs (Relational Markov Models) for interaction prediction.

* [http://vis.cs.brown.edu/~trevor/Papers/Gajos-2006-.pdf Exploring the Design Space for Adaptive Graphical User Interfaces] (Trevor)
: This paper presents comparative evaluations of three methods for implementing adaptable user interfaces. The evaluation methodology gives rise to three key concepts that affect the performance of adaptable UIs: frequency of adaptation, accuracy of adaptation, and the impact of predictability.

* Conceptual Modeling for User Interface Development - David Benyon, Diana Bental, and Thomas Green
: Proposes a new set of terminology for describing and comparing existing and future cognitive models of HCI. (Steven)

* [http://homepage.ntlworld.com/greenery/workStuff/Papers/ERMIA-Skull.PDF The Skull beneath the Skin:
Entity-Relationship Models of Information Artefacts] T. R. G. Green, D. R. Benyon
: A paper in form of prelude to the above, gives a good overview of the ERMIA method. (Steven)

===Cognitive Modeling===

* [http://vis.cs.brown.edu/~trevor/Papers/Kaptelinin-1994-ATI.pdf Activity Theory: Implications for Human-Computer Interaction] (Trevor)
: Discusses the notion of Activity Theory as the basis for HCI research. The most interesting part of this paper for me was the introduction which expressed the need for a ''Theory of HCI''.

* [http://en.wikipedia.org/wiki/Seven_stages_of_action Norman's Seven stages of action]
: Presents Norman's seven stages of action, as well as his model of evaluation. (Steven)

* [http://vis.cs.brown.edu/~trevor/Papers/Wright-2000-AHC.pdf Analyzing Human-Computer Interaction as Distributed Cognition: The Resources Model] (Trevor)
: Creates a compelling argument for why distributed cognition research fits in with HCI, and what types of impacts it may have on the HCI community.

* [http://sonify.psych.gatech.edu/~walkerb/classes/hci/extrareading/nardi.pdf Studying Context, A Comparison of Activity Theory, Situated Action Models, and Distributed Cognition] Bonnie A. Nardi
: Defines the task of the HCI specialist as the application of psychological and anthropological principles to specific design problems. It posits an inherent feud between the accurate study of relative contexts and the necessary, but more general, development of comparative models and results. Gives a coherent overview of activity theory, situated action models, and distributed cognition; finds that activity theory presents the best overall framework. There is little reason given for this ranking, however, and the description of activity theory is the most theoretical and least developed of the three.
: Having spent quite a bit of time studying Soviet psychology (from which came activity theory) last semester, I question the validity of the paper’s claim, as its description of activity theory bears the artifacts of the oppressive regulations which the Soviet government imposed on psychologists. Although the theory may sound more practical, it seems fairly weak as a basis for empirical design analysis.
: The paper’s strongest point is the criticisms which follow descriptions, in which theoretical shortcomings of each perspective are discussed. ('''Owner:''' Steven, '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC))

* [http://www.billbuxton.com/chunking.html Chunking and Phrasing and the Design of Human-Computer Dialogues]

High-level theory of human-computer dialogues. (Andrew Bragdon)

* Polson, P. and Lewis, C. Theory-Based Design for Easily Learned Interfaces. Human-Computer Interaction, 5, 2 (June 1990), 191-220.

: This is a cognitive model of how users find and learn commands in an unfamiliar user interface. This could potentially be adapted to be a piece of a theory of visualization. (Andrew Bragdon)

* [http://www.syros.aegean.gr/users/tsp/conf_pub/C12/c12.pdf Activity Theory vs Cognitive Science in the Study of Human-Computer Interaction]
: Provides a brief history of Cognitive Science and HCI, then compares the effectiveness of the aforementioned theories in aiding design and development. (Owner - week 2 : Steven)

* [http://www.sciencedirect.com/science?_ob=PublicationURL&_tockey=%23TOC%236829%232001%23999449998%23287248%23FLP%23&_cdi=6829&_pubType=J&_auth=y&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=64b44ef6df77ae073d41a7367db866b5 International Journal of Human-Computer Studies - Special Issue on Cognitive Modeling]
:Articles all concerning various issues of cognitive modeling as relates to HCI. (Steven)

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6VDC-4811TNB-5&_user=10&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=259b5c105222437fc84990b7a1eaedee The role of cognitive theory in human–computer interface]. Chalmers, Patricia A, 2003.
:Was scared again, but no need to be. Touches only on a subset of cognitive theories (Schema theory, Cognitive load, and retention theories) and undertakes a survey of some software design theories, but does not attempt an explicit mapping between the two. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=26115.26124 Design Guidelines]. Marshall, Nelson, and Gardiner, 1987.
:Attempt to apply cognitive psychology to user-interface design. Here, the opposite problem is seen—the author's make no significant attempt to take existing heuristic guidelines into account. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://www.cognitivedesignsolutions.com/ Cognitive Design Solutions, Inc.]
:Training and consulting firm that claims to take advantage of Cognitive Design in making design and performance improvements. [[User:E J Kalafarski|E J Kalafarski]] 13:50, 20 February 2009 (UTC)

* [http://infolab.uvt.nl/research/lap2003/agerfalk.pdf Actability Principles in Theory and Practice]. Agerfalk, Par J, 2003.
:Presents a set of nine contemporary principles for the evaluation of IT systems ("social tools to perform communicative action") based explicitly on cognitive principles. Introduces a notion comparable to usability called ''actability''. Presents a mapping for some basic usability principles to some seminal sets of guidelines. [[User:E J Kalafarski|E J Kalafarski]] 14:29, 20 February 2009 (UTC)

==Design==

* Wikipedia articles on [http://en.wikipedia.org/wiki/A_Pattern_Language "A Pattern Language"] and [http://en.wikipedia.org/wiki/Design_pattern "Design Pattern"]
:see summary for Alexander below (David)

* UI Design principles (feedback, etc -- find ref)

* Alexander: A Pattern Language: Towns, Buildings, Construction
:The original design pattern source; what makes a human space work, ineffable best practices, ~250 rules is enough to do communities and house-sized artifacts; could be a good metaphor for making; could be a good metaphor for making human virtual space work? (David)

* [http://useraware.iict.ch/uploads/media/TangibleBits.pdf Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms] Ishii-1997-TBT
:A specific UI proposal, but has nice relevant discussion on how we perceive "foreground" items and "background" items and their relationship, taking advantage of this "parallel" processing of perception. Includes the use of visual metaphors, phicons, and a notion they invent called "digital shadows," in which the shadow projected by an object conveys some information on its contents. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://list.cs.brown.edu/courses/csci1900/2007/documents/restricted/beale.pdf Slanty Design] Beale-2007-SD
:Design method with emphasis on discouraging undesirable behavior, by perhaps forcing the user to adapt to the interface, giving equal weight to user goals, user "non-goals," and wider goals of stakeholders besides the immediate user. The important insight seems to be that these wider goals can enhance the user's experience with the larger system in the long run, if not in the immediate timeframe. Five major design steps. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.amazon.com/Designing-Interactions-Bill-Moggridge/dp/0262134748/ref=pd_bbs_sr_1?ie=UTF8&s=books&qid=1232989194&sr=8-1 Designing Interactions] by Bill Moggridge
: Really awesome book on the evolution of interactions with technology. (Trevor)

* [http://www.amazon.com/Sketching-User-Experiences-Interactive-Technologies/dp/0123740371/ref=sr_1_1?ie=UTF8&s=books&qid=1232989269&sr=1-1 Sketching User Experiences] by Bill Buxton
: Another great book on the practices of interaction design. (Trevor)

* [http://site.ebrary.com/lib/brown/docDetail.action?docID=10173678 The Laws of Simplicity] by John Maeda
: An interesting work on the efficiency of minimalist design. Quick read for those interested. (Steven)
: A set of design guidelines some of which we may be able to build on in automating interface evaluation; will certainly apply to manual evaluations [[User:David Laidlaw|David Laidlaw]]

* [http://www.cs.umd.edu/hcil/pubs/presentations/eyeshaveit/index.htm Ben Shneiderman, The Eyes Have It: User Interfaces for Information Visualization], UM, tech-report, CS-TR-3665. (Jian)
: the paper talks about visualization mantra.

* [http://hci.rwth-aachen.de/materials/publications/borchers2000a.pdf A pattern approach to interaction design] Borchers-2001-PAI
: A highly-cited work on the development of a language for defining design patterns for use in interface development, with an emphasis on communication between application developers and application domain experts. [[User:E J Kalafarski|E J Kalafarski]] 16:37, 3 February 2009 (UTC)

==Thinking, analysis, decision making==

* Morgan D. Jones: The Thinker's Toolkit: Fourteen Powerful Techniques for Problem Solving

:Set of methods for solving problems that might be incorporated into tools for thinking (David)

* Keim, Shazeer, Littman: Proverb: The Probabilistic Cruciverbalist

:An automatic crossword-puzzle solver; the software framework for building this program may be a metaphor for some thinking groupware with plug-in modules. (David)

* Thomas, Cook: Illuminating the Path

:a research agenda for tools for intelligence analysts; not sure of relevance (David)

* Richard Thaler, Cass Sunstein: Nudge - Improving Decisions About Wealth, Health, and Happiness
: A great, easy read for someone who isn't familiar with the psychological perspective. Focuses mainly on public policy issues, but certain sections (on developing a better social security website, for example) relate specifically to digital design. (Steven)

* [http://www.cs.brown.edu/people/trevor/Papers/Heer-2008-GraphicalHistories.pdf Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation] (InfoVis 2008)
: Work by Jeff Heer of Stanford (formerly Berkley) on using Graphical Interaction Histories within the Tableau InfoVis application. This is a great recent example of "workflow analysis" that we've been discussing in class. Though geared toward two-dimensional visualizations with clearly defined events, his work offers some very useful design guidelines for working with interaction histories, including evaluations from the deployment of his techniques within Tableau. (Trevor)

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Gotz-2008-CUV.pdf Characterizing Users' Visual Analytic Activity for Insight Provenance]
: The authors look into combining user triggered and automatically generated vis. histories.

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Isenberg-2008-ESV.pdf An exploratory Study on Visual Information Analysis]
: The authors run a user study to find the tasks involved in collaborative evidence aggregation

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Robinson-2008-CSV.pdf Collaborative Synthesis of Visual Analytic Results]
: Same as the previous one.

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Pirolli-2005-SPL.pdf The sensemaking process and leverage points for technology]
: The authors propose a model of analysis and identify leverage points for visualization.

==Visualization==

* Min Chen, David Ebert, Hans Hagen, Robert S. Laramee, Robert van Liere, Kwan-Liu Ma, William Ribarsky, Gerik Scheuermann, Deborah Silver, "Data, Information, and Knowledge in Visualization," IEEE Computer Graphics and Applications, vol. 29, no. 1, pp. 12-19, Jan./Feb. 2009, doi:10.1109/MCG.2009.6

CS295J/Literature

2009-04-14T19:42:04Z

Radu Jianu:

==Perception==

* Colin Ware: Information Visualization: Perception for Design
:Insight into some of the theory of perception as it pertains to building visual interfaces (David)

* Some unindentified paper(s)/book(s) about Gestalt theories of perception and cognition [http://en.wikipedia.org/wiki/Gestalt_psychology wikipedia page]
:These theories, from the 40's inform visual design and may provide an analogy for integration of theory and practice. They describe some characteristics of perception that have been used as evaluative rules in UI design. (David)

* [http://vrlab.epfl.ch/~pglardon/VR05/papers/chi2004.pdf Feeling Bumps and Holes without a Haptic Interface: the Perception of Pseudo-Haptic Textures] Lecuyer-2004-FBH
: A cool technique on "hacking" human perception by modifying the control/display ratio of visible elements to simulate haptic feedback for the user. Strong analysis of which parts of haptic feedback are useful (e.g., vertical elements can be discarded). Pseudo-haptic feedback is implemented by combining the use of visible feedback with the changing sensitivity of a passive input device (e.g., a mouse). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=267474 Research issues in perception and user interfaces] Encarnacao-1994-RIP
: "The authors focus at on three things: presentation of information to best match human cognitive and perceptual capabilities, interactive tools and systems to facilitate creation and navigation of visualizations, and software system features to improve visualization tools." First and third points sound relevant. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=vnax4nN4Ws4C&oi=fnd&pg=PA703&dq=slanty+design&ots=P7G259hzJa&sig=vbYZmYkquwuA_ollOI6EgciNJjU The Uniqueness of Individual Perception] Whitehouse-1999-ID
: Focuses on the commonalities of perception. Rough overview of sensory mechanisms, and strong anecdotal support of not adapting completely to the user, but rather requiring the user to adapt as well. Identifies some common perceptual problems with particular groups of EUs (e.g., blind people). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.psychonomic.org/search/view.cgi?id=4180 Guided search 2. 0. A revised model of visual search] Wolfe-1994-GS2
: A theory of visual search that builds on the distinction between visual targets that you need to search for in a field of distractors and those that "pop out" at you. (Adam) 16:22, 26 January 2009 (UTC)

* [http://biologie.kappa.ro/Literature/Misc_cogsci/articole/dvp/scholl00.pdf Perceptual causality and animacy] [[Scholl-2000-PCA]]
: Discusses some of the automatic interpretation in our perception, focusing on inferring causal relations and animacy. 

* [http://www.cs.umd.edu/class/fall2002/cmsc434-0201/p79-gaver.pdf Technology Affordances] Gaver-1991-TAF
: Affordances are actions that are appropriate for an object and that come to mind when perceiving the object. (Adam) 16:22, 26 January 2009 (UTC)

* [http://portal.acm.org/ft_gateway.cfm?id=301168&type=pdf&coll=GUIDE&dl=GUIDE&CFID=19761061&CFTOKEN=10084975 Affordance, conventions, and design] Norman-1999-ACD
: How the original concept of affordances differs from how it has been used in HCI. (Adam) 16:22, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=DrhCCWmJpWUC&oi=fnd&pg=PA1&dq=ecological+approach+visual+perception&ots=TeE80z49Fr&sig=c0jHz0ucQUTFNvUM5ObQouQq_Oc The Ecological Approach to Visual Perception] Gibson-1986-EAV
: Outlines direct perception and the original theory of affordances. (Jon) 14:07, 3 February 2009.

* [http://ieeexplore.ieee.org/iel1/21/4054/00156574.pdf?tp=&arnumber=156574&isnumber=4054 Ecological interface design: Theoretical foundations] Vicente-1992-EID
: Theory of how interfaces can avoid forcing processing at a higher level than the task requires. (Jon) 14:56, 3 February 2009.

* [http://www.informaworld.com/smpp/ftinterface~content=a784403799~fulltext=713240930 The Ecology of Human-Machine Systems II: Mediating Direct Perception in Complex Work Domains] Vicente-2000-EHM
: Taking advantage of fast perceptual processes to reduce cognitive demands as applied to the design of a thermal-hydraulic system. (Jon) 14:56, 3 February 2009.

* [http://www.aaai.org/Papers/Workshops/1998/WS-98-09/WS98-09-020.pdf Acting on a visual world: The role of multimodal perception in HCI]. Wolff-1998-AVW.
: Experiment that has implications for gesture interpretation module development.

==Cognition==

* Colin Ware: Visual Thinking: For Design
:Insight into some of the theory of cognition as it pertains to building visual interfaces (David)

* [http://en.wikipedia.org/wiki/Seven_plus_or_minus_two Wikipedia's Seven Plus or Minus Two page]
:A clear description of one part of human thinking; will probably provide pointers to other things to read (David)

* [http://portal.acm.org/citation.cfm?id=108844.108865 A cognitive model for the perception and understanding of graphs] Lohse-1991-CMP
: Describes a computer program that predicts response time to a query from assumptions from eye-tracking, short-term memory capacity, and the amount of information that can be absorbed from the query in each "glance." Attempts to lay the foundation for explaining several steps of human cognition, including input, memory, and processing. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.informaworld.com/smpp/content~content=a784395566~db=all~order=page Cognitive load during problem solving: Effects on learning] John Swiller
: Older article but referenced in a lot of newer ones; looks at how conventional problem-solving is ineffective as a learning device. (lisajane)

* [http://web.ebscohost.com/ehost/pdf?vid=1&hid=4&sid=13a77fd7-bead-41ce-bfb1-38addb0dfa53%40sessionmgr7 Dimensional overlap: Cognitive basis for stimulus–response compatibility—A model and taxonomy] Kornblum-1990-DOC
: People are more effective at a task when the stimulus and response representations are compatible and they don't require "translation". (Adam) 16:22, 26 January 2009 (UTC)

* [http://vis.cs.brown.edu/~trevor/Papers/Iverson-TNR-ImPact.pdf Tracking Neuropsychological Recovery Following Concussion in Sport]
: This paper discusses the neurological basis for the ImPact test given to athletes after they've suffered a concussion. It provides testing and quantitative measures for verbal memory, visual memory, and reaction times. These simple measures of cognition may be useful to incorporate in an HCI study. (Trevor)

A Framework of Interaction Costs in Information Visualization
:ABSTRACT: Interaction cost is an important but poorly understood factor in visualization design. We propose a framework of interaction costs inspired by Norman’s Seven Stages of Action to facilitate study. From 484 papers, we collected 61 interaction-related usability problems reported in 32 user studies and placed them into our framework of seven costs: (1) Decision costs to form goals; (2) System-power costs to form system operations; (3) Multiple input mode costs to form physical sequences; (4) Physical-motion costs to execute sequences; (5) Visual-cluttering costs to perceive state; (6) View-change costs to interpret perception; (7) State-change costs to evaluate interpretation. We also suggested ways to narrow the gulfs of execution (2–4) and evaluation (5–7) based on collected reports. Our framework suggests a need to consider decision costs (1) as the gulf of goal formation.
: Includes some ideas for quantitatively evaluating information visualization interfaces (David)

*Distributed Cognition as a Theoretical Framework for HCI (1994) Christine A. Halverson [http://hci.ucsd.edu/cogsci/faculty_pubs/9403.ps]


* [http://consc.net/papers/extended.html The Extended Mind] Clark-1998-TEM
: Cognition can be thought to be distributable across mediums (outside of the skull). How might we off-load "cognitive" processes to computer systems? ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - Owner)
: I think that Ware gets into this in some of his writing about information visualization (or in his second book, thinking with visualization). We can build in external "caches" or other constructs to be part of our cognitive model. It seems like most of an analytical user interface is part of the external cognitive process. (David)


* [http://courses.csail.mit.edu/6.803/pdf/dualtask.pdf Sources of Flexibility in Human Cognition: Dual-Task Studies of Space and Language] HermerVazquez-1999-SFC
: Our use of language serves as a higher-order cognitive system which can be utilized as "scaffolding" in human thought, supporting goal-driven tasks. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.sjdm.org/mail-archive/jdm-society/attachments/20060401/963b50da/attachment-0003.pdf In two minds: dual-process accounts of reasoning] Evans-2003-ITM
: It is hypothesized that there are two distinct systems of reasoning in the mind. System 1 is innate and fast, system 2 is controlled and slow. Knowledge of this might help us determine which tasks are candidates for one system or another. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6WJB-467J83F-3&_user=489286&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=316065013955ca22e9dde19df6a0f9b8 Priming against your will: How accessible alternatives affect goal pursuit] Shah-2002-PAY
: The authors demonstrate how priming the means to achieving a goal also primes the goal, but inhibits alternative means to achieving the same goal. It means that making the means of achieving a goal salient in an interface will make it more likely that people pursue that goal, and less likely that they will think of other means to pursue it. (Adam)

==HCI==

* [http://portal.acm.org/citation.cfm?id=1357054.1357125&coll=portal&dl=ACM&type=series&idx=SERIES260&part=series&WantType=Proceedings&title=CHI&CFID=20781736&CFTOKEN=83176621 A diary study of mobile information needs]

:A detailed study into how people use mobile devices. '''(Andrew Bragdon - OWNER for Assignment 2)'''

* [http://portal.acm.org/citation.cfm?id=1357054.1357187&coll=Portal&dl=GUIDE&CFID=21136843&CFTOKEN=23841774 Feasibility and pragmatics of classifying working memory load with an electroencephalograph]

:Examines how practical it is to use electroencephelographs to measure cognitive load, and discusses domain-specific knowledge needed.

* [http://delivery.acm.org/10.1145/1250000/1240669/p271-hurst.pdf?key1=1240669&key2=6465483321&coll=GUIDE&dl=GUIDE&CFID=20565232&CFTOKEN=69614228 Dynamic Detection of Novice vs Skilled Use]

:Used a learning classifier, trained on low-level mouse and keyboard usage patterns, to identify novice and expert use dynamically with accuracies as high as 91%. This classifier was then used to provide differrent information and feedback to the user as appropriate.

* [http://portal.acm.org/citation.cfm?id=1054972.1055012&coll=GUIDE&dl=ACM&CFID=20565232&CFTOKEN=69614228 Bubble Cursor]

:Example of a paper which demonstrated a novel interaction technique still obeys Fitts's law.

* [http://tlaloc.sfsu.edu/~lank/research/appearing/FSS604LankE.pdf Sloppy Selection]

:Utilized a quantiative model of user performance which used curvature to predict the speed of a pen as it moved across a surface to help disambiguate target selection intent.

* [http://delivery.acm.org/10.1145/1250000/1240730/p677-iqbal.pdf?key1=1240730&key2=4525483321&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 Disruption and Recovery of Computing Tasks]

:Studied task disruption and recovery in a field study, and found that users often visited several applications as a result of an alert, such as a new email notification, and that 27% of task suspensions resulted in 2 hours or more of disruption. Users in the study said that losing context was a significant problem in switching tasks, and led in part to the length of some of these disruptions. This work hints at the importance of providing affordances to users to maintain and regain lost context during task switching.

* [http://portal.acm.org/citation.cfm?id=985692.985715&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 A diary study of task switching and interruptions]

:Showed that task complexity, task duration, length of absence, and number of interruptions all affected the users' own perceived diffuclty of switching tasks. (Andrew Bragdon)

* John M. Carroll: HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science

:A gargantuan book with chapters by many folks describing some of the models and theories from HCI that may relate back to cognition; may need to create individual (David)

* [http://portal.acm.org/citation.cfm?id=1461832&dl=&coll= Project ernestine: validating a GOMS analysis for predicting and explaining real-world task performance]

: A study in which the [http://en.wikipedia.org/wiki/GOMS#cite_note-CHI92-1 GOMS] method is used to correctly predict the performance of call center operators using a new workstation. Might be interesting because of the methodology used to decompose the task into basic cognitive and perceptual actions, and then measuring these actions to evaluate the new interface. (Eric) The CPM (Critical Path Modeling) aspect used handles the parallel nature of several human components of HCI and seems to very accurately model the low level tasks from this study. (David)

* [http://www.informaworld.com/smpp/content~content=a784766580~db=all The Growth of Cognitive Modeling in Human-Computer Interaction Since GOMS]

* [http://portal.acm.org/citation.cfm?id=169059.169426&coll=Portal&dl=GUIDE&CFID=19188713&CFTOKEN=13376420 The limits of expert performance using hierarchic marking menus]
Marking menus naturally facillitate the transition from novice to expert performance for command invocation, and have been quite influential over the years to research into menu techniques. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/302979.303053 Manual and gaze input cascaded (MAGIC) pointing]

This is a system which combines gaze input (coarse-grained) and mouse input (fine-grained) to quickly target items. This is important because it "kind of" gets around Fitt's law by using gaze input to "warp" the cursor to the general vicinity of what the user wants to work on. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/985692.985727 If not now, when?: the effects of interruption at different moments within task execution] Adamczyk-2004-INN

Presents task models of user attention. (Andrew Bragdon) (Adam - owner; [http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - discussant) '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:58, 28 January 2009 (UTC)


* [http://hfs.sagepub.com/cgi/reprint/44/1/62.pdf Ecological Interface Design: Progress and challenges] Vicente-2002-EID
: Discusses the implications of Ecological Interface Design (EID), a theoretical HCI framework, for designing human-computer interfaces and compares performance of EID-informed designs to other comtemporary approaches. (Owner: Jon)

* [http://doi.acm.org/10.1145/985692.985707 "Constant, constant, multi-tasking craziness": managing multiple working spheres.] Gonzalez-2004-CCM

Empirical study of how information workers spend their time. Puts forward a theory of how users organize small individual tasks into "working spheres." (Andrew Bragdon - OWNER; Adam Darlow - Discussant; Steven Ellis - Discussant)

'''250-word summary and relevance statement''' (Andrew Bragdon)

Any visualization which is used extensively by a user over a period of time will be used in the context of that user's daily workflow. It is therefore essential to understand this larger workflow context to design the visualization application appropriately to fit the needs of real world users. This paper studies in detail the daily workflow tasks and patterns of work of analysts, managers and software developers in a medium-sized software company. This paper provides strong empirical evidence that users, rather than working on discrete and well-defined tasks, in reality, switch tasks on average every two to three minutes, and instead, work on larger thematically connected units of work (working spheres). In addition, the study found that users switched between these larger working spheres on average every 12 minutes. Thus, it is strongly indicated by this paper that many information workers are in a constant state of rapid fire multi-tasking. This suggests that for a visualization to be relevant to any of these information workers, it would need to fit into, and support, this workflow. This is just a first step towards understanding how users interact with visualizations in particular, however; future work that studies how users interact with visualizations as part of their larger daily work patterns is warranted, and would be an important component of a broad theory of visualization.

* [http://www.eecs.berkeley.edu/Pubs/TechRpts/2000/CSD-00-1105.pdf The state of the art in automating usability evaluation of user interfaces] Ivory-2000-SAA
: Presents a new taxonomy for automating usability analysis. Advantages of automated evaluation are purported to be advantages linked to efficiency, such as comparing alternate designs, uncovering more errors more consistently, and predicting time/error costs across an entire design. Breaks down a taxonomy with individual benefits and drawbacks of each method, and checks observations against existing guidelines (e.g. Smith and Mosier guidelines, Motif style guidelines, etc). Introduces several visual tools. Looks extremely relevant as a comprehensive survey of existing techniques. '''OWNER''': [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC) '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC) Discussant: Steven Ellis

* [http://www.hpl.hp.com/techreports/91/HPL-91-03.pdf User Interface Evaluation in the Real World: A Comparison of Four Techniques] Jeffries-1991-UIE
: Overview of the four major UI evaluation methods: heuristic evaluation, usability testing, guidelines, and cognitive walkthrough, followed by a comparison in their application to a case study. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ics.colorado.edu/techpubs/pdf/91-01.pdf Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces] Polson-xxxx-CWM
: Presents the concept of performing a hand walkthrough of the cognitive process, based on another theory of "learning by exploration." Strong results for a limited evaluation timeframe and little or no time for formal instruction of the interface for the user. The reviewer considers each behavior of the interface and its resultant effect on the user, attempting to identify actions that would be difficult for the "average" user. Claims that a given step will ''not'' be difficult must be supported with empirical data or theory. The application of cognitive theory early in the design process seems useful in avoiding costly redesigns when problems are identified later. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=142834&coll= Finding usability problems through heuristic evaluation] Nielsen-1992-FUP
: Emphasis on heuristic evaluation. Shockingly, usability experts are found to be better at performing this type of evaluation. Usability problems relating to elements that are completely missing from the interface are difficult to identify with this method when evaluating unimplemented designs. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://delivery.acm.org/10.1145/130000/128728/p152-jacob.pdf?key1=128728&key2=7032992321&coll=GUIDE&dl=GUIDE&CFID=19735001&CFTOKEN=82907542 The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look at is What you Get] Jacob-1991-UEM
: One of the first research papers to introduce eye tracking as a viable HCI technique. (Trevor)

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=1221372&isnumber=27434 Real-Time Eye Tracking for Human Computer Interfaces] Amarnag-2003-RTE
: Technical details about the implementation of a recent real-time eye-tracking system. (Trevor)

* [http://www.ipgems.com/present/swui_chi_20070502.pdf Semantic Web HCI: Discussing Research Implications] Degler-2007-SWH
: A workshop discussion from CHI 2007 discussing the idea of a "semantic internet" and its relevance to the HCI community. Discusses things like adaptive web interfaces, mashups, dynamic interactions, etc. (Trevor)

* [http://www.springerlink.com/content/u3q14156h6r648h8/fulltext.pdf Implicit Human Computer Interaction Through Context] Schmidtt-2000-IHC
: A highly cited paper discussing the notion of implicit HCI, including semantic grouping of interactions, and some perceptual rules. ('''Trevor - OWNER'''; Andrew Bragdon - discussant; '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:57, 28 January 2009 (UTC))

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1903_1 Cognitive Strategies for the Visual Search of Hierarchical Computer Displays] Anthony J. Hornof
: This article investigates the cognitive strategies that people use to search computer displays. Several different visual layouts are examined. (lisajane)

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1904_9 Unseen and Unaware: Implications of Recent Research on Failures of Visual Awareness for Human-Computer Interface Design] D. Alexander Varakin; Daniel T. Levin; Roger Fidler
: This article reviews basic and applied research documenting failures of visual awareness and the related metacognitive failure and then discuss misplaced beliefs that could accentuate both in the context of the human-computer interface. (lisajane)

* Shneiderman, Plaisant: Designing the User Interface
: My textbook for an HCI class, has many good lists of guidelines. Especially Ch.2 pp 59-102. (lisajane)

* Robert Mack, Jakob Nielsen: Usability Inspection Methods (Ch. 1 Executive Summary)
: Provides an overview of main usability inspection methods, a fair introduction to the industrial applications, as well as certain costs and benefits, of the methods as well as suggestions for expansive research. (Steven)

* [http://portal.acm.org/citation.cfm?id=22950 Jock Mackinlay, Automating the design of graphical presentations of relational information], ACM Transactions on Graphics (TOG),
5(2):110-141, 1986. (Jian)
: The first paper talked about how to automatically generate *good* graphs.

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=04376133 Jock Mackinlay, Pat Hanrahan, Chris Stolte, Show Me: Automatic Presentation for Visual Analysis] IEEE TVCG 13(6): 1137-1144, Nov-Dec, 2007 (Jian)
: Extend their previous paper to analytics tasks.

* [http://www.win.tue.nl/~vanwijk/vov.pdf Jarke J. van Wjik, The value of visualization], IEEE visualization 2005. (Jian)
: discuss vis from a variety of angles as for art, science and technology and question and quantify the utility of visualization.

* [http://www.almaden.ibm.com/u/zhai/papers/steering/chi97.pdf Johnny Accot and Shumin Zhai, Beyond Fitts' law: models for trajectory-based HCI tasks], CHI 97. (Jian)
: Extend Fitts' to trajectory based tasks.

*[http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=01703371 Saraiya, P., North, C., Lam, V., and Duca, K.A, An Insight-Based Longitudinal Study of Visual Analytics], TVCG 12(6): 1511-1522, 2006.(Jian)
* the first paper that quantifies what insight is by comparing several infoVis tools for bioinformatics.

*[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1359732 David H. Laidlaw, Michael Kirby, Cullen Jackson, J. Scott Davidson, Timothy Miller, Marco DaSilva, William Warren, and Michael Tarr.Comparing 2D vector field visualization methods: A user study]. IEEE Transactions on Visualization and Computer Graphics, 11(1):59-70, 2005. (Jian)
: an application-specific comparison of visualization method. a cool paper.

* [http://web.mit.edu/rruth/www/Papers/RosenholtzEtAlCHI2005Clutter.pdf Rosenholtz, Li, Mansfield, and Jin, Feature Congestion: A Measure of Display Clutter], CHI 2005. (Jian)
: quantify visual complexity from a statistics point of view.

* [http://delivery.acm.org/10.1145/240000/236054/p320-john.pdf?key1=236054&key2=2285613321&coll=GUIDE&dl=GUIDE&CFID=19490404&CFTOKEN=25744022 The GOMS Family of User Interface Analysis Techniques: Comparison and Contrast] (Trevor)
: This paper offers an analysis of four types of GOMS (Goals, Objects, Methods and Selection) based interaction techniques. GOMS is a widely used UI paradigm, made popular by Card et al in The Psychology of Human-Computer Interaction (1983).

* [http://vis.cs.brown.edu/~trevor/Papers/Lisetti-2000-AFE.pdf Automatic Facial Expression Interpretation: Where Human-Computer Interaction, Artificial Intelligence and Cognitive Science Intersect] (Trevor)
: Using advanced computer vision/AI techniques, this work aims to discern and make use of users' emotions in UI design.

* [http://vis.cs.brown.edu/~trevor/Papers/weld-2003-APU.pdf Automatically Personalizing User Interfaces] (Trevor)
: Discusses some techniques and design decisions for constructing adaptable and customizable user interfaces. There are some useful references in the paper on using HMMs and RMMs (Relational Markov Models) for interaction prediction.

* [http://vis.cs.brown.edu/~trevor/Papers/Gajos-2006-.pdf Exploring the Design Space for Adaptive Graphical User Interfaces] (Trevor)
: This paper presents comparative evaluations of three methods for implementing adaptable user interfaces. The evaluation methodology gives rise to three key concepts that affect the performance of adaptable UIs: frequency of adaptation, accuracy of adaptation, and the impact of predictability.

* Conceptual Modeling for User Interface Development - David Benyon, Diana Bental, and Thomas Green
: Proposes a new set of terminology for describing and comparing existing and future cognitive models of HCI. (Steven)

* [http://homepage.ntlworld.com/greenery/workStuff/Papers/ERMIA-Skull.PDF The Skull beneath the Skin:
Entity-Relationship Models of Information Artefacts] T. R. G. Green, D. R. Benyon
: A paper in form of prelude to the above, gives a good overview of the ERMIA method. (Steven)

===Cognitive Modeling===

* [http://vis.cs.brown.edu/~trevor/Papers/Kaptelinin-1994-ATI.pdf Activity Theory: Implications for Human-Computer Interaction] (Trevor)
: Discusses the notion of Activity Theory as the basis for HCI research. The most interesting part of this paper for me was the introduction which expressed the need for a ''Theory of HCI''.

* [http://en.wikipedia.org/wiki/Seven_stages_of_action Norman's Seven stages of action]
: Presents Norman's seven stages of action, as well as his model of evaluation. (Steven)

* [http://vis.cs.brown.edu/~trevor/Papers/Wright-2000-AHC.pdf Analyzing Human-Computer Interaction as Distributed Cognition: The Resources Model] (Trevor)
: Creates a compelling argument for why distributed cognition research fits in with HCI, and what types of impacts it may have on the HCI community.

* [http://sonify.psych.gatech.edu/~walkerb/classes/hci/extrareading/nardi.pdf Studying Context, A Comparison of Activity Theory, Situated Action Models, and Distributed Cognition] Bonnie A. Nardi
: Defines the task of the HCI specialist as the application of psychological and anthropological principles to specific design problems. It posits an inherent feud between the accurate study of relative contexts and the necessary, but more general, development of comparative models and results. Gives a coherent overview of activity theory, situated action models, and distributed cognition; finds that activity theory presents the best overall framework. There is little reason given for this ranking, however, and the description of activity theory is the most theoretical and least developed of the three.
: Having spent quite a bit of time studying Soviet psychology (from which came activity theory) last semester, I question the validity of the paper’s claim, as its description of activity theory bears the artifacts of the oppressive regulations which the Soviet government imposed on psychologists. Although the theory may sound more practical, it seems fairly weak as a basis for empirical design analysis.
: The paper’s strongest point is the criticisms which follow descriptions, in which theoretical shortcomings of each perspective are discussed. ('''Owner:''' Steven, '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC))

* [http://www.billbuxton.com/chunking.html Chunking and Phrasing and the Design of Human-Computer Dialogues]

High-level theory of human-computer dialogues. (Andrew Bragdon)

* Polson, P. and Lewis, C. Theory-Based Design for Easily Learned Interfaces. Human-Computer Interaction, 5, 2 (June 1990), 191-220.

: This is a cognitive model of how users find and learn commands in an unfamiliar user interface. This could potentially be adapted to be a piece of a theory of visualization. (Andrew Bragdon)

* [http://www.syros.aegean.gr/users/tsp/conf_pub/C12/c12.pdf Activity Theory vs Cognitive Science in the Study of Human-Computer Interaction]
: Provides a brief history of Cognitive Science and HCI, then compares the effectiveness of the aforementioned theories in aiding design and development. (Owner - week 2 : Steven)

* [http://www.sciencedirect.com/science?_ob=PublicationURL&_tockey=%23TOC%236829%232001%23999449998%23287248%23FLP%23&_cdi=6829&_pubType=J&_auth=y&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=64b44ef6df77ae073d41a7367db866b5 International Journal of Human-Computer Studies - Special Issue on Cognitive Modeling]
:Articles all concerning various issues of cognitive modeling as relates to HCI. (Steven)

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6VDC-4811TNB-5&_user=10&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=259b5c105222437fc84990b7a1eaedee The role of cognitive theory in human–computer interface]. Chalmers, Patricia A, 2003.
:Was scared again, but no need to be. Touches only on a subset of cognitive theories (Schema theory, Cognitive load, and retention theories) and undertakes a survey of some software design theories, but does not attempt an explicit mapping between the two. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=26115.26124 Design Guidelines]. Marshall, Nelson, and Gardiner, 1987.
:Attempt to apply cognitive psychology to user-interface design. Here, the opposite problem is seen—the author's make no significant attempt to take existing heuristic guidelines into account. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://www.cognitivedesignsolutions.com/ Cognitive Design Solutions, Inc.]
:Training and consulting firm that claims to take advantage of Cognitive Design in making design and performance improvements. [[User:E J Kalafarski|E J Kalafarski]] 13:50, 20 February 2009 (UTC)

* [http://infolab.uvt.nl/research/lap2003/agerfalk.pdf Actability Principles in Theory and Practice]. Agerfalk, Par J, 2003.
:Presents a set of nine contemporary principles for the evaluation of IT systems ("social tools to perform communicative action") based explicitly on cognitive principles. Introduces a notion comparable to usability called ''actability''. Presents a mapping for some basic usability principles to some seminal sets of guidelines. [[User:E J Kalafarski|E J Kalafarski]] 14:29, 20 February 2009 (UTC)

==Design==

* Wikipedia articles on [http://en.wikipedia.org/wiki/A_Pattern_Language "A Pattern Language"] and [http://en.wikipedia.org/wiki/Design_pattern "Design Pattern"]
:see summary for Alexander below (David)

* UI Design principles (feedback, etc -- find ref)

* Alexander: A Pattern Language: Towns, Buildings, Construction
:The original design pattern source; what makes a human space work, ineffable best practices, ~250 rules is enough to do communities and house-sized artifacts; could be a good metaphor for making; could be a good metaphor for making human virtual space work? (David)

* [http://useraware.iict.ch/uploads/media/TangibleBits.pdf Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms] Ishii-1997-TBT
:A specific UI proposal, but has nice relevant discussion on how we perceive "foreground" items and "background" items and their relationship, taking advantage of this "parallel" processing of perception. Includes the use of visual metaphors, phicons, and a notion they invent called "digital shadows," in which the shadow projected by an object conveys some information on its contents. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://list.cs.brown.edu/courses/csci1900/2007/documents/restricted/beale.pdf Slanty Design] Beale-2007-SD
:Design method with emphasis on discouraging undesirable behavior, by perhaps forcing the user to adapt to the interface, giving equal weight to user goals, user "non-goals," and wider goals of stakeholders besides the immediate user. The important insight seems to be that these wider goals can enhance the user's experience with the larger system in the long run, if not in the immediate timeframe. Five major design steps. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.amazon.com/Designing-Interactions-Bill-Moggridge/dp/0262134748/ref=pd_bbs_sr_1?ie=UTF8&s=books&qid=1232989194&sr=8-1 Designing Interactions] by Bill Moggridge
: Really awesome book on the evolution of interactions with technology. (Trevor)

* [http://www.amazon.com/Sketching-User-Experiences-Interactive-Technologies/dp/0123740371/ref=sr_1_1?ie=UTF8&s=books&qid=1232989269&sr=1-1 Sketching User Experiences] by Bill Buxton
: Another great book on the practices of interaction design. (Trevor)

* [http://site.ebrary.com/lib/brown/docDetail.action?docID=10173678 The Laws of Simplicity] by John Maeda
: An interesting work on the efficiency of minimalist design. Quick read for those interested. (Steven)
: A set of design guidelines some of which we may be able to build on in automating interface evaluation; will certainly apply to manual evaluations [[User:David Laidlaw|David Laidlaw]]

* [http://www.cs.umd.edu/hcil/pubs/presentations/eyeshaveit/index.htm Ben Shneiderman, The Eyes Have It: User Interfaces for Information Visualization], UM, tech-report, CS-TR-3665. (Jian)
: the paper talks about visualization mantra.

* [http://hci.rwth-aachen.de/materials/publications/borchers2000a.pdf A pattern approach to interaction design] Borchers-2001-PAI
: A highly-cited work on the development of a language for defining design patterns for use in interface development, with an emphasis on communication between application developers and application domain experts. [[User:E J Kalafarski|E J Kalafarski]] 16:37, 3 February 2009 (UTC)

==Thinking, analysis, decision making==

* Morgan D. Jones: The Thinker's Toolkit: Fourteen Powerful Techniques for Problem Solving

:Set of methods for solving problems that might be incorporated into tools for thinking (David)

* Keim, Shazeer, Littman: Proverb: The Probabilistic Cruciverbalist

:An automatic crossword-puzzle solver; the software framework for building this program may be a metaphor for some thinking groupware with plug-in modules. (David)

* Thomas, Cook: Illuminating the Path

:a research agenda for tools for intelligence analysts; not sure of relevance (David)

* Richard Thaler, Cass Sunstein: Nudge - Improving Decisions About Wealth, Health, and Happiness
: A great, easy read for someone who isn't familiar with the psychological perspective. Focuses mainly on public policy issues, but certain sections (on developing a better social security website, for example) relate specifically to digital design. (Steven)

* [http://www.cs.brown.edu/people/trevor/Papers/Heer-2008-GraphicalHistories.pdf Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation] (InfoVis 2008)
: Work by Jeff Heer of Stanford (formerly Berkley) on using Graphical Interaction Histories within the Tableau InfoVis application. This is a great recent example of "workflow analysis" that we've been discussing in class. Though geared toward two-dimensional visualizations with clearly defined events, his work offers some very useful design guidelines for working with interaction histories, including evaluations from the deployment of his techniques within Tableau. (Trevor)

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Isenberg-2008-ESV.pdf An exploratory Study on Visual Information Analysis]
: The authors run a user study to find the tasks involved in collaborative evidence aggregation

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Robinson-2008-CSV.pdf Collaborative Synthesis of Visual Analytic Results]
: Same as the previous one.

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Pirolli-2005-SPL.pdf The sensemaking process and leverage points for technology]
: The authors propose a model of analysis and identify leverage points for visualization.

==Visualization==

* Min Chen, David Ebert, Hans Hagen, Robert S. Laramee, Robert van Liere, Kwan-Liu Ma, William Ribarsky, Gerik Scheuermann, Deborah Silver, "Data, Information, and Knowledge in Visualization," IEEE Computer Graphics and Applications, vol. 29, no. 1, pp. 12-19, Jan./Feb. 2009, doi:10.1109/MCG.2009.6

CS295J/Literature

2009-04-14T19:40:12Z

Radu Jianu:

==Perception==

* Colin Ware: Information Visualization: Perception for Design
:Insight into some of the theory of perception as it pertains to building visual interfaces (David)

* Some unindentified paper(s)/book(s) about Gestalt theories of perception and cognition [http://en.wikipedia.org/wiki/Gestalt_psychology wikipedia page]
:These theories, from the 40's inform visual design and may provide an analogy for integration of theory and practice. They describe some characteristics of perception that have been used as evaluative rules in UI design. (David)

* [http://vrlab.epfl.ch/~pglardon/VR05/papers/chi2004.pdf Feeling Bumps and Holes without a Haptic Interface: the Perception of Pseudo-Haptic Textures] Lecuyer-2004-FBH
: A cool technique on "hacking" human perception by modifying the control/display ratio of visible elements to simulate haptic feedback for the user. Strong analysis of which parts of haptic feedback are useful (e.g., vertical elements can be discarded). Pseudo-haptic feedback is implemented by combining the use of visible feedback with the changing sensitivity of a passive input device (e.g., a mouse). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=267474 Research issues in perception and user interfaces] Encarnacao-1994-RIP
: "The authors focus at on three things: presentation of information to best match human cognitive and perceptual capabilities, interactive tools and systems to facilitate creation and navigation of visualizations, and software system features to improve visualization tools." First and third points sound relevant. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=vnax4nN4Ws4C&oi=fnd&pg=PA703&dq=slanty+design&ots=P7G259hzJa&sig=vbYZmYkquwuA_ollOI6EgciNJjU The Uniqueness of Individual Perception] Whitehouse-1999-ID
: Focuses on the commonalities of perception. Rough overview of sensory mechanisms, and strong anecdotal support of not adapting completely to the user, but rather requiring the user to adapt as well. Identifies some common perceptual problems with particular groups of EUs (e.g., blind people). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.psychonomic.org/search/view.cgi?id=4180 Guided search 2. 0. A revised model of visual search] Wolfe-1994-GS2
: A theory of visual search that builds on the distinction between visual targets that you need to search for in a field of distractors and those that "pop out" at you. (Adam) 16:22, 26 January 2009 (UTC)

* [http://biologie.kappa.ro/Literature/Misc_cogsci/articole/dvp/scholl00.pdf Perceptual causality and animacy] [[Scholl-2000-PCA]]
: Discusses some of the automatic interpretation in our perception, focusing on inferring causal relations and animacy. 

* [http://www.cs.umd.edu/class/fall2002/cmsc434-0201/p79-gaver.pdf Technology Affordances] Gaver-1991-TAF
: Affordances are actions that are appropriate for an object and that come to mind when perceiving the object. (Adam) 16:22, 26 January 2009 (UTC)

* [http://portal.acm.org/ft_gateway.cfm?id=301168&type=pdf&coll=GUIDE&dl=GUIDE&CFID=19761061&CFTOKEN=10084975 Affordance, conventions, and design] Norman-1999-ACD
: How the original concept of affordances differs from how it has been used in HCI. (Adam) 16:22, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=DrhCCWmJpWUC&oi=fnd&pg=PA1&dq=ecological+approach+visual+perception&ots=TeE80z49Fr&sig=c0jHz0ucQUTFNvUM5ObQouQq_Oc The Ecological Approach to Visual Perception] Gibson-1986-EAV
: Outlines direct perception and the original theory of affordances. (Jon) 14:07, 3 February 2009.

* [http://ieeexplore.ieee.org/iel1/21/4054/00156574.pdf?tp=&arnumber=156574&isnumber=4054 Ecological interface design: Theoretical foundations] Vicente-1992-EID
: Theory of how interfaces can avoid forcing processing at a higher level than the task requires. (Jon) 14:56, 3 February 2009.

* [http://www.informaworld.com/smpp/ftinterface~content=a784403799~fulltext=713240930 The Ecology of Human-Machine Systems II: Mediating Direct Perception in Complex Work Domains] Vicente-2000-EHM
: Taking advantage of fast perceptual processes to reduce cognitive demands as applied to the design of a thermal-hydraulic system. (Jon) 14:56, 3 February 2009.

* [http://www.aaai.org/Papers/Workshops/1998/WS-98-09/WS98-09-020.pdf Acting on a visual world: The role of multimodal perception in HCI]. Wolff-1998-AVW.
: Experiment that has implications for gesture interpretation module development.

==Cognition==

* Colin Ware: Visual Thinking: For Design
:Insight into some of the theory of cognition as it pertains to building visual interfaces (David)

* [http://en.wikipedia.org/wiki/Seven_plus_or_minus_two Wikipedia's Seven Plus or Minus Two page]
:A clear description of one part of human thinking; will probably provide pointers to other things to read (David)

* [http://portal.acm.org/citation.cfm?id=108844.108865 A cognitive model for the perception and understanding of graphs] Lohse-1991-CMP
: Describes a computer program that predicts response time to a query from assumptions from eye-tracking, short-term memory capacity, and the amount of information that can be absorbed from the query in each "glance." Attempts to lay the foundation for explaining several steps of human cognition, including input, memory, and processing. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.informaworld.com/smpp/content~content=a784395566~db=all~order=page Cognitive load during problem solving: Effects on learning] John Swiller
: Older article but referenced in a lot of newer ones; looks at how conventional problem-solving is ineffective as a learning device. (lisajane)

* [http://web.ebscohost.com/ehost/pdf?vid=1&hid=4&sid=13a77fd7-bead-41ce-bfb1-38addb0dfa53%40sessionmgr7 Dimensional overlap: Cognitive basis for stimulus–response compatibility—A model and taxonomy] Kornblum-1990-DOC
: People are more effective at a task when the stimulus and response representations are compatible and they don't require "translation". (Adam) 16:22, 26 January 2009 (UTC)

* [http://vis.cs.brown.edu/~trevor/Papers/Iverson-TNR-ImPact.pdf Tracking Neuropsychological Recovery Following Concussion in Sport]
: This paper discusses the neurological basis for the ImPact test given to athletes after they've suffered a concussion. It provides testing and quantitative measures for verbal memory, visual memory, and reaction times. These simple measures of cognition may be useful to incorporate in an HCI study. (Trevor)

A Framework of Interaction Costs in Information Visualization
:ABSTRACT: Interaction cost is an important but poorly understood factor in visualization design. We propose a framework of interaction costs inspired by Norman’s Seven Stages of Action to facilitate study. From 484 papers, we collected 61 interaction-related usability problems reported in 32 user studies and placed them into our framework of seven costs: (1) Decision costs to form goals; (2) System-power costs to form system operations; (3) Multiple input mode costs to form physical sequences; (4) Physical-motion costs to execute sequences; (5) Visual-cluttering costs to perceive state; (6) View-change costs to interpret perception; (7) State-change costs to evaluate interpretation. We also suggested ways to narrow the gulfs of execution (2–4) and evaluation (5–7) based on collected reports. Our framework suggests a need to consider decision costs (1) as the gulf of goal formation.
: Includes some ideas for quantitatively evaluating information visualization interfaces (David)

*Distributed Cognition as a Theoretical Framework for HCI (1994) Christine A. Halverson [http://hci.ucsd.edu/cogsci/faculty_pubs/9403.ps]


* [http://consc.net/papers/extended.html The Extended Mind] Clark-1998-TEM
: Cognition can be thought to be distributable across mediums (outside of the skull). How might we off-load "cognitive" processes to computer systems? ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - Owner)
: I think that Ware gets into this in some of his writing about information visualization (or in his second book, thinking with visualization). We can build in external "caches" or other constructs to be part of our cognitive model. It seems like most of an analytical user interface is part of the external cognitive process. (David)


* [http://courses.csail.mit.edu/6.803/pdf/dualtask.pdf Sources of Flexibility in Human Cognition: Dual-Task Studies of Space and Language] HermerVazquez-1999-SFC
: Our use of language serves as a higher-order cognitive system which can be utilized as "scaffolding" in human thought, supporting goal-driven tasks. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.sjdm.org/mail-archive/jdm-society/attachments/20060401/963b50da/attachment-0003.pdf In two minds: dual-process accounts of reasoning] Evans-2003-ITM
: It is hypothesized that there are two distinct systems of reasoning in the mind. System 1 is innate and fast, system 2 is controlled and slow. Knowledge of this might help us determine which tasks are candidates for one system or another. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6WJB-467J83F-3&_user=489286&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=316065013955ca22e9dde19df6a0f9b8 Priming against your will: How accessible alternatives affect goal pursuit] Shah-2002-PAY
: The authors demonstrate how priming the means to achieving a goal also primes the goal, but inhibits alternative means to achieving the same goal. It means that making the means of achieving a goal salient in an interface will make it more likely that people pursue that goal, and less likely that they will think of other means to pursue it. (Adam)

==HCI==

* [http://portal.acm.org/citation.cfm?id=1357054.1357125&coll=portal&dl=ACM&type=series&idx=SERIES260&part=series&WantType=Proceedings&title=CHI&CFID=20781736&CFTOKEN=83176621 A diary study of mobile information needs]

:A detailed study into how people use mobile devices. '''(Andrew Bragdon - OWNER for Assignment 2)'''

* [http://portal.acm.org/citation.cfm?id=1357054.1357187&coll=Portal&dl=GUIDE&CFID=21136843&CFTOKEN=23841774 Feasibility and pragmatics of classifying working memory load with an electroencephalograph]

:Examines how practical it is to use electroencephelographs to measure cognitive load, and discusses domain-specific knowledge needed.

* [http://delivery.acm.org/10.1145/1250000/1240669/p271-hurst.pdf?key1=1240669&key2=6465483321&coll=GUIDE&dl=GUIDE&CFID=20565232&CFTOKEN=69614228 Dynamic Detection of Novice vs Skilled Use]

:Used a learning classifier, trained on low-level mouse and keyboard usage patterns, to identify novice and expert use dynamically with accuracies as high as 91%. This classifier was then used to provide differrent information and feedback to the user as appropriate.

* [http://portal.acm.org/citation.cfm?id=1054972.1055012&coll=GUIDE&dl=ACM&CFID=20565232&CFTOKEN=69614228 Bubble Cursor]

:Example of a paper which demonstrated a novel interaction technique still obeys Fitts's law.

* [http://tlaloc.sfsu.edu/~lank/research/appearing/FSS604LankE.pdf Sloppy Selection]

:Utilized a quantiative model of user performance which used curvature to predict the speed of a pen as it moved across a surface to help disambiguate target selection intent.

* [http://delivery.acm.org/10.1145/1250000/1240730/p677-iqbal.pdf?key1=1240730&key2=4525483321&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 Disruption and Recovery of Computing Tasks]

:Studied task disruption and recovery in a field study, and found that users often visited several applications as a result of an alert, such as a new email notification, and that 27% of task suspensions resulted in 2 hours or more of disruption. Users in the study said that losing context was a significant problem in switching tasks, and led in part to the length of some of these disruptions. This work hints at the importance of providing affordances to users to maintain and regain lost context during task switching.

* [http://portal.acm.org/citation.cfm?id=985692.985715&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 A diary study of task switching and interruptions]

:Showed that task complexity, task duration, length of absence, and number of interruptions all affected the users' own perceived diffuclty of switching tasks. (Andrew Bragdon)

* John M. Carroll: HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science

:A gargantuan book with chapters by many folks describing some of the models and theories from HCI that may relate back to cognition; may need to create individual (David)

* [http://portal.acm.org/citation.cfm?id=1461832&dl=&coll= Project ernestine: validating a GOMS analysis for predicting and explaining real-world task performance]

: A study in which the [http://en.wikipedia.org/wiki/GOMS#cite_note-CHI92-1 GOMS] method is used to correctly predict the performance of call center operators using a new workstation. Might be interesting because of the methodology used to decompose the task into basic cognitive and perceptual actions, and then measuring these actions to evaluate the new interface. (Eric) The CPM (Critical Path Modeling) aspect used handles the parallel nature of several human components of HCI and seems to very accurately model the low level tasks from this study. (David)

* [http://www.informaworld.com/smpp/content~content=a784766580~db=all The Growth of Cognitive Modeling in Human-Computer Interaction Since GOMS]

* [http://portal.acm.org/citation.cfm?id=169059.169426&coll=Portal&dl=GUIDE&CFID=19188713&CFTOKEN=13376420 The limits of expert performance using hierarchic marking menus]
Marking menus naturally facillitate the transition from novice to expert performance for command invocation, and have been quite influential over the years to research into menu techniques. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/302979.303053 Manual and gaze input cascaded (MAGIC) pointing]

This is a system which combines gaze input (coarse-grained) and mouse input (fine-grained) to quickly target items. This is important because it "kind of" gets around Fitt's law by using gaze input to "warp" the cursor to the general vicinity of what the user wants to work on. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/985692.985727 If not now, when?: the effects of interruption at different moments within task execution] Adamczyk-2004-INN

Presents task models of user attention. (Andrew Bragdon) (Adam - owner; [http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - discussant) '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:58, 28 January 2009 (UTC)


* [http://hfs.sagepub.com/cgi/reprint/44/1/62.pdf Ecological Interface Design: Progress and challenges] Vicente-2002-EID
: Discusses the implications of Ecological Interface Design (EID), a theoretical HCI framework, for designing human-computer interfaces and compares performance of EID-informed designs to other comtemporary approaches. (Owner: Jon)

* [http://doi.acm.org/10.1145/985692.985707 "Constant, constant, multi-tasking craziness": managing multiple working spheres.] Gonzalez-2004-CCM

Empirical study of how information workers spend their time. Puts forward a theory of how users organize small individual tasks into "working spheres." (Andrew Bragdon - OWNER; Adam Darlow - Discussant; Steven Ellis - Discussant)

'''250-word summary and relevance statement''' (Andrew Bragdon)

Any visualization which is used extensively by a user over a period of time will be used in the context of that user's daily workflow. It is therefore essential to understand this larger workflow context to design the visualization application appropriately to fit the needs of real world users. This paper studies in detail the daily workflow tasks and patterns of work of analysts, managers and software developers in a medium-sized software company. This paper provides strong empirical evidence that users, rather than working on discrete and well-defined tasks, in reality, switch tasks on average every two to three minutes, and instead, work on larger thematically connected units of work (working spheres). In addition, the study found that users switched between these larger working spheres on average every 12 minutes. Thus, it is strongly indicated by this paper that many information workers are in a constant state of rapid fire multi-tasking. This suggests that for a visualization to be relevant to any of these information workers, it would need to fit into, and support, this workflow. This is just a first step towards understanding how users interact with visualizations in particular, however; future work that studies how users interact with visualizations as part of their larger daily work patterns is warranted, and would be an important component of a broad theory of visualization.

* [http://www.eecs.berkeley.edu/Pubs/TechRpts/2000/CSD-00-1105.pdf The state of the art in automating usability evaluation of user interfaces] Ivory-2000-SAA
: Presents a new taxonomy for automating usability analysis. Advantages of automated evaluation are purported to be advantages linked to efficiency, such as comparing alternate designs, uncovering more errors more consistently, and predicting time/error costs across an entire design. Breaks down a taxonomy with individual benefits and drawbacks of each method, and checks observations against existing guidelines (e.g. Smith and Mosier guidelines, Motif style guidelines, etc). Introduces several visual tools. Looks extremely relevant as a comprehensive survey of existing techniques. '''OWNER''': [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC) '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC) Discussant: Steven Ellis

* [http://www.hpl.hp.com/techreports/91/HPL-91-03.pdf User Interface Evaluation in the Real World: A Comparison of Four Techniques] Jeffries-1991-UIE
: Overview of the four major UI evaluation methods: heuristic evaluation, usability testing, guidelines, and cognitive walkthrough, followed by a comparison in their application to a case study. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ics.colorado.edu/techpubs/pdf/91-01.pdf Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces] Polson-xxxx-CWM
: Presents the concept of performing a hand walkthrough of the cognitive process, based on another theory of "learning by exploration." Strong results for a limited evaluation timeframe and little or no time for formal instruction of the interface for the user. The reviewer considers each behavior of the interface and its resultant effect on the user, attempting to identify actions that would be difficult for the "average" user. Claims that a given step will ''not'' be difficult must be supported with empirical data or theory. The application of cognitive theory early in the design process seems useful in avoiding costly redesigns when problems are identified later. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=142834&coll= Finding usability problems through heuristic evaluation] Nielsen-1992-FUP
: Emphasis on heuristic evaluation. Shockingly, usability experts are found to be better at performing this type of evaluation. Usability problems relating to elements that are completely missing from the interface are difficult to identify with this method when evaluating unimplemented designs. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://delivery.acm.org/10.1145/130000/128728/p152-jacob.pdf?key1=128728&key2=7032992321&coll=GUIDE&dl=GUIDE&CFID=19735001&CFTOKEN=82907542 The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look at is What you Get] Jacob-1991-UEM
: One of the first research papers to introduce eye tracking as a viable HCI technique. (Trevor)

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=1221372&isnumber=27434 Real-Time Eye Tracking for Human Computer Interfaces] Amarnag-2003-RTE
: Technical details about the implementation of a recent real-time eye-tracking system. (Trevor)

* [http://www.ipgems.com/present/swui_chi_20070502.pdf Semantic Web HCI: Discussing Research Implications] Degler-2007-SWH
: A workshop discussion from CHI 2007 discussing the idea of a "semantic internet" and its relevance to the HCI community. Discusses things like adaptive web interfaces, mashups, dynamic interactions, etc. (Trevor)

* [http://www.springerlink.com/content/u3q14156h6r648h8/fulltext.pdf Implicit Human Computer Interaction Through Context] Schmidtt-2000-IHC
: A highly cited paper discussing the notion of implicit HCI, including semantic grouping of interactions, and some perceptual rules. ('''Trevor - OWNER'''; Andrew Bragdon - discussant; '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:57, 28 January 2009 (UTC))

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1903_1 Cognitive Strategies for the Visual Search of Hierarchical Computer Displays] Anthony J. Hornof
: This article investigates the cognitive strategies that people use to search computer displays. Several different visual layouts are examined. (lisajane)

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1904_9 Unseen and Unaware: Implications of Recent Research on Failures of Visual Awareness for Human-Computer Interface Design] D. Alexander Varakin; Daniel T. Levin; Roger Fidler
: This article reviews basic and applied research documenting failures of visual awareness and the related metacognitive failure and then discuss misplaced beliefs that could accentuate both in the context of the human-computer interface. (lisajane)

* Shneiderman, Plaisant: Designing the User Interface
: My textbook for an HCI class, has many good lists of guidelines. Especially Ch.2 pp 59-102. (lisajane)

* Robert Mack, Jakob Nielsen: Usability Inspection Methods (Ch. 1 Executive Summary)
: Provides an overview of main usability inspection methods, a fair introduction to the industrial applications, as well as certain costs and benefits, of the methods as well as suggestions for expansive research. (Steven)

* [http://portal.acm.org/citation.cfm?id=22950 Jock Mackinlay, Automating the design of graphical presentations of relational information], ACM Transactions on Graphics (TOG),
5(2):110-141, 1986. (Jian)
: The first paper talked about how to automatically generate *good* graphs.

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=04376133 Jock Mackinlay, Pat Hanrahan, Chris Stolte, Show Me: Automatic Presentation for Visual Analysis] IEEE TVCG 13(6): 1137-1144, Nov-Dec, 2007 (Jian)
: Extend their previous paper to analytics tasks.

* [http://www.win.tue.nl/~vanwijk/vov.pdf Jarke J. van Wjik, The value of visualization], IEEE visualization 2005. (Jian)
: discuss vis from a variety of angles as for art, science and technology and question and quantify the utility of visualization.

* [http://www.almaden.ibm.com/u/zhai/papers/steering/chi97.pdf Johnny Accot and Shumin Zhai, Beyond Fitts' law: models for trajectory-based HCI tasks], CHI 97. (Jian)
: Extend Fitts' to trajectory based tasks.

*[http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=01703371 Saraiya, P., North, C., Lam, V., and Duca, K.A, An Insight-Based Longitudinal Study of Visual Analytics], TVCG 12(6): 1511-1522, 2006.(Jian)
* the first paper that quantifies what insight is by comparing several infoVis tools for bioinformatics.

*[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1359732 David H. Laidlaw, Michael Kirby, Cullen Jackson, J. Scott Davidson, Timothy Miller, Marco DaSilva, William Warren, and Michael Tarr.Comparing 2D vector field visualization methods: A user study]. IEEE Transactions on Visualization and Computer Graphics, 11(1):59-70, 2005. (Jian)
: an application-specific comparison of visualization method. a cool paper.

* [http://web.mit.edu/rruth/www/Papers/RosenholtzEtAlCHI2005Clutter.pdf Rosenholtz, Li, Mansfield, and Jin, Feature Congestion: A Measure of Display Clutter], CHI 2005. (Jian)
: quantify visual complexity from a statistics point of view.

* [http://delivery.acm.org/10.1145/240000/236054/p320-john.pdf?key1=236054&key2=2285613321&coll=GUIDE&dl=GUIDE&CFID=19490404&CFTOKEN=25744022 The GOMS Family of User Interface Analysis Techniques: Comparison and Contrast] (Trevor)
: This paper offers an analysis of four types of GOMS (Goals, Objects, Methods and Selection) based interaction techniques. GOMS is a widely used UI paradigm, made popular by Card et al in The Psychology of Human-Computer Interaction (1983).

* [http://vis.cs.brown.edu/~trevor/Papers/Lisetti-2000-AFE.pdf Automatic Facial Expression Interpretation: Where Human-Computer Interaction, Artificial Intelligence and Cognitive Science Intersect] (Trevor)
: Using advanced computer vision/AI techniques, this work aims to discern and make use of users' emotions in UI design.

* [http://vis.cs.brown.edu/~trevor/Papers/weld-2003-APU.pdf Automatically Personalizing User Interfaces] (Trevor)
: Discusses some techniques and design decisions for constructing adaptable and customizable user interfaces. There are some useful references in the paper on using HMMs and RMMs (Relational Markov Models) for interaction prediction.

* [http://vis.cs.brown.edu/~trevor/Papers/Gajos-2006-.pdf Exploring the Design Space for Adaptive Graphical User Interfaces] (Trevor)
: This paper presents comparative evaluations of three methods for implementing adaptable user interfaces. The evaluation methodology gives rise to three key concepts that affect the performance of adaptable UIs: frequency of adaptation, accuracy of adaptation, and the impact of predictability.

* Conceptual Modeling for User Interface Development - David Benyon, Diana Bental, and Thomas Green
: Proposes a new set of terminology for describing and comparing existing and future cognitive models of HCI. (Steven)

* [http://homepage.ntlworld.com/greenery/workStuff/Papers/ERMIA-Skull.PDF The Skull beneath the Skin:
Entity-Relationship Models of Information Artefacts] T. R. G. Green, D. R. Benyon
: A paper in form of prelude to the above, gives a good overview of the ERMIA method. (Steven)

===Cognitive Modeling===

* [http://vis.cs.brown.edu/~trevor/Papers/Kaptelinin-1994-ATI.pdf Activity Theory: Implications for Human-Computer Interaction] (Trevor)
: Discusses the notion of Activity Theory as the basis for HCI research. The most interesting part of this paper for me was the introduction which expressed the need for a ''Theory of HCI''.

* [http://en.wikipedia.org/wiki/Seven_stages_of_action Norman's Seven stages of action]
: Presents Norman's seven stages of action, as well as his model of evaluation. (Steven)

* [http://vis.cs.brown.edu/~trevor/Papers/Wright-2000-AHC.pdf Analyzing Human-Computer Interaction as Distributed Cognition: The Resources Model] (Trevor)
: Creates a compelling argument for why distributed cognition research fits in with HCI, and what types of impacts it may have on the HCI community.

* [http://sonify.psych.gatech.edu/~walkerb/classes/hci/extrareading/nardi.pdf Studying Context, A Comparison of Activity Theory, Situated Action Models, and Distributed Cognition] Bonnie A. Nardi
: Defines the task of the HCI specialist as the application of psychological and anthropological principles to specific design problems. It posits an inherent feud between the accurate study of relative contexts and the necessary, but more general, development of comparative models and results. Gives a coherent overview of activity theory, situated action models, and distributed cognition; finds that activity theory presents the best overall framework. There is little reason given for this ranking, however, and the description of activity theory is the most theoretical and least developed of the three.
: Having spent quite a bit of time studying Soviet psychology (from which came activity theory) last semester, I question the validity of the paper’s claim, as its description of activity theory bears the artifacts of the oppressive regulations which the Soviet government imposed on psychologists. Although the theory may sound more practical, it seems fairly weak as a basis for empirical design analysis.
: The paper’s strongest point is the criticisms which follow descriptions, in which theoretical shortcomings of each perspective are discussed. ('''Owner:''' Steven, '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC))

* [http://www.billbuxton.com/chunking.html Chunking and Phrasing and the Design of Human-Computer Dialogues]

High-level theory of human-computer dialogues. (Andrew Bragdon)

* Polson, P. and Lewis, C. Theory-Based Design for Easily Learned Interfaces. Human-Computer Interaction, 5, 2 (June 1990), 191-220.

: This is a cognitive model of how users find and learn commands in an unfamiliar user interface. This could potentially be adapted to be a piece of a theory of visualization. (Andrew Bragdon)

* [http://www.syros.aegean.gr/users/tsp/conf_pub/C12/c12.pdf Activity Theory vs Cognitive Science in the Study of Human-Computer Interaction]
: Provides a brief history of Cognitive Science and HCI, then compares the effectiveness of the aforementioned theories in aiding design and development. (Owner - week 2 : Steven)

* [http://www.sciencedirect.com/science?_ob=PublicationURL&_tockey=%23TOC%236829%232001%23999449998%23287248%23FLP%23&_cdi=6829&_pubType=J&_auth=y&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=64b44ef6df77ae073d41a7367db866b5 International Journal of Human-Computer Studies - Special Issue on Cognitive Modeling]
:Articles all concerning various issues of cognitive modeling as relates to HCI. (Steven)

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6VDC-4811TNB-5&_user=10&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=259b5c105222437fc84990b7a1eaedee The role of cognitive theory in human–computer interface]. Chalmers, Patricia A, 2003.
:Was scared again, but no need to be. Touches only on a subset of cognitive theories (Schema theory, Cognitive load, and retention theories) and undertakes a survey of some software design theories, but does not attempt an explicit mapping between the two. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=26115.26124 Design Guidelines]. Marshall, Nelson, and Gardiner, 1987.
:Attempt to apply cognitive psychology to user-interface design. Here, the opposite problem is seen—the author's make no significant attempt to take existing heuristic guidelines into account. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://www.cognitivedesignsolutions.com/ Cognitive Design Solutions, Inc.]
:Training and consulting firm that claims to take advantage of Cognitive Design in making design and performance improvements. [[User:E J Kalafarski|E J Kalafarski]] 13:50, 20 February 2009 (UTC)

* [http://infolab.uvt.nl/research/lap2003/agerfalk.pdf Actability Principles in Theory and Practice]. Agerfalk, Par J, 2003.
:Presents a set of nine contemporary principles for the evaluation of IT systems ("social tools to perform communicative action") based explicitly on cognitive principles. Introduces a notion comparable to usability called ''actability''. Presents a mapping for some basic usability principles to some seminal sets of guidelines. [[User:E J Kalafarski|E J Kalafarski]] 14:29, 20 February 2009 (UTC)

==Design==

* Wikipedia articles on [http://en.wikipedia.org/wiki/A_Pattern_Language "A Pattern Language"] and [http://en.wikipedia.org/wiki/Design_pattern "Design Pattern"]
:see summary for Alexander below (David)

* UI Design principles (feedback, etc -- find ref)

* Alexander: A Pattern Language: Towns, Buildings, Construction
:The original design pattern source; what makes a human space work, ineffable best practices, ~250 rules is enough to do communities and house-sized artifacts; could be a good metaphor for making; could be a good metaphor for making human virtual space work? (David)

* [http://useraware.iict.ch/uploads/media/TangibleBits.pdf Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms] Ishii-1997-TBT
:A specific UI proposal, but has nice relevant discussion on how we perceive "foreground" items and "background" items and their relationship, taking advantage of this "parallel" processing of perception. Includes the use of visual metaphors, phicons, and a notion they invent called "digital shadows," in which the shadow projected by an object conveys some information on its contents. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://list.cs.brown.edu/courses/csci1900/2007/documents/restricted/beale.pdf Slanty Design] Beale-2007-SD
:Design method with emphasis on discouraging undesirable behavior, by perhaps forcing the user to adapt to the interface, giving equal weight to user goals, user "non-goals," and wider goals of stakeholders besides the immediate user. The important insight seems to be that these wider goals can enhance the user's experience with the larger system in the long run, if not in the immediate timeframe. Five major design steps. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.amazon.com/Designing-Interactions-Bill-Moggridge/dp/0262134748/ref=pd_bbs_sr_1?ie=UTF8&s=books&qid=1232989194&sr=8-1 Designing Interactions] by Bill Moggridge
: Really awesome book on the evolution of interactions with technology. (Trevor)

* [http://www.amazon.com/Sketching-User-Experiences-Interactive-Technologies/dp/0123740371/ref=sr_1_1?ie=UTF8&s=books&qid=1232989269&sr=1-1 Sketching User Experiences] by Bill Buxton
: Another great book on the practices of interaction design. (Trevor)

* [http://site.ebrary.com/lib/brown/docDetail.action?docID=10173678 The Laws of Simplicity] by John Maeda
: An interesting work on the efficiency of minimalist design. Quick read for those interested. (Steven)
: A set of design guidelines some of which we may be able to build on in automating interface evaluation; will certainly apply to manual evaluations [[User:David Laidlaw|David Laidlaw]]

* [http://www.cs.umd.edu/hcil/pubs/presentations/eyeshaveit/index.htm Ben Shneiderman, The Eyes Have It: User Interfaces for Information Visualization], UM, tech-report, CS-TR-3665. (Jian)
: the paper talks about visualization mantra.

* [http://hci.rwth-aachen.de/materials/publications/borchers2000a.pdf A pattern approach to interaction design] Borchers-2001-PAI
: A highly-cited work on the development of a language for defining design patterns for use in interface development, with an emphasis on communication between application developers and application domain experts. [[User:E J Kalafarski|E J Kalafarski]] 16:37, 3 February 2009 (UTC)

==Thinking, analysis, decision making==

* Morgan D. Jones: The Thinker's Toolkit: Fourteen Powerful Techniques for Problem Solving

:Set of methods for solving problems that might be incorporated into tools for thinking (David)

* Keim, Shazeer, Littman: Proverb: The Probabilistic Cruciverbalist

:An automatic crossword-puzzle solver; the software framework for building this program may be a metaphor for some thinking groupware with plug-in modules. (David)

* Thomas, Cook: Illuminating the Path

:a research agenda for tools for intelligence analysts; not sure of relevance (David)

* Richard Thaler, Cass Sunstein: Nudge - Improving Decisions About Wealth, Health, and Happiness
: A great, easy read for someone who isn't familiar with the psychological perspective. Focuses mainly on public policy issues, but certain sections (on developing a better social security website, for example) relate specifically to digital design. (Steven)

* [http://www.cs.brown.edu/people/trevor/Papers/Heer-2008-GraphicalHistories.pdf Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation] (InfoVis 2008)
: Work by Jeff Heer of Stanford (formerly Berkley) on using Graphical Interaction Histories within the Tableau InfoVis application. This is a great recent example of "workflow analysis" that we've been discussing in class. Though geared toward two-dimensional visualizations with clearly defined events, his work offers some very useful design guidelines for working with interaction histories, including evaluations from the deployment of his techniques within Tableau. (Trevor)

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Gotz-2008-CUV.pdf Characterizing Users' Visual Analytic Activity for Insight Provenance]
: Some work on combining user triggered and automatic vis histories generation.

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Gotz-2008-CUV.pdf Characterizing Users' Visual Analytic Activity for Insight Provenance]
: Some work on combining user triggered and automatic vis histories generation.

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Isenberg-2008-ESV.pdf An exploratory Study on Visual Information Analysis]
: The authors run a user study to find the tasks involved in collaborative evidence aggregation

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Robinson-2008-CSV.pdf Collaborative Synthesis of Visual Analytic Results]
: Same as the previous one.

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Pirolli-2005-SPL.pdf The sensemaking process and leverage points for technology]
: The authors propose a model of analysis and identify leverage points for visualization.

==Visualization==

* Min Chen, David Ebert, Hans Hagen, Robert S. Laramee, Robert van Liere, Kwan-Liu Ma, William Ribarsky, Gerik Scheuermann, Deborah Silver, "Data, Information, and Knowledge in Visualization," IEEE Computer Graphics and Applications, vol. 29, no. 1, pp. 12-19, Jan./Feb. 2009, doi:10.1109/MCG.2009.6

CS295J/Literature

2009-04-14T19:32:26Z

Radu Jianu:

==Perception==

* Colin Ware: Information Visualization: Perception for Design
:Insight into some of the theory of perception as it pertains to building visual interfaces (David)

* Some unindentified paper(s)/book(s) about Gestalt theories of perception and cognition [http://en.wikipedia.org/wiki/Gestalt_psychology wikipedia page]
:These theories, from the 40's inform visual design and may provide an analogy for integration of theory and practice. They describe some characteristics of perception that have been used as evaluative rules in UI design. (David)

* [http://vrlab.epfl.ch/~pglardon/VR05/papers/chi2004.pdf Feeling Bumps and Holes without a Haptic Interface: the Perception of Pseudo-Haptic Textures] Lecuyer-2004-FBH
: A cool technique on "hacking" human perception by modifying the control/display ratio of visible elements to simulate haptic feedback for the user. Strong analysis of which parts of haptic feedback are useful (e.g., vertical elements can be discarded). Pseudo-haptic feedback is implemented by combining the use of visible feedback with the changing sensitivity of a passive input device (e.g., a mouse). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=267474 Research issues in perception and user interfaces] Encarnacao-1994-RIP
: "The authors focus at on three things: presentation of information to best match human cognitive and perceptual capabilities, interactive tools and systems to facilitate creation and navigation of visualizations, and software system features to improve visualization tools." First and third points sound relevant. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=vnax4nN4Ws4C&oi=fnd&pg=PA703&dq=slanty+design&ots=P7G259hzJa&sig=vbYZmYkquwuA_ollOI6EgciNJjU The Uniqueness of Individual Perception] Whitehouse-1999-ID
: Focuses on the commonalities of perception. Rough overview of sensory mechanisms, and strong anecdotal support of not adapting completely to the user, but rather requiring the user to adapt as well. Identifies some common perceptual problems with particular groups of EUs (e.g., blind people). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.psychonomic.org/search/view.cgi?id=4180 Guided search 2. 0. A revised model of visual search] Wolfe-1994-GS2
: A theory of visual search that builds on the distinction between visual targets that you need to search for in a field of distractors and those that "pop out" at you. (Adam) 16:22, 26 January 2009 (UTC)

* [http://biologie.kappa.ro/Literature/Misc_cogsci/articole/dvp/scholl00.pdf Perceptual causality and animacy] [[Scholl-2000-PCA]]
: Discusses some of the automatic interpretation in our perception, focusing on inferring causal relations and animacy. 

* [http://www.cs.umd.edu/class/fall2002/cmsc434-0201/p79-gaver.pdf Technology Affordances] Gaver-1991-TAF
: Affordances are actions that are appropriate for an object and that come to mind when perceiving the object. (Adam) 16:22, 26 January 2009 (UTC)

* [http://portal.acm.org/ft_gateway.cfm?id=301168&type=pdf&coll=GUIDE&dl=GUIDE&CFID=19761061&CFTOKEN=10084975 Affordance, conventions, and design] Norman-1999-ACD
: How the original concept of affordances differs from how it has been used in HCI. (Adam) 16:22, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=DrhCCWmJpWUC&oi=fnd&pg=PA1&dq=ecological+approach+visual+perception&ots=TeE80z49Fr&sig=c0jHz0ucQUTFNvUM5ObQouQq_Oc The Ecological Approach to Visual Perception] Gibson-1986-EAV
: Outlines direct perception and the original theory of affordances. (Jon) 14:07, 3 February 2009.

* [http://ieeexplore.ieee.org/iel1/21/4054/00156574.pdf?tp=&arnumber=156574&isnumber=4054 Ecological interface design: Theoretical foundations] Vicente-1992-EID
: Theory of how interfaces can avoid forcing processing at a higher level than the task requires. (Jon) 14:56, 3 February 2009.

* [http://www.informaworld.com/smpp/ftinterface~content=a784403799~fulltext=713240930 The Ecology of Human-Machine Systems II: Mediating Direct Perception in Complex Work Domains] Vicente-2000-EHM
: Taking advantage of fast perceptual processes to reduce cognitive demands as applied to the design of a thermal-hydraulic system. (Jon) 14:56, 3 February 2009.

* [http://www.aaai.org/Papers/Workshops/1998/WS-98-09/WS98-09-020.pdf Acting on a visual world: The role of multimodal perception in HCI]. Wolff-1998-AVW.
: Experiment that has implications for gesture interpretation module development.

==Cognition==

* Colin Ware: Visual Thinking: For Design
:Insight into some of the theory of cognition as it pertains to building visual interfaces (David)

* [http://en.wikipedia.org/wiki/Seven_plus_or_minus_two Wikipedia's Seven Plus or Minus Two page]
:A clear description of one part of human thinking; will probably provide pointers to other things to read (David)

* [http://portal.acm.org/citation.cfm?id=108844.108865 A cognitive model for the perception and understanding of graphs] Lohse-1991-CMP
: Describes a computer program that predicts response time to a query from assumptions from eye-tracking, short-term memory capacity, and the amount of information that can be absorbed from the query in each "glance." Attempts to lay the foundation for explaining several steps of human cognition, including input, memory, and processing. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.informaworld.com/smpp/content~content=a784395566~db=all~order=page Cognitive load during problem solving: Effects on learning] John Swiller
: Older article but referenced in a lot of newer ones; looks at how conventional problem-solving is ineffective as a learning device. (lisajane)

* [http://web.ebscohost.com/ehost/pdf?vid=1&hid=4&sid=13a77fd7-bead-41ce-bfb1-38addb0dfa53%40sessionmgr7 Dimensional overlap: Cognitive basis for stimulus–response compatibility—A model and taxonomy] Kornblum-1990-DOC
: People are more effective at a task when the stimulus and response representations are compatible and they don't require "translation". (Adam) 16:22, 26 January 2009 (UTC)

* [http://vis.cs.brown.edu/~trevor/Papers/Iverson-TNR-ImPact.pdf Tracking Neuropsychological Recovery Following Concussion in Sport]
: This paper discusses the neurological basis for the ImPact test given to athletes after they've suffered a concussion. It provides testing and quantitative measures for verbal memory, visual memory, and reaction times. These simple measures of cognition may be useful to incorporate in an HCI study. (Trevor)

A Framework of Interaction Costs in Information Visualization
:ABSTRACT: Interaction cost is an important but poorly understood factor in visualization design. We propose a framework of interaction costs inspired by Norman’s Seven Stages of Action to facilitate study. From 484 papers, we collected 61 interaction-related usability problems reported in 32 user studies and placed them into our framework of seven costs: (1) Decision costs to form goals; (2) System-power costs to form system operations; (3) Multiple input mode costs to form physical sequences; (4) Physical-motion costs to execute sequences; (5) Visual-cluttering costs to perceive state; (6) View-change costs to interpret perception; (7) State-change costs to evaluate interpretation. We also suggested ways to narrow the gulfs of execution (2–4) and evaluation (5–7) based on collected reports. Our framework suggests a need to consider decision costs (1) as the gulf of goal formation.
: Includes some ideas for quantitatively evaluating information visualization interfaces (David)

*Distributed Cognition as a Theoretical Framework for HCI (1994) Christine A. Halverson [http://hci.ucsd.edu/cogsci/faculty_pubs/9403.ps]


* [http://consc.net/papers/extended.html The Extended Mind] Clark-1998-TEM
: Cognition can be thought to be distributable across mediums (outside of the skull). How might we off-load "cognitive" processes to computer systems? ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - Owner)
: I think that Ware gets into this in some of his writing about information visualization (or in his second book, thinking with visualization). We can build in external "caches" or other constructs to be part of our cognitive model. It seems like most of an analytical user interface is part of the external cognitive process. (David)


* [http://courses.csail.mit.edu/6.803/pdf/dualtask.pdf Sources of Flexibility in Human Cognition: Dual-Task Studies of Space and Language] HermerVazquez-1999-SFC
: Our use of language serves as a higher-order cognitive system which can be utilized as "scaffolding" in human thought, supporting goal-driven tasks. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.sjdm.org/mail-archive/jdm-society/attachments/20060401/963b50da/attachment-0003.pdf In two minds: dual-process accounts of reasoning] Evans-2003-ITM
: It is hypothesized that there are two distinct systems of reasoning in the mind. System 1 is innate and fast, system 2 is controlled and slow. Knowledge of this might help us determine which tasks are candidates for one system or another. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6WJB-467J83F-3&_user=489286&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=316065013955ca22e9dde19df6a0f9b8 Priming against your will: How accessible alternatives affect goal pursuit] Shah-2002-PAY
: The authors demonstrate how priming the means to achieving a goal also primes the goal, but inhibits alternative means to achieving the same goal. It means that making the means of achieving a goal salient in an interface will make it more likely that people pursue that goal, and less likely that they will think of other means to pursue it. (Adam)

==HCI==

* [http://portal.acm.org/citation.cfm?id=1357054.1357125&coll=portal&dl=ACM&type=series&idx=SERIES260&part=series&WantType=Proceedings&title=CHI&CFID=20781736&CFTOKEN=83176621 A diary study of mobile information needs]

:A detailed study into how people use mobile devices. '''(Andrew Bragdon - OWNER for Assignment 2)'''

* [http://portal.acm.org/citation.cfm?id=1357054.1357187&coll=Portal&dl=GUIDE&CFID=21136843&CFTOKEN=23841774 Feasibility and pragmatics of classifying working memory load with an electroencephalograph]

:Examines how practical it is to use electroencephelographs to measure cognitive load, and discusses domain-specific knowledge needed.

* [http://delivery.acm.org/10.1145/1250000/1240669/p271-hurst.pdf?key1=1240669&key2=6465483321&coll=GUIDE&dl=GUIDE&CFID=20565232&CFTOKEN=69614228 Dynamic Detection of Novice vs Skilled Use]

:Used a learning classifier, trained on low-level mouse and keyboard usage patterns, to identify novice and expert use dynamically with accuracies as high as 91%. This classifier was then used to provide differrent information and feedback to the user as appropriate.

* [http://portal.acm.org/citation.cfm?id=1054972.1055012&coll=GUIDE&dl=ACM&CFID=20565232&CFTOKEN=69614228 Bubble Cursor]

:Example of a paper which demonstrated a novel interaction technique still obeys Fitts's law.

* [http://tlaloc.sfsu.edu/~lank/research/appearing/FSS604LankE.pdf Sloppy Selection]

:Utilized a quantiative model of user performance which used curvature to predict the speed of a pen as it moved across a surface to help disambiguate target selection intent.

* [http://delivery.acm.org/10.1145/1250000/1240730/p677-iqbal.pdf?key1=1240730&key2=4525483321&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 Disruption and Recovery of Computing Tasks]

:Studied task disruption and recovery in a field study, and found that users often visited several applications as a result of an alert, such as a new email notification, and that 27% of task suspensions resulted in 2 hours or more of disruption. Users in the study said that losing context was a significant problem in switching tasks, and led in part to the length of some of these disruptions. This work hints at the importance of providing affordances to users to maintain and regain lost context during task switching.

* [http://portal.acm.org/citation.cfm?id=985692.985715&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 A diary study of task switching and interruptions]

:Showed that task complexity, task duration, length of absence, and number of interruptions all affected the users' own perceived diffuclty of switching tasks. (Andrew Bragdon)

* John M. Carroll: HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science

:A gargantuan book with chapters by many folks describing some of the models and theories from HCI that may relate back to cognition; may need to create individual (David)

* [http://portal.acm.org/citation.cfm?id=1461832&dl=&coll= Project ernestine: validating a GOMS analysis for predicting and explaining real-world task performance]

: A study in which the [http://en.wikipedia.org/wiki/GOMS#cite_note-CHI92-1 GOMS] method is used to correctly predict the performance of call center operators using a new workstation. Might be interesting because of the methodology used to decompose the task into basic cognitive and perceptual actions, and then measuring these actions to evaluate the new interface. (Eric) The CPM (Critical Path Modeling) aspect used handles the parallel nature of several human components of HCI and seems to very accurately model the low level tasks from this study. (David)

* [http://www.informaworld.com/smpp/content~content=a784766580~db=all The Growth of Cognitive Modeling in Human-Computer Interaction Since GOMS]

* [http://portal.acm.org/citation.cfm?id=169059.169426&coll=Portal&dl=GUIDE&CFID=19188713&CFTOKEN=13376420 The limits of expert performance using hierarchic marking menus]
Marking menus naturally facillitate the transition from novice to expert performance for command invocation, and have been quite influential over the years to research into menu techniques. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/302979.303053 Manual and gaze input cascaded (MAGIC) pointing]

This is a system which combines gaze input (coarse-grained) and mouse input (fine-grained) to quickly target items. This is important because it "kind of" gets around Fitt's law by using gaze input to "warp" the cursor to the general vicinity of what the user wants to work on. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/985692.985727 If not now, when?: the effects of interruption at different moments within task execution] Adamczyk-2004-INN

Presents task models of user attention. (Andrew Bragdon) (Adam - owner; [http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - discussant) '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:58, 28 January 2009 (UTC)


* [http://hfs.sagepub.com/cgi/reprint/44/1/62.pdf Ecological Interface Design: Progress and challenges] Vicente-2002-EID
: Discusses the implications of Ecological Interface Design (EID), a theoretical HCI framework, for designing human-computer interfaces and compares performance of EID-informed designs to other comtemporary approaches. (Owner: Jon)

* [http://doi.acm.org/10.1145/985692.985707 "Constant, constant, multi-tasking craziness": managing multiple working spheres.] Gonzalez-2004-CCM

Empirical study of how information workers spend their time. Puts forward a theory of how users organize small individual tasks into "working spheres." (Andrew Bragdon - OWNER; Adam Darlow - Discussant; Steven Ellis - Discussant)

'''250-word summary and relevance statement''' (Andrew Bragdon)

Any visualization which is used extensively by a user over a period of time will be used in the context of that user's daily workflow. It is therefore essential to understand this larger workflow context to design the visualization application appropriately to fit the needs of real world users. This paper studies in detail the daily workflow tasks and patterns of work of analysts, managers and software developers in a medium-sized software company. This paper provides strong empirical evidence that users, rather than working on discrete and well-defined tasks, in reality, switch tasks on average every two to three minutes, and instead, work on larger thematically connected units of work (working spheres). In addition, the study found that users switched between these larger working spheres on average every 12 minutes. Thus, it is strongly indicated by this paper that many information workers are in a constant state of rapid fire multi-tasking. This suggests that for a visualization to be relevant to any of these information workers, it would need to fit into, and support, this workflow. This is just a first step towards understanding how users interact with visualizations in particular, however; future work that studies how users interact with visualizations as part of their larger daily work patterns is warranted, and would be an important component of a broad theory of visualization.

* [http://www.eecs.berkeley.edu/Pubs/TechRpts/2000/CSD-00-1105.pdf The state of the art in automating usability evaluation of user interfaces] Ivory-2000-SAA
: Presents a new taxonomy for automating usability analysis. Advantages of automated evaluation are purported to be advantages linked to efficiency, such as comparing alternate designs, uncovering more errors more consistently, and predicting time/error costs across an entire design. Breaks down a taxonomy with individual benefits and drawbacks of each method, and checks observations against existing guidelines (e.g. Smith and Mosier guidelines, Motif style guidelines, etc). Introduces several visual tools. Looks extremely relevant as a comprehensive survey of existing techniques. '''OWNER''': [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC) '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC) Discussant: Steven Ellis

* [http://www.hpl.hp.com/techreports/91/HPL-91-03.pdf User Interface Evaluation in the Real World: A Comparison of Four Techniques] Jeffries-1991-UIE
: Overview of the four major UI evaluation methods: heuristic evaluation, usability testing, guidelines, and cognitive walkthrough, followed by a comparison in their application to a case study. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ics.colorado.edu/techpubs/pdf/91-01.pdf Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces] Polson-xxxx-CWM
: Presents the concept of performing a hand walkthrough of the cognitive process, based on another theory of "learning by exploration." Strong results for a limited evaluation timeframe and little or no time for formal instruction of the interface for the user. The reviewer considers each behavior of the interface and its resultant effect on the user, attempting to identify actions that would be difficult for the "average" user. Claims that a given step will ''not'' be difficult must be supported with empirical data or theory. The application of cognitive theory early in the design process seems useful in avoiding costly redesigns when problems are identified later. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=142834&coll= Finding usability problems through heuristic evaluation] Nielsen-1992-FUP
: Emphasis on heuristic evaluation. Shockingly, usability experts are found to be better at performing this type of evaluation. Usability problems relating to elements that are completely missing from the interface are difficult to identify with this method when evaluating unimplemented designs. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://delivery.acm.org/10.1145/130000/128728/p152-jacob.pdf?key1=128728&key2=7032992321&coll=GUIDE&dl=GUIDE&CFID=19735001&CFTOKEN=82907542 The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look at is What you Get] Jacob-1991-UEM
: One of the first research papers to introduce eye tracking as a viable HCI technique. (Trevor)

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=1221372&isnumber=27434 Real-Time Eye Tracking for Human Computer Interfaces] Amarnag-2003-RTE
: Technical details about the implementation of a recent real-time eye-tracking system. (Trevor)

* [http://www.ipgems.com/present/swui_chi_20070502.pdf Semantic Web HCI: Discussing Research Implications] Degler-2007-SWH
: A workshop discussion from CHI 2007 discussing the idea of a "semantic internet" and its relevance to the HCI community. Discusses things like adaptive web interfaces, mashups, dynamic interactions, etc. (Trevor)

* [http://www.springerlink.com/content/u3q14156h6r648h8/fulltext.pdf Implicit Human Computer Interaction Through Context] Schmidtt-2000-IHC
: A highly cited paper discussing the notion of implicit HCI, including semantic grouping of interactions, and some perceptual rules. ('''Trevor - OWNER'''; Andrew Bragdon - discussant; '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:57, 28 January 2009 (UTC))

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1903_1 Cognitive Strategies for the Visual Search of Hierarchical Computer Displays] Anthony J. Hornof
: This article investigates the cognitive strategies that people use to search computer displays. Several different visual layouts are examined. (lisajane)

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1904_9 Unseen and Unaware: Implications of Recent Research on Failures of Visual Awareness for Human-Computer Interface Design] D. Alexander Varakin; Daniel T. Levin; Roger Fidler
: This article reviews basic and applied research documenting failures of visual awareness and the related metacognitive failure and then discuss misplaced beliefs that could accentuate both in the context of the human-computer interface. (lisajane)

* Shneiderman, Plaisant: Designing the User Interface
: My textbook for an HCI class, has many good lists of guidelines. Especially Ch.2 pp 59-102. (lisajane)

* Robert Mack, Jakob Nielsen: Usability Inspection Methods (Ch. 1 Executive Summary)
: Provides an overview of main usability inspection methods, a fair introduction to the industrial applications, as well as certain costs and benefits, of the methods as well as suggestions for expansive research. (Steven)

* [http://portal.acm.org/citation.cfm?id=22950 Jock Mackinlay, Automating the design of graphical presentations of relational information], ACM Transactions on Graphics (TOG),
5(2):110-141, 1986. (Jian)
: The first paper talked about how to automatically generate *good* graphs.

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=04376133 Jock Mackinlay, Pat Hanrahan, Chris Stolte, Show Me: Automatic Presentation for Visual Analysis] IEEE TVCG 13(6): 1137-1144, Nov-Dec, 2007 (Jian)
: Extend their previous paper to analytics tasks.

* [http://www.win.tue.nl/~vanwijk/vov.pdf Jarke J. van Wjik, The value of visualization], IEEE visualization 2005. (Jian)
: discuss vis from a variety of angles as for art, science and technology and question and quantify the utility of visualization.

* [http://www.almaden.ibm.com/u/zhai/papers/steering/chi97.pdf Johnny Accot and Shumin Zhai, Beyond Fitts' law: models for trajectory-based HCI tasks], CHI 97. (Jian)
: Extend Fitts' to trajectory based tasks.

*[http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=01703371 Saraiya, P., North, C., Lam, V., and Duca, K.A, An Insight-Based Longitudinal Study of Visual Analytics], TVCG 12(6): 1511-1522, 2006.(Jian)
* the first paper that quantifies what insight is by comparing several infoVis tools for bioinformatics.

*[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1359732 David H. Laidlaw, Michael Kirby, Cullen Jackson, J. Scott Davidson, Timothy Miller, Marco DaSilva, William Warren, and Michael Tarr.Comparing 2D vector field visualization methods: A user study]. IEEE Transactions on Visualization and Computer Graphics, 11(1):59-70, 2005. (Jian)
: an application-specific comparison of visualization method. a cool paper.

* [http://web.mit.edu/rruth/www/Papers/RosenholtzEtAlCHI2005Clutter.pdf Rosenholtz, Li, Mansfield, and Jin, Feature Congestion: A Measure of Display Clutter], CHI 2005. (Jian)
: quantify visual complexity from a statistics point of view.

* [http://delivery.acm.org/10.1145/240000/236054/p320-john.pdf?key1=236054&key2=2285613321&coll=GUIDE&dl=GUIDE&CFID=19490404&CFTOKEN=25744022 The GOMS Family of User Interface Analysis Techniques: Comparison and Contrast] (Trevor)
: This paper offers an analysis of four types of GOMS (Goals, Objects, Methods and Selection) based interaction techniques. GOMS is a widely used UI paradigm, made popular by Card et al in The Psychology of Human-Computer Interaction (1983).

* [http://vis.cs.brown.edu/~trevor/Papers/Lisetti-2000-AFE.pdf Automatic Facial Expression Interpretation: Where Human-Computer Interaction, Artificial Intelligence and Cognitive Science Intersect] (Trevor)
: Using advanced computer vision/AI techniques, this work aims to discern and make use of users' emotions in UI design.

* [http://vis.cs.brown.edu/~trevor/Papers/weld-2003-APU.pdf Automatically Personalizing User Interfaces] (Trevor)
: Discusses some techniques and design decisions for constructing adaptable and customizable user interfaces. There are some useful references in the paper on using HMMs and RMMs (Relational Markov Models) for interaction prediction.

* [http://vis.cs.brown.edu/~trevor/Papers/Gajos-2006-.pdf Exploring the Design Space for Adaptive Graphical User Interfaces] (Trevor)
: This paper presents comparative evaluations of three methods for implementing adaptable user interfaces. The evaluation methodology gives rise to three key concepts that affect the performance of adaptable UIs: frequency of adaptation, accuracy of adaptation, and the impact of predictability.

* Conceptual Modeling for User Interface Development - David Benyon, Diana Bental, and Thomas Green
: Proposes a new set of terminology for describing and comparing existing and future cognitive models of HCI. (Steven)

* [http://homepage.ntlworld.com/greenery/workStuff/Papers/ERMIA-Skull.PDF The Skull beneath the Skin:
Entity-Relationship Models of Information Artefacts] T. R. G. Green, D. R. Benyon
: A paper in form of prelude to the above, gives a good overview of the ERMIA method. (Steven)

===Cognitive Modeling===

* [http://vis.cs.brown.edu/~trevor/Papers/Kaptelinin-1994-ATI.pdf Activity Theory: Implications for Human-Computer Interaction] (Trevor)
: Discusses the notion of Activity Theory as the basis for HCI research. The most interesting part of this paper for me was the introduction which expressed the need for a ''Theory of HCI''.

* [http://en.wikipedia.org/wiki/Seven_stages_of_action Norman's Seven stages of action]
: Presents Norman's seven stages of action, as well as his model of evaluation. (Steven)

* [http://vis.cs.brown.edu/~trevor/Papers/Wright-2000-AHC.pdf Analyzing Human-Computer Interaction as Distributed Cognition: The Resources Model] (Trevor)
: Creates a compelling argument for why distributed cognition research fits in with HCI, and what types of impacts it may have on the HCI community.

* [http://sonify.psych.gatech.edu/~walkerb/classes/hci/extrareading/nardi.pdf Studying Context, A Comparison of Activity Theory, Situated Action Models, and Distributed Cognition] Bonnie A. Nardi
: Defines the task of the HCI specialist as the application of psychological and anthropological principles to specific design problems. It posits an inherent feud between the accurate study of relative contexts and the necessary, but more general, development of comparative models and results. Gives a coherent overview of activity theory, situated action models, and distributed cognition; finds that activity theory presents the best overall framework. There is little reason given for this ranking, however, and the description of activity theory is the most theoretical and least developed of the three.
: Having spent quite a bit of time studying Soviet psychology (from which came activity theory) last semester, I question the validity of the paper’s claim, as its description of activity theory bears the artifacts of the oppressive regulations which the Soviet government imposed on psychologists. Although the theory may sound more practical, it seems fairly weak as a basis for empirical design analysis.
: The paper’s strongest point is the criticisms which follow descriptions, in which theoretical shortcomings of each perspective are discussed. ('''Owner:''' Steven, '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC))

* [http://www.billbuxton.com/chunking.html Chunking and Phrasing and the Design of Human-Computer Dialogues]

High-level theory of human-computer dialogues. (Andrew Bragdon)

* Polson, P. and Lewis, C. Theory-Based Design for Easily Learned Interfaces. Human-Computer Interaction, 5, 2 (June 1990), 191-220.

: This is a cognitive model of how users find and learn commands in an unfamiliar user interface. This could potentially be adapted to be a piece of a theory of visualization. (Andrew Bragdon)

* [http://www.syros.aegean.gr/users/tsp/conf_pub/C12/c12.pdf Activity Theory vs Cognitive Science in the Study of Human-Computer Interaction]
: Provides a brief history of Cognitive Science and HCI, then compares the effectiveness of the aforementioned theories in aiding design and development. (Owner - week 2 : Steven)

* [http://www.sciencedirect.com/science?_ob=PublicationURL&_tockey=%23TOC%236829%232001%23999449998%23287248%23FLP%23&_cdi=6829&_pubType=J&_auth=y&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=64b44ef6df77ae073d41a7367db866b5 International Journal of Human-Computer Studies - Special Issue on Cognitive Modeling]
:Articles all concerning various issues of cognitive modeling as relates to HCI. (Steven)

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6VDC-4811TNB-5&_user=10&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=259b5c105222437fc84990b7a1eaedee The role of cognitive theory in human–computer interface]. Chalmers, Patricia A, 2003.
:Was scared again, but no need to be. Touches only on a subset of cognitive theories (Schema theory, Cognitive load, and retention theories) and undertakes a survey of some software design theories, but does not attempt an explicit mapping between the two. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=26115.26124 Design Guidelines]. Marshall, Nelson, and Gardiner, 1987.
:Attempt to apply cognitive psychology to user-interface design. Here, the opposite problem is seen—the author's make no significant attempt to take existing heuristic guidelines into account. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://www.cognitivedesignsolutions.com/ Cognitive Design Solutions, Inc.]
:Training and consulting firm that claims to take advantage of Cognitive Design in making design and performance improvements. [[User:E J Kalafarski|E J Kalafarski]] 13:50, 20 February 2009 (UTC)

* [http://infolab.uvt.nl/research/lap2003/agerfalk.pdf Actability Principles in Theory and Practice]. Agerfalk, Par J, 2003.
:Presents a set of nine contemporary principles for the evaluation of IT systems ("social tools to perform communicative action") based explicitly on cognitive principles. Introduces a notion comparable to usability called ''actability''. Presents a mapping for some basic usability principles to some seminal sets of guidelines. [[User:E J Kalafarski|E J Kalafarski]] 14:29, 20 February 2009 (UTC)

==Design==

* Wikipedia articles on [http://en.wikipedia.org/wiki/A_Pattern_Language "A Pattern Language"] and [http://en.wikipedia.org/wiki/Design_pattern "Design Pattern"]
:see summary for Alexander below (David)

* UI Design principles (feedback, etc -- find ref)

* Alexander: A Pattern Language: Towns, Buildings, Construction
:The original design pattern source; what makes a human space work, ineffable best practices, ~250 rules is enough to do communities and house-sized artifacts; could be a good metaphor for making; could be a good metaphor for making human virtual space work? (David)

* [http://useraware.iict.ch/uploads/media/TangibleBits.pdf Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms] Ishii-1997-TBT
:A specific UI proposal, but has nice relevant discussion on how we perceive "foreground" items and "background" items and their relationship, taking advantage of this "parallel" processing of perception. Includes the use of visual metaphors, phicons, and a notion they invent called "digital shadows," in which the shadow projected by an object conveys some information on its contents. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://list.cs.brown.edu/courses/csci1900/2007/documents/restricted/beale.pdf Slanty Design] Beale-2007-SD
:Design method with emphasis on discouraging undesirable behavior, by perhaps forcing the user to adapt to the interface, giving equal weight to user goals, user "non-goals," and wider goals of stakeholders besides the immediate user. The important insight seems to be that these wider goals can enhance the user's experience with the larger system in the long run, if not in the immediate timeframe. Five major design steps. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.amazon.com/Designing-Interactions-Bill-Moggridge/dp/0262134748/ref=pd_bbs_sr_1?ie=UTF8&s=books&qid=1232989194&sr=8-1 Designing Interactions] by Bill Moggridge
: Really awesome book on the evolution of interactions with technology. (Trevor)

* [http://www.amazon.com/Sketching-User-Experiences-Interactive-Technologies/dp/0123740371/ref=sr_1_1?ie=UTF8&s=books&qid=1232989269&sr=1-1 Sketching User Experiences] by Bill Buxton
: Another great book on the practices of interaction design. (Trevor)

* [http://site.ebrary.com/lib/brown/docDetail.action?docID=10173678 The Laws of Simplicity] by John Maeda
: An interesting work on the efficiency of minimalist design. Quick read for those interested. (Steven)
: A set of design guidelines some of which we may be able to build on in automating interface evaluation; will certainly apply to manual evaluations [[User:David Laidlaw|David Laidlaw]]

* [http://www.cs.umd.edu/hcil/pubs/presentations/eyeshaveit/index.htm Ben Shneiderman, The Eyes Have It: User Interfaces for Information Visualization], UM, tech-report, CS-TR-3665. (Jian)
: the paper talks about visualization mantra.

* [http://hci.rwth-aachen.de/materials/publications/borchers2000a.pdf A pattern approach to interaction design] Borchers-2001-PAI
: A highly-cited work on the development of a language for defining design patterns for use in interface development, with an emphasis on communication between application developers and application domain experts. [[User:E J Kalafarski|E J Kalafarski]] 16:37, 3 February 2009 (UTC)

==Thinking, analysis, decision making==

* Morgan D. Jones: The Thinker's Toolkit: Fourteen Powerful Techniques for Problem Solving

:Set of methods for solving problems that might be incorporated into tools for thinking (David)

* Keim, Shazeer, Littman: Proverb: The Probabilistic Cruciverbalist

:An automatic crossword-puzzle solver; the software framework for building this program may be a metaphor for some thinking groupware with plug-in modules. (David)

* Thomas, Cook: Illuminating the Path

:a research agenda for tools for intelligence analysts; not sure of relevance (David)

* Richard Thaler, Cass Sunstein: Nudge - Improving Decisions About Wealth, Health, and Happiness
: A great, easy read for someone who isn't familiar with the psychological perspective. Focuses mainly on public policy issues, but certain sections (on developing a better social security website, for example) relate specifically to digital design. (Steven)

* [http://www.cs.brown.edu/people/trevor/Papers/Heer-2008-GraphicalHistories.pdf Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation] (InfoVis 2008)
: Work by Jeff Heer of Stanford (formerly Berkley) on using Graphical Interaction Histories within the Tableau InfoVis application. This is a great recent example of "workflow analysis" that we've been discussing in class. Though geared toward two-dimensional visualizations with clearly defined events, his work offers some very useful design guidelines for working with interaction histories, including evaluations from the deployment of his techniques within Tableau. (Trevor)

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Gotz-2008-CUV.pdf Characterizing Users' Visual Analytic Activity for Insight Provenance]
: Some work on combining user triggered and automatic vis histories generation.

==Visualization==

* Min Chen, David Ebert, Hans Hagen, Robert S. Laramee, Robert van Liere, Kwan-Liu Ma, William Ribarsky, Gerik Scheuermann, Deborah Silver, "Data, Information, and Knowledge in Visualization," IEEE Computer Graphics and Applications, vol. 29, no. 1, pp. 12-19, Jan./Feb. 2009, doi:10.1109/MCG.2009.6

CS295J/Literature

2009-04-14T19:31:31Z

Radu Jianu:

==Perception==

* Colin Ware: Information Visualization: Perception for Design
:Insight into some of the theory of perception as it pertains to building visual interfaces (David)

* Some unindentified paper(s)/book(s) about Gestalt theories of perception and cognition [http://en.wikipedia.org/wiki/Gestalt_psychology wikipedia page]
:These theories, from the 40's inform visual design and may provide an analogy for integration of theory and practice. They describe some characteristics of perception that have been used as evaluative rules in UI design. (David)

* [http://vrlab.epfl.ch/~pglardon/VR05/papers/chi2004.pdf Feeling Bumps and Holes without a Haptic Interface: the Perception of Pseudo-Haptic Textures] Lecuyer-2004-FBH
: A cool technique on "hacking" human perception by modifying the control/display ratio of visible elements to simulate haptic feedback for the user. Strong analysis of which parts of haptic feedback are useful (e.g., vertical elements can be discarded). Pseudo-haptic feedback is implemented by combining the use of visible feedback with the changing sensitivity of a passive input device (e.g., a mouse). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=267474 Research issues in perception and user interfaces] Encarnacao-1994-RIP
: "The authors focus at on three things: presentation of information to best match human cognitive and perceptual capabilities, interactive tools and systems to facilitate creation and navigation of visualizations, and software system features to improve visualization tools." First and third points sound relevant. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=vnax4nN4Ws4C&oi=fnd&pg=PA703&dq=slanty+design&ots=P7G259hzJa&sig=vbYZmYkquwuA_ollOI6EgciNJjU The Uniqueness of Individual Perception] Whitehouse-1999-ID
: Focuses on the commonalities of perception. Rough overview of sensory mechanisms, and strong anecdotal support of not adapting completely to the user, but rather requiring the user to adapt as well. Identifies some common perceptual problems with particular groups of EUs (e.g., blind people). [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.psychonomic.org/search/view.cgi?id=4180 Guided search 2. 0. A revised model of visual search] Wolfe-1994-GS2
: A theory of visual search that builds on the distinction between visual targets that you need to search for in a field of distractors and those that "pop out" at you. (Adam) 16:22, 26 January 2009 (UTC)

* [http://biologie.kappa.ro/Literature/Misc_cogsci/articole/dvp/scholl00.pdf Perceptual causality and animacy] [[Scholl-2000-PCA]]
: Discusses some of the automatic interpretation in our perception, focusing on inferring causal relations and animacy. 

* [http://www.cs.umd.edu/class/fall2002/cmsc434-0201/p79-gaver.pdf Technology Affordances] Gaver-1991-TAF
: Affordances are actions that are appropriate for an object and that come to mind when perceiving the object. (Adam) 16:22, 26 January 2009 (UTC)

* [http://portal.acm.org/ft_gateway.cfm?id=301168&type=pdf&coll=GUIDE&dl=GUIDE&CFID=19761061&CFTOKEN=10084975 Affordance, conventions, and design] Norman-1999-ACD
: How the original concept of affordances differs from how it has been used in HCI. (Adam) 16:22, 26 January 2009 (UTC)

* [http://books.google.com/books?hl=en&lr=&id=DrhCCWmJpWUC&oi=fnd&pg=PA1&dq=ecological+approach+visual+perception&ots=TeE80z49Fr&sig=c0jHz0ucQUTFNvUM5ObQouQq_Oc The Ecological Approach to Visual Perception] Gibson-1986-EAV
: Outlines direct perception and the original theory of affordances. (Jon) 14:07, 3 February 2009.

* [http://ieeexplore.ieee.org/iel1/21/4054/00156574.pdf?tp=&arnumber=156574&isnumber=4054 Ecological interface design: Theoretical foundations] Vicente-1992-EID
: Theory of how interfaces can avoid forcing processing at a higher level than the task requires. (Jon) 14:56, 3 February 2009.

* [http://www.informaworld.com/smpp/ftinterface~content=a784403799~fulltext=713240930 The Ecology of Human-Machine Systems II: Mediating Direct Perception in Complex Work Domains] Vicente-2000-EHM
: Taking advantage of fast perceptual processes to reduce cognitive demands as applied to the design of a thermal-hydraulic system. (Jon) 14:56, 3 February 2009.

* [http://www.aaai.org/Papers/Workshops/1998/WS-98-09/WS98-09-020.pdf Acting on a visual world: The role of multimodal perception in HCI]. Wolff-1998-AVW.
: Experiment that has implications for gesture interpretation module development.

==Cognition==

* Colin Ware: Visual Thinking: For Design
:Insight into some of the theory of cognition as it pertains to building visual interfaces (David)

* [http://en.wikipedia.org/wiki/Seven_plus_or_minus_two Wikipedia's Seven Plus or Minus Two page]
:A clear description of one part of human thinking; will probably provide pointers to other things to read (David)

* [http://portal.acm.org/citation.cfm?id=108844.108865 A cognitive model for the perception and understanding of graphs] Lohse-1991-CMP
: Describes a computer program that predicts response time to a query from assumptions from eye-tracking, short-term memory capacity, and the amount of information that can be absorbed from the query in each "glance." Attempts to lay the foundation for explaining several steps of human cognition, including input, memory, and processing. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.informaworld.com/smpp/content~content=a784395566~db=all~order=page Cognitive load during problem solving: Effects on learning] John Swiller
: Older article but referenced in a lot of newer ones; looks at how conventional problem-solving is ineffective as a learning device. (lisajane)

* [http://web.ebscohost.com/ehost/pdf?vid=1&hid=4&sid=13a77fd7-bead-41ce-bfb1-38addb0dfa53%40sessionmgr7 Dimensional overlap: Cognitive basis for stimulus–response compatibility—A model and taxonomy] Kornblum-1990-DOC
: People are more effective at a task when the stimulus and response representations are compatible and they don't require "translation". (Adam) 16:22, 26 January 2009 (UTC)

* [http://vis.cs.brown.edu/~trevor/Papers/Iverson-TNR-ImPact.pdf Tracking Neuropsychological Recovery Following Concussion in Sport]
: This paper discusses the neurological basis for the ImPact test given to athletes after they've suffered a concussion. It provides testing and quantitative measures for verbal memory, visual memory, and reaction times. These simple measures of cognition may be useful to incorporate in an HCI study. (Trevor)

A Framework of Interaction Costs in Information Visualization
:ABSTRACT: Interaction cost is an important but poorly understood factor in visualization design. We propose a framework of interaction costs inspired by Norman’s Seven Stages of Action to facilitate study. From 484 papers, we collected 61 interaction-related usability problems reported in 32 user studies and placed them into our framework of seven costs: (1) Decision costs to form goals; (2) System-power costs to form system operations; (3) Multiple input mode costs to form physical sequences; (4) Physical-motion costs to execute sequences; (5) Visual-cluttering costs to perceive state; (6) View-change costs to interpret perception; (7) State-change costs to evaluate interpretation. We also suggested ways to narrow the gulfs of execution (2–4) and evaluation (5–7) based on collected reports. Our framework suggests a need to consider decision costs (1) as the gulf of goal formation.
: Includes some ideas for quantitatively evaluating information visualization interfaces (David)

*Distributed Cognition as a Theoretical Framework for HCI (1994) Christine A. Halverson [http://hci.ucsd.edu/cogsci/faculty_pubs/9403.ps]


* [http://consc.net/papers/extended.html The Extended Mind] Clark-1998-TEM
: Cognition can be thought to be distributable across mediums (outside of the skull). How might we off-load "cognitive" processes to computer systems? ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - Owner)
: I think that Ware gets into this in some of his writing about information visualization (or in his second book, thinking with visualization). We can build in external "caches" or other constructs to be part of our cognitive model. It seems like most of an analytical user interface is part of the external cognitive process. (David)


* [http://courses.csail.mit.edu/6.803/pdf/dualtask.pdf Sources of Flexibility in Human Cognition: Dual-Task Studies of Space and Language] HermerVazquez-1999-SFC
: Our use of language serves as a higher-order cognitive system which can be utilized as "scaffolding" in human thought, supporting goal-driven tasks. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.sjdm.org/mail-archive/jdm-society/attachments/20060401/963b50da/attachment-0003.pdf In two minds: dual-process accounts of reasoning] Evans-2003-ITM
: It is hypothesized that there are two distinct systems of reasoning in the mind. System 1 is innate and fast, system 2 is controlled and slow. Knowledge of this might help us determine which tasks are candidates for one system or another. ([http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon])

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6WJB-467J83F-3&_user=489286&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=316065013955ca22e9dde19df6a0f9b8 Priming against your will: How accessible alternatives affect goal pursuit] Shah-2002-PAY
: The authors demonstrate how priming the means to achieving a goal also primes the goal, but inhibits alternative means to achieving the same goal. It means that making the means of achieving a goal salient in an interface will make it more likely that people pursue that goal, and less likely that they will think of other means to pursue it. (Adam)

==HCI==

* [http://portal.acm.org/citation.cfm?id=1357054.1357125&coll=portal&dl=ACM&type=series&idx=SERIES260&part=series&WantType=Proceedings&title=CHI&CFID=20781736&CFTOKEN=83176621 A diary study of mobile information needs]

:A detailed study into how people use mobile devices. '''(Andrew Bragdon - OWNER for Assignment 2)'''

* [http://portal.acm.org/citation.cfm?id=1357054.1357187&coll=Portal&dl=GUIDE&CFID=21136843&CFTOKEN=23841774 Feasibility and pragmatics of classifying working memory load with an electroencephalograph]

:Examines how practical it is to use electroencephelographs to measure cognitive load, and discusses domain-specific knowledge needed.

* [http://delivery.acm.org/10.1145/1250000/1240669/p271-hurst.pdf?key1=1240669&key2=6465483321&coll=GUIDE&dl=GUIDE&CFID=20565232&CFTOKEN=69614228 Dynamic Detection of Novice vs Skilled Use]

:Used a learning classifier, trained on low-level mouse and keyboard usage patterns, to identify novice and expert use dynamically with accuracies as high as 91%. This classifier was then used to provide differrent information and feedback to the user as appropriate.

* [http://portal.acm.org/citation.cfm?id=1054972.1055012&coll=GUIDE&dl=ACM&CFID=20565232&CFTOKEN=69614228 Bubble Cursor]

:Example of a paper which demonstrated a novel interaction technique still obeys Fitts's law.

* [http://tlaloc.sfsu.edu/~lank/research/appearing/FSS604LankE.pdf Sloppy Selection]

:Utilized a quantiative model of user performance which used curvature to predict the speed of a pen as it moved across a surface to help disambiguate target selection intent.

* [http://delivery.acm.org/10.1145/1250000/1240730/p677-iqbal.pdf?key1=1240730&key2=4525483321&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 Disruption and Recovery of Computing Tasks]

:Studied task disruption and recovery in a field study, and found that users often visited several applications as a result of an alert, such as a new email notification, and that 27% of task suspensions resulted in 2 hours or more of disruption. Users in the study said that losing context was a significant problem in switching tasks, and led in part to the length of some of these disruptions. This work hints at the importance of providing affordances to users to maintain and regain lost context during task switching.

* [http://portal.acm.org/citation.cfm?id=985692.985715&coll=Portal&dl=ACM&CFID=21136843&CFTOKEN=23841774 A diary study of task switching and interruptions]

:Showed that task complexity, task duration, length of absence, and number of interruptions all affected the users' own perceived diffuclty of switching tasks. (Andrew Bragdon)

* John M. Carroll: HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science

:A gargantuan book with chapters by many folks describing some of the models and theories from HCI that may relate back to cognition; may need to create individual (David)

* [http://portal.acm.org/citation.cfm?id=1461832&dl=&coll= Project ernestine: validating a GOMS analysis for predicting and explaining real-world task performance]

: A study in which the [http://en.wikipedia.org/wiki/GOMS#cite_note-CHI92-1 GOMS] method is used to correctly predict the performance of call center operators using a new workstation. Might be interesting because of the methodology used to decompose the task into basic cognitive and perceptual actions, and then measuring these actions to evaluate the new interface. (Eric) The CPM (Critical Path Modeling) aspect used handles the parallel nature of several human components of HCI and seems to very accurately model the low level tasks from this study. (David)

* [http://www.informaworld.com/smpp/content~content=a784766580~db=all The Growth of Cognitive Modeling in Human-Computer Interaction Since GOMS]

* [http://portal.acm.org/citation.cfm?id=169059.169426&coll=Portal&dl=GUIDE&CFID=19188713&CFTOKEN=13376420 The limits of expert performance using hierarchic marking menus]
Marking menus naturally facillitate the transition from novice to expert performance for command invocation, and have been quite influential over the years to research into menu techniques. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/302979.303053 Manual and gaze input cascaded (MAGIC) pointing]

This is a system which combines gaze input (coarse-grained) and mouse input (fine-grained) to quickly target items. This is important because it "kind of" gets around Fitt's law by using gaze input to "warp" the cursor to the general vicinity of what the user wants to work on. (Andrew Bragdon)

* [http://doi.acm.org/10.1145/985692.985727 If not now, when?: the effects of interruption at different moments within task execution] Adamczyk-2004-INN

Presents task models of user attention. (Andrew Bragdon) (Adam - owner; [http://vrl.cs.brown.edu/wiki/CS295J/Class_Members%27_Pages/Gideon Gideon] - discussant) '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:58, 28 January 2009 (UTC)


* [http://hfs.sagepub.com/cgi/reprint/44/1/62.pdf Ecological Interface Design: Progress and challenges] Vicente-2002-EID
: Discusses the implications of Ecological Interface Design (EID), a theoretical HCI framework, for designing human-computer interfaces and compares performance of EID-informed designs to other comtemporary approaches. (Owner: Jon)

* [http://doi.acm.org/10.1145/985692.985707 "Constant, constant, multi-tasking craziness": managing multiple working spheres.] Gonzalez-2004-CCM

Empirical study of how information workers spend their time. Puts forward a theory of how users organize small individual tasks into "working spheres." (Andrew Bragdon - OWNER; Adam Darlow - Discussant; Steven Ellis - Discussant)

'''250-word summary and relevance statement''' (Andrew Bragdon)

Any visualization which is used extensively by a user over a period of time will be used in the context of that user's daily workflow. It is therefore essential to understand this larger workflow context to design the visualization application appropriately to fit the needs of real world users. This paper studies in detail the daily workflow tasks and patterns of work of analysts, managers and software developers in a medium-sized software company. This paper provides strong empirical evidence that users, rather than working on discrete and well-defined tasks, in reality, switch tasks on average every two to three minutes, and instead, work on larger thematically connected units of work (working spheres). In addition, the study found that users switched between these larger working spheres on average every 12 minutes. Thus, it is strongly indicated by this paper that many information workers are in a constant state of rapid fire multi-tasking. This suggests that for a visualization to be relevant to any of these information workers, it would need to fit into, and support, this workflow. This is just a first step towards understanding how users interact with visualizations in particular, however; future work that studies how users interact with visualizations as part of their larger daily work patterns is warranted, and would be an important component of a broad theory of visualization.

* [http://www.eecs.berkeley.edu/Pubs/TechRpts/2000/CSD-00-1105.pdf The state of the art in automating usability evaluation of user interfaces] Ivory-2000-SAA
: Presents a new taxonomy for automating usability analysis. Advantages of automated evaluation are purported to be advantages linked to efficiency, such as comparing alternate designs, uncovering more errors more consistently, and predicting time/error costs across an entire design. Breaks down a taxonomy with individual benefits and drawbacks of each method, and checks observations against existing guidelines (e.g. Smith and Mosier guidelines, Motif style guidelines, etc). Introduces several visual tools. Looks extremely relevant as a comprehensive survey of existing techniques. '''OWNER''': [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC) '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC) Discussant: Steven Ellis

* [http://www.hpl.hp.com/techreports/91/HPL-91-03.pdf User Interface Evaluation in the Real World: A Comparison of Four Techniques] Jeffries-1991-UIE
: Overview of the four major UI evaluation methods: heuristic evaluation, usability testing, guidelines, and cognitive walkthrough, followed by a comparison in their application to a case study. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://ics.colorado.edu/techpubs/pdf/91-01.pdf Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces] Polson-xxxx-CWM
: Presents the concept of performing a hand walkthrough of the cognitive process, based on another theory of "learning by exploration." Strong results for a limited evaluation timeframe and little or no time for formal instruction of the interface for the user. The reviewer considers each behavior of the interface and its resultant effect on the user, attempting to identify actions that would be difficult for the "average" user. Claims that a given step will ''not'' be difficult must be supported with empirical data or theory. The application of cognitive theory early in the design process seems useful in avoiding costly redesigns when problems are identified later. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=142834&coll= Finding usability problems through heuristic evaluation] Nielsen-1992-FUP
: Emphasis on heuristic evaluation. Shockingly, usability experts are found to be better at performing this type of evaluation. Usability problems relating to elements that are completely missing from the interface are difficult to identify with this method when evaluating unimplemented designs. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://delivery.acm.org/10.1145/130000/128728/p152-jacob.pdf?key1=128728&key2=7032992321&coll=GUIDE&dl=GUIDE&CFID=19735001&CFTOKEN=82907542 The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look at is What you Get] Jacob-1991-UEM
: One of the first research papers to introduce eye tracking as a viable HCI technique. (Trevor)

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=1221372&isnumber=27434 Real-Time Eye Tracking for Human Computer Interfaces] Amarnag-2003-RTE
: Technical details about the implementation of a recent real-time eye-tracking system. (Trevor)

* [http://www.ipgems.com/present/swui_chi_20070502.pdf Semantic Web HCI: Discussing Research Implications] Degler-2007-SWH
: A workshop discussion from CHI 2007 discussing the idea of a "semantic internet" and its relevance to the HCI community. Discusses things like adaptive web interfaces, mashups, dynamic interactions, etc. (Trevor)

* [http://www.springerlink.com/content/u3q14156h6r648h8/fulltext.pdf Implicit Human Computer Interaction Through Context] Schmidtt-2000-IHC
: A highly cited paper discussing the notion of implicit HCI, including semantic grouping of interactions, and some perceptual rules. ('''Trevor - OWNER'''; Andrew Bragdon - discussant; '''DISCUSSANT''': [[User:E J Kalafarski|E J Kalafarski]] 22:57, 28 January 2009 (UTC))

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1903_1 Cognitive Strategies for the Visual Search of Hierarchical Computer Displays] Anthony J. Hornof
: This article investigates the cognitive strategies that people use to search computer displays. Several different visual layouts are examined. (lisajane)

* [http://www.informaworld.com/smpp/content~db=all?content=10.1207/s15327051hci1904_9 Unseen and Unaware: Implications of Recent Research on Failures of Visual Awareness for Human-Computer Interface Design] D. Alexander Varakin; Daniel T. Levin; Roger Fidler
: This article reviews basic and applied research documenting failures of visual awareness and the related metacognitive failure and then discuss misplaced beliefs that could accentuate both in the context of the human-computer interface. (lisajane)

* Shneiderman, Plaisant: Designing the User Interface
: My textbook for an HCI class, has many good lists of guidelines. Especially Ch.2 pp 59-102. (lisajane)

* Robert Mack, Jakob Nielsen: Usability Inspection Methods (Ch. 1 Executive Summary)
: Provides an overview of main usability inspection methods, a fair introduction to the industrial applications, as well as certain costs and benefits, of the methods as well as suggestions for expansive research. (Steven)

* [http://portal.acm.org/citation.cfm?id=22950 Jock Mackinlay, Automating the design of graphical presentations of relational information], ACM Transactions on Graphics (TOG),
5(2):110-141, 1986. (Jian)
: The first paper talked about how to automatically generate *good* graphs.

* [http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=04376133 Jock Mackinlay, Pat Hanrahan, Chris Stolte, Show Me: Automatic Presentation for Visual Analysis] IEEE TVCG 13(6): 1137-1144, Nov-Dec, 2007 (Jian)
: Extend their previous paper to analytics tasks.

* [http://www.win.tue.nl/~vanwijk/vov.pdf Jarke J. van Wjik, The value of visualization], IEEE visualization 2005. (Jian)
: discuss vis from a variety of angles as for art, science and technology and question and quantify the utility of visualization.

* [http://www.almaden.ibm.com/u/zhai/papers/steering/chi97.pdf Johnny Accot and Shumin Zhai, Beyond Fitts' law: models for trajectory-based HCI tasks], CHI 97. (Jian)
: Extend Fitts' to trajectory based tasks.

*[http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=01703371 Saraiya, P., North, C., Lam, V., and Duca, K.A, An Insight-Based Longitudinal Study of Visual Analytics], TVCG 12(6): 1511-1522, 2006.(Jian)
* the first paper that quantifies what insight is by comparing several infoVis tools for bioinformatics.

*[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1359732 David H. Laidlaw, Michael Kirby, Cullen Jackson, J. Scott Davidson, Timothy Miller, Marco DaSilva, William Warren, and Michael Tarr.Comparing 2D vector field visualization methods: A user study]. IEEE Transactions on Visualization and Computer Graphics, 11(1):59-70, 2005. (Jian)
: an application-specific comparison of visualization method. a cool paper.

* [http://web.mit.edu/rruth/www/Papers/RosenholtzEtAlCHI2005Clutter.pdf Rosenholtz, Li, Mansfield, and Jin, Feature Congestion: A Measure of Display Clutter], CHI 2005. (Jian)
: quantify visual complexity from a statistics point of view.

* [http://delivery.acm.org/10.1145/240000/236054/p320-john.pdf?key1=236054&key2=2285613321&coll=GUIDE&dl=GUIDE&CFID=19490404&CFTOKEN=25744022 The GOMS Family of User Interface Analysis Techniques: Comparison and Contrast] (Trevor)
: This paper offers an analysis of four types of GOMS (Goals, Objects, Methods and Selection) based interaction techniques. GOMS is a widely used UI paradigm, made popular by Card et al in The Psychology of Human-Computer Interaction (1983).

* [http://vis.cs.brown.edu/~trevor/Papers/Lisetti-2000-AFE.pdf Automatic Facial Expression Interpretation: Where Human-Computer Interaction, Artificial Intelligence and Cognitive Science Intersect] (Trevor)
: Using advanced computer vision/AI techniques, this work aims to discern and make use of users' emotions in UI design.

* [http://vis.cs.brown.edu/~trevor/Papers/weld-2003-APU.pdf Automatically Personalizing User Interfaces] (Trevor)
: Discusses some techniques and design decisions for constructing adaptable and customizable user interfaces. There are some useful references in the paper on using HMMs and RMMs (Relational Markov Models) for interaction prediction.

* [http://vis.cs.brown.edu/~trevor/Papers/Gajos-2006-.pdf Exploring the Design Space for Adaptive Graphical User Interfaces] (Trevor)
: This paper presents comparative evaluations of three methods for implementing adaptable user interfaces. The evaluation methodology gives rise to three key concepts that affect the performance of adaptable UIs: frequency of adaptation, accuracy of adaptation, and the impact of predictability.

* Conceptual Modeling for User Interface Development - David Benyon, Diana Bental, and Thomas Green
: Proposes a new set of terminology for describing and comparing existing and future cognitive models of HCI. (Steven)

* [http://homepage.ntlworld.com/greenery/workStuff/Papers/ERMIA-Skull.PDF The Skull beneath the Skin:
Entity-Relationship Models of Information Artefacts] T. R. G. Green, D. R. Benyon
: A paper in form of prelude to the above, gives a good overview of the ERMIA method. (Steven)

===Cognitive Modeling===

* [http://vis.cs.brown.edu/~trevor/Papers/Kaptelinin-1994-ATI.pdf Activity Theory: Implications for Human-Computer Interaction] (Trevor)
: Discusses the notion of Activity Theory as the basis for HCI research. The most interesting part of this paper for me was the introduction which expressed the need for a ''Theory of HCI''.

* [http://en.wikipedia.org/wiki/Seven_stages_of_action Norman's Seven stages of action]
: Presents Norman's seven stages of action, as well as his model of evaluation. (Steven)

* [http://vis.cs.brown.edu/~trevor/Papers/Wright-2000-AHC.pdf Analyzing Human-Computer Interaction as Distributed Cognition: The Resources Model] (Trevor)
: Creates a compelling argument for why distributed cognition research fits in with HCI, and what types of impacts it may have on the HCI community.

* [http://sonify.psych.gatech.edu/~walkerb/classes/hci/extrareading/nardi.pdf Studying Context, A Comparison of Activity Theory, Situated Action Models, and Distributed Cognition] Bonnie A. Nardi
: Defines the task of the HCI specialist as the application of psychological and anthropological principles to specific design problems. It posits an inherent feud between the accurate study of relative contexts and the necessary, but more general, development of comparative models and results. Gives a coherent overview of activity theory, situated action models, and distributed cognition; finds that activity theory presents the best overall framework. There is little reason given for this ranking, however, and the description of activity theory is the most theoretical and least developed of the three.
: Having spent quite a bit of time studying Soviet psychology (from which came activity theory) last semester, I question the validity of the paper’s claim, as its description of activity theory bears the artifacts of the oppressive regulations which the Soviet government imposed on psychologists. Although the theory may sound more practical, it seems fairly weak as a basis for empirical design analysis.
: The paper’s strongest point is the criticisms which follow descriptions, in which theoretical shortcomings of each perspective are discussed. ('''Owner:''' Steven, '''Discussant:''' --- [[User:Trevor O'Brien|Trevor O'Brien]] 23:22, 28 January 2009 (UTC))

* [http://www.billbuxton.com/chunking.html Chunking and Phrasing and the Design of Human-Computer Dialogues]

High-level theory of human-computer dialogues. (Andrew Bragdon)

* Polson, P. and Lewis, C. Theory-Based Design for Easily Learned Interfaces. Human-Computer Interaction, 5, 2 (June 1990), 191-220.

: This is a cognitive model of how users find and learn commands in an unfamiliar user interface. This could potentially be adapted to be a piece of a theory of visualization. (Andrew Bragdon)

* [http://www.syros.aegean.gr/users/tsp/conf_pub/C12/c12.pdf Activity Theory vs Cognitive Science in the Study of Human-Computer Interaction]
: Provides a brief history of Cognitive Science and HCI, then compares the effectiveness of the aforementioned theories in aiding design and development. (Owner - week 2 : Steven)

* [http://www.sciencedirect.com/science?_ob=PublicationURL&_tockey=%23TOC%236829%232001%23999449998%23287248%23FLP%23&_cdi=6829&_pubType=J&_auth=y&_acct=C000022678&_version=1&_urlVersion=0&_userid=489286&md5=64b44ef6df77ae073d41a7367db866b5 International Journal of Human-Computer Studies - Special Issue on Cognitive Modeling]
:Articles all concerning various issues of cognitive modeling as relates to HCI. (Steven)

* [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6VDC-4811TNB-5&_user=10&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=259b5c105222437fc84990b7a1eaedee The role of cognitive theory in human–computer interface]. Chalmers, Patricia A, 2003.
:Was scared again, but no need to be. Touches only on a subset of cognitive theories (Schema theory, Cognitive load, and retention theories) and undertakes a survey of some software design theories, but does not attempt an explicit mapping between the two. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://portal.acm.org/citation.cfm?id=26115.26124 Design Guidelines]. Marshall, Nelson, and Gardiner, 1987.
:Attempt to apply cognitive psychology to user-interface design. Here, the opposite problem is seen—the author's make no significant attempt to take existing heuristic guidelines into account. [[User:E J Kalafarski|E J Kalafarski]] 13:48, 20 February 2009 (UTC)

* [http://www.cognitivedesignsolutions.com/ Cognitive Design Solutions, Inc.]
:Training and consulting firm that claims to take advantage of Cognitive Design in making design and performance improvements. [[User:E J Kalafarski|E J Kalafarski]] 13:50, 20 February 2009 (UTC)

* [http://infolab.uvt.nl/research/lap2003/agerfalk.pdf Actability Principles in Theory and Practice]. Agerfalk, Par J, 2003.
:Presents a set of nine contemporary principles for the evaluation of IT systems ("social tools to perform communicative action") based explicitly on cognitive principles. Introduces a notion comparable to usability called ''actability''. Presents a mapping for some basic usability principles to some seminal sets of guidelines. [[User:E J Kalafarski|E J Kalafarski]] 14:29, 20 February 2009 (UTC)

==Design==

* Wikipedia articles on [http://en.wikipedia.org/wiki/A_Pattern_Language "A Pattern Language"] and [http://en.wikipedia.org/wiki/Design_pattern "Design Pattern"]
:see summary for Alexander below (David)

* UI Design principles (feedback, etc -- find ref)

* Alexander: A Pattern Language: Towns, Buildings, Construction
:The original design pattern source; what makes a human space work, ineffable best practices, ~250 rules is enough to do communities and house-sized artifacts; could be a good metaphor for making; could be a good metaphor for making human virtual space work? (David)

* [http://useraware.iict.ch/uploads/media/TangibleBits.pdf Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms] Ishii-1997-TBT
:A specific UI proposal, but has nice relevant discussion on how we perceive "foreground" items and "background" items and their relationship, taking advantage of this "parallel" processing of perception. Includes the use of visual metaphors, phicons, and a notion they invent called "digital shadows," in which the shadow projected by an object conveys some information on its contents. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://list.cs.brown.edu/courses/csci1900/2007/documents/restricted/beale.pdf Slanty Design] Beale-2007-SD
:Design method with emphasis on discouraging undesirable behavior, by perhaps forcing the user to adapt to the interface, giving equal weight to user goals, user "non-goals," and wider goals of stakeholders besides the immediate user. The important insight seems to be that these wider goals can enhance the user's experience with the larger system in the long run, if not in the immediate timeframe. Five major design steps. [[User:E J Kalafarski|E J Kalafarski]] 16:02, 26 January 2009 (UTC)

* [http://www.amazon.com/Designing-Interactions-Bill-Moggridge/dp/0262134748/ref=pd_bbs_sr_1?ie=UTF8&s=books&qid=1232989194&sr=8-1 Designing Interactions] by Bill Moggridge
: Really awesome book on the evolution of interactions with technology. (Trevor)

* [http://www.amazon.com/Sketching-User-Experiences-Interactive-Technologies/dp/0123740371/ref=sr_1_1?ie=UTF8&s=books&qid=1232989269&sr=1-1 Sketching User Experiences] by Bill Buxton
: Another great book on the practices of interaction design. (Trevor)

* [http://site.ebrary.com/lib/brown/docDetail.action?docID=10173678 The Laws of Simplicity] by John Maeda
: An interesting work on the efficiency of minimalist design. Quick read for those interested. (Steven)
: A set of design guidelines some of which we may be able to build on in automating interface evaluation; will certainly apply to manual evaluations [[User:David Laidlaw|David Laidlaw]]

* [http://www.cs.umd.edu/hcil/pubs/presentations/eyeshaveit/index.htm Ben Shneiderman, The Eyes Have It: User Interfaces for Information Visualization], UM, tech-report, CS-TR-3665. (Jian)
: the paper talks about visualization mantra.

* [http://hci.rwth-aachen.de/materials/publications/borchers2000a.pdf A pattern approach to interaction design] Borchers-2001-PAI
: A highly-cited work on the development of a language for defining design patterns for use in interface development, with an emphasis on communication between application developers and application domain experts. [[User:E J Kalafarski|E J Kalafarski]] 16:37, 3 February 2009 (UTC)

==Thinking, analysis, decision making==

* Morgan D. Jones: The Thinker's Toolkit: Fourteen Powerful Techniques for Problem Solving

:Set of methods for solving problems that might be incorporated into tools for thinking (David)

* Keim, Shazeer, Littman: Proverb: The Probabilistic Cruciverbalist

:An automatic crossword-puzzle solver; the software framework for building this program may be a metaphor for some thinking groupware with plug-in modules. (David)

* Thomas, Cook: Illuminating the Path

:a research agenda for tools for intelligence analysts; not sure of relevance (David)

* Richard Thaler, Cass Sunstein: Nudge - Improving Decisions About Wealth, Health, and Happiness
: A great, easy read for someone who isn't familiar with the psychological perspective. Focuses mainly on public policy issues, but certain sections (on developing a better social security website, for example) relate specifically to digital design. (Steven)

* [http://www.cs.brown.edu/people/trevor/Papers/Heer-2008-GraphicalHistories.pdf Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation] (InfoVis 2008)
: Work by Jeff Heer of Stanford (formerly Berkley) on using Graphical Interaction Histories within the Tableau InfoVis application. This is a great recent example of "workflow analysis" that we've been discussing in class. Though geared toward two-dimensional visualizations with clearly defined events, his work offers some very useful design guidelines for working with interaction histories, including evaluations from the deployment of his techniques within Tableau. (Trevor)

* [http://www.cs.brown.edu/research/vis/docs/pdf/bib/Gotz-2008-CUV.pdf: Characterizing Users' Visual Analytic Activity for Insight Provenance]
: Some work on combining user triggered and automatic vis histories generation.

==Visualization==

* Min Chen, David Ebert, Hans Hagen, Robert S. Laramee, Robert van Liere, Kwan-Liu Ma, William Ribarsky, Gerik Scheuermann, Deborah Silver, "Data, Information, and Knowledge in Visualization," IEEE Computer Graphics and Applications, vol. 29, no. 1, pp. 12-19, Jan./Feb. 2009, doi:10.1109/MCG.2009.6

Plans and Goals

2009-01-30T20:49:04Z

Radu Jianu: /* Radu */

Plans and Goals

2009-01-30T20:48:36Z

Radu Jianu: /* Radu */

Plans and Goals

2009-01-21T03:30:50Z

Radu Jianu: /* Radu */

Plans and Goals

2009-01-21T03:29:18Z

Radu Jianu: /* Radu */

Plans and Goals

2009-01-21T03:26:35Z

Radu Jianu: /* Radu */

Plans and Goals

2009-01-21T03:24:29Z

Radu Jianu: /* Radu */

Plans and Goals

2009-01-21T03:23:41Z

Radu Jianu: /* Radu */

Plans and Goals

2009-01-21T03:21:39Z

Radu Jianu: /* Radu */

Plans and Goals

2009-01-21T03:19:03Z

Radu Jianu: /* Radu */