spring 2010
CS376: Research Topics in Human-Computer Interaction
Project Overview
In this course, you will complete a quarter-long research project. This project will be completed in groups of two.
At a high level, successful projects will raise an important research question, and plan and execute a methodology for answering that question. Often, this methodology will include building and evaluating a prototype system, but hacking is not strictly necessary. All projects require a study — obviously a much more thorough study will be expected of projects that do not involve system building. The goal of the project abstract draft (described below) is to help you scope your work appropriately.
To get a sense of what a good scope for a project is, here are some examples of final papers from the last few years:
- Harvesting Helpfulness: A Case Study of an Online Farmers' Forum, Neil Patel, Greg Schwartz, Steve Marmon
- Ideas2Ideas: Encouraging constructive ideation in an on-line, mass-participation brainstorming system, Michel Krieger, Yan Yan Wang
- Rehearse: Coding Interactively while Prototyping, William Choi, Joel Brandt
- Testing Physical Computing Prototypes Through Time-Shifted & Simulated Input Traces, Timothy Cardenas, Marcello Bastea-Forte, Antonio Ricciardi
- Interaction Methods for Large-Group Coordination in Single-Display Groupware, Neema Moraveji, Michael Smith, Marcia Lee
- VACA: A Tool for Qualitative Video Analysis, Brandon Burr
- Castaway: A context-aware task management system, Angela Kessell and Chris Chan
- Wizard of Oz for Participatory Design: Inventing an Interface for 3D Selection of Neural Pathway Estimates, David Akers
- Bridging the Gap: Fluidly Connecting Paper Notecards with Digital Representations for Story/Task-Based Planning, Tom Hurlbutt
- Dynamic Speedometer: Dashboard Redesign to Discourage Drivers from Speeding, Manu Kumar and Taemie Kim
- Encouraging Contribution to Shared Sketches in Brainstorming Meetings, Marcello Bastéa-Forte and Corina Yen
- txt 4 l8r: Lowering the Burden for Diary Studies Under Mobile Conditions, Joel Brandt and Noah Weiss
For information on how the project will be evaluated, see the grading page.
Forming Groups
This project will be completed in groups of two (email cs376@cs if you'd like a larger group). Project groups will be self-paired.
By 7:00 am on Friday, April 9, use the online submission system to submit the name(s) of who you will be working with. (All group members should complete a submission.)
To assist in finding a group, a message board will be available on the course submission site to post your ideas and communicate with others. This will be available after the second day of class (April 2). Also, take a look at the opportunities for collaboration with individuals outside of the class.
Project Ideas
While you are encouraged to come up with your own project ideas, we have a list opportunities for collaboration with individuals outside of the class.
Project Abstract (Draft and Final Versions)
A draft of your project abstract is due at 7am on Friday, April 16. Course staff will provide feedback on the draft to assist in the preparation of a final version, due at 7am on Friday, April 30. Both are submitted online.
The project abstract should cover the following topics:
- Research Question: what are you trying to answer? State this as clearly as possible in one sentence.
- Hypothesis: what do you think the answer to your question is, and why?
- Method: how will you explore your hypothesis, and why is that the right approach? (This should include the design of your study.) Grounding this in methodologies that other researchers have used (e.g. by drawing from the class readings) is a good idea.
- There are three major points you should hit here.
- Study design: What are you going to do? Be very detailed and precise.
- Evaluation: How will you know you succeeded? What will you measure? How will you measure it?
- Ecological Validity: Why does your study answer your research question? Why does your evaluation address your hypothesis? Make sure your study, and the variables you're measuring, properly address the question you are asking.
- Study Recruitment Plan: how will you get participants for your study? For pilot studies, we suggest you recruit from within the class -- "trading" participation with other groups is a great way to learn about what others are doing. For larger studies (e.g. for those not building a system), you need a clear recruitment plan.
- Related Work: what have others done that is similar? (You need not have related work in the draft version.)
- Biggest Risk: what's the riskiest component of your project? (may not be able to get the hardware you need, robustly implementing the ___ algorithm may take too long, the difference between conditions may not be measurable, ...)
For the draft, we expect you to cover all topics in 1-2 paragraphs--be concise but concrete in your descriptions. For the final version, you'll want to go into greater depth (approximately 2 paragraphs for each issue, with the exception of the research question, which should still be be one precise sentence).
We encourage you to iterate multiple times on this abstract. While there is only one formally defined point for receiving feedback from course staff, you should seek out more informal feedback as you work on this. E-mail us at any point if you'd like us to take a look at your current submission, or come to office hours if you'd like to discuss in person. You are free to change directions after submitting your draft, but the sooner you nail down a direction, the better your project is likely to be.
Progress Meeting
On May 21, course staff will meet individually with each project group to provide feedback on your progress. (We'll schedule this a week or so beforehand.) You should be prepared to present your working system, discuss your study plan, and have pilot results. Use the online submission system to submit any materials you'd like to discuss (e.g., prototypes, data, draft writing.) Come to the meeting prepared to show and tell. What will the title of your final paper be? In other words, how will you summarize your research contribution in just a few words? This exercise will helps you focus and sharpen your efforts on what will best address your research question. This focus will be especially important as time gets tight: some things will matter more than others.
Final Presentation
At the end of the quarter, you will present your research results to the class and outside guests. We have invited a couple HCI luminaries. Feel free to invite interested friends and colleagues!
- Presentations will be on Friday, June 4th, 12:45pm-3:15pm.
- Each group has 8 minutes: 5 for the presentation and 3 for questions. This time limit will be strictly enforced – groups should set up during the question session of the group before them. To enable this, unplug the video cable from your laptop before answering questions.
- Test (and debug) your laptop video projection before presentations begin. Time spent fiddling with display settings will count against your presentation time.
- Structure your presentation like a pyramid — begin with a one-sentence statement of your research result. This will get everyone on the same page. Then, offer a short (e.g., 1 slide, 4 sentences) description of what you did and why you did it. Then, explain things in detail.
- This presentation is short enough that you can write out everything you want to say long-hand. Do this! This will allow you to convey information efficiently and effectively. Read through it enough times so that you have it basically memorized, but not so memorized that you get flustered if you skip a word or someone asks a question.
- Know your audience! You can expect that everyone in the class knows everything you learned in class. So, you don't need to re-introduce the whole field of HCI. A sentence or two to situate your work in the field is good, but spend the rest of the time telling us what you did.
- When presenting, stand near your slides. And look at the audience.
Final Paper
In addition to the presentation, you will present your findings in a final paper. Final papers should be 2-4 pages long in the UIST format. While this may sound short, it is much harder to write an effective, complete short paper than it is to ramble.A good approach to writing a great short paper is to write a long one first, and then trim it down to the most vital parts. Much of the advice from above for preparing your presentation applies to the paper as well. Here are a few more suggestions for preparing your paper:
- Find a paper that you particularly like because of how it's written, and use it as a template. This paper needn't be on the same topic, but a close mapping in terms of type of contribution (e.g. a tool paper vs. a theory paper) will give you more guidance as to how to structure your paper.
- The title and abstract are the most important parts of a paper, and should clearly convey what you did. Motivate your specific problem (not the field as a whole), and focus on what you did. After reading the abstract, the reader should know what your contribution is – don't speak in generalities. For example, instead of saying "We analyze different methods for preparing cookies with interesting ingredients by running a user study.", say "We present three new recipes for chocolate chip cookies each employing a unique ingredient: jellybeans, tofu, and corn nibblets. Cookies were compared using a blind, within-subjects taste test with 30 individuals. The cookie with tofu was found to have superior mouth feel when compared with the other two, but subjects preferred the taste of the corn cookie by a 2:1 margin."
- Review the Project Abstract assignment. Make sure you clearly address each of the important bullets from the abstract in your final paper.
- Please use the APA heading structure to describe your study & results. Clearly tie your analysis to your hypotheses.
- Use pictures to show your interface and graphs to present your data. Graphs should generally aggregate across participants, and show variance. (Only show individual data points if the reader learns something more by doing so.)
- If you have instructions, present them to participants in written form. You'll have a lot on your mind. Likely too much to remember to say everything you want. Written instructions also help insure that everything is consistent across participants.
Groups who do excellent projects will be encouraged to submit their research to UIST 2010's poster session. These submissions are due June 30.