This research seeks to understand the user perspective in evaluating web question answering technology. Previous research concentrated in the design and development of question answering systems but left out the user's perspective. Web question answering technology is important because it represents a way to search for information on the web and it is argued that it can improve task performance. This research proposes to study the relationship between the use of search technology and task performance. A research model is presented and a set of experiments are designed to test the hypotheses.