NASA's Usability Web Site
Follow this link to skip to the main content
+ Contact NASA
Usability and User Centered Design Overview User Centered Design Processes Usability Guidelines Usability Resources and Tools Lessons Learned

+ Home
Lessons Learned

"Business success is always defined by the quality of the overall customer experience before, during and after a transaction."

- Forrester Research

Lessons Learned

NASA Portal Usability

Prior to the launch of the new NASA.gov portal in February 2003, both the existing web site and new portal design went through extensive usability testing.

The focus of the testing was to compare common features and explore the key components of both web sites.

Steps Taken for Usability Testing

The audience demographics were outlined and test participants were selected that matched the target audience profile.

Test tasks were written as a guide so all test participants completed common activities throughout the various sections of the web site. Based on their audience definition, some users were additionally asked to explore specific areas of the web site (i.e. students were asked to visit the student-related section). Additionally, test participants were asked for the general impression of the web site designs, to explain what they thought the individual interface elements represented and to voice their likes and dislikes of each design.

The "think aloud" testing protocol was used which encouraged test participants to vocalize their thought process to the test facilitator as they solved the test tasks and moved through the web sites. Test facilitators probed the participants to explain decisions or express their thoughts when necessary.

Each test participant was given a post-test questionnaire where they were asked a series of questions and to provide scale-based answers.

Test results were recorded and analyzed. Problem areas were noted, findings were rated by severity and recommendations were made by the web design and usability teams in a full usability report. The solutions were worked back into the new web site design.

On-going usability analysis of the live web site and any proposed changes ensure the NASA.gov web site maintains a positive user experience.

Assets from the NASA.gov usability tests:

  • Summary Usability Test Report - PPT (by Critical Mass and Usability Sciences)
    Overview of usability test objectives, audience demographics, testing process, findings and recommendations.
  • Full Usability Test Report - doc (by Critical Mass and Usability Sciences)
    Full usability report including methodology, testing documents, data analysis, screen shots, findings rated by severity and recommendations.

Usability Test Clips: Excerpts from live usability testing
(For privacy reasons, access to view these videos is restricted to NASA employees only.)
Test Participant windows media Windows Media real mediaReal Media
General Public (transcript) Clip 1 (476 KB) Clip 1 (1741 KB) Clip 1 (1832 KB)
General Public (transcript) Clip 2 (522 KB) Clip 2 (1913 KB) Clip 2 (2006 KB)
Educator (Pre-school) (transcript) Clip 3 (338 KB) Clip 3 (1236 KB) Clip 3 (1329 KB)
Educator (Pre-school) (transcript) Clip 4 (234 KB) Clip 4 (830 KB) Clip 4 (935 KB)



FirstGov - Your First Click to the US Government
+ NASA Portal Project Information
+ Official NASA Public Portal Affinity Kit
+ NASA Privacy Statement, Disclaimer,
and Accessibility Certification

NASA - National Aeronautics and Space Administration
NASA Official: Colin Enger

+ Version Information