Measuring Organizational Effectiveness in Research and Development Organizations

Program/Project Management Resource List #67

Revised Sept. 2010

Provided by the NASA Headquarters Library

Organizations exist in order to bring together the efforts of many people towards a common goal, whether it is shoemaking, preparing and delivering meals for the shut-in population of a town, or exploring the depths of outer space. It is relatively easy to measure the effectiveness of some organizations (for instance, the number of meals delivered per donated dollar and number of meals delivered versus the number of shut-ins), but not for others. For instance, can one really compare the performance of Fermilab to that of Bell Labs or Wallops Flight Facility in a meaningful way, even though they are all at the top of their respective research fields? This webpage is a list of resources that will help the reader to discover methods of rating the organizational effectiveness and performance of research and development organizations. For additional information on this topic, you may want to visit our webpages on The Benchmarking Process, Corporate Culture, Managing Scientists and Engineers, Quality Management, or The Government Performance and Results Act. If you would like to know how an R & D organization can justify its expenditures by pointing to the dollars and cents it pours into our national economy, please visit our webpage on Measuring Return on Investment for Government Programs and Agencies. If you would like to know how to measure the performance of an individual project, as opposed to an entire organization, please visit our webpages on Earned Value Management or Project Risk Management.

All items are available at the Headquarters Library, except as noted. NASA Headquarters employees and contractors: Call x0168 or email Library@hq.nasa.gov for information on borrowing or in-library use of any of these items. Members of the public: Contact your local library for the availability of these items. NASA Headquarters employees can request additional materials or research on this topic. The Library welcomes your comments or suggestions about this webpage.


Contents: Books E-books Articles and Reports Internet Resources

Books

Chiesa, Vittorio. R & D Strategy and Organisation: Managing Technical Change in Dynamic Contexts. River Edge, NJ: Imperial College Press, 2001.
HD45 .C475 2001 BOOKSTACKS
 
Coryn, Chris L.S., and Michael Scriven (eds.). Reforming the Evaluation of Research. Vancouver, B.C.: Jossey-Bass and American Evaluation Association, 2008.
Q180.55 .E9 R44 2008 BOOKSTACKS
 
Geisler, Eliezer. The Metrics of Science and Technology. Westport, CT: Quorum Books, 2000.
Q175.5 .G43 2000 BOOKSTACKS
 
Gelès, Claude, et al. Managing Science: Management for R & D Laboratories. New York, NY: Wiley, 2000.
Q180.57 .M358 2000 PPM-STACKS
 
Niven, Paul R. Balanced Scorecard Step-by-step for Government and Nonprofit Agencies. Hoboken, NJ: Wiley, 2003.
JF1525 .T67 N58 2003 BOOKSTACKS
Note: SATERN has a subsequent edition.
 
United States. Government Accountability Office. Federal Research Opportunities Exist to Improve the Management and Oversight of Federally Funded Research and Development Centers. Washington, DC: U.S. Govt. Accountability Office, 2008.
Q180 .U5 G684 2008 BOOKSTACKS

E-books

All e-books listed here are available to NASA civil servants and contractors through the Books 24x7 service of SATERN.
 
Carton, Robert B. and Charles W. Hofer. Measuring Organizational Performance: Metrics for Entrepreneurship and Strategic Management Research. Edward Elgar Publishing: 2006.
 
Nath, Pradosh, and N. Mrinalini. Organization of R & D: An Evaluation of Best Practices. Palgrave MacMillan: 2002.
 
Spitzer, Dean R. Transforming Performance Measurement: Rethinking the Way We Measure and Drive Organizational Success. AMACOM: 2007.
 
The e-book listed below is available to the general public through the National Academies Press.
 
Committee on Evaluating the Efficiency of Research and Development Programs at the U.S. Environmental Protection Agency. Evaluating Research Efficiency in the U.S. Environmental Protection Agency, 2008.

Articles and Reports

Basili, Victor R., and Marvin V. Zelowitz. The Use of Empirical Studies in the Development of High End Computing Applications. Defense Advanced Research Projects Agency, Arlington, VA, Dec. 2009.
(ADA511351: (Jan. 13, 2010) DTIC)
 
Finger, G. Wayne. "Spaceport Performance Measures", in: AIAA SpaceOps 2010, Huntsville, AL, April 25-30, 2010.
(20100039456: (April 25, 2010) NTRS)
 
Gilruth, Peter T., et al. "Measuring performance: Moving NASA Earth science products into the mainstream user community", Space Politics, vol. XXII, no. 3 (Aug. 2006), p. 165-175.
 
Gover, J., and P.G. Huray. Federal Laboratories for the 21st Century. Sandia National Laboratories, Albuquerque, NM, April 1998.
(654011: (Feb. 18, 2010) Dept. of Energy Information Bridge)
 
Jordan, Gretchen B., et. al. Description of the Sandia National Laboratories Science, Technology & Engineering Metrics Process. Sandia National Laboratories, Albuquerque, NM, April 1, 2010.
(984166: (Aug. 5, 2010) Dept. of Energy Information Bridge)
 
Osama, Athar. Multi-Attribute Strategy and Performance Architectures in R & D: The Case of The Balanced Scorecard. Rand Corporation, Santa Monica, CA, March 1, 2006.
(ADA488439: (Nov. 12, 2008) DTIC)
 
Papdakis, Maria, and Albert N. Link (eds.). "Symposium on Performance Measurement for Public R & D Programs", Journal of Technology Transfer, vol. XXII, no. 2 (Summer 1997), p. 3-58.
Note: Also available through DTIC as document no. ADA328314.
 
Slavin, Adam M. Managing Corporate Capabilities: Theory and Industry Approaches. Sandia National Laboratories, Albuquerque, NM, Feb. 1, 2007.
(902210: (Feb. 5, 2008) Dept. of Energy Information Bridge)
 
Sterk, Steve, and Stephan Chesley. "Civil Service Workforce Market Supply and the Effect on Cost Estimating Relationship (CERS) That May Affect the Productivity Factors for Future NASA Missions", in: ISPA/SCEA 2008 Joint International Conference, Noordwijk, Netherlands, May 12-14, 2008.
(20080042977: (Nov. 11, 2008) NTRS)
 
Thompson, B.D. "Assessing Quality Management in an R & D Environment", in: Tenth Annual Quality Management Division Conference, San Diego, CA, Feb. 25-27, 1998.
(658161: (Feb. 5, 2008) Dept. of Energy Information Bridge)

Internet Resources

Convy, James. Office of Program Analysis and Evaluation. Dec. 7, 2009 [Sept. 28, 2010]
http://www.nasa.gov/offices/pae/home/index.html
 
Industrial Research Institute. 2010 [Sept. 28, 2010]
http://www.iriinc.org/
 
International Association for Management of Technology. Sept. 26, 2010 [Sept. 28, 2010]
http://www.iamot.org/
  Sept. 2010