Survey of Organizational Performance and Management Issues, including Work during the COVID-19 Pandemic

United States Government Accountability Office

Introduction

  The U.S. Government Accountability Office (GAO) is an independent, nonpartisan agency that examines how taxpayer dollars are spent, and provides Congress and federal agencies with objective, reliable information to help the government work more efficiently.

GAO is surveying federal managers about several organizational performance and management issues. Your responses are critical to help us better understand the experiences of managers like you, and ensure our work analyzing these issues provides an accurate picture of those experiences across the federal government.

This questionnaire covers a few distinct topics.

• First, during the past three decades, GAO has periodically surveyed managers about the availability and use of different types of data and information—such as performance information, program evaluations, and spending data—to help manage programs and operations within their agencies.

Your responses on these questions will help us better understand how federal managers like you collect, analyze, and use these sources of data and information.

• Second, we recognize that the ongoing Coronavirus Disease 2019 (COVID-19) pandemic has had a significant effect on our society and economy. We also recognize that for many federal employees, it has significantly changed your working environment. This survey includes questions asking about your perceptions of, and experience with, your agency’s actions to maintain continuity of operations, which could include the expanded use of telework and alternative work schedules, among other things.

Your responses to these questions will help us to better understand how agencies are responding to the pandemic, and what, if any, effects this has had on federal managers.

We ask that you please complete this survey within three weeks of receipt. The survey should take about 90 minutes to complete. All of the questions can be answered by checking boxes or filling in blanks. It is possible to save your progress and return, as needed, to complete the survey. The survey will not be considered complete unless you respond to the final question.

GAO will take steps to ensure the confidentiality of your responses. When we report results, we will not include any information that could be used to identify individuals. Instead, we plan to report aggregated survey responses at the government-wide and agency levels, or specific examples without identifiable information. We will not release individually identifiable data outside of GAO, unless compelled by law or requested by the Congress.

We appreciate and thank you for the time you provide to respond to this survey, especially while you are likely dealing with challenges in both your personal and professional life due to the pandemic. Once again, your responses will help GAO and Congress better understand the experiences of federal managers across the government, and provide a more complete and accurate picture of important federal performance and management issues.



 

Section 1. Background

1.  What is your current grade level? (Select one.)

1.
2.
3.
4.
5.
 
  If you answered "Other" above, please specify your grade level.
 

Section 2. Performance Measures and Information

 

This section asks questions about performance measures and information.

For the purpose of this survey, performance measures collect data (i.e., performance information) to track progress towards achieving agency goals or objectives. These measures may also be used to assess the overall performance of a program/operation/ project.

The measures can be quantitative or qualitative, and can focus on different aspects of performance such as customer satisfaction, efficiency, or quality.

 

Subsection 2a. Your Experience as a Manager

 

This first sub-section asks questions about your current role as a manager and the program(s) in which you are involved. When we say “program” we mean any program(s), operation(s), or project(s) for which you have management responsibilities.

 
2.  Are there performance measures for the program(s) that you are involved with? (Select one.)

1.
2. (Click here to skip to question 6)
3. (Click here to skip to question 6)
 

3.  To what extent, if at all, do you agree with the following statements regarding performance measures for the program(s) that you are involved with? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
3a.  Program staff and I take steps to align program performance measures with agency-wide goals and objectives
3b.  There are meaningful performance measures for my program(s)
3c.  Program staff and I have a shared understanding of the definitions used to measure performance
 

4.  To what extent does your program(s) have the following types of measures? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
4a.  We have performance measures that tell us the amount of resources being used to develop, maintain or deliver the products or services we provide (Input measures)
4b.  We have performance measures that tell us how many things we produce or services we provide (Output measures)
4c.  We have performance measures that tell us about the quality of the products or services we provide (Quality measures)
4d.  We have performance measures that tell us if we are operating efficiently (Process measures)
4e.  We have performance measures that tell us whether or not we are satisfying our customers (Customer service measures)
4f.  We have performance measures that tell us how the products or services we provide are distributed across different populations (Equity measures)
4g.  We have performance measures that would demonstrate whether or not we are achieving our intended results (Outcome measures)
 

5.  Which of the following describe your program’s development, if any, of new measures to assess the performance or results of activities undertaken as a result of the COVID-19 pandemic? (Select one answer in each row.)

   
1. Yes
2. No
5a.  We will use existing measures to assess some of these activities
5b.  We have developed new measures for some of these activities
5c.  We are developing, or planning to develop, new measures for some of these activities
5d.  We are not developing any new measures for these activities
5e.  My program does not have any COVID-19-related activities to assess
 

6.  For those program(s) that you are involved with, to what extent, if at all, do you use the information obtained from performance measurement when participating in the following activities? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
6a.  Setting program priorities
6b.  Setting new or revising existing performance goals
6c.  Refining program performance measures
6d.  Developing program strategy
6e.  Allocating resources
6f.  Identifying program problems to be addressed
6g.  Taking corrective action to solve program problems
 
   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
6h.  Identifying opportunities to reduce, eliminate, or better manage duplicative activities
6i.  Coordinating program efforts with other internal or external organizations
6j.  Identifying and sharing effective program approaches with others
6k.  Adopting new program approaches or changing work processes
6l.  Informing the public about how programs are performing
6m.  Setting individual job expectations for the government employees I manage or supervise
6n.  Rewarding government employees I manage or supervise
 

7.  To what extent, if at all, do you agree with the following statements about the performance information for the program(s) that you are involved with? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
7a.  I have access to the performance information I need to manage my program(s)
7b.  The performance information is available in time to be useful
7c.  The performance information is of sufficient quality (valid, credible, accurate, and complete)
7d.  The performance information is in an easy-to-use format
 

8.  For the program(s) that you are involved with, to what extent, if at all, do you agree with the following statements? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
8a.  I have access to the analytical tools needed to collect, analyze, and use performance information
8b.  Staff involved in the program(s) collectively have the knowledge and skills needed to collect, analyze, and use performance information
8c.  I communicate performance information about my program(s) on a routine basis to internal and external stakeholders
8d.  The individual I report to periodically reviews with me the results or outcomes of the program(s)
8e.  Changes by management above my level to the program(s) are based on results- or outcome-oriented performance information
8f.  Existing processes and systems allow my program(s) to collect the performance information needed to assess the results of COVID-19 pandemic-related activities
 

9.  Based on your experience, to what extent, if at all, do you agree with the following statements? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
9a.  The individual I report to pays attention to my agency’s use of performance information in management decision making
9b.  Compared to 3 years ago, the individual I report to pays more attention to my agency’s use of performance information in management decision making
9c.  Employees that report to me pay attention to my agency’s use of performance information in management decision making
9d.  Compared to 3 years ago, employees that report to me pay more attention to my agency’s use of performance information in management decision making
 

10.  During the past 3 years, has your agency provided, arranged, or paid for training that would help you to accomplish the following tasks? (Select one answer in each row.)

   
1. Yes
2. No
10a.  Conduct strategic planning
10b.  Set program performance goals
10c.  Develop program performance measures
10d.  Assess the quality of performance data
10e.  Use program performance information to make decisions
10f.  Link the performance of program(s)/operation(s)/project(s) to the achievement of agency strategic goals
 

Subsection 2b. Other Managers at Your Level

 

This sub-section asks additional questions about performance measures and information. Please provide your opinion as it relates to other managers at your level in your agency.

 
11.  To what extent, if at all, do you agree with the following statements as they relate to other managers at your level in your agency? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
11a.  Managers take steps to align program performance measures with agency-wide goals and objectives
11b.  Managers are held accountable for the results of the program(s) they are responsible for
11c.  Managers are held accountable for agency accomplishment of its strategic goals
11d.  Managers have the decision making authority they need to help the agency accomplish its strategic goals
11e.  Managers can easily access my agency’s performance information
11f.  Managers have analytical tools to collect, analyze, and use performance information
11g.  Managers take steps to ensure that performance information is useful and/or appropriate
11h.  Managers use performance information to recognize employees for their performance
11i.  Managers effectively communicate performance information on a routine basis
11j.  Managers use performance information to share effective program approaches with others
 

Subsection 2c. Your Agency and Top Leadership

 

This sub-section asks additional questions about performance measures and information. Please provide your opinion as it relates to your agency and your agency’s top leadership.

 
12.  To what extent, if at all, do you agree with the following statements as they relate to performance information at your agency? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
12a.  My agency’s performance information is easily accessible to employees, as appropriate
12b.  My agency’s performance information is easily accessible to the public, as appropriate
12c.  My agency’s performance information is available in time to be useful for employees
12d.  My agency’s performance information is of sufficient quality (valid, credible, accurate, and complete)
12e.  My agency’s performance information is in an easy-to-use format
 

13.  To what extent, if at all, do you agree with the following statements as they relate to your agency? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
13a.  My agency takes steps to align program performance measures throughout the organization with agency-wide goals and objectives
13b.  Employees in my agency receive positive recognition for helping the agency accomplish its strategic goals
13c.  My agency is investing the resources needed to ensure that its performance information is of sufficient quality
13d.  My agency has staff with the knowledge and skills needed to collect, analyze, and use performance information
13e.  My agency is investing in resources to improve the agency's capacity to use performance information
 

14.  To what extent, if at all, do you agree with the following statements as they relate to your agency’s top leadership? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
14a.  My agency's top leadership demonstrates a strong commitment to achieving results
14b.  My agency's top leadership demonstrates a strong commitment to using performance information to guide decision making
14c.  My agency’s top leadership communicates performance information throughout the organization on a routine basis
14d.  My agency’s top leadership pays attention to the use of performance information in management decision making throughout my agency
14e.  Compared to three years ago, my agency’s top leadership pays more attention to the use of performance information in management decision making throughout my agency
 

Subsection 2d. Quarterly Performance Reviews

 

Please Note:

Quarterly performance reviews, which some agencies refer to as “stat” meetings or data-driven performance reviews, are regular meetings held at the highest levels of your agency.
These reviews examine progress toward accomplishing agency priority goals, and in some cases, other agency performance goals.

Among other things, these reviews are typically used to assess agencies’ coordination efforts, activities and contributions to goals, and strategies for improvement, when applicable. Quarterly performance reviews are to involve key leadership and other relevant parties.

These reviews may be conducted more frequently than quarterly.

In the following questions, “quarterly performance reviews” refers to all aspects of these reviews, including preparation, review, and follow-up.

 
 

In the following question, “agency” refers only to your cabinet-level department (e.g., Department of Transportation) or independent agency (e.g., Environmental Protection Agency).

Please do not consider activities at the major component level (e.g., Federal Aviation Administration, Army, Internal Revenue Service).

As with prior questions, “program” means any program(s), operation(s), or project(s) for which you have management responsibilities.

 
15.  How familiar are you with your agency’s quarterly performance reviews? (Select one.)

1.
2.
3. (Click here to skip to Section 3. Program Evaluations)
 

16.  To what extent, if at all, do you agree with the following statements as they relate to your agency’s quarterly performance reviews? (Select one answer in each row.)

 
  Information for Reviews
   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
16a.  My agency has the performance information needed for these reviews
16b.  My agency has the capacity to analyze the performance information needed for these reviews
16c.  Performance information for these reviews is communicated to relevant parties in an easy-to-understand, useful format
 
  Review Participants
   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
16d.  Agency leadership actively participates in these reviews
16e.  These reviews include staff with relevant knowledge needed to facilitate problem solving and identify improvement opportunities
16f.  These reviews include officials external to the agency who contribute to the goals discussed at the reviews
16g.  The program(s) that I am involved with has been the subject of these reviews
 
  Review Purpose and Follow-Up
   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
16h.  These reviews are held on a regular, routine basis
16i.  These reviews focus on goals and objectives that are aligned with my agency’s strategic and performance plans
16j.  Agency leadership uses these reviews to help achieve agency performance goals
16k.  Agency leadership is using these reviews to assess the results of our COVID-19 pandemic-related activities
16l.  My agency uses these reviews to identify problems or opportunities associated with agency performance goals
16m.  My agency has a process in place for following up on problems or opportunities identified through these reviews
 
  Other Agency Reviews
   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
16n.  These reviews have led to similar meetings at lower levels
 

Section 3. Program Evaluations

 

Program evaluations are individual, systematic studies using research methods to assess how well a program, operation or project is achieving its objectives and the reasons why it may, or may not, be performing as expected. Program evaluations answer specific questions, typically associated with a single product or report, such as how well a program is operating, whether a program is reaching targeted recipients, why a program is not achieving its desired outcomes, or whether one approach is more effective than another.

Program evaluation as defined here does not include information gathered for more regular management use, such as routine program monitoring, performance information, or quarterly performance reviews. It also does not include an audit or review performed by GAO or your agency’s inspector general.

Please note: When we say “program” here we mean any program(s), operation(s), or project(s) for which you have management responsibilities.

 
17.  To what extent do you agree with the following statements about program evaluations of your program(s)?
 
17a.  I am familiar with program evaluation(s) at my agency.

1.
2.
3.
4.
5. (Click here to skip to question 23)
6. (Click here to skip to question 23)
 
17b.  I have access to program evaluation(s) I need to manage my program(s).

1.
2.
3.
4.
5.
6.
 

18.  Within your program(s), have you served in any of the following roles in program evaluation(s)? (Select one answer in each row.)

   
1. Yes
2. No
18a.  Leader or member of an agency team that identified or prioritized research questions for potential evaluation(s)
18b.  Evaluator who has managed third parties responsible for conducting evaluation(s)
18c.  Member of the program staff that provided program information or context to evaluators
18d.  Evaluator or member of a team that conducted evaluation(s)
18e.  Manager who has used the results of the evaluation(s) to make performance improvement decisions
 

19.  To what extent does your program(s) use results from evaluations for the following purposes? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
19a.  Implementing changes to improve program performance
19b.  Adopting new program approaches, operations, or processes
19c.  Sharing effective program approaches or lessons learned
19d.  Allocating resources within the program
19e.  Explaining or providing context for performance results
19f.  Informing the public about the program’s performance, as appropriate
 

20.  To what extent do you agree with the following statements about evaluations of your program(s)? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
20a.  Evaluations addressed issues important to key stakeholders
20b.  Evaluations were completed without undue influence
20c.  Evaluations were technically rigorous (i.e., they produced accurate, valid, and high quality evidence)
20d.  Evaluation results had clear implications for program improvement
20e.  Evaluation results were delivered in time to be useful
20f.  Evaluation recommendations were feasible to implement with existing resources
 

21.  To what extent do you agree with the following statements about staff collectively in your program(s)? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
21a.  Program staff have the skills necessary to conduct program evaluations
21b.  Program staff have the skills necessary to understand program evaluation methods, results, and limitations
21c.  Program staff have the skills necessary to implement evaluation recommendations
21d.  Program staff receive training in program evaluation (e.g., formal classroom training, conferences, on the job training)
21e.  Program staff have access to evaluation experts to support evaluation-related tasks (e.g., through other agency programs, external organizations)
 

22.  To what extent do you agree with the following statements about evaluations of your program(s)? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
22a.  Agency top leadership was committed to using evaluations
22b.  Congress supported the use of evaluations
22c.  Evaluations of my program were guided by an agency evaluation plan
22d.  Evaluations were guided by agency evaluation policies
22e.  Evaluations involved consultation with key staff in my program
22f.  Evaluations involved consultation with key external stakeholders
22g.  Disagreements among stakeholders were easy to resolve
22h.  Evaluation results were made easily accessible and available to the public, as appropriate
22i.  My program systematically tracked the implementation of evaluation recommendations
 

23.  Please answer the following question.
 
  If an evaluation of your program contained recommendations for program improvements, how likely would you be to take the following actions? (Select one answer in each row.)

   
1. Extremely likely
2. Very likely
3. Somewhat likely
4. Not at all likely
  23a. Support implementation of recommended changes
  23b. Seek additional resources for implementation of recommendations
  23c. Support making the evaluation results public (for example, on your agency or program website), as appropriate
  23d. Invite one or more members of the evaluation team to share the results with your agency’s top leadership
  23e. Invite one or more members of the evaluation team to share the results with program staff
 
  If an evaluation of your program based on questions identified by program staff contained recommendations for program improvements, how likely would you be to take the following actions? (Select one answer in each row.)

   
1. Extremely likely
2. Very likely
3. Somewhat likely
4. Not at all likely
  23a. Support implementation of recommended changes
  23b. Seek additional resources for implementation of recommendations
  23c. Support making the evaluation results public (for example, on your agency or program website), as appropriate
  23d. Invite one or more members of the evaluation team to share the results with your agency’s top leadership
  23e. Invite one or more members of the evaluation team to share the results with program staff
 
  If an evaluation of your program based on questions identified by your agency’s top leadership contained recommendations for program improvements, how likely would you be to take the following actions? (Select one answer in each row.)

   
1. Extremely likely
2. Very likely
3. Somewhat likely
4. Not at all likely
  23a. Support implementation of recommended changes
  23b. Seek additional resources for implementation of recommendations
  23c. Support making the evaluation results public (for example, on your agency or program website), as appropriate
  23d. Invite one or more members of the evaluation team to share the results with your agency’s top leadership
  23e. Invite one or more members of the evaluation team to share the results with program staff
 

Section 4. Additional Types of Information

 

Please Note:

This section focuses on additional types of information—beyond performance information and program evaluation covered in previous sections—that may be useful for the program(s) that you are involved with. As with prior questions, when we say “program” we mean any program(s), operation(s), or project(s) for which you have management responsibilities.

Among other things, these additional types of information can include the following:

Administrative data are collected by agencies, contractors, or grantees, among others, to carry out the basic operations and administration of a program. Examples could include data from nutrition assistance program applications, medical program payment records, school enrollment records, or local measurements of pollution collected to administer environmental laws.

Statistical data are collected for the purpose of describing or making estimates concerning society, the economy, or the environment, or relevant subgroups or components. They can consist of survey data, aggregate indicators, descriptive statistics, or other data collected by your agency or others to better understand a population or condition. Examples could include Census data, economic data, highway traffic statistics, or crime statistics.

Research and Analysis may provide information and insights pertinent to a program, its objectives, the populations it serves, or challenges it faces. Examples could include a study on mental health disorders and likelihood of employment, or an economic analysis on child support debt. An agency may conduct its own research and analysis, or it may contract for others to conduct it. The agency may also identify relevant research and analysis conducted by other entities, such as other federal, state or local government entities; academic researchers; or think tanks.

 
24.  To what extent do you have the following types of information available to you for the program(s) that you are involved with? (Select one answer in each row.)

1. (Click here to skip to question 27)
 
   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
24a.  Administrative data
24b.  Statistical data
24c.  Research and analysis
24d.  Other information not specified above. (Please describe below).
 
  If you answered "Other information not specified above," please specify the other information here.
 

25.  Based on your response in question 24, to what extent, if at all, do you use any of those types of information when participating in the following activities for the program(s) you are involved with? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
25a.  Providing context about the problem the program is designed to address
25b.  Setting or revising program priorities and goals
25c.  Developing program strategy
25d.  Explaining or providing context for performance results
25e.  Refining program performance measures
25f.  Allocating resources
25g.  Identifying opportunities to improve program performance
 
   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
25h.  Identifying and sharing effective program approaches with others
25i.  Adopting new program approaches or changing work processes
25j.  Identifying opportunities to reduce, eliminate or better manage duplicative activities
25k.  Coordinating program efforts within your agency or with other external entities
25l.  Identifying opportunities to support the program’s activities to respond to the COVID-19 pandemic
25m.  Other activity not listed. (Please describe below).
 
  If you answered "Other activity not listed," please specify the other activity here.
 

26.  Thinking about all these additional types of information (i.e., administrative and statistical data, and research and analysis) that you have available for your program(s), to what extent, if at all, do you agree with the following statements? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
26a.  Program staff collectively have the knowledge and skills needed to collect, analyze, and use these additional types of information
26b.  I have access to the analytical tools needed to collect, analyze, and use these additional types information
26c.  I have the additional types of information I need to manage my programs
26d.  I have access to these additional types of information produced by my agency
26e.  I have access to these additional types of information produced by entities outside my agency (such as other federal agencies, academic researchers, and think tanks)
 

27.  Thinking more broadly about your agency, to what extent, if at all, do you agree with the following statements about additional types of information (i.e., administrative and statistical data, and research and analysis)? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
27a.  My agency communicates about the additional types of information that are available to its employees
27b.  My agency has the analytical tools needed to collect, analyze, and use these additional types of information
27c.  My agency has staff with the knowledge and skills needed to collect, analyze and use these additional types of information
27d.  My agency is investing resources to improve its capacity to collect, analyze, and use these additional types of information
27e.  My agency has staff with the knowledge and skills to integrate and compare findings from performance measurement, program evaluations, and additional types of information
27f.  My agency has information systems and processes in place to protect the privacy and security of its data
27g.  My agency’s top leadership demonstrates a strong commitment to using a variety of data and information in decision making (including performance information, program evaluations, and additional types of information)
 

28.  During the past 3 years, has your agency provided, arranged, or paid for training that would help you to accomplish the following tasks? (Select one answer in each row.)

   
1. Yes
2. No
28a.  Identify and collect additional types of information, such as administrative or statistical data, or research and analysis
28b.  Assess the quality of data, such as administrative or statistical data
28c.  Assess the credibility of data, research, and analysis
28d.  Analyze administrative and statistical data, and research and analysis to draw conclusions or inform decisions
28e.  Better understand how to choose the right type(s) of information for different kinds of decisions
 

Section 5. Financial Information

 

Please Note:

In addition to performance information, program evaluations, and other types of information addressed previously, government agencies produce a wide range of financial information. This section focuses specifically on the information submitted for and available on USAspending.gov, an official source of spending and spending-related data of the U.S. Government. In compliance with the Federal Funding Accountability and Transparency Act of 2006 (FFATA), as amended by the Digital Accountability and Transparency Act of 2014 (DATA Act) requirements, USAspending.gov provides information on almost all types of federal spending including, but not limited to, agency budgetary and financial data as well as federal grants, contracts, and loans.

As with our prior questions, when we say “program” we mean any program(s), operation(s), or project(s) for which you have management responsibilities.

 
29.  How familiar are you with the USAspending.gov website? (Select one.)

1.
2.
3. (Click here to skip to Section 6. Funding and Continuity of Operations during the COVID- 19 Pandemic)
 

30.  To what extent, if at all, are data available on USAspending.gov useful for the following activities? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
30a.  Improve understanding of overall spending for your program(s)
30b.  Compare spending data and related information for other program(s) within your agency to your own
30c.  Compare spending data and related information for program(s) in other agencies or government-wide to your own
30d.  Increase the availability/transparency of spending data and related information regarding your program(s) for the public or other stakeholders
30e.  Manage your program(s)
30f.  Improve understanding of COVID-19 pandemic-related spending for your program(s)
30g.  Other use not listed. (Please describe below).
 
  If you answered "Other use not listed," please specify the other use here.
 

31.  To what extent, if at all, have any of the following factors limited or prevented your use of data on USAspending.gov? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
31a.  Data and information on my program(s) are not available on USAspending.gov
31b.  I already have access to information I need from another source
31c.  I am not sure what is available on USAspending.gov
31d.  It is difficult to use the website to locate data and information I need
31e.  The data and information on USAspending.gov is not in a format that is useful to me
31f.  Data and information on USAspending.gov are not of sufficient quality for my needs
31g.  Other factor not listed. (Please describe below).
 
  If you answered "Other factor not listed," please specify the other factor here.
 

Section 6. Funding and Continuity of Operations during the COVID- 19 Pandemic

 

Beginning in March 2020, Congress and the President have taken a series of actions to respond to the effects of the COVID-19 pandemic. Several laws, including the Coronavirus Aid, Relief, and Economic Security (CARES) Act, provide emergency financial support for our nation’s health care system, economy, and citizens. Funding is being provided through existing programs as well as new programs and funds.

In addition, through executive actions, the President has made additional federal funds available. This has included making disaster relief funding available through disaster declarations, and directing agencies and programs to reallocate existing funding—to the extent permissible by law—to help respond to the pandemic.

On March 17, 2020, consistent with the President’s declaration of a national emergency, the Office of Management and Budget issued guidance that directs agencies to adjust their operations and services to minimize face-to-face interactions while ensuring that government operations continue. Among other things, the guidance gives agencies the flexibility to reduce or postpone functions deemed non-mission-critical, or that require in-person interactions, and to realign individuals or work units to higher-priority activities. It also directs agencies to review and modify their policies and procedures to safeguard the health and safety of federal workplaces.

Please note: When we say “program” here and throughout this survey, we mean any program(s), operation(s), or project(s) for which you have management responsibilities.

 
32.  To what extent, if at all, has funding for your program(s) changed because of actions to respond to the effects of the COVID-19 pandemic? (Select one.)

1.
2.
3.
4.
5.
6.
 

33.  Considering your management responsibilities prior to the onset of the COVID-19 pandemic, which of the following statements describe how your program(s) activities have been affected? (Select yes or no for each row.)

   
1. Yes
2. No
33a.  Some program activities were expanded
33b.  Some program activities were reduced
33c.  Some program activities remained the same
33d.  Some program activities were suspended but have been restarted
33e.  Some program activities were suspended and we plan to restart them
33f.  Some program activities were terminated
 

34.  How did you make use, if at all, of the following types of guidance in managing your program’s operations during the pandemic? (Select one answer in each row.)

   
1. I made extensive use of this
2. I made regular use of this
3. I made minor use of this
4. I did not use this
5. This guidance does not exist
6. No basis to judge/Not applicable
34a.  Agency continuity of operations (COOP) plan
34b.  Agency pandemic response plan
34c.  Guidance provided during internal agency briefings (in-person, teleconference, or webcast)
34d.  Internal agency communications (e.g., memos, emails, information on internal web sites, or answers to frequently asked questions)
34e.  External guidance or plans (e.g., from OMB or OPM)
34f.  Other guidance not listed.(Please describe below).
 
  If you answered "Other guidance not listed," please specify the other guidance here.
 

35.  To what extent, if at all, was guidance from your agency available in time to be useful to support the following types of management decisions regarding continuing your program’s operations during the COVID-19 pandemic? (Select one answer in each row.)

   
1. Always in time to be useful
2. Usually in time to be useful
3. In time to be useful about half the time
4. Rarely in time to be useful
5. Never in time to be useful
6. No basis to judge/ Not applicable
35a.  Determining which activities to increase, maintain, and/or decrease
35b.  Expanding operations for activities that are being increased
35c.  Continuing operations for those activities that are being maintained
35d.  Reducing or ending activities that are being decreased
35e.  Reallocating resources among activities
35f.  Protecting the health and safety of program staff
35g.  Providing human capital flexibilities for program staff (e.g., telework, alternate schedules, leave, etc.)
35h.  Hiring/onboarding new staff to fill critical needs
 

36.  To what extent, if at all, was guidance from your agency sufficient to support the following types of decisions during the COVID-19 pandemic? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
36a.  Determining which activities to increase, maintain, and/or decrease
36b.  Expanding operations for activities that are being increased
36c.  Continuing operations for those activities that are being maintained
36d.  Reducing or ending activities that are being decreased
36e.  Reallocating resources among activities
36f.  Protecting the health and safety of program staff
36g.  Providing human capital flexibilities for program staff (e.g., telework, alternate schedules, leave, etc.)
36h.  Hiring/onboarding new staff to fill critical needs
 

37.  How have the following factors facilitated or hindered your ability to maintain your program’s operations during the COVID-19 pandemic? (Select one answer in each row.)

   
1. Greatly facilitated
2. Somewhat facilitated
3. Neither facilitated nor hindered
4. Somewhat hindered
5. Greatly hindered
6. No basis to judge/Not applicable
37a.  Reallocation of resources within your agency
37b.  Flexibility offered to staff to work alternate schedules
37c.  Flexibility offered to staff to work remotely
37d.  Flexibility offered to staff to take leave
37e.  Your agency’s ability to maintain a safe environment for work that continued onsite
37f.  Your agency’s infrastructure to support remote work (i.e., policies, guidance, technology, and technical assistance)
37g.  Prior agency training and exercises on its continuity of operations plan
37h.  Ability to hire/add new staff to fill critical needs
37i.  Other factor not listed. (Please describe below).
 
  If you answered "Other factor not listed," please specify the other factor here.
 

Section 7. Telework during the COVID- 19 Pandemic

 

On March 17, 2020, consistent with the President’s declaration of a national emergency, the Office of Management and Budget directed agencies to “maximize telework across the nation for the Federal workforce (including mandatory telework, if necessary), while maintaining mission-critical workforce needs.” Subsequent guidance from the Office of Personnel Management clarified that for certain employees that cannot safely travel to an approved work location, or work remotely due to their job function, the agency would provide a portable work assignment or provide leave.

As with prior questions, when we say “program” below we mean any program, operation, or project for which you have management responsibilities.

 
38.  Which of the following responses generally describes where you worked, and have been working, before and during the COVID-19 pandemic?

For this question, please select one answer for “Before” and one answer for “During.”
 
38a.  Before the pandemic:
(SELECT ONLY ONE ANSWER)
 
38b.  During the pandemic:
(SELECT ONLY ONE ANSWER)
 

39.  While teleworking during the pandemic, to what extent have you been satisfied or dissatisfied with the ability to complete the following activities? (Select one answer in each row.)

   
1. Very Satisfied
2. Somewhat Satisfied
3. Neither Satisfied nor Dissatisfied
4. Somewhat Dissatisfied
5. Very Dissatisfied
6. No basis to judge/Not applicable
39a.  My ability to complete my own work tasks
39b.  My ability to supervise program staff
39c.  Program staff’s ability to complete their work tasks
39d.  Maintaining personal connections among staff
39e.  Our ability to coordinate within our agency
39f.  Our ability to coordinate with stakeholders outside our agency
 

40.  Thinking about your own preferences, to what extent would you say that you supported, or will support, use of telework by staff in your program(s) at the following times? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
40a.  Before any changes resulting from the COVID-19 pandemic
40b.  While OMB’s directive to maximize telework during the COVID-19 pandemic is in effect
40c.  In the future, if OMB’s directive to maximize telework is suspended
 

41.  How have the following factors facilitated or hindered the use of telework for your program(s) during the COVID-19 pandemic? (Select one answer in each row.)

   
1. Greatly facilitated
2. Somewhat facilitated
3. Neither facilitated nor hindered
4. Somewhat hindered
5. Greatly hindered
6. No basis to judge/Not applicable
41a.  Your agency’s telework policy prior to the pandemic
41b.  Modifications to your agency’s telework policy (including those made through COOP) during the pandemic
41c.  The commitment to telework demonstrated by your agency’s top leadership prior to the pandemic
41d.  The commitment to telework demonstrated by your agency’s top leadership during the pandemic
41e.  The commitment to telework prior to the pandemic demonstrated by the person you report to
41f.  The commitment to telework during the pandemic demonstrated by the person you report to
41g.  The nature of your program’s activities (i.e., extent to which tasks can be completed via telework)
41h.  Your agency’s equipment and technology
41i.  Availability of telework training or instructional materials
41j.  Access to technical support to address technology issues
 

42.  Thinking of the staff that work for your program(s), to what extent, if at all, do the following generally describe where your staff have worked during the COVID-19 pandemic? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
42a.  Teleworked or worked remotely
42b.  Worked onsite
42c.  Took administrative, weather, or safety leave, specifically
 

43.  Based on your own experience, or your understanding of working onsite during the COVID-19 pandemic, to what extent do you agree with the following statements? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
43a.  Work spaces and other necessary facilities were sufficiently clean and sanitized
43b.  Face masks were available, as needed
43c.  Other personal protective equipment (e.g., gloves, robes/gowns, etc.) was available, as needed
43d.  Hand sanitizer was available, as needed
43e.  It was possible to maintain social distancing while onsite
43f.  Employees received temperature screening before entering agency facilities
 

44.  Based on your own experience, to what extent have employees at your agency who were exposed to confirmed case(s) of COVID-19 been asked to do the following? (Select one answer in each row.)

   
1. Very great
extent
2. Great
extent
3. Moderate
extent
4. Small
extent
5. No
extent
6. No basis to judge/Not applicable
44a.  Take sick leave
44b.  Take administrative leave
44c.  Take Family Medical Leave Act (FMLA) or CARES Act leave
44d.  Take annual leave
44e.  Work onsite as long as asymptomatic
44f.  Continue to work, but do so remotely
 

Submit responses to GAO

45.  Is your survey complete and ready to be submitted to GAO?

1.
2.
 



Questionnaire Programming Language - Version 6.3
U.S. Government Accountability Office

Please wait, file upload in progress.