DOC/NOAA/NIST Online Critiques & Scores

The U.S. Department of Commerce (DOC) is a partner agency with eRA. The DOC consists of thirteen bureaus, which include the National Oceanic and Atmospheric Administration (NOAA) and the National Institute of Standards and Technology (NIST). These bureaus utilize eRA's Peer Review module for online critiques and scores in a similar manner, of which the details are provided below.

Overview of the DOC/NOAA/NIST Scoring Process

  • Each criterion is assigned a maximum score value, based on its importance in the funding opportunity.

  • Each criterion is evaluated on its scientific and technical merit.

  • Reviewers enter a score ranging from 0 to the maximum allowed score for the criterion (the higher the score, the better the application).

  • The sum total of the criterion scores determines the reviewer's raw score of the application. With each criterion having an independent maximum value, it permits the agencies to provide more weight or importance to the various criterion.

Open and Complete the Critique

Follow these steps to complete the online critique:

  1. Go to the List of Applications or List of My Assigned Applications screen in Internet Assisted Review.
  2. In the Application Number column for the application you are critiquing, click the three-dot ellipses icon and select the Submit Critique option.
The ClosedOnline Critique screen opens.
  1. Optionally, review the Important Reminders heading by clicking on the heading text Important Reminders in the blue bar. This might contain instructions, set by the SRO, that are relevant for the current meeting.
  2. Click the Closedgreen headers in whatever order suits you and begin filling out the critique. Use the tab key to jump from field to field.
  1. For each review criteria, read all guidance at the top of the editing area by clicking the read more link, which shows all available guidance for the criteria item.
  2. If applicable, select scores from the Score dropdown menu. See the next section for details.
  3. Select a radio button from each radio button group.
  4. Enter your comments in text fields. See DOC/NOAA/NIST Online Critiques & Scores. As a best practice, to ensure you don't forget a field unintentionally, enter N/A or none in the field if you have no comments for the field. This reduces warnings about empty fields when you submit the critique.
After you have completed the critique, you are ready to submit the critique; see Submit an Online Critique below.
If you don't want to submit at this time, see Save the Critique to Finish Later.

Editing in a Critique Text Field

When you click in a field, a toolbar appears with formatting tools:

Editing Tools Icons

The first six of these are familiar to most users, and are bold, italic, underline, strikethrough, subscript, and superscript. You can hover your cursor over any editing tool to see its name and its keyboard shortcut keys if available.

The less familiar icons are explained below.

Formatting

Button

 Action
Remove Format Icon Removes all formatting from selected text.
Bullet and Numbers Icons Numbered List/Bulleted List tools. Bullet or number the selected text.
Special Character Icon Special character tool. Opens a Select Special Character window, from which you can choose special characters. While you can copy and paste from other applications to the Online Critique screen, special characters might not be rendered correctly in the final critique if you do so. It is recommended that you use the special character editing tool for inserting special characters to ensure correct rendering of special characters.
Undo and Redo Icons Undo and redo tools.

The Online Critique text boxes have an advanced spelling and grammar checker. The status of the checker is indicated by a Closedcolored dot in the bottom right corner of the text field.

The status colors are:

  • Orange – the checker is enabled
  • Red – there is a least one suggestion found within the text.
  • Gray – the checker is disabled

Spelling suggestions are underlined with a red line, while grammar suggestions are underlined in blue.

Text field showing a status icon as red, indicating a suggestion has been found within the text

Hovering over a suggestion provides a Closedlist of options.

Suggestions menu when you hover over a suggestion

The suggestions can be ignored by clicking the Ignore all button, or the word can be added to the local dictionary by clicking the ClosedAdd Word button.

Additional action options from the list of suggestions

The three-dot ClosedMore options icon provides three additional selections.

More options menu

  • ClosedProofread in dialog – opens a dialog box in a separate window. The window shows the current issue and possible suggestions. At the bottom of the window, the number of suggestions is shown and navigation buttons let you scroll to other issues/suggestions.

    Proofread in dialog window

  • ClosedSettings – Opens a dialog box with a variety of options that can be selected or toggled on and off using the corresponding toggle switch.

    Setting control window

  • Disable – turns the checker off and set the status color to gray.

Clicking the status dot provides the same options as described above:

Actions available when you click on the status dot

  • The power switch icon disables/enables the checker.
  • The gear icon opens the Settings dialog box.
  • The double arrow icon opens the Proofread in dialog window.
  • The numbered circles represent the number of suggestions.

When all the suggestions have been reviewed and updated, Closeda circled checkmark appears in the bottom right corner.

When all sugestions are processed, a check icon is displayed

Submit the Critique

After you fill out the critique completely, you are ready to submit. Make sure you are on the Online Critique screen and do the following:

  • In the gray summary box at the top of the Online Critique screen, click the Submit button.

The Submit button on the 'sticky' bar

  1. If any entries are not completed, a Closedwarning dialog lists the incomplete fields.
  1. Click Continue with Submission only if you know the omissions to be valid and intentional.
  2. Otherwise, click Go Back and Edit.
You are returned to the incomplete critique. To help you easily find the incomplete entries, the blue and green review criteria that have incomplete entries are expanded, while all other review criteria are collapsed. In addition, the fields that lack a response are outlined in orange and have an orange exclamation icon next to them, as shown here:
Incomplete entry showing orange outline and warning icon
  1. Fill out the incomplete entries if necessary; if you are sure you want them blank, then you can leave them blank and submit regardless.
  2. Click the Submit button again, and if necessary, click the Continue with Submission button if you want to leave blanks.
  3. Review the information and click the Confirm button to complete the online critique submission.
The ClosedSubmit Critique and Preliminary Score window appears.
Submit Critique and Preliminary Score confirmation window


A Closedmessage appears at the top of the screen indicating successful submission.

At this point, a submitted critique is saved into the system. If you later decide you want to edit the submission, you can do so; see Make Changes to a Critique After Submitting.

You can view your own critiques and scores as well as those of other reviewers (when permitted) once you have submitted them. The process by which critiques are viewed differs from phase to phase. Refer to Viewing Critiques for a description of the phase-specific method of viewing critiques.

Related TopicsRelated Topics Link Icon