Submit Online Critiques & Scores for Reviews not using Factor Criteria

Navigation and submission capabilities of online critiques for funding opportunities using the simplified review framework (SRF) remain the same for all agencies (see About Online Critiques and Navigating the Online Critique Screen for more information). The differences between the critiques for different agencies is the method of scoring and the number of factors that are evaluated.

Open and Complete the Critique

Follow these steps to complete the online critique:

  1. Go to the List of Applications or List of My Assigned Applications screen in Internet Assisted Review.
  2. In the Application Number column for the application you are critiquing, click the three-dot ellipses icon and select the Submit Critique option.
The ClosedOnline Critique screen opens.
  1. Optionally, review the Important Reminders heading by clicking on the heading text Important Reminders in the blue bar. This might contain instructions, set by the SRO, that are relevant for the current meeting.
  2. Click the Closedblue or green headers in whatever order suits you and begin filling out the critique. Use the tab key to jump from field to field.
  1. For each review criteria, read all guidance at the top of the editing area by clicking the read more link, which shows all available guidance for the criteria item.
  2. If applicable, select scores from the Score dropdown menu. See the next section for details.
  3. Select a radio button from each radio button group.
  4. Enter your comments in text fields. See Editing in a Critique Text Field. As a best practice, to ensure you don't forget a field unintentionally, enter N/A or none in the field if you have no comments for the field. This reduces warnings about empty fields when you submit the critique.
After you have completed the critique, you are ready to submit the critique; see Submit an Online Critique below.
If you don't want to submit at this time, see Save the Critique to Finish Later.

About Scores

NIH and the majority of Operating Divisions (OpDivs) followed the Enhancing Peer Review initiative, characterized by the existence of scored review criteria and a score scale of 1–9. The scored categories differ depending on the Funding Opportunity Announcement (FOA) and activity code of the applications. Reviewers provide separate scores for each category on a scale of 1 to 9, where 1 is exceptional and 9 is poor.

Also see:

Online Critique Score Boxes

As NIH transitions to the use of new Online Critique templates, there may be times when reviewers and review staff see a mix of templates in IAR.

Some templates show the criterion/factor Closedscore boxes outside of each criterion expandable section.

Online Critique Template with score boxes outside the criterion sections

Newer templates have the Closedscore boxes contained within the expandable criterion sections:

The newer Online Critque Template where score boxes are contained within the expandable criterion sections

To access the score box, Closedexpand the section by clicking the section title:

Expanded criterion section showing the score box within the section

As funding opportunities expire and new opportunities are published, the older templates (score boxes outside the criterion sections) will eventually not be seen.

Editing in a Critique Text Field

When you click in a field, a toolbar appears with formatting tools:

Editing Tools Icons

The first six of these are familiar to most users, and are bold, italic, underline, strikethrough, subscript, and superscript. You can hover your cursor over any editing tool to see its name and its keyboard shortcut keys if available.

The less familiar icons are explained below.

Formatting

Button

 Action
Remove Format Icon Removes all formatting from selected text.
Bullet and Numbers Icons Numbered List/Bulleted List tools. Bullet or number the selected text.
Special Character Icon Special character tool. Opens a Select Special Character window, from which you can choose special characters. While you can copy and paste from other applications to the Online Critique screen, special characters might not be rendered correctly in the final critique if you do so. It is recommended that you use the special character editing tool for inserting special characters to ensure correct rendering of special characters.
Undo and Redo Icons Undo and redo tools.

The Online Critique text boxes have an advanced spelling and grammar checker. The status of the checker is indicated by a Closedcolored dot in the bottom right corner of the text field.

The status colors are:

  • Orange – the checker is enabled
  • Red – there is a least one suggestion found within the text.
  • Gray – the checker is disabled

Spelling suggestions are underlined with a red line, while grammar suggestions are underlined in blue.

Text field showing a status icon as red, indicating a suggestion has been found within the text

Hovering over a suggestion provides a Closedlist of options.

Suggestions menu when you hover over a suggestion

The suggestions can be ignored by clicking the Ignore all button, or the word can be added to the local dictionary by clicking the ClosedAdd Word button.

Additional action options from the list of suggestions

The three-dot ClosedMore options icon provides three additional selections.

More options menu

  • ClosedProofread in dialog – opens a dialog box in a separate window. The window shows the current issue and possible suggestions. At the bottom of the window, the number of suggestions is shown and navigation buttons let you scroll to other issues/suggestions.

    Proofread in dialog window

  • ClosedSettings – Opens a dialog box with a variety of options that can be selected or toggled on and off using the corresponding toggle switch.

    Setting control window

  • Disable – turns the checker off and set the status color to gray.

Clicking the status dot provides the same options as described above:

Actions available when you click on the status dot

  • The power switch icon disables/enables the checker.
  • The gear icon opens the Settings dialog box.
  • The double arrow icon opens the Proofread in dialog window.
  • The numbered circles represent the number of suggestions.

When all the suggestions have been reviewed and updated, Closeda circled checkmark appears in the bottom right corner.

When all sugestions are processed, a check icon is displayed

Submit the Critique

After you fill out the critique completely, you are ready to submit. Make sure you are on the Online Critique screen and do the following:

  • In the gray summary box at the top of the Online Critique screen, click the Submit button.

The Submit button on the 'sticky' bar

  1. If any entries are not completed, a Closedwarning dialog lists the incomplete fields.
  1. Click Continue with Submission only if you know the omissions to be valid and intentional.
  2. Otherwise, click Go Back and Edit.
You are returned to the incomplete critique. To help you easily find the incomplete entries, the blue and green review criteria that have incomplete entries are expanded, while all other review criteria are collapsed. In addition, the fields that lack a response are outlined in orange and have an orange exclamation icon next to them, as shown here:
Incomplete entry showing orange outline and warning icon
  1. Fill out the incomplete entries if necessary; if you are sure you want them blank, then you can leave them blank and submit regardless.
  2. Click the Submit button again, and if necessary, click the Continue with Submission button if you want to leave blanks.
The ClosedSubmit Critique and Preliminary Score window appears.
  1. Review the information and click the Confirm button to complete the online critique submission.
    A Closedmessage appears at the top of the screen indicating successful submission.

At this point, a submitted critique is saved into the system. If you later decide you want to edit the submission, you can do so; see Make Changes to a Critique After Submitting.

You can view your own critiques and scores as well as those of other reviewers (when permitted) once you have submitted them. The process by which critiques are viewed differs from phase to phase. Refer to Viewing Critiques for a description of the phase-specific method of viewing critiques.

Related TopicsRelated Topics Link Icon