To ensure seamless data loading in Encord, allowlist https://app.encord.com/ or https://app.us.encord.com/ in any 3rd party VPNs, firewalls, or URL isolators. This helps to prevent potential issues with opening your data in Encord.
Review Mode
Introductory Videos
The following video goes through the basics of reviewing images in the Label Editor.
Use the show-hide labels buttons, workspace settings, and the drag and select in the workspace to speed up your approved label selection and review process.
Review Mode Components
- A. Editor menu
- B. Single label review toggle
- C. Quick toolbar
- D. Pending reviews pane
- E. Completed reviews pane
- F. Reject and Approve buttons
- G. Editor timeline (for videos and image sequences only)
- H. Editor header
- I. Edit labels during review
- J. Approve and Reject all in frame buttons
Single Label Review
The normal review mode displays all labels simultaneously, allowing you to quickly approve or reject many labels in bulk actions. Alternately, enter the Single label review mode by toggling the switch at the top left. The single label review mode automatically highlights the selected instance, and hides all other objects. This allows you to carefully review one instance at a time including their attributes, and quickly iterate through the different instances using the Up and Down keys on your keyboard or by clicking the appropriate buttons in the UI.
The Single label review feature can also be considered “turbo review mode,” analogous to the “turbo attribute mode” in annotation mode, because it allows the reviewer to quickly step through and review instance attributes. “Turbo attribute mode” in the editor settings can be disabled while in review mode.
- Open the editor settings by clicking in the editor header.
- In the General settings section adjust the Set the default zoom level for single label view value highlighted in the screenshot below. The settings will be applied for the next selected label.
- Initially, the default is set to 60%
- 20% corresponds to no zoom. It’s the magnification at which the image or frame is displayed in the Label Editor.
- To zoom in, increase the percentage value.
- To zoom out, decrease the percentage value. The minimum value is 1%.
Edit Labels During Review
It is sometimes faster, more convenient, and less error-prone to have reviewers make edits to annotations, instead of outright rejecting them. Rejection requires the return of the entire set of labels to the annotator. Edit review allows reviewers to make changes to labels, remove labels, and add new labels. Approved or rejected labels cannot be edited. Only Pending labels can be edited by reviewers. New labels made by editors are automatically approved, and cannot be changed once they have been saved. Once all labels have been approved the task moves to the Complete stage. To edit labels in review mode:- Click the Edit labels button.
- Add or remove labels, or edit existing labels as necessary using the same interface annotators use to create labels.
- Click the Save and return to review button to save your edits and return to review mode.
The Save and return to review button replaces the Save and Cancel buttons used in earlier versions of this feature.
Pending Reviews Pane
All labels for review for a particular data asset assigned to the reviewer are automatically loaded into then Pending reviews pane. The labels are grouped by Ontology class.Completed Reviews Pane
Completed reviews are displayed in the Completed reviews pane. You can click on specific objects to highlight them. Labels can be selected and then approved or rejected for a given instance or in bulk using the Reject and Approve buttons or the matching hotkeys, b for reject and n for approve. Approved labels appear in a green background and rejected labels appear in red.Approve and Reject All In Frame Buttons
The Approve all in frame and Reject all in frame buttons take the named action without having to select a particular instance or set of instances. This speeds up workflows, particularly in images, where you can judge whether all instances are correct or not by looking at an individual frame.Reject and Approve Buttons
To reject/approve multiple object instances across frames, select the instances, and then click the Reject or Approve button, as appropriate. Alternately, you may press b for reject and n for approve.Change Review Judgement
Video Tutorial - Strict review & change review judgment
Video Tutorial - Strict review & change review judgment
- Revert labels to pending :
- Revert an approved task to pending by clicking the green tick icon next to the instance.
- Revert a rejected task to pending by clicking the red cross icon next to the instance.
- Once the reviewer completes their review, they need to click the Approve task or Reject task to finalize the review.
Controls Common To Both Modes
Editor Timeline
The Editor timeline visualizes when objects and instances appear throughout videos, scenes, and audio files. The cursor tracks playback in real time, always reflecting the current frame. The timeline is shown by default and can be resized or hidden by dragging it up or down.Editor Menu
- Return to Project - Returns the user to the Project navigation.
- Save changes - Saves the current state of all labels.
- View - Allows users to change what information is displayed next to all labels.
- Bulk label operations (annotation mode only) - Allows the user to perform actions on many labels at once.
- Automated labeling (annotation mode only) - Lets the user choose between several automated labeling techniques.
- Dark mode - Toggle dark mode on and off.
- Keyboard shortcuts - Displays a full list of keyboard shortcuts.
- Editor settings - Opens the Editor settings.
Editor Header
| Icon | Name | Description |
|---|---|---|
 | Help | Links to the: quick start guide, documentation, learning hub, and Encord support team. |
 | Notifications | Shows the current status and history of actions taken in the application. This includes uploading datasets, training models, and exporting labels. |
 | Share | Copies the URL of the asset currently being labeled or reviewed. |
 | Save labels | Manually saves labels on the Encord server. |
 | Label Editor settings | Settings controlling your labeling and reviewing experience. |
 | Issues | Shows any issues and comments for the current task, such as any objects or classifications marked as Required, or comments added by other users. |
Quick Toolbar
- Rotate the label editor.
- Adjust filters; contrast, brightness, gamma, pixelated scaling, and grayscaling.
- Remove polygon vertices.
- Add comments or issues to a frame or image.
- Quickly center an image.
- Zoom in and out.
Remove polygon vertices (the scissors tool) is currently not available in review or review-edit mode.
Rotate the Label Editor
Click the Rotate toolbar icon on the quick toolbar to bring up a pop-up that enables you to rotate the label editor by using the slider, as shown below.
Pixelated Scaling
The Pixelated scaling feature enhances the visibility of individual pixels in an image or frame by disabling the browser’s automatic edge smoothing. This increased pixel clarity aids annotators in creating precise, pixel-perfect annotations, thereby improving their annotation accuracy, especially when zooming into an image.| Pixelated Scaling turned on | Pixelated Scaling turned off |
|---|---|
 |  |
)in the Quick toolbar and enabling the Pixelated scaling checkbox, as shown below.
| File type | Chrome | Firefox |
|---|---|---|
| Image | ✅ | ✅ |
| Image group | ✅ | ✅ |
| Video | ❌ | ✅ |
| Image sequence | ❌ | ✅ |
Grayscale Filter
The Grayscale filter feature enhances the visibility across an image or frame by applying an RGB grayscale to the image/frame. The filter applies across the pixels of an image/frame using the value for Red, Green, or Blue as a base then converting to grayscale.You can use the Grayscale filter on images, videos, and DICOM (DICOM and NIfTi) series.
Grayscale DICOM/NIfTi
Media Navigation Controls
The video frame slider lets you quickly scroll through frames in a video asset. Below the frame slider are a range of controls to let you play, skip and navigate through media. Notice that the navigation controls are not displayed in single images files, as well as any media with only 1 frame. Icon descriptions:
Issues and Comments
Issues can be added to annotation and review tasks to communicate with other users. All issues contain comment threads relating to the entire task or specific sections of the task. A small notification badge on the Issues icon displays the number of unresolved issues in a task.- Label rejection: Created when a reviewer rejects labels. The reviewer is prompted to provide a reason for the rejection in the form of a comment. If all instances in a frame or image are rejected, a separate rejection issue is created for each label. Labels with rejection issues display a red Issues icon next to the instance name, which turns green once the issue is resolved.
- File: Apply to the entire file and can be created at any stage within the Label Editor.
- Pinned: Apply to a specific part of the file or frame and can be created at any stage within the Label Editor. Red Pin icons indicate unresolved issues and remain red until they are marked as resolved.
- Frame: Apply to a specific frame and can be created at any stage within the Label Editor. Frame issues can only be created when multiple frames are present; such as in a video, image sequence, or DICOM volume.
- Frame range: Apply to a range of frames and can be created at any stage within the Label Editor. Frame range issues can only be created when multiple frames are present; such as in a video, image sequence, or DICOM volume. Frame range issues can only be created in during label validation.
- Task requirement: Are created for each object or classification marked Required in the Ontology. The issue is resolved when the required object or classification is applied. Task requirement issues are the only issues visible in a Consensus annotate stage.
Issues cannot be created in a Consensus annotate stage.
- Open the Issues pane by clicking the Issues icon.
- Click the New issue icon (or keyboard shortcut Ctrl+N).
- Click the Apply to dropdown to select the type of issue you want to create.
- Select any Issue Tags you want to apply to the issue.
- Add a comment to the issue.
- If you selected ‘Pin on canvas’ in Step 3, click the desired location on the canvas.
- Click Create issue.
- Open the Issues pane by clicking the Issues icon.
- Click the tick to mark a thread as resolved.
- Open the Issues pane by clicking the Issues icon.
- Click the Ellipsis icon to show more options.
- Click Delete thread.
Users can only delete issues that they created. Label rejections cannot be deleted, only resolved.
- Open the Issues pane by clicking the Issues icon.
- Click Reopen on an issue that was previously resolved.
- Ask questions: Annotators and reviewers can ask questions about the task. Admins can use this feedback to improve guidance.
- Explain task rejection: Reviewers can provide reasons for rejection, helping annotators avoid repeating mistakes.
- Track unresolved issues: Keep a record of open discussions that need follow-up before finalizing annotations.
Editor Lock
The ‘Editor lock’ is a safety feature we implemented to prevent several people making changes to the same file - annotators labeling, or reviewers reviewing the same data unit. A warning is triggered in two cases:- When you have the same task open in two different tabs or browser windows:
- When a different user is editing the same task:
