To ensure seamless data loading in Encord, allowlist https://app.encord.com/ or https://app.us.encord.com/ in any 3rd party VPNs, firewalls, or URL isolators. This helps to prevent potential issues with opening your data in Encord.
Review Mode
Introductory Videos
The following video goes through the basics of reviewing images in the Label Editor.
Use the show-hide labels buttons, workspace settings, and the drag and select in the workspace to speed up your approved label selection and review process.
Review Mode Components
- A. Editor menu
- B. Single label review toggle
- C. Quick toolbar
- D. Pending reviews pane
- E. Completed reviews pane
- F. Reject and Approve buttons
- G. Editor timeline (for videos and image sequences only)
- H. Editor header
- I. Edit labels during review
- J. Approve and Reject all in frame buttons
Single Label Review
The normal review mode displays all labels simultaneously, allowing you to quickly approve or reject many labels in bulk actions. Alternately, enter the Single label review mode by toggling the switch at the top left. The single label review mode automatically highlights the selected instance, and hides all other objects. This allows you to carefully review one instance at a time including their attributes, and quickly iterate through the different instances using the Up and Down keys on your keyboard or by clicking the appropriate buttons in the UI.
The Single label review feature can also be considered “turbo review mode,” analogous to the “turbo attribute mode” in annotation mode, because it allows the reviewer to quickly step through and review instance attributes. “Turbo attribute mode” in the editor settings can be disabled while in review mode.
- Open the editor settings by clicking in the editor header.
- In the General settings section adjust the Set the default zoom level for single label view value highlighted in the screenshot below. The settings will be applied for the next selected label.
- Initially, the default is set to 60%
- 20% corresponds to no zoom. It’s the magnification at which the image or frame is displayed in the Label Editor.
- To zoom in, increase the percentage value.
- To zoom out, decrease the percentage value. The minimum value is 1%.
Edit Labels During Review
It is sometimes faster, more convenient, and less error-prone to have reviewers make edits to annotations, instead of outright rejecting them. Rejection requires the return of the entire set of labels to the annotator. Edit review allows reviewers to make changes to labels, remove labels, and add new labels. Approved or rejected labels cannot be edited. Only Pending labels can be edited by reviewers. New labels made by editors are automatically approved, and cannot be changed once they have been saved. Once all labels have been approved the task moves to the Complete stage. To edit labels in review mode:- Click the Edit labels button.
- Add or remove labels, or edit existing labels as necessary using the same interface annotators use to create labels.
- Click the Save and return to review button to save your edits and return to review mode.
The Save and return to review button replaces the Save and Cancel buttons used in earlier versions of this feature.
Pending Reviews Pane
All labels for review for a particular data asset assigned to the reviewer are automatically loaded into then Pending reviews pane. The labels are grouped by Ontology class.Completed Reviews Pane
Completed reviews are displayed in the Completed reviews pane. You can click on specific objects to highlight them. Labels can be selected and then approved or rejected for a given instance or in bulk using the Reject and Approve buttons or the matching hotkeys, b for reject and n for approve. Approved labels appear in a green background and rejected labels appear in red.Approve and Reject All In Frame Buttons
The Approve all in frame and Reject all in frame buttons take the named action without having to select a particular instance or set of instances. This speeds up workflows, particularly in images, where you can judge whether all instances are correct or not by looking at an individual frame.Reject and Approve Buttons
To reject/approve multiple object instances across frames, select the instances, and then click the Reject or Approve button, as appropriate. Alternately, you may press b for reject and n for approve.Change Review Judgement
Video Tutorial - Strict review & change review judgment
Video Tutorial - Strict review & change review judgment
- Revert labels to pending :
- Revert an approved task to pending by clicking the green tick icon next to the instance.
- Revert a rejected task to pending by clicking the red cross icon next to the instance.
- Once the reviewer completes their review, they need to click the Approve task or Reject task to finalize the review.
Controls Common To Both Modes
The current workflow status is displayed in the top left corner of the label editor.
Editor Menu
- Return to Project - Returns the user to the Project navigation.
- Save changes - Saves the current state of all labels.
- View - Allows users to change what information is displayed next to all labels.
- Bulk label operations (annotation mode only) - Allows the user to perform actions on many labels at once.
- Automated labeling (annotation mode only) - Lets the user choose between several automated labeling techniques.
- Dark mode - Toggle dark mode on and off.
- Keyboard shortcuts - Displays a full list of keyboard shortcuts.
- Editor settings - Opens the Editor settings.
Editor Header
| Icon | Name | Description |
|---|---|---|
 | Help | Links to the: quick start guide, documentation, learning hub, and Encord support team. |
 | Notifications | Shows the current status and history of actions taken in the application. This includes uploading datasets, training models, and exporting labels. |
 | Share | Copies the URL of the asset currently being labeled or reviewed. |
 | Save labels | Manually saves labels on the Encord server. |
 | Label Editor settings | Settings controlling your labeling and reviewing experience. |
 | Issues | Shows any issues and comments for the current task, such as any objects or classifications marked as Required, or comments added by other users. |
Quick Toolbar
- Rotate the label editor.
- Adjust filters; contrast, brightness, gamma, pixelated scaling, and grayscaling.
- Remove polygon vertices.
- Add comments or issues to a frame or image.
- Quickly center an image.
- Zoom in and out.
Remove polygon vertices (the scissors tool) is currently not available in review or review-edit mode.
Rotate the Label Editor
Click the Rotate toolbar icon on the quick toolbar to bring up a pop-up that enables you to rotate the label editor by using the slider, as shown below.
Pixelated Scaling
The Pixelated scaling feature enhances the visibility of individual pixels in an image or frame by disabling the browser’s automatic edge smoothing. This increased pixel clarity aids annotators in creating precise, pixel-perfect annotations, thereby improving their annotation accuracy, especially when zooming into an image.| Pixelated Scaling turned on | Pixelated Scaling turned off |
|---|---|
 |  |
)in the Quick toolbar and enabling the Pixelated scaling checkbox, as shown below.
| File type | Chrome | Firefox |
|---|---|---|
| Image | ✅ | ✅ |
| Image group | ✅ | ✅ |
| Video | ❌ | ✅ |
| Image sequence | ❌ | ✅ |
Grayscale Filter
The Grayscale filter feature enhances the visibility across an image or frame by applying an RGB grayscale to the image/frame. The filter applies across the pixels of an image/frame using the value for Red, Green, or Blue as a base then converting to grayscale.You can use the Grayscale filter on images, videos, and DICOM (DICOM and NIfTi) series.
Grayscale DICOM/NIfTi
Media Navigation Controls
The video frame slider lets you quickly scroll through frames in a video asset. Below the frame slider are a range of controls to let you play, skip and navigate through media. Notice that the navigation controls are not displayed in single images files, as well as any media with only 1 frame. Icon descriptions:
Issues and Comments
Issues can be added to annotation and review tasks to communicate with other users. All issues contain comment threads relating to the entire task or specific sections of the task. A small notification badge on the Issues icon displays the number of unresolved issues in a task.- Label rejection: Created when a reviewer rejects labels. The reviewer is prompted to provide a reason for the rejection in the form of a comment. If all instances in a frame or image are rejected, a separate rejection issue is created for each label. Labels with rejection issues display a red Issues icon next to the instance name, which turns green once the issue is resolved.
- File: Apply to the entire file and can be created at any stage within the Label Editor.
- Pinned: Apply to a specific part of the file or frame and can be created at any stage within the Label Editor. Red Pin icons indicate unresolved issues and remain red until they are marked as resolved.
- Frame: Apply to a specific frame and can be created at any stage within the Label Editor. Frame issues can only be created when multiple frames are present; such as in a video, image sequence, or DICOM volume.
- Frame range: Apply to a range of frames and can be created at any stage within the Label Editor. Frame range issues can only be created when multiple frames are present; such as in a video, image sequence, or DICOM volume. Frame range issues can only be created in Encord Active.
- Task requirement: Are created for each object or classification marked Required in the Ontology. The issue is resolved when the required object or classification is applied. Task requirement issues are the only issues visible in a Consensus annotate stage.
Issues cannot be created in a Consensus annotate stage.
- Open the Issues pane by clicking the Issues icon.
- Click the New issue icon (or keyboard shortcut Ctrl+N).
- Click the Apply to dropdown to select the type of issue you want to create.
- Select any Issue Tags you want to apply to the issue.
- Add a comment to the issue.
- If you selected ‘Pin on canvas’ in Step 3, click the desired location on the canvas.
- Click Create issue.
- Open the Issues pane by clicking the Issues icon.
- Click the tick to mark a thread as resolved.
- Open the Issues pane by clicking the Issues icon.
- Click the Ellipsis icon to show more options.
- Click Delete thread.
Users can only delete issues that they created. Label rejections cannot be deleted, only resolved.
- Open the Issues pane by clicking the Issues icon.
- Click Reopen on an issue that was previously resolved.
- Ask questions: Annotators and reviewers can ask questions about the task. Admins can use this feedback to improve guidance.
- Explain task rejection: Reviewers can provide reasons for rejection, helping annotators avoid repeating mistakes.
- Track unresolved issues: Keep a record of open discussions that need follow-up before finalizing annotations.
Editor Lock
The ‘Editor lock’ is a safety feature we implemented to prevent several people making changes to the same file - annotators labeling, or reviewers reviewing the same data unit. A warning is triggered in two cases:- When you have the same task open in two different tabs or browser windows:
- When a different user is editing the same task:
Caption Review Interface
For caption review tasks, Encord provides a specialized interface designed for efficient review of video captions and transcriptions. This interface includes enhanced features for streamlined caption approval and rejection workflows.Double-Tap Confirmation
The caption review interface uses a double-tap confirmation system to prevent accidental approvals or rejections:All approval and rejection actions require double-tap confirmation. Press the same key or button twice to confirm your action.
- Press A or click the Approve button The button shows “Hit A again to confirm”.
- Press A again or click the button again to confirm the approval
- Press R or click the Reject button to open rejection options
- Choose the rejection reason:
- Press 1 for “Caption issue” or click the Caption issue button
- Press 2 for “Video issue” or click the Video issue button The selected button shows confirmation text (for example: “Hit 1 again to confirm”)
- Press the same key again or click the button again to confirm the rejection
Revert to pending
When reviewing tasks, you can revert approved or rejected tasks back to a pending state. This allows you to reconsider your review decision or make additional changes before finalizing the task status.When you click the revert to pending button, it becomes disabled and shows a loading indicator while the operation is in progress. This prevents accidental multiple clicks and ensures the action completes properly.
Auto-Play Toggle
The caption review interface includes an auto-play feature that automatically plays video content when reviewing captions:- Click the Auto-play button in the video controls to toggle auto-play on or off When enabled, videos automatically start playing when a caption is selected for review
The auto-play setting is preserved across review sessions.
Enhanced Video Controls
The caption review interface provides streamlined video controls:- Seek bar: Click anywhere on the seek bar to jump to that position in the video
- Speed control: Use the dropdown or Shift + Up/Down arrows to adjust playback speed
- Loop toggle: Click the loop button or press L to enable/disable video looping
- Mute toggle: Click the mute button or press M to mute/unmute audio
Keyboard Shortcuts for Caption Review
The caption review interface uses simplified keyboard shortcuts optimized for review workflows:| Key | Action |
|---|---|
| Space | Play/Pause video |
| A | Approve caption (press twice to confirm) |
| R | Show rejection options |
| 1 | Caption issue rejection (press twice to confirm) |
| 2 | Video issue rejection (press twice to confirm) |
| B | Back to approve/reject view |
| M | Mute/Unmute audio |
| L | Toggle video looping |
| Shift + ↑/↓ | Adjust video playback speed |
Review Settings Persistence
The caption review interface automatically saves your preferences including:- Playback speed settings
- Auto-play toggle state
- Video looping preference
- Audio mute state
- Keyboard shortcuts panel visibility