Are Annotate and Active Projects the same?
The short answer is no. Here are the differences:- Annotate Projects are made of Datasets (data), Ontologies, and Workflows. Once Annotation Projects get underway, labels and comments also become part of the Annotate Projects.
What is a quality metric?
A quality metric is a function that can be applied to your data, labels, and model predictions to assess their quality and rank them accordingly. Encord Active uses these metrics to analyze and decompose your data, labels, and predictions. Here is a blog post on how we like to think about quality metrics. To learn more about quality metrics, go here. Quality metrics are not only limited to those that ship with Encord Active. In fact, the power lies in defining your own quality metrics for indexing your data just right. Here is the documentation for writing your own metrics.How do I write my own quality metrics?
See our documentation on writing your own metrics.How do I use Encord Active for active learning?
Encord Active supports the active learning process by allowing you to- Explore your data to select what to label next
- Employ acquisition functions to automatically select what to label next
- Find label errors that potentially harm your model performance
- Sending data to Encord’s Annotation module for labeling
- Automatically decompose your model performance to help you determine where to put your focus for the next model iteration
- Tag subsets of data to set aside test sets for specific edge cases for which you want to maintain your model performance between each production model
How do I import my model predictions?
Active supports importing predictions in the following ways:- Use the Active UI to import your model predictions.
- Use the Active API to import your model predictions.
How can I do dataset management with Encord Active?
Use Collections in your Active Projects to handle all your Project data (not just Dataset) needs. Once you’ve created a Collection, you can send the Collection to Annotate in the following ways:- Apply the Collection directly to your existing Annotate Projects
- Create a new Dataset and attached Annotate Project off of your Collection
- Apply classifications to all frames/images in your Collections directly to your existing Annotate Projects