Evaluating performance
Before evaluating performance, you'll need to have trained a pipeline.

Evaluating a pipeline's performance

Biodock allows you to evaluate an AI pipeline's performance quantitatively and statistically after a model has been trained. To do this, navigate to Train and Deploy, and click View details underneath the version number.
This will take you to a page that contains three tabs - Training details, Qualitative performance, and Statistical performance for your AI pipeline.

Training details

The training details section helps you get a broad picture of the AI pipeline and the data it was trained on. You can review information such as total images, included images, average number of images, included classes, and errors or warnings.

Qualitative performance

The qualitative performance tab allows you to see, qualitatively, how well the model performed on your test image and your training images. To toggle between the two, simply select on the toggle between Test images and Train images.
You'll immediately see the image viewer, which will allow you to toggle between different images and see objects that were predicted with AI.

Thresholds

For each object, your AI models output a confidence score. The threshold controls the minimum score needed to be included in the output. Drag the slider up and down to control which objects are displayed - a lower threshold will output more objects, while a higher threshold will output fewer objects. Then, to lock in your threshold for use during Analysis, click Update analysis threshold.

Choose visible classes

Use the class selector and Show outlines in order to toggle on and off outlines to help you look at how the segmentation did.

Statistical performance

The statistical performance section shows a table with summary statistics about how the model performed on both the train and test set. These metrics are especially useful when trying to compare performance between different models.

Activating a pipeline

Currently, pipelines can only be activated by Biodock. Once you finish training a model, it will enter a Pending state. A Biodock representative will reach out to you to flip it to Active, which will allow you to use it from the Analyze screen.