End-to-end throughput
Divide the number of input voxels by elapsed wall time, from reading the volume to writing the final labels. Include preprocessing, inference, stitching and postprocessing.
SEGConnectomics
Assign neuron identities throughout a three-dimensional image of brain tissue. Measure how long a reconstruction stays correct and how quickly the pipeline processes the volume.
The task
Divide the number of input voxels by elapsed wall time, from reading the volume to writing the final labels. Include preprocessing, inference, stitching and postprocessing.
ERL measures the expected length of an error-free path along a proofread reference skeleton. Splits interrupt paths and merges invalidate affected runs. Report ERL in micrometres.
Compare runs on the same volume and hardware profile. Record accelerator type and count, memory and storage conditions. Report throughput and ERL together so a faster run can be assessed for continuity.
Image volumes, voxel geometry and reference annotations.
End-to-end timing and reconstruction continuity scoring.