Image Classification

Image classification classifies images. The input images could be entire images or video frames, or regions of images or video frames. Classification chooses between the classes that you have created within a classifier.

Before using image classification, you must train a classifier. For instructions that describe how to train Media Server, refer to the Media Server Administration Guide.

Configuration Parameter Description
ClassificationThreshold The minimum confidence score necessary for Media Server to output a classification result.
Classifier The classifier to use for classification.
GPUBatchingDuration The maximum amount of time to wait, before sending a batch of video frames to the GPU for analysis.
GPUNumParallel The maximum number of video frames to analyze concurrently using the GPU (per CPU thread).
Input The name of the track to analyze.
MaxInputQueueLength Can be used to place a limit on latency.
NumParallel The maximum number of CPU threads to use for analysis.
Region A region of the frame to restrict processing to.
RegionUnit The units that the Region parameter uses to specify the size and position of a region.
RestrictToInputRegion Specifies whether to analyze a region of the input image or video frame that is specified in the input record, instead of the entire image.
SampleInterval The interval at which frames are selected to be analyzed.
SegmentDuration The maximum duration of a record in the SegmentedResult or SegmentedResultWithSource track.
SyncDatabase Specifies whether to synchronize with the training database before beginning the analysis task.
Type The analysis engine to use. Set this parameter to ImageClassification.
VariableState Specifies whether there are multiple classes in the image classifier that represent different states of the same type of object.

Output Tracks

Output track Type Description Output1This column indicates whether the information contained in the track is included by default in the output created by an output task (when you don't set the Input parameter for the output task).
Data ImageClassificationResult Contains one record, describing the analysis results, for each input record. No
DataWithSource ImageClassificationResultAndImage

The same as the Data track, but each record also includes the source frame.

No
Result ImageClassificationResult

Contains a record, describing the analysis results, for each event.

  • When the input is images, Media Server classifies each image separately.
  • When the input is video from an ingest engine, or an engine that does not support tracking, Media Server begins a new result when the classification changes significantly.
  • When the input is video from an engine that supports tracking (for example number plate recognition), results begin and end at the times provided by the other analysis task (for example when the vehicle appears and disappears). The IDs used for the image classification records are also inherited from the input records.
Yes
ResultWithSource ImageClassificationResultAndImage

The same as the Result track, but each record also includes the best source frame.

No
SegmentedResult ImageClassificationResult (Available only when processing video). Contains one or more records, describing the analysis results, for each event. The maximum duration of records in this track is limited by the parameter SegmentDuration, so multiple records are created with the same ID when an event exceeds this duration. Yes
SegmentedResultWithSource ImageClassificationResultAndImage

(Available only when processing video). The same as the SegmentedResult track, but each record also includes the best source frame.

No
Start ImageClassificationResult

The same as the Data track, except it contains only the first record of each event.

No
End ImageClassificationResult

The same as the Data track, except it contains only the last record of each event.

No

ImageClassificationResult

Field name Type Description
classification Classification The result of classification.
classifier String The name of the classifier that was used to perform classification.

ImageClassificationResultAndImage

The same as ImageClassificationResult records, with the following additional fields.

Field name Type Description
image ImageData The source frame

_FT_HTML5_bannerTitle.htm