The scorer first compares the speech-to-text transcript with the truth transcript to align the two. Then, it counts the number of words that are matched, as well as those that are mismatched in the alignment.
To run the scorer task
Send an AddTask
action to IDOL Speech Server, and set the following parameters:
Type
|
The task name. Set to Scorer . |
TxtFile
|
The normalized ‘truth’ transcript file. |
CtmFile
|
The .ctm file that was produced by speech-to-text on the audio file. |
ScoreFile
|
The file to write the scores to. |
Out
|
The .ctm file to write the ‘truth’ transcript including timestamps to. |
For example:
http://localhost:15000/action=AddTask&Type=Scorer&TxtFile=C:\data\transcript.txt&CtmFile=C:\misc\alignment.ctm&ScoreFile=score.ctm&Out=FinalTranscript.ctm
This action performs the Scorer
task by comparing the transcript.txt
file to the alignment.ctm
file. IDOL Speech Server writes the scores to the score.ctm
file, and the truth transcript that contains the timestamps to the FinalTranscript.ctm
file .
Use the GetResults
action to return the results.
|