The scorer first compares the speech-to-text transcript with the truth transcript to align the two. Then, it counts the number of words that are matched, as well as those that are mismatched in the alignment.
To run the scorer task
Send an AddTask
action to IDOL Speech Server, and set the following parameters:
Type
|
The task name. Set to Scorer . |
TxtFile
|
The normalized ‘truth’ transcript file. |
CtmFile
|
The .ctm file that was produced by speech-to-text on the audio file. |
ScoreFile
|
The file to write the scores to. |
Out
|
The .ctm file to write the ‘truth’ transcript including timestamps to. |
For example:
http://localhost:13000/action=AddTask&Type=Scorer&TxtFile=C:\data\transcript.txt&CtmFile=C:\misc\alignment.ctm&ScoreFile=score.ctm&Out=FinalTranscript.ctm
This action uses port 13000
to instruct IDOL Speech Server, which is located on the local machine, to perform the Scorer
task by comparing the transcript.txt
file to the alignment.ctm
file. The action instructs IDOL Speech Server to write the scores to the score.ctm
file, and the truth transcript that contains the timestamps to the FinalTranscript.ctm
file .
Use the GetResults
action to return the results.
|