Blame view
tools/sctk-2.4.10/src/hubscr/test2-sastt.base/sastt-case2.sys.rttm.filt.mdeval
4.97 KB
8dcb6dfcb
first commit
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 |
command line (run on 2009 May 1 at 15:00:28) Version: 22 ../../md-eval/md-eval.pl -nafcs -c 0.25 -o -r sastt-case2.ref.rttm.filt -s sastt-case2.sys.rttm.filt -M sastt-case2.sys.rttm.filt.mdeval.spkrmap
Time-based metadata alignment
Metadata evaluation parameters:
time-optimized metadata mapping
max gap between matching metadata events = 1 sec
max extent to match for SU's = 0.5 sec
Speaker Diarization evaluation parameters:
The max time to extend no-score zones for NON-LEX exclusions is 0.5 sec
The no-score collar at SPEAKER boundaries is 0.25 sec
Exclusion zones for evaluation and scoring are:
-----MetaData----- -----SpkrData-----
exclusion set name: DEFAULT DEFAULT DEFAULT DEFAULT
token type/subtype no-eval no-score no-eval no-score
(UEM) X X
LEXEME/un-lex X
NON-LEX/breath X
NON-LEX/cough X
NON-LEX/laugh X
NON-LEX/lipsmack X
NON-LEX/other X
NON-LEX/sneeze X
NOSCORE/<na> X X X X
NO_RT_METADATA/<na> X
SU/unannotated X
*** Performance analysis for Speaker Diarization for c=1 f=VT_20051027-1400 ***
EVAL TIME = 4.88 secs
EVAL SPEECH = 4.88 secs (100.0 percent of evaluated time)
SCORED TIME = 1.24 secs ( 25.3 percent of evaluated time)
SCORED SPEECH = 1.24 secs (100.0 percent of scored time)
EVAL WORDS = 34
SCORED WORDS = 10 ( 29.4 percent of evaluated words)
---------------------------------------------
MISSED SPEECH = 0.00 secs ( 0.0 percent of scored time)
FALARM SPEECH = 0.00 secs ( 0.0 percent of scored time)
MISSED WORDS = 0 ( 0.0 percent of scored words)
---------------------------------------------
SCORED SPEAKER TIME = 2.37 secs (191.8 percent of scored speech)
MISSED SPEAKER TIME = 1.13 secs ( 47.4 percent of scored speaker time)
FALARM SPEAKER TIME = 0.00 secs ( 0.0 percent of scored speaker time)
SPEAKER ERROR TIME = 0.00 secs ( 0.0 percent of scored speaker time)
SPEAKER ERROR WORDS = 10 (100.0 percent of scored speaker words)
---------------------------------------------
OVERALL SPEAKER DIARIZATION ERROR = 47.43 percent of scored speaker time `(c=1 f=VT_20051027-1400)
---------------------------------------------
Speaker type confusion matrix -- speaker weighted
REF\SYS (count) unknown MISS
unknown 2 / 50.0% 2 / 50.0%
FALSE ALARM 0 / 0.0%
---------------------------------------------
Speaker type confusion matrix -- time weighted
REF\SYS (seconds) unknown MISS
unknown 1.25 / 52.6% 1.13 / 47.4%
FALSE ALARM 0.00 / 0.0%
---------------------------------------------
*** Performance analysis for Speaker Diarization for ALL ***
EVAL TIME = 4.88 secs
EVAL SPEECH = 4.88 secs (100.0 percent of evaluated time)
SCORED TIME = 1.24 secs ( 25.3 percent of evaluated time)
SCORED SPEECH = 1.24 secs (100.0 percent of scored time)
EVAL WORDS = 34
SCORED WORDS = 10 ( 29.4 percent of evaluated words)
---------------------------------------------
MISSED SPEECH = 0.00 secs ( 0.0 percent of scored time)
FALARM SPEECH = 0.00 secs ( 0.0 percent of scored time)
MISSED WORDS = 0 ( 0.0 percent of scored words)
---------------------------------------------
SCORED SPEAKER TIME = 2.37 secs (191.8 percent of scored speech)
MISSED SPEAKER TIME = 1.13 secs ( 47.4 percent of scored speaker time)
FALARM SPEAKER TIME = 0.00 secs ( 0.0 percent of scored speaker time)
SPEAKER ERROR TIME = 0.00 secs ( 0.0 percent of scored speaker time)
SPEAKER ERROR WORDS = 10 (100.0 percent of scored speaker words)
---------------------------------------------
OVERALL SPEAKER DIARIZATION ERROR = 47.43 percent of scored speaker time `(ALL)
---------------------------------------------
Speaker type confusion matrix -- speaker weighted
REF\SYS (count) unknown MISS
unknown 2 / 50.0% 2 / 50.0%
FALSE ALARM 0 / 0.0%
---------------------------------------------
Speaker type confusion matrix -- time weighted
REF\SYS (seconds) unknown MISS
unknown 1.25 / 52.6% 1.13 / 47.4%
FALSE ALARM 0.00 / 0.0%
---------------------------------------------
|