md_test25.output.saved
23.1 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
command line (run on 2004 Oct 29 at 14:17:54): ../src/md-eval-v19a.pl -af -e -D -d -W -w -t 1.0 -l 2 -u md_test25.uem -r md_test25.ref.rttm -s md_test25.sys.rttm
Word-based metadata alignment, max gap between matching words = 1.0 sec
Metadata evaluation parameters:
word-optimized metadata mapping
max gap between matching metadata events = 0.1 words
max extent to match for SU's = 2 words
Speaker Diarization evaluation parameters:
The max time to extend no-score zones for NON-LEX exclusions is 0.5 sec
The no-score collar at SPEAKER boundaries is 0 sec
Exclusion zones for evaluation and scoring are:
-----MetaData----- -----SpkrData-----
exclusion set name: DEFAULT DEFAULT DEFAULT DEFAULT
token type/subtype no-eval no-score no-eval no-score
(UEM) X X
LEXEME/un-lex X
NON-LEX/breath X
NON-LEX/cough X
NON-LEX/laugh X
NON-LEX/lipsmack X
NON-LEX/other X
NON-LEX/sneeze X
NOSCORE/<na> X X X X
NO_RT_METADATA/<na> X
SU/unannotated X
Word alignment and scoring details for channel 1 of file 20010206_1830_1900_ABC_WNT
ref del ins sub REF: token type tbeg tend speaker SYS: token type Rtbeg Rtend tbeg tend sys-speaker
1 - - 0 amyloid lex 1028.06 1028.58 tim_johnson amyloid lex (1028.06 1028.58) 1028.06 1028.58 tim_johnson
1 - - 0 the lex 1028.58 1028.76 tim_johnson the lex (1028.58 1028.76) 1028.58 1028.76 tim_johnson
1 - - 0 abnormal lex 1028.76 1029.17 tim_johnson abnormal lex (1028.76 1029.17) 1028.76 1029.17 tim_johnson
1 - - 0 protein lex 1029.17 1029.52 tim_johnson protein lex (1029.17 1029.52) 1029.17 1029.52 tim_johnson
1 - - 0 in lex 1029.52 1029.58 tim_johnson in lex (1029.52 1029.58) 1029.52 1029.58 tim_johnson
1 - - 0 the lex 1029.58 1029.65 tim_johnson the lex (1029.58 1029.65) 1029.58 1029.65 tim_johnson
1 - - 0 brain lex 1029.65 1029.92 tim_johnson brain lex (1029.65 1029.92) 1029.65 1029.92 tim_johnson
1 - - 0 unless lex 1029.96 1030.21 tim_johnson unless lex (1029.96 1030.21) 1029.96 1030.21 tim_johnson
1 - - 0 we lex 1030.21 1030.32 tim_johnson we lex (1030.21 1030.32) 1030.21 1030.32 tim_johnson
1 - - 0 find lex 1030.32 1030.62 tim_johnson find lex (1030.32 1030.62) 1030.32 1030.62 tim_johnson
1 - - 0 well lex 1031.19 1031.42 peter_jennin well lex (1031.19 1031.42) 1031.19 1031.42 peter_jennin
1 - - 0 those lex 1031.27 1031.42 tim_johnson those lex (1031.27 1031.42) 1031.27 1031.42 tim_johnson
1 - - 0 answers lex 1031.42 1031.81 tim_johnson answers lex (1031.42 1031.81) 1031.42 1031.81 tim_johnson
1 - - 0 so lex 1031.73 1031.90 peter_jennin so lex (1031.73 1031.90) 1031.73 1031.90 peter_jennin
1 - - 0 we're lex 1031.81 1031.94 tim_johnson we're lex (1031.81 1031.94) 1031.81 1031.94 tim_johnson
1 - - 0 doomed lex 1031.94 1032.07 tim_johnson doomed lex (1031.94 1032.07) 1031.94 1032.07 tim_johnson
1 - - 0 remind lex 1031.90 1032.24 peter_jennin remind lex (1031.90 1032.24) 1031.90 1032.24 peter_jennin
1 - - 0 us lex 1032.24 1032.30 peter_jennin us lex (1032.24 1032.30) 1032.24 1032.30 peter_jennin
1 - - 0 where lex 1032.30 1032.36 peter_jennin where lex (1032.30 1032.36) 1032.30 1032.36 peter_jennin
1 - - 0 we lex 1032.50 1032.70 peter_jennin we lex (1032.50 1032.70) 1032.50 1032.70 peter_jennin
1 - - 0 are un-lex 1032.70 1032.79 peter_jennin are un-lex (1032.70 1032.79) 1032.70 1032.79 peter_jennin
1 - - 0 are lex 1032.79 1032.97 peter_jennin are lex (1032.79 1032.97) 1032.79 1032.97 peter_jennin
1 - - 0 on lex 1032.97 1033.28 peter_jennin on lex (1032.97 1033.28) 1032.97 1033.28 peter_jennin
1 - - 0 drugs lex 1033.28 1033.65 peter_jennin drugs lex (1033.28 1033.65) 1033.28 1033.65 peter_jennin
1 - - 0 and lex 1033.65 1033.83 peter_jennin and lex (1033.65 1033.83) 1033.65 1033.83 peter_jennin
1 - - 0 early lex 1033.83 1034.06 peter_jennin early lex (1033.83 1034.06) 1033.83 1034.06 peter_jennin
1 - - 0 diagnosis lex 1034.06 1034.76 peter_jennin diagnosis lex (1034.06 1034.76) 1034.06 1034.76 peter_jennin
EDIT alignment and scoring details for channel 1 of file 20010206_1830_1900_ABC_WNT
ref del ins sub REF: token type tbeg tend speaker SYS: token type Rtbeg Rtend tbeg tend sys-speaker
1 - - 0 other EDIT 1032.70 1032.79 peter_jennin other EDIT (1032.70 1032.79) 1032.70 1032.79 peter_jennin
FILLER alignment and scoring details for channel 1 of file 20010206_1830_1900_ABC_WNT
ref del ins sub REF: token type tbeg tend speaker SYS: token type Rtbeg Rtend tbeg tend sys-speaker
1 - - 0 discourse_marker FILLER 1031.19 1031.42 peter_jennin discourse_marker FILLER (1031.19 1031.42) 1031.19 1031.42 peter_jennin
1 - - 0 discourse_marker FILLER 1031.73 1031.90 peter_jennin discourse_marker FILLER (1031.73 1031.90) 1031.73 1031.90 peter_jennin
IP alignment and scoring details for channel 1 of file 20010206_1830_1900_ABC_WNT
ref del ins sub REF: token type tbeg tend speaker SYS: token type Rtbeg Rtend tbeg tend sys-speaker
1 - - 0 filler IP 1031.19 1031.19 peter_jennin filler IP (1031.19 1031.19) 1031.19 1031.19 peter_jennin
1 - - 0 filler IP 1031.73 1031.73 peter_jennin filler IP (1031.73 1031.73) 1031.73 1031.73 peter_jennin
1 - - 0 edit IP 1032.79 1032.79 peter_jennin edit IP (1032.79 1032.79) 1032.79 1032.79 peter_jennin
SU alignment and scoring details for channel 1 of file 20010206_1830_1900_ABC_WNT
ref del ins sub REF: token type tbeg tend speaker SYS: token type Rtbeg Rtend tbeg tend sys-speaker
1 - - 0 statement SU 1029.96 1032.07 tim_johnson statement SU (1029.96 1032.07) 1029.96 1032.07 tim_johnson
1 - - 0 statement SU 1031.19 1034.76 peter_jennin statement SU (1031.19 1034.76) 1031.19 1034.76 peter_jennin
Chronological display of sys data aligned with ref data for file '20010206_1830_1900_ABC_WNT', channel '1'
----------------------- reference ----------------------- | mapped | --------------------- system output ---------------------
--type-- -subtyp- -----word/spkr----- -tbeg- -tend- | ref_ID | --type-- -subtyp- -----word/spkr----- -tbeg- -tend-
beg SPEAKER adult_ma tim_johnson 1028.06 | |
1028.06 | |beg SPEAKER adult_ma tim_johnson=>tim_jo 1028.06
LEXEME lex AMYLOID 1028.06 1028.58 | LX1 | LEXEME lex AMYLOID 1028.06 1028.58
CB clausal tim_johnson 1028.58 | |
LEXEME lex THE 1028.58 1028.76 | LX2 | LEXEME lex THE 1028.58 1028.76
LEXEME lex ABNORMAL 1028.76 1029.17 | LX3 | LEXEME lex ABNORMAL 1028.76 1029.17
LEXEME lex PROTEIN 1029.17 1029.52 | LX4 | LEXEME lex PROTEIN 1029.17 1029.52
LEXEME lex IN 1029.52 1029.58 | LX5 | LEXEME lex IN 1029.52 1029.58
LEXEME lex THE 1029.58 1029.65 | LX6 | LEXEME lex THE 1029.58 1029.65
LEXEME lex BRAIN 1029.65 1029.92 | LX7 | LEXEME lex BRAIN 1029.65 1029.92
beg SU statemen tim_johnson 1029.96 | SU1 |beg SU statemen tim_johnson=>tim_jo 1029.96
LEXEME lex UNLESS 1029.96 1030.21 | LX8 | LEXEME lex UNLESS 1029.96 1030.21
LEXEME lex WE 1030.21 1030.32 | LX9 | LEXEME lex WE 1030.21 1030.32
LEXEME lex FIND 1030.32 1030.62 | LX10 | LEXEME lex FIND 1030.32 1030.62
end SPEAKER adult_ma tim_johnson 1030.62 | |
1030.62 | |end SPEAKER adult_ma tim_johnson=>tim_jo 1030.62
beg SEGMENT <na> peter_jennings 1031.15 | |
beg SPEAKER adult_ma peter_jennings 1031.19 | |
1031.19 | |beg SPEAKER adult_ma peter_jennings=>pet 1031.19
beg SU statemen peter_jennings 1031.19 | SU2 |beg SU statemen peter_jennings=>pet 1031.19
beg FILLER discours peter_jennings 1031.19 | FL1 |beg FILLER discours peter_jennings=>pet 1031.19
IP filler peter_jennings 1031.19 | IP1 | IP filler peter_jennings=>pet 1031.19
beg LEXEME lex WELL 1031.19 | LX11 |beg LEXEME lex WELL 1031.19
beg SPEAKER adult_ma tim_johnson 1031.27 | |
1031.27 | |beg SPEAKER adult_ma tim_johnson=>tim_jo 1031.27
beg LEXEME lex THOSE 1031.27 | LX12 |beg LEXEME lex THOSE 1031.27
end LEXEME lex WELL 1031.42 | LX11 |
end LEXEME lex THOSE 1031.42 | LX12 |
1031.42 | LX11 |end LEXEME lex WELL 1031.42
1031.42 | LX12 |end LEXEME lex THOSE 1031.42
end FILLER discours peter_jennings 1031.42 | FL1 |end FILLER discours peter_jennings=>pet 1031.42
end SPEAKER adult_ma peter_jennings 1031.42 | |
1031.42 | |end SPEAKER adult_ma peter_jennings=>pet 1031.42
beg LEXEME lex ANSWERS 1031.42 | LX13 |beg LEXEME lex ANSWERS 1031.42
beg SPEAKER adult_ma peter_jennings 1031.73 | |
1031.73 | |beg SPEAKER adult_ma peter_jennings=>pet 1031.73
beg FILLER discours peter_jennings 1031.73 | FL2 |beg FILLER discours peter_jennings=>pet 1031.73
IP filler peter_jennings 1031.73 | IP2 | IP filler peter_jennings=>pet 1031.73
beg LEXEME lex SO 1031.73 | LX14 |beg LEXEME lex SO 1031.73
end LEXEME lex ANSWERS 1031.81 | LX13 |end LEXEME lex ANSWERS 1031.81
CB clausal tim_johnson 1031.81 | |
beg LEXEME lex WE'RE 1031.81 | LX15 |beg LEXEME lex WE'RE 1031.81
end LEXEME lex SO 1031.90 | LX14 |end LEXEME lex SO 1031.90
end FILLER discours peter_jennings 1031.90 | FL2 |end FILLER discours peter_jennings=>pet 1031.90
beg LEXEME lex REMIND 1031.90 | LX17 |beg LEXEME lex REMIND 1031.90
end LEXEME lex WE'RE 1031.94 | LX15 |end LEXEME lex WE'RE 1031.94
LEXEME lex DOOMED 1031.94 1032.07 | LX16 | LEXEME lex DOOMED 1031.94 1032.07
end SU statemen tim_johnson 1032.07 | SU1 |end SU statemen tim_johnson=>tim_jo 1032.07
end SPEAKER adult_ma tim_johnson 1032.07 | |
1032.07 | |end SPEAKER adult_ma tim_johnson=>tim_jo 1032.07
end LEXEME lex REMIND 1032.24 | LX17 |end LEXEME lex REMIND 1032.24
LEXEME lex US 1032.24 1032.30 | LX18 | LEXEME lex US 1032.24 1032.30
LEXEME lex WHERE 1032.30 1032.36 | LX19 | LEXEME lex WHERE 1032.30 1032.36
LEXEME lex WE 1032.50 1032.70 | LX20 | LEXEME lex WE 1032.50 1032.70
beg EDIT other peter_jennings 1032.70 | ED1 |beg EDIT other peter_jennings=>pet 1032.70
LEXEME un-lex ARE 1032.70 1032.79 | LX21 | LEXEME un-lex ARE 1032.70 1032.79
end EDIT other peter_jennings 1032.79 | ED1 |end EDIT other peter_jennings=>pet 1032.79
IP edit peter_jennings 1032.79 | IP3 | IP edit peter_jennings=>pet 1032.79
LEXEME lex ARE 1032.79 1032.97 | LX22 | LEXEME lex ARE 1032.79 1032.97
LEXEME lex ON 1032.97 1033.28 | LX23 | LEXEME lex ON 1032.97 1033.28
LEXEME lex DRUGS 1033.28 1033.65 | LX24 | LEXEME lex DRUGS 1033.28 1033.65
LEXEME lex AND 1033.65 1033.83 | LX25 | LEXEME lex AND 1033.65 1033.83
LEXEME lex EARLY 1033.83 1034.06 | LX26 | LEXEME lex EARLY 1033.83 1034.06
LEXEME lex DIAGNOSIS 1034.06 1034.76 | LX27 | LEXEME lex DIAGNOSIS 1034.06 1034.76
end SU statemen peter_jennings 1034.76 | SU2 |end SU statemen peter_jennings=>pet 1034.76
end SPEAKER adult_ma peter_jennings 1034.76 | |
1034.76 | |end SPEAKER adult_ma peter_jennings=>pet 1034.76
end SEGMENT <na> peter_jennings 1034.88 | |
*** Performance analysis for EDITs *** overall error SCORE = 0.00%
EDIT word coverage statistics -- in terms of reference words
Nref Ndel Nins Nsub %Del %Ins %Sub %D+I %Tot
ALL 0 0 0 0 0.00 0.00 0.00 0.00 0.00
EDIT detection statistics -- in terms of # of EDITs
Nref Ndel Nins Nsub %Del %Ins %Sub %D+I %Tot
ALL 1 0 0 0 0.00 0.00 0.00 0.00 0.00
f=20010206_1830_1900_ABC_WNT 1 0 0 0 0.00 0.00 0.00 0.00 0.00
EDIT detection confusion matrix -- in terms of # of EDITs
ALL - ref\sys other {Miss}
other 1 0
{FA} 0
EDIT word offset statistics for ALL data
word offsets: <-3 -3 -2 -1 0 1 2 3 >3
BEG: 0 - - - 1 - - - 0
END: 0 - - - 1 - - - 0
*** Performance analysis for FILLERs *** overall error SCORE = 0.00%
FILLER word coverage statistics -- in terms of reference words
Nref Ndel Nins Nsub %Del %Ins %Sub %D+I %Tot
ALL 4 0 0 0 0.00 0.00 0.00 0.00 0.00
FILLER detection statistics -- in terms of # of FILLERs
Nref Ndel Nins Nsub %Del %Ins %Sub %D+I %Tot
ALL 2 0 0 0 0.00 0.00 0.00 0.00 0.00
f=20010206_1830_1900_ABC_WNT 2 0 0 0 0.00 0.00 0.00 0.00 0.00
FILLER detection confusion matrix -- in terms of # of FILLERs
ALL - ref\sys discours {Miss}
discourse_marker 2 0
{FA} 0
FILLER word offset statistics for ALL data
word offsets: <-3 -3 -2 -1 0 1 2 3 >3
BEG: 0 - - - 2 - - - 0
END: 0 - - - 2 - - - 0
*** Performance analysis for IPs *** overall error SCORE = 0.00%
IP (exact) detection statistics -- in terms of reference words
Nref Ndel Nins Nsub %Del %Ins %Sub %D+I %Tot
ALL 3 0 0 0 0.00 0.00 0.00 0.00 0.00
IP detection statistics -- in terms of # of IPs
Nref Ndel Nins Nsub %Del %Ins %Sub %D+I %Tot
ALL 3 0 0 0 0.00 0.00 0.00 0.00 0.00
f=20010206_1830_1900_ABC_WNT 3 0 0 0 0.00 0.00 0.00 0.00 0.00
IP detection confusion matrix -- in terms of # of IPs
ALL - ref\sys edit filler {Miss}
edit 1 0 0
filler 0 2 0
{FA} 0 0
IP word offset statistics for ALL data
word offsets: <-3 -3 -2 -1 0 1 2 3 >3
BEG: 0 - - - 3 - - - 0
END: 0 - - - 3 - - - 0
*** Performance analysis for SUs *** overall error SCORE = 0.00%
SU (exact) end detection statistics -- in terms of reference words
Nref Ndel Nins Nsub %Del %Ins %Sub %D+I %Tot
ALL 2 0 0 0 0.00 0.00 0.00 0.00 0.00
SU detection statistics -- in terms of # of SUs
Nref Ndel Nins Nsub %Del %Ins %Sub %D+I %Tot
ALL 2 0 0 0 0.00 0.00 0.00 0.00 0.00
f=20010206_1830_1900_ABC_WNT 2 0 0 0 0.00 0.00 0.00 0.00 0.00
SU detection confusion matrix -- in terms of # of SUs
ALL - ref\sys statemen {Miss}
statement 2 0
{FA} 0
SU word offset statistics for ALL data
word offsets: <-3 -3 -2 -1 0 1 2 3 >3
BEG: 0 - - - 2 - - - 0
END: 0 - - - 2 - - - 0
*** Performance analysis for Speaker Diarization for f=20010206_1830_1900_ABC_WNT ***
EVAL TIME = 243.11 secs
EVAL SPEECH = 6.13 secs ( 2.5 percent of evaluated time)
SCORED TIME = 243.11 secs (100.0 percent of evaluated time)
SCORED SPEECH = 6.13 secs ( 2.5 percent of scored time)
EVAL WORDS = 27
SCORED WORDS = 27 (100.0 percent of evaluated words)
---------------------------------------------
MISSED SPEECH = 0.00 secs ( 0.0 percent of scored time)
FALARM SPEECH = 0.00 secs ( 0.0 percent of scored time)
MISSED WORDS = 0 ( 0.0 percent of scored words)
---------------------------------------------
SCORED SPEAKER TIME = 6.62 secs (108.0 percent of scored speech)
MISSED SPEAKER TIME = 0.00 secs ( 0.0 percent of scored speaker time)
FALARM SPEAKER TIME = 0.00 secs ( 0.0 percent of scored speaker time)
SPEAKER ERROR TIME = 0.00 secs ( 0.0 percent of scored speaker time)
SPEAKER ERROR WORDS = 0 ( 0.0 percent of scored speaker words)
---------------------------------------------
OVERALL SPEAKER DIARIZATION ERROR = 0.00 percent of scored speaker time `(f=20010206_1830_1900_ABC_WNT)
---------------------------------------------
Speaker type confusion matrix -- speaker weighted
REF\SYS (count) adult_male MISS
adult_male 2 / 100.0% 0 / 0.0%
FALSE ALARM 0 / 0.0%
---------------------------------------------
Speaker type confusion matrix -- time weighted
REF\SYS (seconds) adult_male MISS
adult_male 6.62 / 100.0% 0.00 / 0.0%
FALSE ALARM 0.00 / 0.0%
---------------------------------------------
*** Performance analysis for Speaker Diarization for ALL ***
EVAL TIME = 243.11 secs
EVAL SPEECH = 6.13 secs ( 2.5 percent of evaluated time)
SCORED TIME = 243.11 secs (100.0 percent of evaluated time)
SCORED SPEECH = 6.13 secs ( 2.5 percent of scored time)
EVAL WORDS = 27
SCORED WORDS = 27 (100.0 percent of evaluated words)
---------------------------------------------
MISSED SPEECH = 0.00 secs ( 0.0 percent of scored time)
FALARM SPEECH = 0.00 secs ( 0.0 percent of scored time)
MISSED WORDS = 0 ( 0.0 percent of scored words)
---------------------------------------------
SCORED SPEAKER TIME = 6.62 secs (108.0 percent of scored speech)
MISSED SPEAKER TIME = 0.00 secs ( 0.0 percent of scored speaker time)
FALARM SPEAKER TIME = 0.00 secs ( 0.0 percent of scored speaker time)
SPEAKER ERROR TIME = 0.00 secs ( 0.0 percent of scored speaker time)
SPEAKER ERROR WORDS = 0 ( 0.0 percent of scored speaker words)
---------------------------------------------
OVERALL SPEAKER DIARIZATION ERROR = 0.00 percent of scored speaker time `(ALL)
---------------------------------------------
Speaker type confusion matrix -- speaker weighted
REF\SYS (count) adult_male MISS
adult_male 2 / 100.0% 0 / 0.0%
FALSE ALARM 0 / 0.0%
---------------------------------------------
Speaker type confusion matrix -- time weighted
REF\SYS (seconds) adult_male MISS
adult_male 6.62 / 100.0% 0.00 / 0.0%
FALSE ALARM 0.00 / 0.0%
---------------------------------------------