Leaderboards

Since 2015, several approaches have been taken to Task 1, and even though the performances are increasing, there is still a lot to be done (see the Leaderboard for more detailed results).

Figure. 2. ZR Task 1 results on English ABX test sets (ABX-15: Conversational speech--Buckeye; ABX-17: Audiobooks--LibriVox). The left two scores are on MFCC representations. The right two scores have been trained on Librispeech 960. See [Systems Summary Table](/about/about/#systems_table_ref) for references and shortcode

ABX-15 Leaderboard

English Xitsonga
# Author Model ID across within across within
Table 1. ABX-15 Leaderboard

ABX-17 Leaderboard

English French Mandarin German Wolof
1s 10s 120s 1s 10s 120s 1s 10s 120s 1s 10s 120s 1s 10s 120s
# Author Model ID A W A W A W A W A W A W A W A W A W A W A W A W A W A W A W
# Author Model ID A W A W A W A W A W A W A W A W A W A W A W A W A W A W A W
1s 10s 120s 1s 10s 120s 1s 10s 120s 1s 10s 120s 1s 10s 120s
English French Mandarin German Wolof
Table 1. ABX-17 Leaderboard

ABX-LS Leaderboard

clean other
# Author Model ID Budget Set across within across within