Take your top 32* artists and pit them against each other in a knock-out style tournament. For each "match", randomly shuffle the artist's tracks and play the first track, that comes up. After you play both artist's tracks, the artist with the track you preferred goes forward, and so on and so forth.
Some other rules about tracks:
1. No track can be played twice
2. No live versions of a track to be played if there are album versions
Here's how my tournament went (artist play rank in brackets):
* I skipped my 29th artist Anneke van Giersbergen & Danny Cavanagh because the only thing they made together was one live album on which they play songs from their own albums and some covers. Instead I added my number 33, which is Nightwish.
1. Mariah Carey (27) VS Tori Amos (1)
Open Arms < Dragon
Not a fair fight to begin with. …