Hmm, this sounds like an interesting idea. The only problem I could think of is, like you write, the final vote to decide who is going to leave.
However, I would hope the votes will be rather fair, depending on the outcome of the Last game rather than on something else.
And I definitively like the special victory conditions.
