When playing DST, I encountered some trolls. The other people on the server and I would try to kick them, but they would leave before the vote was passed, therefore they were able to rejoin immediately and continue trolling. Maybe you, Klei, could make it to where if they leave in the middle of their vote, it counts as getting kicked. Likewise, you could also prevent them from leaving while they are on trial, so to speak.
In short, you can avoid the kick timer by leaving before you are kicked.
-player 1 votes to kick a player 2 -player 2 leaves while others are voting to kick him -player 2 rejoins the server