This will be heavily abused by players.
Example 1: There is a convoy on a public server and there is a non-vtc member driving in the convoy. This is perfectly legal, but the VTC members may not like that so they will kick the player, when the player did nothing wrong.
Example 2: There are a group of friends who will all vote to kick each other as a joke.
Example 3: There is a player following a streamer, that streamer tells all of their viewers to vote kick the player, when the player violated no rules.
I could keep going on, just look at games that have/had implemented a vote kick system. You can find tons of articles of people complaining about it being abused. Additionally, a kick isn't going to do anything. On the rare chance that it is used without malicious intent, the player can just join right back.