Whitelisting will also prevent people from trolling your server (lighting all your wood houses on fire for example), so it’s a good idea in general.