Indeed. But, speaking of not scaring you away, sit back and consider what you actually need. 99 out of 100 websites (probably more) would be perfectly served by a stock VPS solution.
If you cover common+easy attack vectors like code injection and file uploads, you might not have any further practical concerns. For most sites, the number one security precaution is to make sure you have offsite backups and can quickly re-launch your site, with a minimal loss of data, from a clean start.