Indeed. But, speaking of not scaring you away, sit back and consider what you actually need. 99 out of 100 websites (probably more) would be perfectly served by a stock VPS solution.
Totally true. I would say, get a VPS… Maybe chroot the LAMP stack and use best practices. Boom sauce. Done.