It's still useful to have though, and Apple makes it really easy to install. GlimmerBlocker, Maple, Processing and a few game clients I use need it. It does seem that the default is that "Enable applet plug-in and Web Start applications" is off by default (in the Java Preferences app; there's no mention in System Preferences).
In general, however, if you know you need Java and how to install Java as a dependency then in all likelihood you're savvy enough to avoid being infected.
Apple still ships Java; it's just not installed by default. When you run a Java app without having Java installed, you get a prompt to automatically download and install Java.