GPS is a known battery killer, I keep mine off unless I actually need it (eg. using Navigation), then turn it back off. If I leave GPS on, "Maps" jumps up into the top 3 battery burners list even though I'm not actively using any Map-related apps.I reset today and everything is exactly back to how it was. I used to always use SmartStay on ICS with no problem, but I'll try turning it off too. The S-Voice setting makes a lot of sense though.
Only thing is Android System is generally the biggest battery killer for me. So I think it has something to do with either WiFi or GPS. Guess we'll find out...
I can't say I've explicitly isolated SmartStay as a heavy battery user, but given what it does (continually monitor the camera and run a pattern recognition algorithm to figure out if you're looking at the phone) it just seems like it would have to burn a fair amount of juice.