fwiw the syncing of email "recents" (aka everyone you email, even via email services that aren't apple) to iCloud is disableable if you use a mobile provisioning profile to add the imap account. doing it via the GUI sends all your contacts to Apple (if you're using iCloud).