You can adjust this feature in the Phone app by going to More > Settings > Caller ID announcement > Announce caller ID. Most people should probably choose Only when using a headset, which can save you ...