If you use the standard "Reply" option from your email, the email will go directly to the creator of the Announcement only. 

If you reply to an announcement email using the "Reply All" option and your administrator has allowed comments to be enabled for that group, then the reply will post publicly for all to see.