When I start typing a person's email address in To:, CC: or BCC:; the quick address bar provides a long list of contacts with whom I have had conversations before.
This long list contains list of both, temporary and permanent contacts (that I have personally added to the Contacts).

Is there any way out where I can remove my temporary contacted list of email addresses so that I get the desired result of persons from my Contacts, to whom I wish to send an email?