How can I switch my Public Profile picture?

I know I am missing something really simple here, but what if I don't want my public profile picture to be either my Twitter or Facebook picture?

Official response from Adriel Hampton

Presently you cannot switch this. Making the profiles easier to edit is definitely something we're looking at.