Erin, I would suggest running a filter in your database to find everyone who does not have a tag, adding those folks to a list, and then deleting the contacts on that list. Check these resources for more info on how to do that!

http://nationbuilder.com/how_to_filter
http://nationbuilder.com/how_to_create_a_list#database