Double click the blank box. A drop down opens. Move your cursor down until one is highlighted. Hit the delete key. If you want to get rid of all of them scroll to the bottom of the list and keep hitting delete.
Bingo. Follow what Chrisau said. That's called Windows AutoComplete...just need to delete the entries and if it annoys you, you can turn it off in your Internet Explorer Options.