Time to face the music
When you are developing a product you need to see how people are using it. Don't be afraid of getting negative feedback or seeing how people don't use the product the way you want them to. It's obvious that testing tells you what is not working. Be careful not get too focused on feedback from people and carefully plan what you will change. I recommend you to read Steve Krung's “Don't Make Me Think” to learn how to think like a usability expert.