Probably didn't fertilize at the right time. You also need to trim it back so new branches sprout to get new fruit.

Did you lure in the wasps