You may not be getting much yield because the soil is getting tired and needs nutrients...especially with a tree growing in it.
You could give it a good dose of manure and it might help.
If you want to make it meadow like you can buy a meadow flower seed mix...Chuck it on and let them grow! Something like this for example.