Negative reviews have a significant weight in the rate of your downloads, but a smart trick is that reviews are set to a version of the app, therefore if you update the app to a new version the negative reviews will no longer appear.