Smoke has to exit somewhere, whether out the stack, vents, or from leaks around the lid or elsewhere. As long as it exits above the grate level, it really doesn't matter. Unless the smoke is staining your grill and that bothers you, don't worry about it. It won't increase smoke flavor.