Although, if the evidence is damning and you don't want it found, keeping it on your person is not the worst idea. That way you know the only way they find any evidence is if they find you.

Even if you try to destroy the evidence, evidence of you destroying the evidence works just as well for a lot of cases.