Only in the way that taking it down would feel to me like I'd accepted they were right, if you get my drift?
I'm quite stubborn like that though.
At the end of the day it's better to have a good relationship with your client although I'd make it known they were wrong to accuse you of copyright infringement.