Nah, not really. The only real problem is if you handle old tubes once they have significant burn in times it's very easy to rub off the old silkscreening. Other than that the oils on your hand (unless your hands are simply ultra-nasty) are not likely to cause a significant problem with the durability of a tube - their glass if very thick and not likely to break from oil-heat related breakage. It's much more likely to break from drop/mishandling, and much more likely to simply outlive itself in usefullness than to be broken if handled properly at all.