Cold sores can be very nasty and are caused by a virus that is in the same family as the virus that causes genital herpes although it is not nearly as devastating. People say that you can get cold sores when you are at a low ebb fighting off some other infection for instance. Some people seem to get one after the other and some get them for a period in their lives and then not again.