It all depends on the condition of your battery, however if you have a decent to great battery Justin is correct, that voltage drain is not going to kill your battery, besides again like Justin said, once your i-Pod, cell phone, or whatever is charged to max capacity the charging stops.
My lighter plug in the roadster is wired to the switch, if the car is off the plug is dead.