From what I remember from long ago, if it really is a non-accessory socket with the lighter, putting accessories into it will cause the socket to have a problem over time. Think what I did many years ago was to get an extension socket and then use the end of that instead.
I'm guessing that the socket would need to be replaced in your case.