Well I'm new to Space SE and have gone through many questions but I couldn't help but notice that is it even remotely possible that one can touch the stars without burning him/her self ? Is there any kind of possibility ?
Surprisingly, yes, for some of them.
Small, old stars can be at room temperature ex: WISE 1828+2650, so you could touch the surface without getting burned.
Any star you can see in the sky with the naked eye, however, would be hot enough to destroy your body instantaneously if you came anywhere near them.
An article about cold stars:
No. While none exist to date it would be possible for a dead star to have cooled to a safe temperature. However, such objects are inherently supported by degeneracy pressure--they're very dense. Very heavy & very dense = very high surface gravity (typically 300,000+g.) While you're not burned you're squashed.
The low mass limit for a brown dwarf is 13 times Jupiter's mass. However, Jupiter is about as big as such things get, piling on more mass increases the pressure enough the size stays about constant. Jupiter's gravity is already 2.5g, for a constant size surface gravity scales linearly with mass, so a brown dwarf should have a surface gravity upwards of 30g. You're not quite so squashed as you were on the dead star but you're still squashed.
You might be touching a piece of one right now. Heavier elements, like gold, are formed when massive stars undergo a supernova at the end of their lives. During this gigantic explosion they fuse elements together to form heavier ones, which then get scattered out into space as dust, which eventually coalesces under gravity, forms a planet, and with a bit of luck, evolves life forms which mine and smelt that gold and turn it into jewelry. So if you have a gold ring or chain on you, spend a minute to think how it was made in the core of a dying star.
The outer layers of a red giant or supergiant star are, although hot, extremely tenuous. For instance VY Canis Majoris has an average density of a few $mg$ per cubic meter. It might be possible to dive through the outer parts of the star on a hyperbolic orbit and escape before your spacecraft picked up enough heat energy to be a problem. If you could do that, then you could put on a spacesuit with a small hole in one glove, and open up the cabin briefly. It would feel like the spot on your hand was exposed to vacuum (painful, but not immediately dangerous for a small spot) but technically I think you would be touching the star.