Are torrents safe??

I've been told by many that downloading from torrent sites may result in a trojan attack!!!

Is it just another rumour or a fact??

If yes then what might be the best precautions??