I replace selenium rectifiers with type 1N4007 diodes, which are more than adequate and work fine. They cost a few cents. Take the old rectifier completely out of the circuit (don't bridge the diode across it).
Phil Nelson
Phil's Old Radios
http://antiqueradio.org/index.html