Stereo speakers far too sensitive

[lnx64]

Ok so this is my bedroom setup: https://imgur.com/a/EcJuOFp

The amp/receiver is a Fisher RS-1052, and the speakers are my fathers old Pioneer's that I replaced the crossovers on (I built my own). Before the crossover mod and after, it has one issue with this Fisher, it's just too damn sensitive. I turn the volume just one little speck up and it's already blasting and rattling the room. I'd like to have more control obviously over the volume and not have, off, a little quiet, and omg my eardrums, considering there's an entire range of the knob.

I did try connecting my oscilloscope to the speaker terminals with only a dummy load attached to verify the volume knob isn't broken, and no, it has a very linear range, so apparently this amp is just so damn loud I guess, but with these speakers there's no room whatsoever.

Considering the amp is 50ish watts, and the speakers "claim" 150 watts, I'm surprised it's this loud at all off one indent on the volume knob.

I was figuring maybe on my crossover, I should design an LPAD attenuator for it perhaps?

(The stock crossover was garbage, low pass, and two high pass filters, the mid was on a high pass as well, and they were designed with the crossover well above where mids should be, so it always had a built in EQ "V" curve, and I hated it. I redesigned the crossover to be more flat in the response, so my tone controls on the receiver can be in the middle and it actually sound correct, and it does now, because watching movies on it sounds very much like a proper movie theater which is funny, these speakers don't sound that bad for MDF construction and being "Rack" speakers, once it had a properly designed bandpass for the mids, and adjusted the high pass for the tweeter).

If I go an LPAD route, about how many dB of attenuation should I be aiming for?

To give a better understanding of the limited volume range, the knob goes up to 10, but at 2 it's already rattling windows and making the CD player skip, it's THAT loud. Though, when I look at pictures of other people using a Fisher RS-1052, they seem to have theirs at 2 as well like this is apparently common with this receiver no matter what speakers are used.