Well I may have fudged this one up.
The ground wire to the splitter outside the house and to the amp, was not properly grounded. So far since properly grounding it (and hopefully has nothing to do with being night time now), the signal has been FAR better.
http://i.imgur.com/f0EBZ9Y.jpg
EDIT: You know, a lot of websites say grounding an attic antenna is useless, but so far, it's proven to help a lot. I've been watching antenna TV, without one single breakup yet.