I missed that you only have 40 watts on a Class D amp in a small room. I used a Class D 30 watt amp on bookshelf speakers once and yeah, harsh is the first word I would use to describe it.

You should consider buying a more powerful amp. I love Emotiva amps, personally.