There was a discussion on this a few weeks ago but I don't recall what thread it was in.

The magnetic flux, or gauss, generated by the woofer's magnet is very minimal even right up against the cabinet. The CRT sets were extremely sensitive to any external magnetic fields and close proximity to a speaker could cause distortion on the screen and could become permanent with prolonged exposure.

I would not worry about it.