I'd say the optimal crossover depends on several things, rather than one single "correct" XO frequency.
The 170 SE bookshelves are 3 dB down at 58 Hz, but can dig a little deeper in most rooms. Some folks prefer to high-pass the loudspeaker at this point (F3). Others may want to cross higher for better sub/system integration, to avoid certain room modes, or to reduce strain on the woofer itself for high SPL playback. And some might prefer to run the speakers full-range (no crossover applied) because they don't have a sub or they prefer full-range playback.
In most rooms, I think a 60-80 Hz crossover would be work well for the 170s. I actually run my 170s full-range since it's a music-only system in my bedroom. For bass-heavy music at moderate volumes, I can see the fabric grill pulsing and the Ascend logo hopping about. This occurs because the 6.5" woofer is pushing and pulling the air in front of the loudspeaker. It's completely normal. The 170 woofer system is well-designed and quite robust. It won't hurt the speaker as long as you're not trying to peel paint off the walls with insane volume.
You mentioned applying an 80 Hz crossover and switching the speakers from "Large." Are you using a subwoofer? If not, and if this is music-only system, I don't see any harm in keeping them full-range. For movies, though, I'd recommend applying a crossover to reduce some of the deep bass going to the loudspeaker.