First, I don't recall there being a clocktower in... oh, you mean that cool telescope and pressure plate? No, we didn't swim in Noloben - I think it was more of a wade, no?
And as for Ahnonay - well, swimming to something that is not hidden and is not far away isn't so exciting, now, is it?