When I started out, I preferred to watch my films without music, as its presence tends to mask the underlying pace of the film. I felt I could feel the rhythm of the film better without music to influence me.
The sound is the key; audiences will accept visual discontinuity much more easily than they'll accept jumps in the sound. If the track makes sense, you can do almost anything visually.