That's certainly not normal... are there like a hundred gazillion clips on that card? Try a freshly formatted card, switching to playback should be very quick.