Usually the entire mp4 file will have to be downloaded before it begins playing. However, with instant playing encoding enabled, you can play the video before the entire video has downloaded. You can research how to encode videos to play instantly if you wish to do this.