In preferences, go to display and sound and then click on the display mode drop down. There should be an option for windowed mode there.
 
Top