Absolutely.
The thermostat slows down the flow of water through the radiator, to give it a chance to cool down before it returns to the engine. Removing the thermostat will cause a free flow of hot water through the radiator, which will return to the engine at nearly the same temperature and cause the engine to overheat in a short amount of time.