Do I need internet connection to use the switch all the times?

If you are using the switch from within your home Wi-Fi network, no internet connection is required. The internet connection is only required to setup the switch controller initially and to operate remotely.