How can I upload video on webflow without hosting through some third party application like youtube and vimeo
You can’t. Either use the supported ones, or find a third party video content delivery solution or use a CDN to host the video files and use the native HTML5 video element.
I heard about a video hosting platform muse. Can we host video from that platform’