[Hummingbird] Caching Issue

We used Weglot for multi-language, and there is its language switcher in the navigation menu, same on mobile.

When page cache is activated, everything on desktop is fine, but on mobile version, the language switcher will not work, instead of showing the actual button, it displays the short code of the widget.

I first troubleshoot with clear the page cache, then load the website on mobile phone, the language switcher is fine, once I go to a different page, it stops working and shows the shortcode. If I just deactive the page cache function, then everything fine again.

Wondering if there is a way to exclude the language switcher from being cached?