In my case the problem was caused by long list of configured networks.

wifimanager list

I removed old wifi configurations using

wifimanager remove -ssid <ssid>

left only 2 up there and it works!