Sambapos 5.7.16 what does this button do and why it shows error?

You should follow the instructions for activating it by running license.exe according to here.

That button is supposed to launch license.exe but the new version you need to close sambaPOS while you run it.