This happens with both the Released version and beta version. I use beta, and it is version 22.214.171.124. This only happens when you are in Book mode, aka two screens.
When you have the keyboard open, and you then open settings. This is what happens.
Settings opens on the opposite screen
If you attempt to swipe the settings window up, so that you can next swipe it off the screen to close, this will not work. The Settings window will remain whatever size it was left, you can interact with it, and the screen behind. But you must turn the screens off, wait a few seconds then turn back on to be able to remove the settings application. Sometimes, SurfaceQuickStep will stop responding.