Character 'Y' switching between two keyboard layouts (cz -> rus)

[rampaq]

There is an issue with two keyboard layouts in 3.20210804.1/2, which was not present in previous versions.

I set a primary Czech (cz) keyboard and add a russian phonetic layout, toggled between by Alt+Shift.
setxkbmap -layout cz,cz -variant ,rus -option grp:alt_shift_toggle

Then a capital 'Y' types as russian 'Ы' for some reason.

echo "Y" | xdotool type --clearmodifiers --file -                                             
# output: Ы

echo "ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz" | xdotool type --clearmodifiers --file -                                             
# output: ABCDEFGHIJKLMNOPQRSTUVWXЫZabcdefghijklmnopqrstuvwxyz

What is interesting that this happens only with capital 'Y'. I thought that xdotool pushes the toggle switch command but that does not seem to be the case as setxkbmap -layout cz,cz -variant ,rus -option grp:alt_space_toggle (changed toggle key) behaves exactly the same.

However, when I change the primary layout to us then everything is ok:

setxkbmap -layout us,us -variant ,rus -option grp:alt_space_toggle
echo "ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz" | xdotool type --clearmodifiers --file -
ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz

And yes, the 'Y' is still ascii hex 59 on both cz, us keyboards.

Note: setxkbmap after setting the layout does not solve the problem, as was suggested by some in #97

setxkbmap -print output:

xkb_keymap {
        xkb_keycodes  { include "evdev+aliases(qwertz)" };
        xkb_types     { include "complete"      };
        xkb_compat    { include "complete"      };
        xkb_symbols   { include "pc+cz+cz(rus):2+inet(evdev)+group(alt_space_toggle)+group(alt_shift_toggle)+capslock(escape)"  };
        xkb_geometry  { include "pc(pc105)"     };
};

Is there some even hacky fix?

[jordansissel]

Weird key map problems in xdotool are An old but unsolved issue. Thank you for the great details in your report!

I don’t have any suggestions right now, but I am hopeful we can find a fix soon.

[rampaq]

Yes, but this is only a matter of the latest version, as I did not noticed any problems before.

In fact, it is caused by a supposed fix for Latin letters (PR #283). I built xdotool without that PR and it works! Quite baffled why does setting Shift modifier causes this, also only for this one 'Y' letter.

How does xdotool handle unicode characters btw?

Y = 59, Ы = (unicode) d0 ab
all hex, from hexdump

[jordansissel]

Oh that’s good to know — I’ll check on your test case (Y vs Ы, with and without #283) and see what I can find. I appreciate you testing the code in different ways to find a likely cause of the bug :)

…

On Sun, Aug 29, 2021 at 1:30 PM Tomáš Faikl ***@***.***> wrote: Yes, but this is only a matter of the latest version, as I did not noticed any problems before. In fact, it is caused by a supposed fix for Latin letters (PR #283 <#283>). I built xdotool without that PR and it works! Quite baffled why does setting Shift modifier causes this, also only for this one 'Y' letter. How does xdotool handle unicode characters btw? Y = 59, Ы = (unicode) d0 ab all hex, from hexdump — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#354 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AABAF2U5XODZ73VQJ7HNC53T7KKF7ANCNFSM5DANGGIA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

[jordansissel]

I tested this a bit and found that with your keymap, the 'Y' key is available two different ways. The first way is what xdotool chooses and it doesn't type it correctly (as you noted).

xdotool sends the "Shift" key then the Cyrillic_yeru ы key, when it should be sending a different sequence of modifiers (shift, alt, etc). I'll need to dig more to figure out what xdotool is doing wrong.

[rampaq]

Thanks for pursuing this further! If you need any testing, please let me know (I'm using 3.20160805.1-3 for now, haven't tested newer releases).