-
-
Notifications
You must be signed in to change notification settings - Fork 2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Test case for https://github.com/keymanapp/status.keyman.com/issues/264 #12
Comments
User Test ResultsTest specification and instructions ⬜ SUITE_INSPECT: Visual Inspection of master/beta branches
✅ SUITE_INSTALLATION: Basic installation35 tests in 5 groups PASSED
✅ SUITE_UI: Keyman Configuration dialog3 tests in 1 groups PASSED🟥 SUITE_OSK: On Screen Keyboard tests
✅ SUITE_CLI: Command line tools35 tests in 1 groups PASSED
🟥 SUITE_KBDS: Verify specific keyboards
✅ SUITE_UNINSTALL: Uninstallation5 tests in 5 groups PASSED
✅ SUITE_UPDATE: Update an existing installation4 tests in 4 groups PASSED
Results Template
|
SUITE_INSTALLATION: Basic installationGROUP_BIONIC: Ubuntu 18.04 Bionic with Gnome Shell and X11
|
SUITE_UI: Keyman Configuration dialog
|
SUITE_OSK: On Screen Keyboard testsGROUP_BIONIC: Ubuntu 18.04 Bionic with Gnome Shell and X11
|
SUITE_CLI: Command line tools
|
SUITE_INSTALLATION: Basic installationGROUP_FOCAL: Ubuntu 20.04 Focal with Gnome Shell and X11
|
SUITE_INSTALLATION: Basic installationGROUP_WASTA: Wasta 20.04 with Cinnamon
|
SUITE_OSK: On Screen Keyboard testsGROUP_WASTA: Wasta 20.04 with Gnome Shell and X11
|
SUITE_KBDS: Verify specific keyboardsGROUP_BIONIC: Ubuntu 18.04 Bionic with Gnome Shell and X11
|
SUITE_KBDS: Verify specific keyboardsGROUP_FOCAL: Ubuntu 20.04 Focal with Gnome Shell and X11
|
SUITE_KBDS: Verify specific keyboardsGROUP_WASTA: Wasta 20.04 with Cinnamon
|
SUITE_INSTALLATION: Basic installationGROUP_JAMMY_X11: Ubuntu 22.04 Jammy with Gnome Shell and X11
GROUP_JAMMY_WAYLAND: Ubuntu 22.04 Jammy with Gnome Shell and Wayland
|
SUITE_OSK: On Screen Keyboard testsGROUP_JAMMY_X11: Ubuntu 22.04 Jammy with Gnome Shell and X11
GROUP_JAMMY_WAYLAND: Ubuntu 22.04 Jammy with Gnome Shell and Wayland
|
SUITE_UNINSTALL: UninstallationGROUP_FOCAL: Ubuntu 20.04 Focal with Gnome Shell and X11
SUITE_UPDATE: Update an existing installationGROUP_FOCAL: Ubuntu 20.04 Focal with Gnome Shell and X11
|
SUITE_UNINSTALL: UninstallationGROUP_WASTA: Wasta 20.04 with Cinnamon
SUITE_UPDATE: Update an existing installationGROUP_WASTA: Wasta 20.04 with Cinnamon
|
SUITE_UNINSTALL: UninstallationGROUP_JAMMY_X11: Ubuntu 22.04 Jammy with Gnome Shell and X11
GROUP_JAMMY_WAYLAND: Ubuntu 22.04 Jammy with Gnome Shell and Wayland
SUITE_UPDATE: Update an existing installationGROUP_JAMMY: Ubuntu 22.04 Jammy with Gnome Shell and X11 or Wayland
|
SUITE_UPDATE: Update an existing installationGROUP_BIONIC: Ubuntu 18.04 Bionic with Gnome Shell and X11
|
@keymanapp-test-bot retest SUITE_OSK GROUP_BIONIC TEST_OSK |
Please retest. I've tested them and they are working for me with @keymanapp-test-bot retest SUITE_OSK GROUP_JAMMY_X11 TEST_OSK, SUITE_OSK GROUP_JAMMY_WAYLAND TEST_OSK, SUITE_OSK GROUP_WASTA TEST_OSK |
Okay, I will retest it and will post my result. Thanks. |
@keymanapp-test-bot retest all Tested all again because tests for Gnome were not tested previously. |
SUITE_INSPECT: Visual Inspection of master/beta branches
|
SUITE_UNINSTALL: UninstallationGROUP_BIONIC: Ubuntu 18.04 Bionic with Gnome Shell and X11
SUITE_UPDATE: Update an existing installationGROUP_BIONIC: Ubuntu 18.04 Bionic with Gnome Shell and X11
|
SUITE_INSTALLATION: Basic installationGROUP_FOCAL: Ubuntu 20.04 Focal with Gnome Shell and X11
|
SUITE_OSK: On Screen Keyboard testsGROUP_FOCAL: Ubuntu 20.04 Focal with Gnome Shell and X11
|
SUITE_KBDS: Verify specific keyboardsGROUP_FOCAL: Ubuntu 20.04 Focal with Gnome Shell and X11
|
SUITE_CLI: Command line tools
|
SUITE_UNINSTALL: UninstallationGROUP_FOCAL: Ubuntu 20.04 Focal with Gnome Shell and X11
SUITE_UPDATE: Update an existing installationGROUP_FOCAL: Ubuntu 20.04 Focal with Gnome Shell and X11
|
SUITE_INSTALLATION: Basic installationGROUP_WASTA: Wasta 20.04 with Cinnamon
|
SUITE_KBDS: Verify specific keyboardsGROUP_WASTA: Wasta 20.04 with Cinnamon
|
SUITE_UNINSTALL: UninstallationGROUP_WASTA: Wasta 20.04 with Cinnamon
SUITE_UPDATE: Update an existing installationGROUP_WASTA: Wasta 20.04 with Cinnamon
|
SUITE_OSK: On Screen Keyboard testsGROUP_WASTA: Wasta 20.04 with Gnome Shell and X11
|
SUITE_INSTALLATION: Basic installationGROUP_JAMMY_WAYLAND: Ubuntu 22.04 Jammy with Gnome Shell and Wayland
|
SUITE_KBDS: Verify specific keyboardsGROUP_JAMMY_WAYLAND: Ubuntu 22.04 Jammy with Gnome Shell and Wayland
|
SUITE_OSK: On Screen Keyboard testsGROUP_JAMMY_X11: Ubuntu 22.04 Jammy with Gnome Shell and X11
GROUP_JAMMY_WAYLAND: Ubuntu 22.04 Jammy with Gnome Shell and Wayland
|
SUITE_INSTALLATION: Basic installationGROUP_JAMMY_X11: Ubuntu 22.04 Jammy with Gnome Shell and X11
|
SUITE_KBDS: Verify specific keyboardsGROUP_JAMMY_X11: Ubuntu 22.04 Jammy with Gnome Shell and X11
|
SUITE_UNINSTALL: UninstallationGROUP_JAMMY_X11: Ubuntu 22.04 Jammy with Gnome Shell and X11
GROUP_JAMMY_WAYLAND: Ubuntu 22.04 Jammy with Gnome Shell and Wayland
SUITE_UPDATE: Update an existing installationGROUP_JAMMY: Ubuntu 22.04 Jammy with Gnome Shell and X11 or Wayland
|
Please check @keymanapp-test-bot retest SUITE_INSPECT TEST_VERIFY_HISTORY |
Does this also happen after you reboot the VM? |
I added a section to the "Setup" step to change the complex text layout settings in LibreOffice which is required for TEST_KM_WRITER. Can you please retest? @keymanapp-test-bot retest SUITE_KBDS TEST_KM_WRITER |
Okay, I have retested this and I was able to see the updated History file. :-) Thanks. |
SUITE_INSTALLATION: Basic installationGROUP_BIONIC: Ubuntu 18.04 Bionic with Gnome Shell and X11
|
No, . Retested this with the latest Keyman 15.0.528 beta build and it seems to be working fine. |
@ermshiperete The screen keyboard you can enable in the Accessibility dialog doesn't support Keyman. You'll have to install @keymanapp-test-bot retest SUITE_OSK GROUP_JAMMY_X11 TEST_OSK TEST_OSK_CONFIG, SUITE_OSK GROUP_JAMMY_WAYLAND all |
Keyman for Linux Acceptance Test Procedures
>
at the start of a new line under the checkbox to note the result. (For an example, see #3973).Gather Assets for Testing
click to expand
Either VM or physical machine will work.
Ubuntu 18.04 Bionic with Gnome Shell and X11
Ubuntu 20.04 Focal with Gnome Shell and X11
Ubuntu 22.04 Jammy with Gnome Shell and X11
Expand to see how to do and verify this
when login in, click the cog and select "Ubuntu on Xorg"
verify that you're using X11 by running the following command in a terminal:
This should output
x11
.Ubuntu 22.04 Jammy with Gnome Shell and Wayland
Expand to see how to do and verify this
when login in, click the cog and select "Ubuntu" (not "Ubuntu on Xorg")
verify that you're using Wayland by running the following command in a terminal:
This should output
wayland
.Wasta 20.04 with Cinnamon
Setup Steps
click to expand
Install latest updates on the system:
On Ubuntu 18.04 Bionic use the following commands instead:
Uninstall previous versions of Keyman for Linux on the system:
On Ubuntu 18.04 Bionic use these commands instead:
Remove left-over artifacts by running:
rm -rf ~/.local/share/keyman/ sudo rm -rf /usr/local/share/keyman/
Remove all keyboards from Input Sources that except "English (US)"
Add the ppa (for pre-beta tests, replace
keyman-beta
withkeyman-alpha
):Add a second non-Keyman keyboard so that the language/keyboard dropdown shows (these are the steps for Ubuntu; for Wasta they are similar):
Expand to see the steps
From Ubuntu, start "Settings" --> "Region & Language" (in newer Ubuntu versions: "Settings" --> "Keyboard"; on Wasta Linux open IBus Preferences which can be opened by typing "ibus keyboards").
Below "Input Sources" click the "+" and then the three dots:
in the search field, type "French" (or any other language), "Other" and then of the French keyboards and finally the "Add" button.
now the language/keyboard dropdown will show. If not, reboot.
Reboot
Change "Complex text layout" setting in LibreOffice Writer:
Expand to see the steps
In LO Tools/Options, go to the Language Settings/Languages tab. Under "Default Languages for Documents" check the box for Complex text layout and select Khmer as language.
You'll also have to change the default style: go to Styles/Manage Styles, right-click on "Default Paragraph Style" and select Modify. Go to the Font tab. For CTL Font, select Family "Khmer Mondulkiri" (or another "Khmer" font) and Language "Khmer".
User Testing
click to expand
SUITE_INSPECT: Visual Inspection of master/beta branches
/HISTORY.md
contains all the current changesSUITE_INSTALLATION: Basic installation
NOTE: The login screen allows you to select different environments by clicking on the cog symbol. Different Ubuntu versions put it in different places and use slightly different icons. In the groups below the menu item to select is put in parenthesis and quotes, e.g. Ubuntu 18.04 Bionic with Gnome Shell and X11 ("Ubuntu").
Tests
TEST_INSTALL: Install keyman and onboard
in a terminal window, run:
verify that this works without showing any error
TEST_START: From the launcher, start "Keyman Configuration"
TEST_KB_INSTALL: Download and install a keyboard
TEST_KB_ADDED: Verify the installed appears in the keyboard dropdown
(with language name (Khmer) and "Khmer Angkor" as the keyboard name)
TEST_KB_WORKS: Verify that typing with Keyman keyboard works in gedit
Type Windows-spacebar (on Ubuntu 18.04 Bionic: Ctrl-spacebar) to switch to the Khmer Angkor keyboard
verify that the language tag "km" appears in the taskbar
Open the text editor (gedit), verify that the newly installed keyboard can type
Open LibreOffice Writer, verify that the newly installed keyboard can type
Type Windows-spacebar to switch back to English keyboard
TEST_KB_ICELANDIC: Add a keyboard for an additional language
:a
should result inä
)TEST_KB_INST_PKG: Install a package from disk
sil_ipa.kmp
keyboard linked after "Package Download".sil_ipa.kmp
file on disk and click "Open" to install itNote: you might have to close and re-open the Settings dialog if you still had it open to properly show the keyboards
n>
should result inŋ
SUITE_UI: Keyman Configuration dialog
It is sufficient to run these tests on one platform only.
TEST_UI_ABOUT: About keyboard
TEST_UI_HELP: Keyboard help
TEST_UI_OPTIONS: Options
SUITE_OSK: On Screen Keyboard tests
Tests
TEST_OSK: On Screen Keyboard tests
TEST_OSK_CONFIG: On Screen Keyboard configuration
SUITE_CLI: Command line tools
It is sufficient to run these tests on one platform only.
Run the following tests in a terminal window.
km-package-get
km-package-get
. Verify that you get an error message.km-package-get hieroglyphic
. Verify the file~/.cache/keyman/hieroglyphic.kmp
got downloaded.man km-package-get
. Verify it shows the manual page explaining the parameters.km-package-install
km-package-install
. Verify that you get an error message.km-package-install -p sil_korda_jamo
. Verify that this adds the "Korean KORDA Jamo (SIL)" keyboard to the keyboard dropdown.sudo km-package-install -s -f ~/.cache/keyman/hieroglyphic.kmp
. Verify that this adds the "Hieroglyphic" keyboard for ancient Egyptian to the keyboard dropdown.km-package-install -p gff_ahmha
and pressTAB
key. Verify that this completes the command tokm-package-install -p gff_ahmharic
.man km-package-install
. Verify it shows the manual page explaining the parameters.km-package-list-installed
km-package-list-installed
. Verify that it lists the keyboards you previously installed.km-package-list-installed -u
. Verify you get the same list as in the previous test.km-package-list-installed --long
. Verify that it lists the keyboards you previously installed, displaying details for each keyboard.km-package-list-installed -s
. This should show the Hieroglyphic keyboard as the only one under "Installed shared Keyman keyboard packages".km-package-list-installed -o
. There should be no keyboards under "Installed OS Keyman keyboard packages".man km-package-list-installed
. Verify it shows the manual page explaining the parameters.km-kvk2ldml
km-kvk2ldml
. Verify that you get an error message.km-kvk2ldml -o /tmp/test.ldml ~/.local/share/keyman/khmer_angkor/khmer_angkor.kvk
. Verify that this creates the file/tmp/test.ldml
.km-kvk2ldml -p ~/.local/share/keyman/khmer_angkor/khmer_angkor.kvk
. Verify that this prints information about the keyboard.km-kvk2ldml -k -p ~/.local/share/keyman/khmer_angkor/khmer_angkor.kvk
. Verify that in addition to the information about the keyboard it prints the keys contained in the keyboard.man km-kvk2ldml
. Verify it shows the manual page explaining the parameters.km-package-uninstall
km-package-uninstall
. Verify that you get an error message.km-package-uninstall sil_euro_latin
~/.local/share/keyman/sil_euro_latin
no longer existssudo km-package-uninstall -s hieroglyphic
/usr/local/share/keyman/hieroglyphic
no longer existsman km-package-uninstall
. Verify it shows the manual page explaining the parameters.km-config
km-config
. Verify that it opens the "Keyman Configuration" dialog.km-config --version
. Verify that it outputs the version number.km-config -i file://$HOME/.cache/keyman/hieroglyphic.kmp
. Verify that this opens the installation dialog for the hieroglyphic keyboard.km-package-get el_dinka && km-config --install ~/.cache/keyman/el_dinka.kmp
. Verify that this opens the installation dialog for the el_dinka/Thuɔŋjäŋ keyboard.km-config keyman://download/keyboard/sil_pan_africa_positional?bcp47=bjt-latn
man km-config
. Verify it shows the manual page explaining the parameters.SUITE_KBDS: Verify specific keyboards
Tests
n>
. Verify that the result is "ŋ".n>
. Verify that the result is "ŋ".han<space>geul<space>
. Verify that the result is "한글".han<space>geul<space>
. Verify that the result is "한글".xEjmr
. Verify that the output is "ខ្មែរ".xEjmr
. Verify that the output is "ខ្មែរ".SUITE_UNINSTALL: Uninstallation
Tests
TEST_UNINSTALL: Remove the keyman package
(on Ubuntu 18.04 Bionic use these commands instead:
/usr/lib/python3/dist-packages/keyman_config
are gone~/.local/share/keyman
still exist and still contain the*.kmp
and other files.SUITE_UPDATE: Update an existing installation
Preparation
remove keyman package
remove beta and alpha ppas:
sudo rm /etc/apt/sources.list.d/keymanapp-ubuntu-keyman*
add stable ppa
install latest stable version
verify that this installed the latest stable version:
km-config --version
re-add beta ppa:
For pre-beta tests install the alpha ppa:
reboot
Tests
TEST_UPGRADE: Upgrade Keyman
km-config --version
What's New Tests ???
/history.md
and verify functionalityThe text was updated successfully, but these errors were encountered: