Draft: test-cases: Add LTP test case for syscalls testing
LTP project offers test for each Linux Kernel syscall.
This commits adds support to launch ltp syscalls test on Apertis test framework.
Since the job description is given in the kernelci repository, there is no run step. see https://github.com/kernelci/test-definitions/blob/staging.kernelci.org/automated/linux/ltp/ltp.yaml
Also dependent packages are installed manually in the template, it looks like there is some convenient macros to do the same things.
example test jobs is here https://lava.collabora.co.uk/scheduler/job/6153858 This work has been done as part of https://phabricator.apertis.org/T8760.
Merge request reports
Activity
- test-cases/ltp.yaml 0 → 100644
1 metadata: 2 name: ltp 3 format: "Apertis Test Definition 1.0" 4 image-types: 5 fixedfunction: [ armhf, arm64, amd64 ] 6 image-deployment: 7 - OSTree - lava/group-ltp-syscalls-tpl.yaml 0 → 100644
26 - test: 27 namespace: system 28 definitions: 29 - from: git 30 name: ltp-syscalls 31 parameters: 32 SKIPFILE: skipfile-lkft.yaml 33 SKIP_INSTALL: 'true' 34 TST_CMDFILES: syscalls 35 LTP_INSTALL_PATH: /usr/lib/ltp 36 path: automated/linux/ltp/ltp.yaml 37 repository: https://github.com/kernelci/test-definitions 38 revision: staging.kernelci.org 39 name: ltp-syscalls 40 timeout: 41 minutes: 120 - Comment on lines +1 to +41
I noticed that you created a new group, which might be helpful in some cases. Usually that is done to avoid repeating stuff used by several tests, but in this case there is only one test-case. Is there any reason to have a new group? If not maybe you can use the default one, which is automatically use if the the name does not match with other group (at least that is what I understand but @detlev can confirm).
Yes, I can confirm that the default template is used if the group name doesn't match any template. But creating a new group is useful when a test (or a group of tests) need specific setups and variables, which seems to be the case here.
If You don't want to test all apertis images, I wonder if the test should be manual, because all tests in this repository will be run on the images they support (architecture, type) unless they are manual.
@jmassot In what exact conditions should the test be run ?
- test-cases/ltp.yaml 0 → 100644
1 metadata: 2 name: ltp 3 format: "Apertis Test Definition 1.0" 4 image-types: 5 fixedfunction: [ armhf, arm64, amd64 ] I'm not sure what are the plans here, I'm reviewing this without exactly known them. As you mentioned, this test is time consuming, so at the beginning I would only run it on
armhf
for which we have more boards in our LAVA lab.Maybe something to think is to run it on a different schedule than the rest of the test...
- test-cases/ltp.yaml 0 → 100644
2 name: ltp 3 format: "Apertis Test Definition 1.0" 4 image-types: 5 fixedfunction: [ armhf, arm64, amd64 ] 6 image-deployment: 7 - OSTree 8 group: ltp-syscalls 9 type: functional 10 exec-type: automated 11 priority: medium 12 maintainer: "Apertis Project" 13 description: "Test the Linux kernel syscalls." 14 15 expected: 16 - "The output should show pass." 17 - test-cases/ltp.yaml 0 → 100644
2 name: ltp 3 format: "Apertis Test Definition 1.0" 4 image-types: 5 fixedfunction: [ armhf, arm64, amd64 ] 6 image-deployment: 7 - OSTree 8 group: ltp-syscalls 9 type: functional 10 exec-type: automated 11 priority: medium 12 maintainer: "Apertis Project" 13 description: "Test the Linux kernel syscalls." 14 15 expected: 16 - "The output should show pass." 17