Automated iptables-nmap test executes successfuly even `nmap` debian package not exists on apertis repository
Affected images versions
Test case is applicable to all the below deployment types.
| Deployment | Type | v2022 | v2023 |
|---|---|---|---|
| apt | fixedfunction | yes | yes |
| ostree | fixedfunction | yes | yes |
| apt | hmi | yes | yes |
| ostree | hmi | yes | yes |
| apt | basesdk | yes | yes |
| apt | sdk | yes | yes |
| apt | nfs | yes | yes |
Testcase
https://qa.apertis.org/testcases/v2024dev2/iptables-nmap.html
Steps to reproduce
Apt base test report : https://qa.apertis.org/report/v2023/20230322.1745/apt
OSTree image report: https://qa.apertis.org/report/v2022/20230517.0219/ostree
on the above test report, test cases are successfully passed for different architecture and incomplete for other.
Expected result
This test case should not pass, because nmap debian pacakge is not part of Apertis distribution and iptable is not shipping any binary to run the namp command.
Actual result
Even though required package is not exist on the repository, test case status showing successful.
Reproducibility
Impact of bug
iptable-nmap test case is high priority test cases, as per our release criteria all the high and critical test should be passed, else delay in release and direct impacting the product team releases.
Root cause
Outcomes
- tests/apertis-test-cases!545 (merged)
- tests/apertis-test-cases!550 (merged)
- tests/apertis-test-cases!551 (merged)
Management data
This section is for management only, it should be the last one in the description.
/cc @andrunko @em @sagar @sudarshan @wlozano
Phabricator link: https://phabricator.apertis.org/T9744