[Asa-dev] [CI] SBSA ACS tests

[Marcin Juszkiewicz]

W dniu 30.10.2020 o 13:03, Marcin Juszkiewicz via Asa-dev pisze:
> I added new CI job: ldcg-sbsa-acs.
> 
> It builds HEAD of qemu and edk2 and then use it to run Arm SBSA ACS 
> testsuite for SBSA levels 3-6.
> 
> https://snapshots.linaro.org/ldcg/sbsa-acs/3/ has logs from each run.
> 
> This allows us to check which components are still missing for each level.
> 
> I created some Jira cards yesterday to list missing parts:
> 
> ASA-65 - add PMU counters
> ASA-66 - add GIC ITS support
> ASA-67 - add Virtual Host Extensions (required for level 4)
> ASA-68 - add SMMU (it is not detected by SBSA ACS now)
> 
> I plan to look at those logs and create additional cards so we can see 
> what is still missing (or not enabled).
> 
> Next run will have larger timeout as 30s looks a bit too short.

Current situation summary:

SBSA level | tests run | passed | failed
----------------------------------------
     3      |     45    |   32   |    6
     4      |     87    |   44   |   13
     5      |     92    |   44   |   20
     6      |    102    |   44   |   29


Lot of tests were skipped.