Hi,
The meeting minutes are summarized below. Thanks for attending.
MINUTES:
Vendor remote lab is interesting to openEuler for wide hardware coverage.
-
Leverage existing Linaro LKFT Lab + remote lab
-
e.g, NXP remote lab (shared by NXP, Linaro, KernelCI)
-
https://lavalab.nxp.com/
-
CompassCI also has plan for remote lab support
CompassCI also has the capability for bisecting support (the algorithm can
be universal to both kernel and user space applications). LKP itself
doesn’t have the bisecting capability. TuxSuite is focusing mainly on the
kernel part.
Paolo: is it functional or performance bisecting in CompassCI?
Fengguang: currently functional, performance support will be added later
CompassCI starts from upstream, and then downstream (so not only downstream
kernel).
Arch Linux package build is used by CompassCI, so it is easy to add
different kernel builds.
Scale testing with QEMU (e.g, run openEuler on Kunpeng 920, and run
multiple QEMU instances on openEuler), and it can be deployed via remote
lab. Fengguang: it is nice.
17+ machines in CompassCI lab now. Maybe start with 1 machine for
prototyping (the dispatcher can run on the same machine for QEMU case).
Anmar: the dispatcher is fully dockerized now, there should be no big issue
to run on openEuler.
Paolo: modularization can be helpful to merge the benefits of both
Paolo: Is the part for performance bisecting ready in CompassCI?
Fengguang: not yet
Paolo: maybe we can work together to have some common solution to avoid
reinventing the wheel. It’s under design for LKFT so it’s a good place for
us to collaborate.
Fengguang: Focus is on build now then the benchmark testing.
Anmar: the Linaro team and Fengguang to connect later on to make sure the
tool is useful for both CI systems.
Questions and Answers:
-
Q. Can LKP run without having to install packages or tests, only the job
definitions (scripts) ? If we can run tests without having to install the
pre-req every time, that will speed up testing if we use a rootfs that has
all its pre-req installed.
-
A. Compass CI has cpio archives it uses to overlay the tests
dependencies to speed the test runs. These overlays are pre-built and
available to the Compass-CI system
-
Q. We want to get a better understanding of the compare functionality
-
A. compare fetches different results and presents them. Nothing more.
-
Q. What are the plans for alignment with upstream LKP? By examining the
https://github.com/fengguang/lkp-tests and comparing it to
https://github.com/intel/lkp-tests.git, it seems the trees started
diverging in March 2020.
-
A. Fengguang’s LKP-tests repo is periodically re-based on the upstream
LKP-tests repo every couple of months. There is effort to push some of the
changes back upstream but been minimal so far. Most of the tests run on
Arm64 so from a testing perspective, Arm64 is well represented. It’s also
not clear if LKP will accept many patches at the moment. However, a
discussion needs to happen with the upstream at some point in time.
-
Q. How difficult is it to modularise the following LKP components:
-
Monitors
-
Tests
-
Test-plans
-
Email reports
-
Harmonizing output
-
Functional
-
Benchmark
-
Regression detection
-
A. LKP is already modularized and functions as a pipeline.
Regards,
Jammy
On Wed, 9 Dec 2020 at 17:03, Jammy Zhou via Lkq-dev <
lkq-dev(a)op-lists.linaro.org> wrote:
> Hi All,
>
> We're going to have some follow up discussion about Compass CI and LKFT.
> Welcome to join.
>
> @Anmar, please help share the detailed agenda to the list when available.
>
> ------
> Topic: CompassCI/LKFT follow up discussion
> Time: Dec 10, 2020 09:00 PM Hong Kong SAR
>
> Join Zoom Meeting
> https://linaro-org.zoom.us/j/97232094091
>
> Meeting ID: 972 3209 4091
> One tap mobile
> +16699009128,,97232094091# US (San Jose)
> +12532158782,,97232094091# US (Tacoma)
>
> Dial by your location
> +1 669 900 9128 US (San Jose)
> +1 253 215 8782 US (Tacoma)
> +1 301 715 8592 US (Washington D.C)
> +1 312 626 6799 US (Chicago)
> +1 346 248 7799 US (Houston)
> +1 646 558 8656 US (New York)
> 888 788 0099 US Toll-free
> 877 853 5247 US Toll-free
> Meeting ID: 972 3209 4091
> Find your local number: https://linaro-org.zoom.us/u/ad2qaJfAiY
>
> Regards,
> Jammy
> --
> Lkq-dev mailing list
> Lkq-dev(a)op-lists.linaro.org
> https://op-lists.linaro.org/mailman/listinfo/lkq-dev
>
Hello Fengguang,
I hope this email finds you well. We have a few questions we would
appreciate your insight on. We can discuss the answers on this email thread
or at the tail end of our call tomorrow.
- Can LKP run without having to install packages or tests, only the job
definitions (scripts) ? If we can run tests without having to install the
pre-req every time, that will speed up testing if we use a rootfs that has
all its pre-req installed.
- We want to get a better understanding of the benchmark parser
including how benchmark regression are detected
- We want to get a better understanding of the compare functionality
- What are the plans for alignment with upstream LKP? By examining the
https://github.com/fengguang/lkp-tests and comparing it to
https://github.com/intel/lkp-tests.git, it seems the trees started
diverging in March 2020.
- Which tests are Intel specific? Are there plans for porting them to
Arm64?
- How difficult is it to modularise the following LKP components:
- Monitors
- Tests
- Test-plans
- Email reports
- Harmonizing output
- Functional
- Benchmark
- Regression detection
We look forward to talking to you tomorrow.
Cheers!
anmar
Hi All,
We're going to have some follow up discussion about Compass CI and LKFT.
Welcome to join.
@Anmar, please help share the detailed agenda to the list when available.
------
Topic: CompassCI/LKFT follow up discussion
Time: Dec 10, 2020 09:00 PM Hong Kong SAR
Join Zoom Meeting
https://linaro-org.zoom.us/j/97232094091
Meeting ID: 972 3209 4091
One tap mobile
+16699009128,,97232094091# US (San Jose)
+12532158782,,97232094091# US (Tacoma)
Dial by your location
+1 669 900 9128 US (San Jose)
+1 253 215 8782 US (Tacoma)
+1 301 715 8592 US (Washington D.C)
+1 312 626 6799 US (Chicago)
+1 346 248 7799 US (Houston)
+1 646 558 8656 US (New York)
888 788 0099 US Toll-free
877 853 5247 US Toll-free
Meeting ID: 972 3209 4091
Find your local number: https://linaro-org.zoom.us/u/ad2qaJfAiY
Regards,
Jammy
Hi Anmar,
> Can you point me at the OpenEuler kernel trees and the branches you guys use?
The openEuler kernel tree is
https://gitee.com/openeuler/kernel
The current active branches are
kernel-4.19
openEuler-20.09
Thanks,
Fengguang
