Hi Yinsi,
Well, yes. It solved the problem for OpenEuler. Unfortunately it broke it for our Raspberry Pi based qemu workers so we had to revert the health check while we do some more digging.
Thanks
Dave
---------------- Dave Pigott LAVA Lab Lead Linaro Ltd t: (+44) (0) 1223 400063
On 15 Mar 2021, at 10:18, liuyinsi@163.com wrote:
Hi Dave,
"The QEMU instances are failing to boot from NFS", has this problem been solved by add "gic-version=3" in qemu command? I try and it can work.
boot command: qemu-system-aarch64 -cpu host -machine virt-2.10,accel=kvm,gic-version=3 -nographic ....
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-04 18:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
The files that we download change every day based on builds that are uploaded to snapshots.linaro.org http://snapshots.linaro.org/. We test the latest builds, not the same build over and over.
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
Thanks
Dave
On 4 Mar 2021, at 09:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi anmar/luca,
http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 https://github.com/Linaro/test-definitions.git https://github.com/Linaro/test-definitions.git
- http download:
How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.
- https download:
use "git" instead of "https" can work well. git clone git:// git://github.com/Linaro/test-definitions.gitgithub.com/Linaro/test-definitions.git git://github.com/Linaro/test-definitions.git
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Anmar Oueja mailto:anmar.oueja@linaro.org Date: 2021-03-03 07:03 To: Jammy Zhou mailto:jammy.zhou@linaro.org CC: Luca Di Stefano mailto:luca.distefano@linaro.org; liuyinsi@163.com mailto:liuyinsi@163.com; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Pigott mailto:dave.pigott@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou <jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> wrote: Hi Luca,
On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org> wrote:
On 01/03/2021 06:56, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Luca, liuyinsi@163.com mailto:liuyinsi@163.com From: Luca Di Stefano mailto:luca.distefano@linaro.org Date: 2021-02-23 20:11 To: liuyinsi@163.com mailto:liuyinsi@163.com; Oueja mailto:anmar.oueja@linaro.org; Pigott mailto:dave.pigott@linaro.org CC: wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; lkq-dev mailto:lkq-dev@op-lists.linaro.org Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.com mailto:liuyinsi@163.com, please do not email to liuyinsi@huawei.com mailto:liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed?
There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
https://lkft-staging.validation.linaro.org/scheduler/job/100307T https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands？In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container?
We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.
Here are some examples:
https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197 https://lkft.validation.linaro.org/scheduler/job/2313641#L197
Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01 https://lkft.validation.linaro.org/scheduler/device/qemu-h01
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much.
Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks, Yinsi
Thank you
Thanks, yinsi liuyinsi@163.com mailto:liuyinsi@163.com 发件人： Anmar Oueja mailto:anmar.oueja@linaro.org 发送日期： 2021年02月18日 02:43 收件人： liuyinsi mailto:liuyinsi@huawei.com 抄送人： Cameron mailto:jonathan.cameron@huawei.com，wufengguang mailto:wufengguang@huawei.com，yuchuan mailto:13186087857@163.com，lkq-dev mailto:lkq-dev@op-lists.linaro.org，Dave Pigott mailto:dave.pigott@linaro.org，Luca Di Stefano mailto:luca.distefano@linaro.org，Jammy Zhou mailto:jammy.zhou@linaro.org 主题： Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307 https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar