Hi Luca,

liuyinsi@163.com

From: Luca Di Stefano Date: 2021-02-23 20:11 To: liuyinsi@163.com; Oueja; Pigott CC: wufengguang; Cameron; jammy.zhou@linaro.org; lkq-dev Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote: Hello anmar,

I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.

Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.

Hello David and Luca,

Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:

How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.

https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.

Where did you execute the commands？In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.

which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?

Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.

yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'.

Thanks, Yinsi

Thank you

Thanks, yinsi

liuyinsi@163.com 发件人： Anmar Oueja 发送日期： 2021年02月18日 02:43 收件人： liuyinsi 抄送人： Cameron，wufengguang，yuchuan，lkq-dev，Dave Pigott，Luca Di Stefano，Jammy Zhou 主题： Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,

Happy Lunar New Year!!!

David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.

Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.

This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307

Can you please work with David and Luca to try and figure this out.

Cheers! anmar

Hi Luca,

On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano luca.distefano@linaro.org wrote:

On 01/03/2021 06:56, liuyinsi@163.com wrote:

Hi Luca,

liuyinsi@163.com

*From:* Luca Di Stefano luca.distefano@linaro.org *Date:* 2021-02-23 20:11 *To:* liuyinsi@163.com; Oueja anmar.oueja@linaro.org; Pigott dave.pigott@linaro.org *CC:* wufengguang wufengguang@huawei.com; Cameron jonathan.cameron@huawei.com; jammy.zhou@linaro.org; lkq-dev lkq-dev@op-lists.linaro.org *Subject:* Re: Fw: Issues with docker on OpenEulerOS

Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote:

Hello anmar,

I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.

Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.

Hello David and Luca,

Which command did it report errors when it was executed?

There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:

How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service .

https://lkft-staging.validation.linaro.org/scheduler/job/100307T

That's an example of the boot process.

Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.

Where did you execute the commands？In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container?

We run everything on a container on the server.

which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?

As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ),

Sounds great.

yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.

Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads

Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.

We see also other issues with qemu jobs that we are currently investigating.

Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much.

Does that command need to be run in the background? otherwise i get a new shell opened only.

yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux,

you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'.

In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'

Thank you

Thanks,

Yinsi

Thank you

Thanks, yinsi

---

liuyinsi@163.com

发件人： Anmar Oueja anmar.oueja@linaro.org 发送日期： 2021年02月18日 02:43 收件人： liuyinsi liuyinsi@huawei.com 抄送人： Cameron jonathan.cameron@huawei.com，wufengguang wufengguang@huawei.com，yuchuan 13186087857@163.com，lkq-dev lkq-dev@op-lists.linaro.org，Dave Pigott dave.pigott@linaro.org，Luca Di Stefano luca.distefano@linaro.org，Jammy Zhou jammy.zhou@linaro.org 主题： Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,

Happy Lunar New Year!!!

David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.

Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.

This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307

Can you please work with David and Luca to try and figure this out.

Cheers! anmar

Hi anmar/luca,

http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... https://github.com/Linaro/test-definitions.git

1. http download: How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.

2. https download: use "git" instead of "https" can work well. git clone git://github.com/Linaro/test-definitions.git

Thanks Yinsi

liuyinsi@163.com

From: Anmar Oueja Date: 2021-03-03 07:03 To: Jammy Zhou CC: Luca Di Stefano; liuyinsi@163.com; wufengguang; Cameron; lkq-dev; Pigott Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,

On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou jammy.zhou@linaro.org wrote: Hi Luca,

On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano luca.distefano@linaro.org wrote:

On 01/03/2021 06:56, liuyinsi@163.com wrote: Hi Luca,

liuyinsi@163.com

From: Luca Di Stefano Date: 2021-02-23 20:11 To: liuyinsi@163.com; Oueja; Pigott CC: wufengguang; Cameron; jammy.zhou@linaro.org; lkq-dev Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote: Hello anmar,

I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.

Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.

Hello David and Luca,

Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:

How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.

https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.

Where did you execute the commands？In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.

which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?

As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.

yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.

Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.

Here are some examples:

https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197

Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01

We see also other issues with qemu jobs that we are currently investigating.

Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.

yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'

Thank you

Thanks, Yinsi

Thank you

Thanks, yinsi

liuyinsi@163.com 发件人： Anmar Oueja 发送日期： 2021年02月18日 02:43 收件人： liuyinsi 抄送人： Cameron，wufengguang，yuchuan，lkq-dev，Dave Pigott，Luca Di Stefano，Jammy Zhou 主题： Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,

Happy Lunar New Year!!!

David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.

Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.

This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307

Can you please work with David and Luca to try and figure this out.

Cheers! anmar

Hi Dave,

liuyinsi@163.com

From: Dave Pigott Date: 2021-03-04 18:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

The files that we download change every day based on builds that are uploaded to snapshots.linaro.org. We test the latest builds, not the same build over and over.

1. What the amount of updates.? What percentage of it we'll actually use? 2. how do you run qemu kvm in a container, i log in a debian container and fail to use qemu-system-aarch64 command, but i can run success in the physical machine, error as the follows:

root@87a2c3380232:/# ./kvm-debian.sh macaddr: 02-ff-e8-78-e2-ed Could not access KVM kernel module: No such file or directory qemu-system-aarch64: failed to initialize KVM: No such file or directory

Thanks Yinsi

Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.

Thanks

Dave

On 4 Mar 2021, at 09:11, liuyinsi@163.com wrote:

Hi anmar/luca,

http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... https://github.com/Linaro/test-definitions.git

1. http download: How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.

2. https download: use "git" instead of "https" can work well. git clone git://github.com/Linaro/test-definitions.git

Thanks Yinsi

liuyinsi@163.com

From: Anmar Oueja Date: 2021-03-03 07:03 To: Jammy Zhou CC: Luca Di Stefano; liuyinsi@163.com; wufengguang; Cameron; lkq-dev; Pigott Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,

On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou jammy.zhou@linaro.org wrote: Hi Luca,

On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano luca.distefano@linaro.org wrote:

On 01/03/2021 06:56, liuyinsi@163.com wrote: Hi Luca,

liuyinsi@163.com

From: Luca Di Stefano Date: 2021-02-23 20:11 To: liuyinsi@163.com; Oueja; Pigott CC: wufengguang; Cameron; jammy.zhou@linaro.org; lkq-dev Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote: Hello anmar,

I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.

Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.

Hello David and Luca,

Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:

How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.

https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.

Where did you execute the commands？In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.

which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?

As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.

yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.

Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.

Here are some examples:

https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197

Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01

We see also other issues with qemu jobs that we are currently investigating.

Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.

yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'

Thank you

Thanks, Yinsi

Thank you

Thanks, yinsi

liuyinsi@163.com 发件人： Anmar Oueja 发送日期： 2021年02月18日 02:43 收件人： liuyinsi 抄送人： Cameron，wufengguang，yuchuan，lkq-dev，Dave Pigott，Luca Di Stefano，Jammy Zhou 主题： Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,

Happy Lunar New Year!!!

David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.

Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.

This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307

Can you please work with David and Luca to try and figure this out.

Cheers! anmar

Hi Yinsi,

Well, yes. It solved the problem for OpenEuler. Unfortunately it broke it for our Raspberry Pi based qemu workers so we had to revert the health check while we do some more digging.

Thanks

Dave

---------------- Dave Pigott LAVA Lab Lead Linaro Ltd t: (+44) (0) 1223 400063

On 15 Mar 2021, at 10:18, liuyinsi@163.com wrote:

Hi Dave,

"The QEMU instances are failing to boot from NFS", has this problem been solved by add "gic-version=3" in qemu command? I try and it can work.

boot command: qemu-system-aarch64 -cpu host -machine virt-2.10,accel=kvm,gic-version=3 -nographic ....

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-04 18:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

The files that we download change every day based on builds that are uploaded to snapshots.linaro.org http://snapshots.linaro.org/. We test the latest builds, not the same build over and over.

Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.

Thanks

Dave

...

On 4 Mar 2021, at 09:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Hi anmar/luca,

http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 https://github.com/Linaro/test-definitions.git https://github.com/Linaro/test-definitions.git

1. http download:

How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.

2. https download:

use "git" instead of "https" can work well. git clone git:// git://github.com/Linaro/test-definitions.gitgithub.com/Linaro/test-definitions.git git://github.com/Linaro/test-definitions.git

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com From: Anmar Oueja mailto:anmar.oueja@linaro.org Date: 2021-03-03 07:03 To: Jammy Zhou mailto:jammy.zhou@linaro.org CC: Luca Di Stefano mailto:luca.distefano@linaro.org; liuyinsi@163.com mailto:liuyinsi@163.com; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Pigott mailto:dave.pigott@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,

On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou <jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> wrote: Hi Luca,

On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org> wrote:

On 01/03/2021 06:56, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

...

Hi Luca, liuyinsi@163.com mailto:liuyinsi@163.com From: Luca Di Stefano mailto:luca.distefano@linaro.org Date: 2021-02-23 20:11 To: liuyinsi@163.com mailto:liuyinsi@163.com; Oueja mailto:anmar.oueja@linaro.org; Pigott mailto:dave.pigott@linaro.org CC: wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; lkq-dev mailto:lkq-dev@op-lists.linaro.org Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

...

Hello anmar,

I'm sorry I forgot to tell you my email is liuyinsi@163.com mailto:liuyinsi@163.com, please do not email to liuyinsi@huawei.com mailto:liuyinsi@huawei.com.

Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.

Hello David and Luca,

Which command did it report errors when it was executed?

There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:

How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.

https://lkft-staging.validation.linaro.org/scheduler/job/100307T https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.

...

Where did you execute the commands？In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container?

We run everything on a container on the server.

which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?

As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.

yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.

Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.

Here are some examples:

https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197 https://lkft.validation.linaro.org/scheduler/job/2313641#L197

Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01 https://lkft.validation.linaro.org/scheduler/device/qemu-h01

We see also other issues with qemu jobs that we are currently investigating.

...

...

Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much.

Does that command need to be run in the background? otherwise i get a new shell opened only.

yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'

Thank you

...

Thanks, Yinsi

Thank you

...

Thanks, yinsi liuyinsi@163.com mailto:liuyinsi@163.com 发件人： Anmar Oueja mailto:anmar.oueja@linaro.org 发送日期： 2021年02月18日 02:43 收件人： liuyinsi mailto:liuyinsi@huawei.com 抄送人： Cameron mailto:jonathan.cameron@huawei.com，wufengguang mailto:wufengguang@huawei.com，yuchuan mailto:13186087857@163.com，lkq-dev mailto:lkq-dev@op-lists.linaro.org，Dave Pigott mailto:dave.pigott@linaro.org，Luca Di Stefano mailto:luca.distefano@linaro.org，Jammy Zhou mailto:jammy.zhou@linaro.org 主题： Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,

Happy Lunar New Year!!!

David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.

Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.

This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307 https://lkft-staging.validation.linaro.org/scheduler/job/100307

Can you please work with David and Luca to try and figure this out.

Cheers! anmar

Fix / workaround is upstream now.. https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/ar...

Looks like it didn’t get a stable tag though. I’ll find out if there is a reason and get Shameer to request a backport if not.

Thanks,

Jonathan

From: Dave Pigott [mailto:dave.pigott@linaro.org] Sent: 15 March 2021 10:30 To: liuyinsi@163.com Cc: Oueja anmar.oueja@linaro.org; luca luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; Jonathan Cameron jonathan.cameron@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS

Hi Yinsi,

Well, yes. It solved the problem for OpenEuler. Unfortunately it broke it for our Raspberry Pi based qemu workers so we had to revert the health check while we do some more digging.

Thanks

Dave

---------------- Dave Pigott LAVA Lab Lead Linaro Ltd t: (+44) (0) 1223 400063

On 15 Mar 2021, at 10:18, liuyinsi@163.commailto:liuyinsi@163.com wrote:

Hi Dave,

"The QEMU instances are failing to boot from NFS", has this problem been solved by add "gic-version=3" in qemu command? I try and it can work.

boot command: qemu-system-aarch64 -cpu host -machine virt-2.10,accel=kvm,gic-version=3 -nographic ....

Thanks Yinsi

liuyinsi@163.commailto:liuyinsi@163.com

From: Dave Pigottmailto:dave.pigott@linaro.org Date: 2021-03-04 18:04 To: liuyinsi@163.commailto:liuyinsi@163.com CC: Anmar Ouejamailto:anmar.oueja@linaro.org; Luca Di Stefanomailto:luca.distefano@linaro.org; wufengguangmailto:wufengguang@huawei.com; Jonathan Cameronmailto:jonathan.cameron@huawei.com; lkq-devmailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

The files that we download change every day based on builds that are uploaded to snapshots.linaro.orghttp://snapshots.linaro.org/. We test the latest builds, not the same build over and over.

Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.

Thanks

Dave

On 4 Mar 2021, at 09:11, liuyinsi@163.commailto:liuyinsi@163.com wrote:

Hi anmar/luca,

http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... https://github.com/Linaro/test-definitions.git

1. http download: How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.

2. https download: use "git" instead of "https" can work well. git clone git://git://github.com/Linaro/test-definitions.gitgithub.com/Linaro/test-definitions.gitgit://github.com/Linaro/test-definitions.git

Thanks Yinsi

________________________________ liuyinsi@163.commailto:liuyinsi@163.com

From: Anmar Ouejamailto:anmar.oueja@linaro.org Date: 2021-03-03 07:03 To: Jammy Zhoumailto:jammy.zhou@linaro.org CC: Luca Di Stefanomailto:luca.distefano@linaro.org; liuyinsi@163.commailto:liuyinsi@163.com; wufengguangmailto:wufengguang@huawei.com; Cameronmailto:jonathan.cameron@huawei.com; lkq-devmailto:lkq-dev@op-lists.linaro.org; Pigottmailto:dave.pigott@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,

On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou <jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org> wrote: Hi Luca,

On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano <luca.distefano@linaro.orgmailto:luca.distefano@linaro.org> wrote:

On 01/03/2021 06:56, liuyinsi@163.commailto:liuyinsi@163.com wrote: Hi Luca, ________________________________ liuyinsi@163.commailto:liuyinsi@163.com

From: Luca Di Stefanomailto:luca.distefano@linaro.org Date: 2021-02-23 20:11 To: liuyinsi@163.commailto:liuyinsi@163.com; Ouejamailto:anmar.oueja@linaro.org; Pigottmailto:dave.pigott@linaro.org CC: wufengguangmailto:wufengguang@huawei.com; Cameronmailto:jonathan.cameron@huawei.com; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org; lkq-devmailto:lkq-dev@op-lists.linaro.org Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.commailto:liuyinsi@163.com wrote: Hello anmar,

I'm sorry I forgot to tell you my email is liuyinsi@163.commailto:liuyinsi@163.com, please do not email to liuyinsi@huawei.commailto:liuyinsi@huawei.com.

Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.

Hello David and Luca,

Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:

How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.

https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.

Where did you execute the commands？In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.

which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?

As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.

yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.

Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.

Here are some examples:

https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197

Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01

We see also other issues with qemu jobs that we are currently investigating.

Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.

yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'

Thank you

Thanks, Yinsi

Thank you

Thanks, yinsi ________________________________ liuyinsi@163.commailto:liuyinsi@163.com 发件人： Anmar Ouejamailto:anmar.oueja@linaro.org 发送日期： 2021年02月18日 02:43 收件人： liuyinsimailto:liuyinsi@huawei.com 抄送人： Cameronmailto:jonathan.cameron@huawei.com，wufengguangmailto:wufengguang@huawei.com，yuchuanmailto:13186087857@163.com，lkq-devmailto:lkq-dev@op-lists.linaro.org，Dave Pigottmailto:dave.pigott@linaro.org，Luca Di Stefanomailto:luca.distefano@linaro.org，Jammy Zhoumailto:jammy.zhou@linaro.org 主题： Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,

Happy Lunar New Year!!!

David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.

Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.

This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307

Can you please work with David and Luca to try and figure this out.

Cheers! anmar

Hi Jonathan,

the openEulerOS host kernel is 4.19.90-2003.4.0.0036.oe1.aarch64, I am not sure how to patching it. Which version do you want to upgrade to?

Thanks Yinsi

liuyinsi@163.com

From: Jonathan Cameron Date: 2021-03-15 20:36 To: Dave Pigott; liuyinsi@163.com CC: Oueja; luca; wufengguang; lkq-dev; jammy.zhou@linaro.org; Shameerali Kolothum Thodi Subject: RE: Issues with docker on OpenEulerOS What is the host kernel on that machine? Any chance of patching it in the meantime to get things moving?

Jonathan

From: Jonathan Cameron Sent: 15 March 2021 12:07 To: 'Dave Pigott' dave.pigott@linaro.org; liuyinsi@163.com Cc: Oueja anmar.oueja@linaro.org; luca luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org Subject: RE: Issues with docker on OpenEulerOS

Fix / workaround is upstream now.. https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/ar...

Looks like it didn’t get a stable tag though. I’ll find out if there is a reason and get Shameer to request a backport if not.

Thanks,

Jonathan

From: Dave Pigott [mailto:dave.pigott@linaro.org] Sent: 15 March 2021 10:30 To: liuyinsi@163.com Cc: Oueja anmar.oueja@linaro.org; luca luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; Jonathan Cameron jonathan.cameron@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS

Hi Yinsi,

Well, yes. It solved the problem for OpenEuler. Unfortunately it broke it for our Raspberry Pi based qemu workers so we had to revert the health check while we do some more digging.

Thanks

Dave

---------------- Dave Pigott LAVA Lab Lead Linaro Ltd t: (+44) (0) 1223 400063

On 15 Mar 2021, at 10:18, liuyinsi@163.com wrote:

Hi Dave,

"The QEMU instances are failing to boot from NFS", has this problem been solved by add "gic-version=3" in qemu command? I try and it can work.

boot command: qemu-system-aarch64 -cpu host -machine virt-2.10,accel=kvm,gic-version=3 -nographic ....

Thanks Yinsi

liuyinsi@163.com

From: Dave Pigott Date: 2021-03-04 18:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

The files that we download change every day based on builds that are uploaded to snapshots.linaro.org. We test the latest builds, not the same build over and over.

Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.

Thanks

Dave

On 4 Mar 2021, at 09:11, liuyinsi@163.com wrote:

Hi anmar/luca,

http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... https://github.com/Linaro/test-definitions.git

1. http download: How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.

2. https download: use "git" instead of "https" can work well. git clone git://github.com/Linaro/test-definitions.git

Thanks Yinsi

liuyinsi@163.com

From: Anmar Oueja Date: 2021-03-03 07:03 To: Jammy Zhou CC: Luca Di Stefano; liuyinsi@163.com; wufengguang; Cameron; lkq-dev; Pigott Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,

On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou jammy.zhou@linaro.org wrote: Hi Luca,

On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano luca.distefano@linaro.org wrote:

On 01/03/2021 06:56, liuyinsi@163.com wrote: Hi Luca,

liuyinsi@163.com

From: Luca Di Stefano Date: 2021-02-23 20:11 To: liuyinsi@163.com; Oueja; Pigott CC: wufengguang; Cameron; jammy.zhou@linaro.org; lkq-dev Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote: Hello anmar,

I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.

Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.

Hello David and Luca,

Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:

How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.

https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.

Where did you execute the commands？In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.

which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?

As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.

yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.

Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.

Here are some examples:

https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197

Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01

We see also other issues with qemu jobs that we are currently investigating.

Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.

yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'

Thank you

Thanks, Yinsi

Thank you

Thanks, yinsi

liuyinsi@163.com 发件人： Anmar Oueja 发送日期： 2021年02月18日 02:43 收件人： liuyinsi 抄送人： Cameron，wufengguang，yuchuan，lkq-dev，Dave Pigott，Luca Di Stefano，Jammy Zhou 主题： Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,

Happy Lunar New Year!!!

David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.

Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.

This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307

Can you please work with David and Luca to try and figure this out.

Cheers! anmar

On 16 Mar 2021, at 03:11, liuyinsi@163.com wrote:

...

Hi Dave,

liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-04 18:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

The files that we download change every day based on builds that are uploaded to snapshots.linaro.org http://snapshots.linaro.org/. We test the latest builds, not the same build over and over.

Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.

vi ~/.gitconfig

[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/

This will change from https to git.

Thanks Yinsi

Hi Yinsi,

If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.

Dave

...

Thanks

Dave

...

...

...

anmar

Hi Dave,

"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?

Thanks Yinsi

liuyinsi@163.com

From: liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott CC: Oueja; luca; wufengguang; Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS

Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.

vi ~/.gitconfig

[url "git://github.com"] insteadOf = https://github.com

This will change from https to git.

Hi Yinsi,

If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.

Hi Dave,

You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.

Thanks Yinsi

Dave

Thanks

Dave

anmar

Hi Dave,

I notice the job 2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... on openEulerOS machine is ok, first download speed about 2.63MB/s.

It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.

Thanks Yinsi

liuyinsi@163.com

From: Dave Pigott Date: 2021-03-18 17:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.

Dave

On 18 Mar 2021, at 08:19, liuyinsi@163.com wrote:

Hi Dave,

"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?

Thanks Yinsi

liuyinsi@163.com

From: liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott CC: Oueja; luca; wufengguang; Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS

Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.

vi ~/.gitconfig

[url "git://github.com"] insteadOf = https://github.com

This will change from https to git.

Hi Yinsi,

If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.

Hi Dave,

You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.

Thanks Yinsi

Dave

Thanks

Dave

anmar

Hi Dave,

What is the docker images name you want to pull from dockerhub？

Thanks Yinsi

| | liuyinsi | | 邮箱：liuyinsi@163.com |

签名由 网易邮箱大师 定制

On 03/18/2021 19:28, Dave Pigott wrote: Hi Yinsi,

We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?

Thanks

Dave

On 18 Mar 2021, at 10:47, liuyinsi@163.com wrote:

Hi Dave,

I notice the job 2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... on openEulerOS machine is ok, first download speed about 2.63MB/s.

It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.

Thanks Yinsi

liuyinsi@163.com

From: Dave Pigott Date: 2021-03-18 17:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.

Dave

On 18 Mar 2021, at 08:19, liuyinsi@163.com wrote:

Hi Dave,

"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?

Thanks Yinsi

liuyinsi@163.com

From: liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott CC: Oueja; luca; wufengguang; Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS

Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.

vi ~/.gitconfig

[url "git://github.com"] insteadOf = https://github.com

This will change from https to git.

Hi Yinsi,

If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.

Hi Dave,

You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.

Thanks Yinsi

Dave

Thanks

Dave

anmar

Hi Dave,

I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.

Thanks Yinsi

| | liuyinsi | | 邮箱：liuyinsi@163.com |

签名由 网易邮箱大师 定制

On 03/18/2021 19:47, Dave Pigott wrote: Hi Yinsi,

It’s lavasoftware/lava-dispatcher:2021.03

Dave

On 18 Mar 2021, at 11:44, liuyinsi@163.com wrote:

Hi Dave,

What is the docker images name you want to pull from dockerhub？

Thanks Yinsi

| | liuyinsi | | 邮箱：liuyinsi@163.com |

签名由 网易邮箱大师 定制

On 03/18/2021 19:28, Dave Pigott wrote: Hi Yinsi,

We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?

Thanks

Dave

On 18 Mar 2021, at 10:47, liuyinsi@163.com wrote:

Hi Dave,

I notice the job 2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... on openEulerOS machine is ok, first download speed about 2.63MB/s.

It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.

Thanks Yinsi

liuyinsi@163.com

From: Dave Pigott Date: 2021-03-18 17:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.

Dave

On 18 Mar 2021, at 08:19, liuyinsi@163.com wrote:

Hi Dave,

"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?

Thanks Yinsi

liuyinsi@163.com

From: liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott CC: Oueja; luca; wufengguang; Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS

Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.

vi ~/.gitconfig

[url "git://github.com"] insteadOf = https://github.com

This will change from https to git.

Hi Yinsi,

If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.

Hi Dave,

You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.

Thanks Yinsi

Dave

Thanks

Dave

anmar

@yinsi

What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5

Or can we ask openEuler to carry a backport of this set directly?

Another alternative is to see if there is an available BIOS with the fix in place and upgrade.

Jonathan

On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:

Hi Yinsi,

Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.

Thanks for your help!

Dave

...

On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:

Hi Dave,

I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,

It’s lavasoftware/lava-dispatcher:2021.03

Dave

...

On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Hi Dave,

What is the docker images name you want to pull from dockerhub？

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,

We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?

Thanks

Dave

...

On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Hi Dave,

I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.

It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.

Dave

...

On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Hi Dave,

"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS

...

> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig

[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/

This will change from https to git.

Hi Yinsi,

If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.

Hi Dave,

You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.

Thanks Yinsi

Dave

...

> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar

+Hanjun

As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.

On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote:

@yinsi

What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5

Or can we ask openEuler to carry a backport of this set directly?

Another alternative is to see if there is an available BIOS with the fix in place and upgrade.

Jonathan

On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:

...

Hi Yinsi,

Okay - that fixed it. We’ve now got an excellent download speed. We’re

back to the problems with qemu compatibility. Working on this.

...

Thanks for your help!

Dave

...

On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:

Hi Dave,

I pull the images in openEulerOS, though you got the message about

docker pull limit, you still can pull successfully, ignore the message if not block our work.

...

...

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com <

https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

...

...

On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org

wrote:

...

...

Hi Yinsi,

It’s lavasoftware/lava-dispatcher:2021.03

Dave

...

On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com

wrote:

...

...

...

Hi Dave,

What is the docker images name you want to pull from dockerhub？

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com <

https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

...

...

...

On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org

wrote:

...

...

...

Hi Yinsi,

We’re trying to upgrade the docker worker to the latest release and

we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?

...

...

...

Thanks

Dave

...

On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com

wrote:

...

...

...

...

Hi Dave,

I notice the job 2313644 <

https://lkft.validation.linaro.org/scheduler/job/2313644%3E is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... < http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... on openEulerOS machine is ok, first download speed about 2.63MB/s.

...

...

...

...

It's better to improve your download code, to face unstable and slow

network issues, for example, increase timeout and add retries.

...

...

...

...

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com

From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano

mailto:luca.distefano@linaro.org; wufengguang mailto: wufengguang@huawei.com; Jonathan Cameron mailto: jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org

...

...

...

...

Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

If you look at a failed example - e.g.

https://lkft.validation.linaro.org/scheduler/job/2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644%3E - you’ll see it’s not failing on a git clone, it’s failing on a wget.

...

...

...

...

Dave

...

On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com

wrote:

...

...

...

...

...

Hi Dave,

"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit

~/.gitconfig?

...

...

...

...

...

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com

From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca <mailto:

luca.distefano@linaro.org>; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto: lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto: jammy.zhou@linaro.org

...

...

...

...

...

Subject: Re: Re: Issues with docker on OpenEulerOS

>> >> Locally, in the lab, we use KissCache for https cacheing. We

would have to go through every test definition submitted by every bot and developer to change from https to git.

...

...

...

...

...

>> > vi ~/.gitconfig > > [url "git://github.com git://github.com"] > insteadOf = https://github.com https://github.com/ > > This will change from https to git. >

Hi Yinsi,

If you look at the job definitions, e.g.

https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... < https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.

...

...

...

...

...

Hi Dave,

You can edit the file in any environment where you execute the

clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone,

...

...

...

...

...

then it will automatically change https to git.

Thanks Yinsi

Dave >> >> >> >> Thanks >> >> Dave >> >> >>>>> >>>>> >>>>> anmar

We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.

Thanks,

Jonathan

From: liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: Re: Re: Issues with docker on OpenEulerOS

@Jammy,

Our dailybuild already make v5.10 for openEuler 21.03.

@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.

Thanks Yinsi ________________________________ liuyinsi@163.commailto:liuyinsi@163.com

From: Jammy Zhoumailto:jammy.zhou@linaro.org Date: 2021-03-19 08:29 To: Jonathan Cameronmailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo)mailto:guohanjun@huawei.com CC: Dave Pigottmailto:dave.pigott@linaro.org; liuyinsimailto:liuyinsi@163.com; Anmar Ouejamailto:anmar.oueja@linaro.org; Luca Di Stefanomailto:luca.distefano@linaro.org; wufengguangmailto:wufengguang@huawei.com; lkq-devmailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodimailto:shameerali.kolothum.thodi@huawei.com Subject: Re: Issues with docker on OpenEulerOS +Hanjun

As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.

On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.commailto:Jonathan.Cameron@huawei.com> wrote: @yinsi

What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5

Or can we ask openEuler to carry a backport of this set directly?

Another alternative is to see if there is an available BIOS with the fix in place and upgrade.

Jonathan

On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> wrote:

Hi Yinsi,

Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.

Thanks for your help!

Dave

...

On 18 Mar 2021, at 12:11, liuyinsi@163.commailto:liuyinsi@163.com wrote:

Hi Dave,

I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.commailto:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> wrote: Hi Yinsi,

It’s lavasoftware/lava-dispatcher:2021.03

Dave

...

On 18 Mar 2021, at 11:44, liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> wrote:

Hi Dave,

What is the docker images name you want to pull from dockerhub？

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.commailto:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> wrote: Hi Yinsi,

We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?

Thanks

Dave

...

On 18 Mar 2021, at 10:47, liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> wrote:

Hi Dave,

I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.

It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.

Thanks Yinsi

liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com>

From: Dave Pigott <mailto:dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> Date: 2021-03-18 17:04 To: liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> CC: Anmar Oueja <mailto:anmar.oueja@linaro.orgmailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.orgmailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.commailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.commailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.orgmailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org> Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.

Dave

...

On 18 Mar 2021, at 08:19, liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> wrote:

Hi Dave,

"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?

Thanks Yinsi

liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com>

From: liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> Date: 2021-03-17 10:19 To: Dave Pigott <mailto:dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> CC: Oueja <mailto:anmar.oueja@linaro.orgmailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.orgmailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.commailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.commailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.orgmailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org> Subject: Re: Re: Issues with docker on OpenEulerOS

...

> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig

[url "git://github.comhttp://github.com <git://github.comhttp://github.com>"] insteadOf = https://github.com https://github.com/

This will change from https to git.

Hi Yinsi,

If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.

Hi Dave,

You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.

Thanks Yinsi

Dave

...

> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar

On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi < shameerali.kolothum.thodi@huawei.com> wrote:

Ok, I have backported the fix to 5.10.

Please find the patches here,

https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3

Sanity testing at my end shows it working. Please try and let me know.

Thanks Shmeer.

On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.

Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.

anmar

*From:* Jonathan Cameron

*Sent:* 19 March 2021 09:13 *To:* liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) < guohanjun@huawei.com>; Pigott dave.pigott@linaro.org *Cc:* Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano < luca.distefano@linaro.org>; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi < shameerali.kolothum.thodi@huawei.com> *Subject:* RE: Re: Issues with docker on OpenEulerOS

We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major.

@Shameer, let us know if you hit any problems.

Thanks,

Jonathan

*From:* liuyinsi@163.com [mailto:liuyinsi@163.com liuyinsi@163.com] *Sent:* 19 March 2021 08:29 *To:* jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott < dave.pigott@linaro.org> *Cc:* Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano < luca.distefano@linaro.org>; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi < shameerali.kolothum.thodi@huawei.com> *Subject:* Re: Re: Issues with docker on OpenEulerOS

@Jammy,

Our dailybuild already make v5.10 for openEuler 21.03.

@Dave

The openeuler OS host kernel has been updated to v5.10, because I have restarted the host,

the previously running container has stopped.

Thanks

Yinsi

liuyinsi@163.com

*From:* Jammy Zhou jammy.zhou@linaro.org

*Date:* 2021-03-19 08:29

*To:* Jonathan Cameron Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com

*CC:* Dave Pigott dave.pigott@linaro.org; liuyinsi liuyinsi@163.com; Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com

*Subject:* Re: Issues with docker on OpenEulerOS

+Hanjun

As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.

On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron < Jonathan.Cameron@huawei.com> wrote:

@yinsi

What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5

Or can we ask openEuler to carry a backport of this set directly?

Another alternative is to see if there is an available BIOS with the fix in place and upgrade.

Jonathan

On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:

...

Hi Yinsi,

Okay - that fixed it. We’ve now got an excellent download speed. We’re

back to the problems with qemu compatibility. Working on this.

...

Thanks for your help!

Dave

...

On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:

Hi Dave,

I pull the images in openEulerOS, though you got the message about

docker pull limit, you still can pull successfully, ignore the message if not block our work.

...

...

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com <

https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am...

...

签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

...

On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org

wrote:

...

...

Hi Yinsi,

It’s lavasoftware/lava-dispatcher:2021.03

Dave

...

On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com

wrote:

...

...

...

Hi Dave,

What is the docker images name you want to pull from dockerhub？

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com <

https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am...

...

签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

...

...

On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org

wrote:

...

...

...

Hi Yinsi,

We’re trying to upgrade the docker worker to the latest release and

we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?

...

...

...

Thanks

Dave

...

On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com

wrote:

...

...

...

...

Hi Dave,

I notice the job 2313644 <

https://lkft.validation.linaro.org/scheduler/job/2313644%3E is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... < http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... on openEulerOS machine is ok, first download speed about 2.63MB/s.

...

...

...

...

It's better to improve your download code, to face unstable and slow

network issues, for example, increase timeout and add retries.

...

...

...

...

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com

From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano

mailto:luca.distefano@linaro.org; wufengguang mailto: wufengguang@huawei.com; Jonathan Cameron mailto: jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org

...

...

...

...

Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

If you look at a failed example - e.g.

https://lkft.validation.linaro.org/scheduler/job/2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644%3E - you’ll see it’s not failing on a git clone, it’s failing on a wget.

...

...

...

...

Dave

...

On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com

wrote:

...

...

...

...

...

Hi Dave,

"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit

~/.gitconfig?

...

...

...

...

...

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com

From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca <mailto:

luca.distefano@linaro.org>; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto: lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto: jammy.zhou@linaro.org

...

...

...

...

...

Subject: Re: Re: Issues with docker on OpenEulerOS

>> >> Locally, in the lab, we use KissCache for https cacheing. We

would have to go through every test definition submitted by every bot and developer to change from https to git.

...

...

...

...

...

>> > vi ~/.gitconfig > > [url "git://github.com git://github.com"] > insteadOf = https://github.com https://github.com/ > > This will change from https to git. >

Hi Yinsi,

If you look at the job definitions, e.g.

https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... < https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.

...

...

...

...

...

Hi Dave,

You can edit the file in any environment where you execute the

clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone,

...

...

...

...

...

then it will automatically change https to git.

Thanks Yinsi

Dave >> >> >> >> Thanks >> >> Dave >> >> >>>>> >>>>> >>>>> anmar

Hi Yinsi,

We can no longer ssh to the server. Can you resolve this please?

Thanks

Dave

On 7 Apr 2021, at 10:17, liuyinsi@163.com wrote:

Ok，done. Please try to test QEMU again.

Thanks Yinsi

On 04/01/2021 20:57, Anmar Oueja mailto:anmar.oueja@linaro.org wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> wrote: Ok, I have backported the fix to 5.10. Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 Sanity testing at my end shows it working. Please try and let me know.

Thanks Shmeer.

On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.

Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.

anmar

From: Jonathan Cameron Sent: 19 March 2021 09:13 To: liuyinsi@163.com mailto:liuyinsi@163.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: RE: Re: Issues with docker on OpenEulerOS We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems. Thanks, Jonathan From: liuyinsi@163.com mailto:liuyinsi@163.com [mailto:liuyinsi@163.com mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Jonathan Cameron <jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: Re: Re: Issues with docker on OpenEulerOS @Jammy, Our dailybuild already make v5.10 for openEuler 21.03. @Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped. Thanks Yinsi liuyinsi@163.com mailto:liuyinsi@163.com From: Jammy Zhou mailto:jammy.zhou@linaro.org Date: 2021-03-19 08:29 To: Jonathan Cameron mailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com CC: Dave Pigott mailto:dave.pigott@linaro.org; liuyinsi mailto:liuyinsi@163.com; Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com Subject: Re: Issues with docker on OpenEulerOS +Hanjun As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19. On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.com mailto:Jonathan.Cameron@huawei.com> wrote: @yinsi

What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5

Or can we ask openEuler to carry a backport of this set directly?

Another alternative is to see if there is an available BIOS with the fix in place and upgrade.

Jonathan

On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote:

...

Hi Yinsi,

Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.

Thanks for your help!

Dave

...

On 18 Mar 2021, at 12:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Hi Dave,

I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com mailto:liuyinsi@163.com < https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5Dhttps://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 < https://mail.163.com/dashi/dlpro.html?from=mail88https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制

On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,

It’s lavasoftware/lava-dispatcher:2021.03

Dave

...

On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote:

Hi Dave,

What is the docker images name you want to pull from dockerhub？

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com mailto:liuyinsi@163.com < https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5Dhttps://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 < https://mail.163.com/dashi/dlpro.html?from=mail88https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制

On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,

We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?

Thanks

Dave

...

On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote:

Hi Dave,

I notice the job 2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 < http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s.

It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> From: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> CC: Anmar Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> - you’ll see it’s not failing on a git clone, it’s failing on a wget.

Dave

...

On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote:

Hi Dave,

"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> From: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> Date: 2021-03-17 10:19 To: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> CC: Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> Subject: Re: Re: Issues with docker on OpenEulerOS

>> >> Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. >> > vi ~/.gitconfig > > [url "git://github.com http://github.com/ <git://github.com http://github.com/>"] > insteadOf = https://github.com/https://github.com https://github.com/ < https://github.com/https://github.com/ https://github.com/> > > This will change from https to git. >

Hi Yinsi,

If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40 < https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.

Hi Dave,

You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.

Thanks Yinsi

Dave >> >> >> >> Thanks >> >> Dave >> >> >>>>> >>>>> >>>>> anmar

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

Hi Yinsi,

The Lab IP is 51.148.40.1

Thanks

Dave

On 8 Apr 2021, at 12:30, liuyinsi@163.com wrote:

Hi Dave/Anmar,

The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 04/07/2021 18:21, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,

We can no longer ssh to the server. Can you resolve this please?

Thanks

Dave

...

On 7 Apr 2021, at 10:17, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Ok，done. Please try to test QEMU again.

Thanks Yinsi

On 04/01/2021 20:57, Anmar Oueja mailto:anmar.oueja@linaro.org wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> wrote: Ok, I have backported the fix to 5.10. Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 Sanity testing at my end shows it working. Please try and let me know.

Thanks Shmeer.

On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.

Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.

anmar

From: Jonathan Cameron Sent: 19 March 2021 09:13 To: liuyinsi@163.com mailto:liuyinsi@163.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: RE: Re: Issues with docker on OpenEulerOS We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems. Thanks, Jonathan From: liuyinsi@163.com mailto:liuyinsi@163.com [mailto:liuyinsi@163.com mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Jonathan Cameron <jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: Re: Re: Issues with docker on OpenEulerOS @Jammy, Our dailybuild already make v5.10 for openEuler 21.03. @Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped. Thanks Yinsi liuyinsi@163.com mailto:liuyinsi@163.com From: Jammy Zhou mailto:jammy.zhou@linaro.org Date: 2021-03-19 08:29 To: Jonathan Cameron mailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com CC: Dave Pigott mailto:dave.pigott@linaro.org; liuyinsi mailto:liuyinsi@163.com; Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com Subject: Re: Issues with docker on OpenEulerOS +Hanjun As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19. On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.com mailto:Jonathan.Cameron@huawei.com> wrote: @yinsi

What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5

Or can we ask openEuler to carry a backport of this set directly?

Another alternative is to see if there is an available BIOS with the fix in place and upgrade.

Jonathan

On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote:

...

Hi Yinsi,

Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.

Thanks for your help!

Dave

...

On 18 Mar 2021, at 12:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Hi Dave,

I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com mailto:liuyinsi@163.com < https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5Dhttps://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 < https://mail.163.com/dashi/dlpro.html?from=mail88https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制

On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,

It’s lavasoftware/lava-dispatcher:2021.03

Dave

...

On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote:

Hi Dave,

What is the docker images name you want to pull from dockerhub？

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com mailto:liuyinsi@163.com < https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5Dhttps://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 < https://mail.163.com/dashi/dlpro.html?from=mail88https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制

On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,

We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?

Thanks

Dave

...

On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote:

Hi Dave,

I notice the job 2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 < http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s.

It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> From: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> CC: Anmar Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> - you’ll see it’s not failing on a git clone, it’s failing on a wget.

Dave

> On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > > Hi Dave, > > "http download timeout", does it happen often? > "https download timeout", has this problem been solved by edit ~/.gitconfig? > > Thanks > Yinsi > > liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > > From: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > Date: 2021-03-17 10:19 > To: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > CC: Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> > Subject: Re: Re: Issues with docker on OpenEulerOS > > >>> >>> Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. >>> >> vi ~/.gitconfig >> >> [url "git://github.com http://github.com/ <git://github.com http://github.com/>"] >> insteadOf = https://github.com/https://github.com https://github.com/ < https://github.com/https://github.com/ https://github.com/> >> >> This will change from https to git. >> > > Hi Yinsi, > > If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40 < https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git. > > Hi Dave, > > You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, > then it will automatically change https to git. > > Thanks > Yinsi > > Dave >>> >>> >>> >>> Thanks >>> >>> Dave >>> >>> >>>>>> >>>>>> >>>>>> anmar

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

OK，done. Please try to login.

Thanks Yinsi

| | liuyinsi | | 邮箱：liuyinsi@163.com |

签名由 网易邮箱大师 定制

On 04/08/2021 20:06, Luca Di Stefano wrote:

Hi Yinsi,

Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:

- 51.148.40.18

- 51.148.40.7

- 51.148.40.11

Thank you.

Luca

On 08/04/2021 13:02, Dave Pigott wrote:

Hi Yinsi,

The Lab IP is 51.148.40.1

Thanks

Dave

On 8 Apr 2021, at 12:30, liuyinsi@163.com wrote:

Hi Dave/Anmar,

The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.

Thanks Yinsi

| | liuyinsi | | 邮箱：liuyinsi@163.com |

签名由 网易邮箱大师 定制

On 04/07/2021 18:21, Dave Pigott wrote: Hi Yinsi,

We can no longer ssh to the server. Can you resolve this please?

Thanks

Dave

On 7 Apr 2021, at 10:17, liuyinsi@163.com wrote:

Ok，done. Please try to test QEMU again.

Thanks Yinsi

On 04/01/2021 20:57, Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com wrote: Ok, I have backported the fix to 5.10.

Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3

Sanity testing at my end shows it working. Please try and let me know.

Thanks Shmeer.

On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.

Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.

anmar

From: Jonathan Cameron Sent: 19 March 2021 09:13 To:liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: RE: Re: Issues with docker on OpenEulerOS

We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.

Thanks,

Jonathan

From:liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To:jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: Re: Re: Issues with docker on OpenEulerOS

@Jammy,

Our dailybuild already make v5.10 for openEuler 21.03.

@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.

Thanks Yinsi liuyinsi@163.com

From: Jammy Zhou Date: 2021-03-19 08:29 To: Jonathan Cameron; Guohanjun (Hanjun Guo) CC: Dave Pigott; liuyinsi; Anmar Oueja; Luca Di Stefano; wufengguang; lkq-dev; Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun

As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.

On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote: @yinsi

What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5

Or can we ask openEuler to carry a backport of this set directly?

Another alternative is to see if there is an available BIOS with the fix in place and upgrade.

Jonathan

On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:

Hi Yinsi,

Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.

Thanks for your help!

Dave

...

On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:

Hi Dave,

I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,

It’s lavasoftware/lava-dispatcher:2021.03

Dave

...

On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Hi Dave,

What is the docker images name you want to pull from dockerhub？

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,

We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?

Thanks

Dave

...

On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Hi Dave,

I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.

It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com

From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.

Dave

...

On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Hi Dave,

"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?

Thanks Yinsi

liuyinsi@163.com mailto:liuyinsi@163.com

From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS

...

> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig

[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/

This will change from https to git.

Hi Yinsi,

If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.

Hi Dave,

You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.

Thanks Yinsi

Dave

...

> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar

| | liuyinsi | | 邮箱：liuyinsi@163.com |

签名由 网易邮箱大师 定制

Hi All,

Thank you Yinsi for all the support.

Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this.

Thank you all.

Luca

On 09/04/2021 12:46, Dave Pigott wrote:

Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.

Thank you all!

Dave

On 9 Apr 2021, at 04:57, [1]liuyinsi@163.com wrote:

OK，done. Please try to login. Thanks Yinsi [defaultAvatar.png] liuyinsi 邮箱：liuyinsi@163.com

签名由 [2]网易邮箱大师 定制

On 04/08/2021 20:06, [3]Luca Di Stefano wrote:

Hi Yinsi,

Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:

- 51.148.40.18

- 51.148.40.7

- 51.148.40.11

Thank you.

Luca

On 08/04/2021 13:02, Dave Pigott wrote:

Hi Yinsi,

The Lab IP is 51.148.40.1

Thanks

Dave

On 8 Apr 2021, at 12:30, [4]liuyinsi@163.com wrote:

Hi Dave/Anmar, The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist. Thanks Yinsi [defaultAvatar.png] liuyinsi 邮箱：liuyinsi@163.com

签名由 [5]网易邮箱大师 定制

On 04/07/2021 18:21, [6]Dave Pigott wrote:

Hi Yinsi, We can no longer ssh to the server. Can you resolve this please? Thanks Dave

On 7 Apr 2021, at 10:17, [7]liuyinsi@163.com wrote:

Ok，done. Please try to test QEMU again. Thanks Yinsi On 04/01/2021 20:57, [8]Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <[9]shameerali.kolothum.thodi@huawei.com> wrote: Ok, I have backported the fix to 5.10.

Please find the patches here, [10]https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2 -on-v3

Sanity testing at my end shows it working. Please try and let me know. Thanks Shmeer. On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix. Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help. anmar From: Jonathan Cameron Sent: 19 March 2021 09:13 To: [11]liuyinsi@163.com; [12]jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <[13]guohanjun@huawei.com>; Pigott <[14]dave.pigott@linaro.org> Cc: Anmar Oueja <[15]anmar.oueja@linaro.org>; Luca Di Stefano <[16]luca.distefano@linaro.org>; wufengguang <[17]wufengguang@huawei.com>; lkq-dev <[18]lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <[19]shameerali.kolothum.thodi@huawei.com> Subject: RE: Re: Issues with docker on OpenEulerOS

We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.

Thanks,

Jonathan

From: [20]liuyinsi@163.com [[21]mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: [22]jammy.zhou@linaro.org; Jonathan Cameron <[23]jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <[24]guohanjun@huawei.com>; Pigott <[25]dave.pigott@linaro.org> Cc: Anmar Oueja <[26]anmar.oueja@linaro.org>; Luca Di Stefano <[27]luca.distefano@linaro.org>; wufengguang <[28]wufengguang@huawei.com>; lkq-dev <[29]lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <[30]shameerali.kolothum.thodi@huawei.com> Subject: Re: Re: Issues with docker on OpenEulerOS

@Jammy,

Our dailybuild already make v5.10 for openEuler 21.03.

@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.

Thanks Yinsi [31]liuyinsi@163.com

From: [32]Jammy Zhou Date: 2021-03-19 08:29 To: [33]Jonathan Cameron; [34]Guohanjun (Hanjun Guo) CC: [35]Dave Pigott; [36]liuyinsi; [37]Anmar Oueja; [38]Luca Di Stefano; [39]wufengguang; [40]lkq-dev; [41]Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun

As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.

On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <[42]Jonathan.Cameron@huawei.com> wrote: @yinsi What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5 Or can we ask openEuler to carry a backport of this set directly? Another alternative is to see if there is an available BIOS with the fix in place and upgrade. Jonathan On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <[43]dave.pigott@linaro.org> wrote:

Hi Yinsi,

Okay - that fixed it. We’ve now got an excellent download speed.

We’re back to the problems with qemu compatibility. Working on this.

Thanks for your help!

Dave

...

On 18 Mar 2021, at 12:11, [44]liuyinsi@163.com wrote:

Hi Dave,

I pull the images in openEulerOS, though you got the message about

docker pull limit, you still can pull successfully, ignore the message if not block our work.

...

Thanks Yinsi

liuyinsi 邮箱：[45]liuyinsi@163.com

<[46]https://maas.mail.163.com/dashi-web-extend/html/proSignature.html? ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail -online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82 %AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <[47]https://mail.163.com/dashi/dlpro.html?from=mail88%3E 定制

...

On 03/18/2021 19:47, Dave Pigott

mailto:[48]dave.pigott@linaro.org wrote:

...

Hi Yinsi,

It’s lavasoftware/lava-dispatcher:2021.03

Dave

...

On 18 Mar 2021, at 11:44, [49]liuyinsi@163.com

mailto:[50]liuyinsi@163.com wrote:

...

...

Hi Dave,

What is the docker images name you want to pull from dockerhub？

Thanks Yinsi

liuyinsi 邮箱：[51]liuyinsi@163.com

<[52]https://maas.mail.163.com/dashi-web-extend/html/proSignature.html? ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail -online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82 %AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <[53]https://mail.163.com/dashi/dlpro.html?from=mail88%3E 定制

...

...

On 03/18/2021 19:28, Dave Pigott

mailto:[54]dave.pigott@linaro.org wrote:

...

...

Hi Yinsi,

We’re trying to upgrade the docker worker to the latest release

and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?

...

...

Thanks

Dave

...

On 18 Mar 2021, at 10:47, [55]liuyinsi@163.com

mailto:[56]liuyinsi@163.com wrote:

...

...

...

Hi Dave,

I notice the job 2313644

<[57]https://lkft.validation.linaro.org/scheduler/job/2313644%3E is created 2 weeks, 6 days ago, can you test a new job, test wget [58]http://images.validation.linaro.org/snapshots.linaro.org/components /lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 <[59]http://images.validation.linaro.org/snapshots.linaro.org/component s/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s.

...

...

...

It's better to improve your download code, to face unstable and

slow network issues, for example, increase timeout and add retries.

...

...

...

Thanks Yinsi

[60]liuyinsi@163.com mailto:[61]liuyinsi@163.com

From: Dave Pigott mailto:[62]dave.pigott@linaro.org Date: 2021-03-18 17:04 To: [63]liuyinsi@163.com mailto:[64]liuyinsi@163.com CC: Anmar Oueja mailto:[65]anmar.oueja@linaro.org; Luca Di

Stefano mailto:[66]luca.distefano@linaro.org; wufengguang mailto:[67]wufengguang@huawei.com; Jonathan Cameron mailto:[68]jonathan.cameron@huawei.com; lkq-dev mailto:[69]lkq-dev@op-lists.linaro.org; [70]jammy.zhou@linaro.org mailto:[71]jammy.zhou@linaro.org

...

...

...

Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,

If you look at a failed example - e.g.

[72]https://lkft.validation.linaro.org/scheduler/job/2313644 <[73]https://lkft.validation.linaro.org/scheduler/job/2313644%3E - you’ll see it’s not failing on a git clone, it’s failing on a wget.

...

...

...

Dave

...

On 18 Mar 2021, at 08:19, [74]liuyinsi@163.com

mailto:[75]liuyinsi@163.com wrote:

...

...

...

...

Hi Dave,

"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit

~/.gitconfig?

...

...

...

...

Thanks Yinsi

[76]liuyinsi@163.com mailto:[77]liuyinsi@163.com

From: [78]liuyinsi@163.com mailto:[79]liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:[80]dave.pigott@linaro.org CC: Oueja mailto:[81]anmar.oueja@linaro.org; luca

mailto:[82]luca.distefano@linaro.org; wufengguang mailto:[83]wufengguang@huawei.com; Cameron mailto:[84]jonathan.cameron@huawei.com; lkq-dev mailto:[85]lkq-dev@op-lists.linaro.org; [86]jammy.zhou@linaro.org mailto:[87]jammy.zhou@linaro.org

...

...

...

...

Subject: Re: Re: Issues with docker on OpenEulerOS

...

> > Locally, in the lab, we use KissCache for https cacheing. We

would have to go through every test definition submitted by every bot and developer to change from https to git.

...

...

...

...

...

> vi ~/.gitconfig

[url "git://[88]github.com git://[89]github.com"] insteadOf = [90]https://github.com

<[91]https://github.com/%3E

...

...

...

...

...

This will change from https to git.

Hi Yinsi,

If you look at the job definitions, e.g.

[92]https://lkft.validation.linaro.org/scheduler/job/2409008/definition #defline40 <[93]https://lkft.validation.linaro.org/scheduler/job/2409008/definitio n#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.

...

...

...

...

Hi Dave,

You can edit the file in any environment where you execute the

clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone,

...

...

...

...

then it will automatically change https to git.

Thanks Yinsi

Dave

...

> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar

[defaultAvatar.png] liuyinsi 邮箱：liuyinsi@163.com

签名由 [94]网易邮箱大师 定制

References

Visible links 1. mailto:liuyinsi@163.com 2. https://mail.163.com/dashi/dlpro.html?from=mail88 3. mailto:luca.distefano@linaro.org 4. mailto:liuyinsi@163.com 5. https://mail.163.com/dashi/dlpro.html?from=mail88 6. mailto:dave.pigott@linaro.org 7. mailto:liuyinsi@163.com 8. mailto:anmar.oueja@linaro.org 9. mailto:shameerali.kolothum.thodi@huawei.com 10. https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 11. mailto:liuyinsi@163.com 12. mailto:jammy.zhou@linaro.org 13. mailto:guohanjun@huawei.com 14. mailto:dave.pigott@linaro.org 15. mailto:anmar.oueja@linaro.org 16. mailto:luca.distefano@linaro.org 17. mailto:wufengguang@huawei.com 18. mailto:lkq-dev@op-lists.linaro.org 19. mailto:shameerali.kolothum.thodi@huawei.com 20. mailto:liuyinsi@163.com 21. mailto:liuyinsi@163.com 22. mailto:jammy.zhou@linaro.org 23. mailto:jonathan.cameron@huawei.com 24. mailto:guohanjun@huawei.com 25. mailto:dave.pigott@linaro.org 26. mailto:anmar.oueja@linaro.org 27. mailto:luca.distefano@linaro.org 28. mailto:wufengguang@huawei.com 29. mailto:lkq-dev@op-lists.linaro.org 30. mailto:shameerali.kolothum.thodi@huawei.com 31. mailto:liuyinsi@163.com 32. mailto:jammy.zhou@linaro.org 33. mailto:Jonathan.Cameron@huawei.com 34. mailto:guohanjun@huawei.com 35. mailto:dave.pigott@linaro.org 36. mailto:liuyinsi@163.com 37. mailto:anmar.oueja@linaro.org 38. mailto:luca.distefano@linaro.org 39. mailto:wufengguang@huawei.com 40. mailto:lkq-dev@op-lists.linaro.org 41. mailto:shameerali.kolothum.thodi@huawei.com 42. mailto:Jonathan.Cameron@huawei.com 43. mailto:dave.pigott@linaro.org 44. mailto:liuyinsi@163.com 45. mailto:liuyinsi@163.com 46. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am..."] 47. https://mail.163.com/dashi/dlpro.html?from=mail88 48. mailto:dave.pigott@linaro.org 49. mailto:liuyinsi@163.com 50. mailto:liuyinsi@163.com 51. mailto:liuyinsi@163.com 52. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am..."] 53. https://mail.163.com/dashi/dlpro.html?from=mail88 54. mailto:dave.pigott@linaro.org 55. mailto:liuyinsi@163.com 56. mailto:liuyinsi@163.com 57. https://lkft.validation.linaro.org/scheduler/job/2313644 58. http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... 59. http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... 60. mailto:liuyinsi@163.com 61. mailto:liuyinsi@163.com 62. mailto:dave.pigott@linaro.org 63. mailto:liuyinsi@163.com 64. mailto:liuyinsi@163.com 65. mailto:anmar.oueja@linaro.org 66. mailto:luca.distefano@linaro.org 67. mailto:wufengguang@huawei.com 68. mailto:jonathan.cameron@huawei.com 69. mailto:lkq-dev@op-lists.linaro.org 70. mailto:jammy.zhou@linaro.org 71. mailto:jammy.zhou@linaro.org 72. https://lkft.validation.linaro.org/scheduler/job/2313644 73. https://lkft.validation.linaro.org/scheduler/job/2313644 74. mailto:liuyinsi@163.com 75. mailto:liuyinsi@163.com 76. mailto:liuyinsi@163.com 77. mailto:liuyinsi@163.com 78. mailto:liuyinsi@163.com 79. mailto:liuyinsi@163.com 80. mailto:dave.pigott@linaro.org 81. mailto:anmar.oueja@linaro.org 82. mailto:luca.distefano@linaro.org 83. mailto:wufengguang@huawei.com 84. mailto:jonathan.cameron@huawei.com 85. mailto:lkq-dev@op-lists.linaro.org 86. mailto:jammy.zhou@linaro.org 87. mailto:jammy.zhou@linaro.org 88. http://github.com/ 89. http://github.com/ 90. https://github.com/ 91. https://github.com/ 92. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... 93. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... 94. https://mail.163.com/dashi/dlpro.html?from=mail88

Hidden links: 96. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... 97. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... 98. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am...

Hi Yinsi,

I had to offline the worker over the weekend because the download speed was making jobs fail due to timeouts cloning and wgetting

Not much we as the lab team can do about that.

Dave

On 9 Apr 2021, at 15:19, liuyinsi@163.com wrote:

Hi All,

It's great to collaborate. :)

Thank you all.

Yinsi

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 04/09/2021 19:52, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi All,

Thank you Yinsi for all the support.

Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this.

Thank you all.

Luca

On 09/04/2021 12:46, Dave Pigott wrote:

...

Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.

Thank you all!

Dave

...

On 9 Apr 2021, at 04:57, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

OK，done. Please try to login.

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 04/08/2021 20:06, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi Yinsi,

Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:

• 51.148.40.18

• 51.148.40.7

• 51.148.40.11

Thank you.

Luca

On 08/04/2021 13:02, Dave Pigott wrote:

...

Hi Yinsi,

The Lab IP is 51.148.40.1

Thanks

Dave

...

On 8 Apr 2021, at 12:30, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Hi Dave/Anmar,

The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 04/07/2021 18:21, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,

We can no longer ssh to the server. Can you resolve this please?

Thanks

Dave

...

On 7 Apr 2021, at 10:17, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Ok，done. Please try to test QEMU again.

Thanks Yinsi

On 04/01/2021 20:57, Anmar Oueja mailto:anmar.oueja@linaro.org wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> wrote: Ok, I have backported the fix to 5.10. Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 Sanity testing at my end shows it working. Please try and let me know.

Thanks Shmeer.

On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.

Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.

anmar

From: Jonathan Cameron Sent: 19 March 2021 09:13 To: liuyinsi@163.com mailto:liuyinsi@163.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: RE: Re: Issues with docker on OpenEulerOS We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems. Thanks, Jonathan From: liuyinsi@163.com mailto:liuyinsi@163.com [mailto:liuyinsi@163.com mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Jonathan Cameron <jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: Re: Re: Issues with docker on OpenEulerOS @Jammy, Our dailybuild already make v5.10 for openEuler 21.03. @Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped. Thanks Yinsi liuyinsi@163.com mailto:liuyinsi@163.com From: Jammy Zhou mailto:jammy.zhou@linaro.org Date: 2021-03-19 08:29 To: Jonathan Cameron mailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com CC: Dave Pigott mailto:dave.pigott@linaro.org; liuyinsi mailto:liuyinsi@163.com; Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com Subject: Re: Issues with docker on OpenEulerOS +Hanjun As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19. On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.com mailto:Jonathan.Cameron@huawei.com> wrote: @yinsi

What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5

Or can we ask openEuler to carry a backport of this set directly?

Another alternative is to see if there is an available BIOS with the fix in place and upgrade.

Jonathan

On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote:

> Hi Yinsi, > > Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this. > > Thanks for your help! > > Dave > > > On 18 Mar 2021, at 12:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote: > > > > Hi Dave, > > > > I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work. > > > > Thanks > > Yinsi > > > > > > > > liuyinsi > > 邮箱：liuyinsi@163.com mailto:liuyinsi@163.com > > <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 > > > > On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: > > Hi Yinsi, > > > > It’s lavasoftware/lava-dispatcher:2021.03 > > > > Dave > > > >> On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > >> > >> Hi Dave, > >> > >> What is the docker images name you want to pull from dockerhub？ > >> > >> Thanks > >> Yinsi > >> > >> > >> > >> > >> > >> > >> liuyinsi > >> 邮箱：liuyinsi@163.com mailto:liuyinsi@163.com > >> <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 > >> > >> On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: > >> Hi Yinsi, > >> > >> We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas? > >> > >> Thanks > >> > >> Dave > >> > >> > >>> On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > >>> > >>> Hi Dave, > >>> > >>> I notice the job 2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 <http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s. > >>> > >>> It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries. > >>> > >>> Thanks > >>> Yinsi > >>> > >>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > >>> > >>> From: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > >>> Date: 2021-03-18 17:04 > >>> To: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > >>> CC: Anmar Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> > >>> Subject: Re: Issues with docker on OpenEulerOS > >>> Hi Yinsi, > >>> > >>> If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> - you’ll see it’s not failing on a git clone, it’s failing on a wget. > >>> > >>> Dave > >>> > >>> > >>>> On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > >>>> > >>>> Hi Dave, > >>>> > >>>> "http download timeout", does it happen often? > >>>> "https download timeout", has this problem been solved by edit ~/.gitconfig? > >>>> > >>>> Thanks > >>>> Yinsi > >>>> > >>>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > >>>> > >>>> From: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > >>>> Date: 2021-03-17 10:19 > >>>> To: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > >>>> CC: Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> > >>>> Subject: Re: Re: Issues with docker on OpenEulerOS > >>>> > >>>> > >>>>>> > >>>>>> Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > >>>>>> > >>>>> vi ~/.gitconfig > >>>>> > >>>>> [url "git://github.com http://github.com/ <git://github.com http://github.com/>"] > >>>>> insteadOf = https://github.com https://github.com/ <https://github.com/ https://github.com/> > >>>>> > >>>>> This will change from https to git. > >>>>> > >>>> > >>>> Hi Yinsi, > >>>> > >>>> If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40 <https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git. > >>>> > >>>> Hi Dave, > >>>> > >>>> You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, > >>>> then it will automatically change https to git. > >>>> > >>>> Thanks > >>>> Yinsi > >>>> > >>>> Dave > >>>>>> > >>>>>> > >>>>>> > >>>>>> Thanks > >>>>>> > >>>>>> Dave > >>>>>> > >>>>>> > >>>>>>>>> > >>>>>>>>> > >>>>>>>>> anmar > >> > > > >

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

Hi Jammy,

This is all good - not sure what, if anything, the Lab can do to fix these problems. This would appear to be a CI/Front end issue.

Thanks

Dave

On 13 Apr 2021, at 03:07, Jammy Zhou jammy.zhou@linaro.org wrote:

I checked with Chase who has good experience of LAVA in China. It looks like a cache/mirror server is helpful in this context.

The download speed from S3 often is a problem for China. We may need to setup a mirror/cache server (e.g. jfrog artifactory) in the lab to mirror or cache the files that LAVA test jobs need. Once we have a cache/mirror server set, the test plan should be updated to download file from mirror/cache server instead of the original S3 server. A local mirror/cache server will improve both reliability and speed of CI.

Regards, Jammy

On Mon, 12 Apr 2021 at 17:34, Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,

I had to offline the worker over the weekend because the download speed was making jobs fail due to timeouts cloning and wgetting

Not much we as the lab team can do about that.

Dave

...

On 9 Apr 2021, at 15:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Hi All,

It's great to collaborate. :)

Thank you all.

Yinsi

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 04/09/2021 19:52, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi All,

Thank you Yinsi for all the support.

Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this.

Thank you all.

Luca

On 09/04/2021 12:46, Dave Pigott wrote:

...

Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.

Thank you all!

Dave

...

On 9 Apr 2021, at 04:57, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

OK，done. Please try to login.

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 04/08/2021 20:06, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi Yinsi,

Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:

• 51.148.40.18

• 51.148.40.7

• 51.148.40.11

Thank you.

Luca

On 08/04/2021 13:02, Dave Pigott wrote:

...

Hi Yinsi,

The Lab IP is 51.148.40.1

Thanks

Dave

...

On 8 Apr 2021, at 12:30, liuyinsi@163.com mailto:liuyinsi@163.com wrote:

Hi Dave/Anmar,

The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制

On 04/07/2021 18:21, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,

We can no longer ssh to the server. Can you resolve this please?

Thanks

Dave

> On 7 Apr 2021, at 10:17, liuyinsi@163.com mailto:liuyinsi@163.com wrote: > > > Ok，done. Please try to test QEMU again. > > Thanks > Yinsi > > > > > On 04/01/2021 20:57, Anmar Oueja mailto:anmar.oueja@linaro.org wrote: > On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> wrote: > Ok, I have backported the fix to 5.10. > > Please find the patches here, > https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 > > Sanity testing at my end shows it working. Please try and let me know. > > Thanks Shmeer. > > On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix. > > Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help. > > anmar > > From: Jonathan Cameron > Sent: 19 March 2021 09:13 > To: liuyinsi@163.com mailto:liuyinsi@163.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> > Subject: RE: Re: Issues with docker on OpenEulerOS > > We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. > @Shameer, let us know if you hit any problems. > > Thanks, > > Jonathan > > > From: liuyinsi@163.com mailto:liuyinsi@163.com [mailto:liuyinsi@163.com mailto:liuyinsi@163.com] > Sent: 19 March 2021 08:29 > To: jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Jonathan Cameron <jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> > Subject: Re: Re: Issues with docker on OpenEulerOS > > @Jammy, > > Our dailybuild already make v5.10 for openEuler 21.03. > > @Dave > The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, > the previously running container has stopped. > > Thanks > Yinsi > liuyinsi@163.com mailto:liuyinsi@163.com > > From: Jammy Zhou mailto:jammy.zhou@linaro.org > Date: 2021-03-19 08:29 > To: Jonathan Cameron mailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com > CC: Dave Pigott mailto:dave.pigott@linaro.org; liuyinsi mailto:liuyinsi@163.com; Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com > Subject: Re: Issues with docker on OpenEulerOS > +Hanjun > > As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19. > > On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.com mailto:Jonathan.Cameron@huawei.com> wrote: > @yinsi > > What are chances of upgrading the host os to a more recent openEuler kernel. > 4.19 is a bit of a stretch for a backport of the fix. > I guess it might be easy, but would feel more comfortable with 5.10 or 5.5 > > Or can we ask openEuler to carry a backport of this set directly? > > Another alternative is to see if there is an available BIOS with the fix > in place and upgrade. > > Jonathan > > On Thu, 18 Mar 2021 13:38:28 +0000 > Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: > > > Hi Yinsi, > > > > Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this. > > > > Thanks for your help! > > > > Dave > > > > > On 18 Mar 2021, at 12:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote: > > > > > > Hi Dave, > > > > > > I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work. > > > > > > Thanks > > > Yinsi > > > > > > > > > > > > liuyinsi > > > 邮箱：liuyinsi@163.com mailto:liuyinsi@163.com > > > <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 > > > > > > On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: > > > Hi Yinsi, > > > > > > It’s lavasoftware/lava-dispatcher:2021.03 > > > > > > Dave > > > > > >> On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > > >> > > >> Hi Dave, > > >> > > >> What is the docker images name you want to pull from dockerhub？ > > >> > > >> Thanks > > >> Yinsi > > >> > > >> > > >> > > >> > > >> > > >> > > >> liuyinsi > > >> 邮箱：liuyinsi@163.com mailto:liuyinsi@163.com > > >> <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 > > >> > > >> On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: > > >> Hi Yinsi, > > >> > > >> We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas? > > >> > > >> Thanks > > >> > > >> Dave > > >> > > >> > > >>> On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > > >>> > > >>> Hi Dave, > > >>> > > >>> I notice the job 2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 <http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s. > > >>> > > >>> It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries. > > >>> > > >>> Thanks > > >>> Yinsi > > >>> > > >>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > > >>> > > >>> From: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > > >>> Date: 2021-03-18 17:04 > > >>> To: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > > >>> CC: Anmar Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> > > >>> Subject: Re: Issues with docker on OpenEulerOS > > >>> Hi Yinsi, > > >>> > > >>> If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> - you’ll see it’s not failing on a git clone, it’s failing on a wget. > > >>> > > >>> Dave > > >>> > > >>> > > >>>> On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > > >>>> > > >>>> Hi Dave, > > >>>> > > >>>> "http download timeout", does it happen often? > > >>>> "https download timeout", has this problem been solved by edit ~/.gitconfig? > > >>>> > > >>>> Thanks > > >>>> Yinsi > > >>>> > > >>>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > > >>>> > > >>>> From: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > > >>>> Date: 2021-03-17 10:19 > > >>>> To: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > > >>>> CC: Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> > > >>>> Subject: Re: Re: Issues with docker on OpenEulerOS > > >>>> > > >>>> > > >>>>>> > > >>>>>> Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > > >>>>>> > > >>>>> vi ~/.gitconfig > > >>>>> > > >>>>> [url "git://github.com http://github.com/ <git://github.com http://github.com/>"] > > >>>>> insteadOf = https://github.com https://github.com/ <https://github.com/ https://github.com/> > > >>>>> > > >>>>> This will change from https to git. > > >>>>> > > >>>> > > >>>> Hi Yinsi, > > >>>> > > >>>> If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40 <https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git. > > >>>> > > >>>> Hi Dave, > > >>>> > > >>>> You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, > > >>>> then it will automatically change https to git. > > >>>> > > >>>> Thanks > > >>>> Yinsi > > >>>> > > >>>> Dave > > >>>>>> > > >>>>>> > > >>>>>> > > >>>>>> Thanks > > >>>>>> > > >>>>>> Dave > > >>>>>> > > >>>>>> > > >>>>>>>>> > > >>>>>>>>> > > >>>>>>>>> anmar > > >> > > > > > > > > > > liuyinsi > 邮箱：liuyinsi@163.com > https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制 >

On Fri, Apr 23, 2021 at 6:10 AM liuyinsi@163.com liuyinsi@163.com wrote:

Hi Dave/Anmar,

Such as the title, our openeulerOS server will be power down at May 1st, just one day, 8:00 -- 18:00.

Thanks for letting us know Yinsi.

Have a good weekend,

anmar

Thanks Yinsi

Hi Dave,

http download failed: it's better to improve your download code, increase timeout and add retries. https download failed: use "git clone git" instead of "git clone https".

Thanks Yinsi.

liuyinsi@163.com

From: Dave Pigott Date: 2021-04-13 17:39 To: Jammy Zhou CC: liuyinsi; Luca Di Stefano; Anmar Oueja; Shameerali Kolothum Thodi; wufengguang; Guohanjun (Hanjun Guo); Jonathan Cameron; lkq-dev; Chase Qi Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,

This is all good - not sure what, if anything, the Lab can do to fix these problems. This would appear to be a CI/Front end issue.

Thanks

Dave

On 13 Apr 2021, at 03:07, Jammy Zhou jammy.zhou@linaro.org wrote:

I checked with Chase who has good experience of LAVA in China. It looks like a cache/mirror server is helpful in this context.

The download speed from S3 often is a problem for China. We may need to setup a mirror/cache server (e.g. jfrog artifactory) in the lab to mirror or cache the files that LAVA test jobs need. Once we have a cache/mirror server set, the test plan should be updated to download file from mirror/cache server instead of the original S3 server. A local mirror/cache server will improve both reliability and speed of CI.

Regards, Jammy

On Mon, 12 Apr 2021 at 17:34, Dave Pigott dave.pigott@linaro.org wrote: Hi Yinsi,

I had to offline the worker over the weekend because the download speed was making jobs fail due to timeouts cloning and wgetting

Not much we as the lab team can do about that.

Dave

On 9 Apr 2021, at 15:19, liuyinsi@163.com wrote:

Hi All,

It's great to collaborate. :)

Thank you all.

Yinsi

liuyinsi 邮箱：liuyinsi@163.com 签名由 网易邮箱大师 定制 On 04/09/2021 19:52, Luca Di Stefano wrote: Hi All, Thank you Yinsi for all the support. Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this. Thank you all. Luca

On 09/04/2021 12:46, Dave Pigott wrote: Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.

Thank you all!

Dave

On 9 Apr 2021, at 04:57, liuyinsi@163.com wrote:

OK，done. Please try to login.

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com 签名由 网易邮箱大师 定制 On 04/08/2021 20:06, Luca Di Stefano wrote: Hi Yinsi, Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are: - 51.148.40.18 - 51.148.40.7 - 51.148.40.11 Thank you. Luca

On 08/04/2021 13:02, Dave Pigott wrote: Hi Yinsi,

The Lab IP is 51.148.40.1

Thanks

Dave

On 8 Apr 2021, at 12:30, liuyinsi@163.com wrote:

Hi Dave/Anmar,

The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.

Thanks Yinsi

liuyinsi 邮箱：liuyinsi@163.com 签名由 网易邮箱大师 定制 On 04/07/2021 18:21, Dave Pigott wrote: Hi Yinsi,

We can no longer ssh to the server. Can you resolve this please?

Thanks

Dave

On 7 Apr 2021, at 10:17, liuyinsi@163.com wrote:

Ok，done. Please try to test QEMU again.

Thanks Yinsi

On 04/01/2021 20:57, Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com wrote: Ok, I have backported the fix to 5.10.

Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3

Sanity testing at my end shows it working. Please try and let me know.

Thanks Shmeer.

On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.

Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.

anmar

From: Jonathan Cameron Sent: 19 March 2021 09:13 To: liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: RE: Re: Issues with docker on OpenEulerOS

We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.

Thanks,

Jonathan

From: liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: Re: Re: Issues with docker on OpenEulerOS

@Jammy,

Our dailybuild already make v5.10 for openEuler 21.03.

@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.

Thanks Yinsi liuyinsi@163.com

From: Jammy Zhou Date: 2021-03-19 08:29 To: Jonathan Cameron; Guohanjun (Hanjun Guo) CC: Dave Pigott; liuyinsi; Anmar Oueja; Luca Di Stefano; wufengguang; lkq-dev; Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun

As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.

On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote: @yinsi

What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5

Or can we ask openEuler to carry a backport of this set directly?

Another alternative is to see if there is an available BIOS with the fix in place and upgrade.

Jonathan

On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote: