English： 1. Where can I get the component installation and deployment information during the smoke-test? Such as include component startup options and commands? What options do the test components need to configure? 2. Is the smoke-test using a single machine or a cluster? 3. Smoke-test test cases without Ranger 2.2.0 components. 4. The gpdb 5.28.5 component does not support python3 when compiled. 5. ycsb 0.17.0 component smoke test error log: File "/usr/lib/ycsb/bin/ycsb", line 228 except subprocess.CalledProcessError, err: ^ SyntaxError: invalid syntax
6．We solved the problem and raised a PR: https://github.com/apache/bigtop/pull/1025
Chinese: 1、冒烟测试过程中组件安装部署信息在哪儿可以获取到？比如包括组件启动选项和命令是什么？测试组件需要配置哪些选项？ 2、冒烟测试是用单机还是集群？ 3、冒烟测试没有ranger组件的测试用例 4、gpdb 5.28.5 组件编译时不支持python3 5、ycsb 0.17.0 组件冒烟测试报错： File "/usr/lib/ycsb/bin/ycsb", line 228 except subprocess.CalledProcessError, err: ^ SyntaxError: invalid syntax 6、我们解决问题提了一个PR： https://github.com/apache/bigtop/pull/1025
Best Regards
Hi Yangjian,
- Where can I get the component installation and deployment information during the smoke-test?
Such as include component startup options and commands? What options do the test components need to configure? 2. Is the smoke-test using a single machine or a cluster?
Bigtop offers 'Provisioner'(https://github.com/apache/bigtop/tree/master/provisioner/docker) to deploy docker containers to run the related smoke tests.
For example: Spark smoke test: ./docker-hadoop.sh --create 3 \ --image bigtop/puppet:trunk-rockylinux-8 \ --memory 16g \ --repo file:///bigtop-home/output \ --disable-gpg-check \ --stack hdfs,yarn,mapreduce, spark \ --smoke-tests spark
- Smoke-test test cases without Ranger 2.2.0 components.
Ranger hasn't been added into Bigtop yet.
- The gpdb 5.28.5 component does not support python3 when compiled.
Bigtop support python3 in different Distros like Ubuntu20, centos-7, Rockylinux-8, Debian-11/10, Fedora-36. You could add python3 support for openEuler in Bigtop toolchain and offer the openEuler docker images.(https://github.com/apache/bigtop/tree/master/docker)
5.ycsb 0.17.0 component smoke test error log:
Please build the the openEuler docker image corresponding to the other Distros in Bigtop to setup the build and smoke tests environment. And then build the components and run the smoke tests against in the openEuler docker image. The dependency packages should be pre-installed in the related openEuler docker container.
Thanks.
BRs, Yuqi
On Mon, 26 Sept 2022 at 19:18, Yangjian (nt) via Bdds-dev bdds-dev@op-lists.linaro.org wrote:
English：
- Where can I get the component installation and deployment information during the smoke-test?
Such as include component startup options and commands? What options do the test components need to configure? 2. Is the smoke-test using a single machine or a cluster? 3. Smoke-test test cases without Ranger 2.2.0 components. 4. The gpdb 5.28.5 component does not support python3 when compiled. 5. ycsb 0.17.0 component smoke test error log: File "/usr/lib/ycsb/bin/ycsb", line 228 except subprocess.CalledProcessError, err: ^ SyntaxError: invalid syntax
6．We solved the problem and raised a PR: https://github.com/apache/bigtop/pull/1025
Chinese: 1、冒烟测试过程中组件安装部署信息在哪儿可以获取到？比如包括组件启动选项和命令是什么？测试组件需要配置哪些选项？ 2、冒烟测试是用单机还是集群？ 3、冒烟测试没有ranger组件的测试用例 4、gpdb 5.28.5 组件编译时不支持python3 5、ycsb 0.17.0 组件冒烟测试报错： File "/usr/lib/ycsb/bin/ycsb", line 228 except subprocess.CalledProcessError, err: ^ SyntaxError: invalid syntax 6、我们解决问题提了一个PR： https://github.com/apache/bigtop/pull/1025
Best Regards
-- Bdds-dev mailing list -- bdds-dev@op-lists.linaro.org To unsubscribe send an email to bdds-dev-leave@op-lists.linaro.org
Hi All:
We are doing smoke test verification and found the following problems:
1. Hadoop Smoke test failed in openEuler https://issues.apache.org/jira/browse/BIGTOP-3854 2. Solr smoke test failed in OpenEuler https://issues.apache.org/jira/browse/BIGTOP-3859 3. gpdb5.28.5 needs to support python3 version in OpenEuler https://issues.apache.org/jira/browse/BIGTOP-3860
Please help to check
-----邮件原件----- 发件人: Yuqi Gu [mailto:yuqi.gu@linaro.org] 发送时间: 2022年9月27日 9:57 收件人: Yangjian (nt) yangjian.yx@huawei.com 抄送: bdds-dev@op-lists.linaro.org; chenqiang (N) mac.chenqiang@huawei.com; Guodong Xu guodong.xu@linaro.org; Luoliyuan luoliyuan@huawei.com 主题: Re: [Bdds-dev] Some problems with bigtop are adapted to openEuler system, pls help to reply, tks.
Hi Yangjian,
- Where can I get the component installation and deployment information during the smoke-test?
Such as include component startup options and commands? What options do the test components need to configure? 2. Is the smoke-test using a single machine or a cluster?
Bigtop offers 'Provisioner'(https://github.com/apache/bigtop/tree/master/provisioner/docker) to deploy docker containers to run the related smoke tests.
For example: Spark smoke test: ./docker-hadoop.sh --create 3 \ --image bigtop/puppet:trunk-rockylinux-8 \ --memory 16g \ --repo file:///bigtop-home/output \ --disable-gpg-check \ --stack hdfs,yarn,mapreduce, spark \ --smoke-tests spark
- Smoke-test test cases without Ranger 2.2.0 components.
Ranger hasn't been added into Bigtop yet.
- The gpdb 5.28.5 component does not support python3 when compiled.
Bigtop support python3 in different Distros like Ubuntu20, centos-7, Rockylinux-8, Debian-11/10, Fedora-36. You could add python3 support for openEuler in Bigtop toolchain and offer the openEuler docker images.(https://github.com/apache/bigtop/tree/master/docker)
5.ycsb 0.17.0 component smoke test error log:
Please build the the openEuler docker image corresponding to the other Distros in Bigtop to setup the build and smoke tests environment. And then build the components and run the smoke tests against in the openEuler docker image. The dependency packages should be pre-installed in the related openEuler docker container.
Thanks.
BRs, Yuqi
On Mon, 26 Sept 2022 at 19:18, Yangjian (nt) via Bdds-dev bdds-dev@op-lists.linaro.org wrote:
English：
- Where can I get the component installation and deployment information during the smoke-test?
Such as include component startup options and commands? What options do the test components need to configure? 2. Is the smoke-test using a single machine or a cluster? 3. Smoke-test test cases without Ranger 2.2.0 components. 4. The gpdb 5.28.5 component does not support python3 when compiled. 5. ycsb 0.17.0 component smoke test error log: File "/usr/lib/ycsb/bin/ycsb", line 228 except subprocess.CalledProcessError, err: ^ SyntaxError: invalid syntax
6．We solved the problem and raised a PR: https://github.com/apache/bigtop/pull/1025
Chinese: 1、冒烟测试过程中组件安装部署信息在哪儿可以获取到？比如包括组件启动选项和命令是什么？测试组件需要配置哪些选项？ 2、冒烟测试是用单机还是集群？ 3、冒烟测试没有ranger组件的测试用例 4、gpdb 5.28.5 组件编译时不支持python3 5、ycsb 0.17.0 组件冒烟测试报错： File "/usr/lib/ycsb/bin/ycsb", line 228 except subprocess.CalledProcessError, err: ^ SyntaxError: invalid syntax 6、我们解决问题提了一个PR： https://github.com/apache/bigtop/pull/1025
Best Regards
-- Bdds-dev mailing list -- bdds-dev@op-lists.linaro.org To unsubscribe send an email to bdds-dev-leave@op-lists.linaro.org
-
Yangjian (nt) -
Yuqi Gu