Hi All,
Thanks for joining the call today. Below are some notes from this meeting.
*Attendees*: Gugang, Shenshu, Xiaoqi Ma, Jian Yang, Yuqi, Jun He, Ganesh, Jammy, Elsie
*Notes*:
- Current BigTop release is v1.5, now moving to 3.0 to integrate Hadoop v3.x, and Ambari mpack support is in progress - ApacheCon 2021 is coming (Sep. 21~23), and some announcement is planned about BigTop release v3.0 - People who use HDP and CDH start looking at BigTop - Future plans and ideas for BigTop (need to prioritize) - Kubernetes support - More components to be added like Apache Beam, Arrow, Ranger, etc - Looking forward to feedback from Huawei and other vendors about BigTop and other Big Data and Data Science projects - JIRA link for BigTop v3.0 release https://issues.apache.org/jira/browse/BIGTOP-3471 - BigTop mailing list http://bigtop.apache.org/mail-lists.html - Shenshu shared some requirements (by comparing to Ambari+HDP) - deploy all components by Ambari - support openEuler/Kylin/UOS operating systems - upgrade some components to new versions such as Hadoop/Hive/Hbase/etc - add Pig/Storm/Ranger/Atlas/Knox/Accumulo/Druid/Impala/Kudu - provide a install package (tar.gz) that contains all the rpms/debs - every component should release a tar.gz package - Most components will be upgraded for BigTop v3.0, and the missing components can be interesting to add - Solr will be upgraded to 8.7 for BigTop v3.0 - Gang: current CI has only x86 and CentOS for components like Hadoop, Spark, Hbase in the BigTop community, doesn’t have Aarch64 - Jun: the work for v3.0 is still ongoing, some CI support is disabled temporarily, for the final release, x86/Aarch64/PowerPC will all be supported - Gang: Ambari mpack can only detect several components now, which is quite limited - Yuqi: Ambari will be upgraded to 2.7.5, there will be some work for mpack, we can do together if there is some special requirements (the core components have high priority) - Hadoop 3.3 has official support for AArch64 - Impala and Kudu will be required (please raise a ticket in the JIRA link for BIGTOP-3471), similar for other requirements - For BigTop, it is hard to have a single tar file for all components. Encourage to participate in the BigTop community (e.g, mailing list) for related discussions - The BigTop community is open to add more distro support (like openEuler). Is there some docker image for openEuler? - Yes, docker image can be found in the docker_img folder of openEuler repo, like https://repo.openeuler.org/openEuler-20.03-LTS-SP1/docker_img/
Regards, Jammy
On Wed, 26 May 2021 at 20:43, Jammy Zhou via Bdds-dev < bdds-dev@op-lists.linaro.org> wrote:
Hi All,
With recent changes in the industry, BigTop is getting more momentum as an open source distro for Big Data components like Hadoop, Spark and HBase.
We're going to host a meeting to discuss how we can work together in the community to enhance it and resolve the gaps/issues. For example:
- What components are still missed?
- What component versions should be used?
- Any problems for using with Ambari?
Please check the meeting info below, and welcome to join.
Topic: BigTop open discussion Time: May 28, 2021 10:00 AM CST (UTC+8)
Join Zoom Meeting https://linaro-org.zoom.us/j/98394347833
Meeting ID: 983 9434 7833 One tap mobile +16699009128,,98394347833# US (San Jose) +12532158782,,98394347833# US (Tacoma)
Dial by your location +1 669 900 9128 US (San Jose) +1 253 215 8782 US (Tacoma) +1 301 715 8592 US (Washington DC) +1 312 626 6799 US (Chicago) +1 346 248 7799 US (Houston) +1 646 558 8656 US (New York) 888 788 0099 US Toll-free 877 853 5247 US Toll-free Meeting ID: 983 9434 7833 Find your local number: https://linaro-org.zoom.us/u/acSg35gbut
Regards, Jammy -- Bdds-dev mailing list Bdds-dev@op-lists.linaro.org https://op-lists.linaro.org/mailman/listinfo/bdds-dev