Hi All,
Thanks for joining the call today. Below are some notes from this meeting.
*Attendees*:
Gugang, Shenshu, Xiaoqi Ma, Jian Yang, Yuqi, Jun He, Ganesh, Jammy, Elsie
*Notes*:
- Current BigTop release is v1.5, now moving to 3.0 to integrate Hadoop
v3.x, and Ambari mpack support is in progress
- ApacheCon 2021 is coming (Sep. 21~23), and some announcement is
planned about BigTop release v3.0
- People who use HDP and CDH start looking at BigTop
- Future plans and ideas for BigTop (need to prioritize)
- Kubernetes support
- More components to be added like Apache Beam, Arrow, Ranger, etc
- Looking forward to feedback from Huawei and other vendors about BigTop
and other Big Data and Data Science projects
- JIRA link for BigTop v3.0 release
https://issues.apache.org/jira/browse/BIGTOP-3471
- BigTop mailing list http://bigtop.apache.org/mail-lists.html
- Shenshu shared some requirements (by comparing to Ambari+HDP)
- deploy all components by Ambari
- support openEuler/Kylin/UOS operating systems
- upgrade some components to new versions such as
Hadoop/Hive/Hbase/etc
- add Pig/Storm/Ranger/Atlas/Knox/Accumulo/Druid/Impala/Kudu
- provide a install package (tar.gz) that contains all the rpms/debs
- every component should release a tar.gz package
- Most components will be upgraded for BigTop v3.0, and the missing
components can be interesting to add
- Solr will be upgraded to 8.7 for BigTop v3.0
- Gang: current CI has only x86 and CentOS for components like Hadoop,
Spark, Hbase in the BigTop community, doesn’t have Aarch64
- Jun: the work for v3.0 is still ongoing, some CI support is
disabled temporarily, for the final release, x86/Aarch64/PowerPC will all
be supported
- Gang: Ambari mpack can only detect several components now, which is
quite limited
- Yuqi: Ambari will be upgraded to 2.7.5, there will be some work for
mpack, we can do together if there is some special requirements (the core
components have high priority)
- Hadoop 3.3 has official support for AArch64
- Impala and Kudu will be required (please raise a ticket in the JIRA
link for BIGTOP-3471), similar for other requirements
- For BigTop, it is hard to have a single tar file for all components.
Encourage to participate in the BigTop community (e.g, mailing list) for
related discussions
- The BigTop community is open to add more distro support (like
openEuler). Is there some docker image for openEuler?
- Yes, docker image can be found in the docker_img folder of
openEuler repo, like
https://repo.openeuler.org/openEuler-20.03-LTS-SP1/docker_img/
Regards,
Jammy
On Wed, 26 May 2021 at 20:43, Jammy Zhou via Bdds-dev <
bdds-dev(a)op-lists.linaro.org> wrote:
> Hi All,
>
> With recent changes in the industry, BigTop is getting more momentum as an
> open source distro for Big Data components like Hadoop, Spark and HBase.
>
> We're going to host a meeting to discuss how we can work together in the
> community to enhance it and resolve the gaps/issues. For example:
>
> - What components are still missed?
> - What component versions should be used?
> - Any problems for using with Ambari?
>
> Please check the meeting info below, and welcome to join.
> ============
> Topic: BigTop open discussion
> Time: May 28, 2021 10:00 AM CST (UTC+8)
>
> Join Zoom Meeting
> https://linaro-org.zoom.us/j/98394347833
>
> Meeting ID: 983 9434 7833
> One tap mobile
> +16699009128,,98394347833# US (San Jose)
> +12532158782,,98394347833# US (Tacoma)
>
> Dial by your location
> +1 669 900 9128 US (San Jose)
> +1 253 215 8782 US (Tacoma)
> +1 301 715 8592 US (Washington DC)
> +1 312 626 6799 US (Chicago)
> +1 346 248 7799 US (Houston)
> +1 646 558 8656 US (New York)
> 888 788 0099 US Toll-free
> 877 853 5247 US Toll-free
> Meeting ID: 983 9434 7833
> Find your local number: https://linaro-org.zoom.us/u/acSg35gbut
>
> Regards,
> Jammy
> --
> Bdds-dev mailing list
> Bdds-dev(a)op-lists.linaro.org
> https://op-lists.linaro.org/mailman/listinfo/bdds-dev
>
Hi All,
With recent changes in the industry, BigTop is getting more momentum as an
open source distro for Big Data components like Hadoop, Spark and HBase.
We're going to host a meeting to discuss how we can work together in the
community to enhance it and resolve the gaps/issues. For example:
- What components are still missed?
- What component versions should be used?
- Any problems for using with Ambari?
Please check the meeting info below, and welcome to join.
============
Topic: BigTop open discussion
Time: May 28, 2021 10:00 AM CST (UTC+8)
Join Zoom Meeting
https://linaro-org.zoom.us/j/98394347833
Meeting ID: 983 9434 7833
One tap mobile
+16699009128,,98394347833# US (San Jose)
+12532158782,,98394347833# US (Tacoma)
Dial by your location
+1 669 900 9128 US (San Jose)
+1 253 215 8782 US (Tacoma)
+1 301 715 8592 US (Washington DC)
+1 312 626 6799 US (Chicago)
+1 346 248 7799 US (Houston)
+1 646 558 8656 US (New York)
888 788 0099 US Toll-free
877 853 5247 US Toll-free
Meeting ID: 983 9434 7833
Find your local number: https://linaro-org.zoom.us/u/acSg35gbut
Regards,
Jammy
