[Bdds-dev] 答复: 答复: RDMA capability for Bigdata components

Yangjian (nt) yangjian.yx at huawei.com
Wed Sep 9 11:02:41 UTC 2020


Hi

Yes, the HiBD is not open source, so need to connect with OHIO-State-University, whether it can be supported by ARM, or they can open the source code in GitHub, or whether linaro can responsible for building the same RDMA library based on ARM?


发件人: Yuqi Gu [mailto:yuqi.gu at linaro.org]
发送时间: 2020年9月9日 17:58
收件人: Yangjian (nt) <yangjian.yx at huawei.com>
抄送: Ganesh Raju <ganesh.raju at linaro.org>; bdds-dev at op-lists.linaro.org
主题: Re: [Bdds-dev] 答复: RDMA capability for Bigdata components

Hi,

It's pretty helpful to support RDMA for hadoop, Spark , Kafka, etc.
But from http://hibd.cse.ohio-state.edu/downloads, it just offers the tarball for x86 and 'RDMA for Apache Hadoop 3.x Userguide'  is not available.
IMHO, we should confirm whether HiBD<http://hibd.cse.ohio-state.edu/> is open-source or not.
Maybe it would be better to set up a talk-channel with guys in OHIO-State-University first.
Thanks!

BRs,
Yuqi

On Tue, 8 Sep 2020 at 21:49, Yangjian (nt) via Bdds-dev <bdds-dev at op-lists.linaro.org<mailto:bdds-dev at op-lists.linaro.org>> wrote:

Hi

    Yes, It can improve the arm ecology and some big data components performance, at some times looking at the views of other partners.


发件人: Ganesh Raju [mailto:ganesh.raju at linaro.org<mailto:ganesh.raju at linaro.org>]
发送时间: 2020年9月8日 21:39
收件人: Yangjian (nt) <yangjian.yx at huawei.com<mailto:yangjian.yx at huawei.com>>
抄送: bdds-dev at op-lists.linaro.org<mailto:bdds-dev at op-lists.linaro.org>
主题: Re: [Bdds-dev] RDMA capability for Bigdata components

Hi
I think it is good to invest some time onto this. We had raised this to steering committee a while back (almost 1.5 years ago). We need to relook at it.

Thanks,
Ganesh

On Thu, Sep 3, 2020 at 11:18 AM Yangjian (nt) via Bdds-dev <bdds-dev at op-lists.linaro.org<mailto:bdds-dev at op-lists.linaro.org><mailto:bdds-dev at op-lists.linaro.org<mailto:bdds-dev at op-lists.linaro.org>>> wrote:
Hi ALL:

     To raise a topic, whether the RDMA capability can be supported on ARM in BigTop project for some bigData components, refer to the link as fellows, Big Data Components + RDMA can improve the performance, such as Spark and Hadoop.

http://hibd.cse.ohio-state.edu/
--
Bdds-dev mailing list
Bdds-dev at op-lists.linaro.org<mailto:Bdds-dev at op-lists.linaro.org><mailto:Bdds-dev at op-lists.linaro.org<mailto:Bdds-dev at op-lists.linaro.org>>
https://op-lists.linaro.org/mailman/listinfo/bdds-dev


--
IRC: ganeshraju@#linaro on irc.freenode.ne<http://irc.freenode.ne><http://irc.freenode.net/>t
--
Bdds-dev mailing list
Bdds-dev at op-lists.linaro.org<mailto:Bdds-dev at op-lists.linaro.org>
https://op-lists.linaro.org/mailman/listinfo/bdds-dev


More information about the Bdds-dev mailing list