Cloud-dev

cloud-dev@op-lists.linaro.org

3 discussions

by Kevin Zhao

FYI, Ceph upstream want to purchase Arm64 machines for Integration test. ---------- Forwarded message --------- 发件人： Dan Mick <dmick(a)redhat.com> Date: 2021年10月9日周六上午7:25 Subject: RFP for arm64 test nodes To: dev <dev(a)ceph.io>, ceph-users <ceph-users(a)ceph.io> Ceph has been completely ported to build and run on ARM hardware (architecture arm64/aarch64), but we're unable to test it due to lack of hardware. We propose to purchase a significant number of ARM servers (50+?) to install in our upstream Sepia test lab to use for upstream testing of Ceph, alongside the x86 hardware we already own. This message is to start a discussion of what the nature of that hardware should be, and an investigation as to what's available and how much it might cost. The general idea is to build something arm64-based that is similar to the smithi/gibba nodes: https://wiki.sepia.ceph.com/doku.php?id=hardware:gibba Some suggested features: * base hardware/peripheral support for current releases of RHEL, CentOS, Ubuntu * 1 fast and largish (400GB+) NVME drive for OSDs (it will be partitioned into 4-5 subdrives for tests) * 1 large (1TB+) SSD/HDD for boot/system and logs (faster is better but not as crucial as for cluster storage) * Remote/headless management (IPMI?) * At least 1 10G network interface per host * Order of 64GB main memory per host Density is valuable to the lab; we have space but not an unlimited amount. Any suggestions on vendors or specific server configurations? Thanks! _______________________________________________ Dev mailing list -- dev(a)ceph.io To unsubscribe send an email to dev-leave(a)ceph.io

3 years, 10 months

Check the instance with SVE function enabled

by Kevin Zhao

Hi Zhangfeng, Please check the instance with SVE function enabled. The image is 4C8G 80G disks. OS Centos-8-stream default user: centos, IP: 213.146.155.84 The private key to login will send you via another email. -- *Best Regards* *Kevin Zhao* Tech Lead, LDCG Cloud Infrastructure Linaro Vertical Technologies IRC(freenode): kevinz Slack(kubernetes.slack.com): kevinz kevin.zhao(a)linaro.org | Mobile/Direct/Wechat: +86 18818270915

3 years, 11 months

Kernel error message when enabling DAX mode

by Kevin Zhao

Hi Qiqing, Below are the reproduced info, and the attached file is the dmesg. Run first time: Operate on pmem0: [kevinz@localhost ~]$ sudo ndctl create-namespace --mode fsdax -e namespace0.0 -f -vvvv libndctl: ndctl_pfn_enable: pfn0.0: failed to enable Error: namespace0.0: failed to enable failed to reconfigure namespace: No such device or address kernel log: [ 542.182599] nd_pmem: probe of pfn0.0 failed with error -17 opreate on Pmem1: [kevinz@localhost ~]$ sudo ndctl create-namespace --mode fsdax -e namespace1.0 -f -vvvv libndctl: ndctl_pfn_enable: pfn1.0: failed to enable Error: namespace1.0: failed to enable Kernel log: [ 564.802595] nd_pmem: probe of pfn1.0 failed with error -17 Run another time: opreate on Pmem1: [kevinz@localhost ~]$ sudo ndctl create-namespace --mode fsdax -e namespace1.0 -f -vvvv [ 586.131493] Unable to handle kernel paging request at virtual address ffff205c00000000 [ 586.139389] Mem abort info: [ 586.142176] ESR = 0x96000006 [ 586.145217] EC = 0x25: DABT (current EL), IL = 32 bits [ 586.150505] SET = 0, FnV = 0 [ 586.153550] EA = 0, S1PTW = 0 [ 586.156678] Data abort info: [ 586.159545] ISV = 0, ISS = 0x00000006 [ 586.163368] CM = 0, WnR = 0 [ 586.166323] swapper pgtable: 64k pages, 48-bit VAs, pgdp=0000000025080000 [ 586.173085] [ffff205c00000000] pgd=1800205bfe1c0003, p4d=1800205bfe1c0003, pud=1800205bfe1c0003, pmd=0000000000000000 [ 586.183656] Internal error: Oops: 96000006 [#1] SMP [ 586.188514] Modules linked in: nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 rfkill ip6_tables nft_compat ip_set nf_tables nfnetlink vfat fat ipmi_ssif crct10dif_ce ghash_ce sha1_ce sbsa_gwdt acpi_ipmi ipmi_si ipmi_devintf ipmi_msghandler dax_pmem_compat spi_dw_mmio device_dax spi_dw dax_pmem_core ip_tables xfs libcrc32c hibmc_drm drm_vram_helper drm_kms_helper realtek syscopyarea sysfillrect sysimgblt fb_sys_fops drm_ttm_helper ttm drm hns3 nd_pmem hisi_sas_v3_hw nd_btt hclge hisi_sas_main libsas sha2_ce nvme sha256_arm64 megaraid_sas nvme_core sg hnae3 scsi_transport_sas i2c_algo_bit i2c_designware_platform nfit i2c_designware_core gpio_dwapb dm_mirror dm_region_hash dm_log dm_mod [ 586.259887] CPU: 67 PID: 2735 Comm: ndctl Not tainted 5.13.801 #1 [ 586.265954] Hardware name: Huawei TaiShan 200 (Model 2280)/BC82AMDDA, BIOS 1.73 03/25/2021 [ 586.274179] pstate: 20400009 (nzCv daif +PAN -UAO -TCO BTYPE=--) [ 586.280157] pc : __memcpy+0x100/0x180 [ 586.283808] lr : pmem_do_read+0xac/0x138 [nd_pmem] [ 586.288583] sp : ffff80003736f040 [ 586.291884] x29: ffff80003736f040 x28: 0000000000010000 x27: fff0000000000000 [ 586.298988] x26: ffffffc8088fab40 x25: 0000000000000000 x24: ffff800011578988 [ 586.306092] x23: ffff20223b411cc0 x22: 000003c8088fab40 x21: ffff205c00000000 [ 586.313195] x20: 0000000000010000 x19: 0000000000010000 x18: ffffffffffffffff [ 586.320299] x17: 0000000000000000 x16: 0000000000000000 x15: 0000000000000008 [ 586.327403] x14: 0000000000000001 x13: 0000000000000028 x12: 0101010101010101 [ 586.334507] x11: 7f7f7f7f7f7f7f7f x10: 00000000ffffffff x9 : ffff8000097a1030 [ 586.341611] x8 : ffff202246bd8e00 x7 : ffff202246bd7ab8 x6 : ffff20223ead0000 [ 586.348714] x5 : 0000000000000000 x4 : 0000000000000000 x3 : 0000000000000000 [ 586.355817] x2 : 000000000000ff80 x1 : ffff205c00000000 x0 : ffff20223ead0000 [ 586.362922] Call trace: [ 586.365357] __memcpy+0x100/0x180 [ 586.368656] pmem_submit_bio+0x180/0x1f0 [nd_pmem] [ 586.373428] submit_bio_noacct+0xdc/0x3f8 [ 586.377422] submit_bio+0x54/0x1e0 [ 586.380809] submit_bh_wbc+0x16c/0x1f8 [ 586.384552] block_read_full_page+0x310/0x448 [ 586.388892] blkdev_readpage+0x20/0x28 [ 586.392627] do_read_cache_page+0x2ec/0x3c0 [ 586.396797] read_cache_page+0x18/0x20 [ 586.400531] read_part_sector+0x50/0x1b0 [ 586.404445] read_lba+0xc8/0x1b8 [ 586.407660] efi_partition+0xd4/0x618 [ 586.411307] blk_add_partitions+0x144/0x520 [ 586.415472] bdev_disk_changed+0xc0/0x158 [ 586.419465] __blkdev_get+0x1d0/0x240 [ 586.423111] blkdev_get_by_dev+0x110/0x258 [ 586.427189] __device_add_disk+0x1f4/0x440 [ 586.431268] device_add_disk+0x18/0x20 [ 586.434999] pmem_attach_disk+0x3c4/0x4e8 [nd_pmem] [ 586.439855] nd_pmem_probe+0xc0/0xf0 [nd_pmem] [ 586.444280] nvdimm_bus_probe+0x78/0x1d0 [ 586.448187] really_probe+0xec/0x4c8 [ 586.451755] driver_probe_device+0x100/0x170 [ 586.456007] device_driver_attach+0x74/0x80 [ 586.460173] bind_store+0xdc/0x120 [ 586.463560] drv_attr_store+0x28/0x38 [ 586.467207] sysfs_kf_write+0x48/0x58 [ 586.470856] kernfs_fop_write_iter+0x138/0x1c8 [ 586.475280] new_sync_write+0x108/0x188 [ 586.479107] vfs_write+0x1e0/0x2a8 [ 586.482495] ksys_write+0x6c/0xf0 [ 586.485794] __arm64_sys_write+0x20/0x28 [ 586.489700] invoke_syscall.constprop.4+0x50/0xd8 [ 586.494391] do_el0_svc+0xe8/0x148 [ 586.497779] el0_svc+0x2c/0x90 [ 586.500828] el0_sync_handler+0x88/0xd0 [ 586.504648] el0_sync+0x148/0x180 [ 586.507952] Code: d503201f d503201f d503201f d503201f (a8c12027) [ 586.514060] ---[ end trace 04600250bd0bcced ]--- [ 586.518657] Kernel panic - not syncing: Oops: Fatal exception [ 586.524392] SMP: stopping secondary CPUs [ 587.130797] Kernel Offset: disabled [ 587.134271] CPU features: 0x00000001,a3202c40 [ 587.138610] Memory Limit: none [ 587.141664] ---[ end Kernel panic - not syncing: Oops: Fatal exception ]--- -- *Best Regards* *Kevin Zhao* Tech Lead, LDCG Cloud Infrastructure Linaro Vertical Technologies IRC(freenode): kevinz Slack(kubernetes.slack.com): kevinz kevin.zhao(a)linaro.org | Mobile/Direct/Wechat: +86 18818270915

3 years, 12 months

2025

2024

2023

2022

2021

Cloud-dev