[Enter `^Ec?' for help] [spying] [ 295.688374] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 295.976865] XFS (dm-5): Mounting V5 Filesystem [ 295.981994] XFS (dm-5): Ending clean mount [ 295.986110] SELinux: Context system_u:object_r:ceph_var_lib_t:s0 is not valid (left unmapped). [ 296.056384] XFS (dm-5): Unmounting Filesystem [ OK ] Stopped Kernel Samepage Merging. [ OK ] Stopped User Manager for UID 1000. Stopping User runtime directory /run/user/1000... [ OK ] Started Show Plymouth Reboot Screen. [ OK ] Unmounted /run/user/1000. [ OK ] Reached target Unmount All Filesystems. [ OK ] Stopped User runtime directory /run/user/1000. [ OK ] Removed slice User Slice of UID 1000. Stopping Permit User Sessions... [ OK ] Stopped Permit User Sessions. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target NFS client services. Stopping GSSAPI Proxy Daemon... [ OK ] Stopped target User and Group Name Lookups. [ OK ] Stopped GSSAPI Proxy Daemon. [ OK ] Stopped NTP client/server. [ OK ] Stopped Dynamic System Tuning Daemon. [ OK ] Stopped target Network. Stopping Network Manager... [ OK ] Stopped Network Manager. Stopping D-Bus System Message Bus... [ OK ] Stopped D-Bus System Message Bus. [ OK ] Stopped VDO volume services. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Removed slice User and Session Slice. [ OK ] Stopped target Sockets. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Closed SSSD Kerberos Cache Manager responder socket. [ OK ] Stopped Forward Password Requests to Plymouth Directory Watch. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped Update is Completed. [ [ 297.215606] audit: type=1305 audit(1689125789.708:411): op=set audit_pid=0 old=733 auid=4294967295 ses=4294967295 subj=system_u:system_r:auditd_t:s0 res=1 OK ] Stopped Read and set NIS domainname from /etc/sysconfig/network. [ OK ][ 297.236938] audit: type=1131 audit(1689125789.729:412): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=auditd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' Stopped Rebuild[ 297.259259] audit: type=1131 audit(1689125789.751:413): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-tmpfiles-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' Dynamic Linker [ 297.282977] audit: type=1131 audit(1689125789.775:414): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=import-state comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' Cache. [[0;32[ 297.306231] audit: type=1131 audit(1689125789.798:415): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-tmpfiles-setup-dev comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' m OK ] Sto[ 297.329834] audit: type=1131 audit(1689125789.822:416): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-sysusers comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' pped Rebuild Jou[ 297.353728] audit: type=1131 audit(1689125789.846:417): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-remount-fs comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' rnal Catalog. [ OK ] Stopped Rebuild Hardware Database. Stopping Load/Save Random Seed... [ OK ] Stopped target Swap. Stopping Update UTMP about System Boot/Shutdown... [ OK [0[ 297.396171] audit: type=1131 audit(1689125789.888:418): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=lvm2-monitor comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' m] Stopped targe[ 297.418801] audit: type=1130 audit(1689125789.911:419): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-reboot comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' t Local Encrypte[ 297.441544] audit: type=1131 audit(1689125789.911:420): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-reboot comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' d Volumes. [ OK ] Stopped Forward Password Requests to Wall Directory Watch. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Load/Save Ran[ 297.484265] watchdog: watchdog0: watchdog did not stop! dom Seed. [[0[ 297.491194] printk: systemd-shutdow: 38 output lines suppressed due to ratelimiting ;32m OK ] Stopped Update UTMP about System Boot/Shutdown. [ 297.503839] systemd-shutdown[1]: Syncing filesystems and block devices. Stopping Security Auditing Service... [ OK ] Stopped Security Auditing Service. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Import network configuration from initramfs. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local File Systems (Pre). [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create System Users. Stopping Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Stopped Remount Root and Kernel File Systems. [ OK ] Stopped Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Reached target Shutdown. [ OK ] Reached target Final Step. [ 297.583210] systemd-shutdown[1]: Sending SIGTERM to remaining processes... [ OK ] Started Reboot. [ OK ] Reached target Reboot. [ 297.608416] systemd-shutdown[1]: Sending SIGKILL to remaining processes... [ 297.617287] systemd-shutdown[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 297.624329] systemd-shutdown[1]: Unmounting file systems. [ 297.630228] [16143]: Remounting '/' read-only in with options 'seclabel'. [ 297.733437] EXT4-fs (sda1): re-mounted. Opts: [ 297.738911] systemd-shutdown[1]: All filesystems unmounted. [ 297.744477] systemd-shutdown[1]: Deactivating swaps. [ 297.749519] systemd-shutdown[1]: All swaps deactivated. [ 297.754736] systemd-shutdown[1]: Detaching loop devices. [ 297.760137] systemd-shutdown[1]: All loop devices detached. [ 297.898219] kvm: exiting hardware virtualization [ 297.903108] sd 4:0:0:0: [sda] Synchronizing SCSI cache [ 298.148705] reboot: Restarting system [ 298.152372] reboot: machine restart € € € Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup                      Press Ctrl+S to enter the Setup Menu..  € €  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  € €  el(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.72 Press Ctrl+S to enter the Setup Menu..  € € € €  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 6D FD GUID: 00000000 0000 0000 0000 0CC47ADA6AC0 DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.156 MAS : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.156 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:6d:fd)... Configuring (net0 0c:c4:7a:88:6d:fd).... Configuring (net0 0c:c4:7a:88:6d:fd)..... Configuring (net0 0c:c4:7a:88:6d:fd)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (6.4.0-g84139c18d56f) 8  CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8              CentOS Stream (4.18.0-489.el8.x86_64) 8  The selected entry will be started automatically in 5s.  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (6.4.0-g84139c18d56f) 8   The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 6.4.0-g84139c18d56f (jenkins-build@braggi06) (gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-19), GNU ld version 2.30-113.el8) #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-6.4.0-g84139c18d56f root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.649 MHz processor [ 0.000313] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000317] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000683] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.005851] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.005860] Using GB pages for direct mapping [ 0.006075] RAMDISK: [mem 0x31426000-0x34a0afff] [ 0.006078] ACPI: Early table checksum verification disabled [ 0.006081] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006085] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006090] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006094] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006098] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006100] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006103] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006106] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006109] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006112] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006115] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006118] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006120] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006123] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006126] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006129] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006132] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006135] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006138] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006141] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006144] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006147] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006149] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006152] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006153] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006154] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006155] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006156] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006157] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006158] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006159] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006160] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006161] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006162] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006163] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006163] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006164] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006165] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006166] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006167] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006168] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006169] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006170] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006171] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006239] No NUMA configuration found [ 0.006240] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006244] NODE_DATA(0) allocated [mem 0x87ffeb000-0x87fffdfff] [ 0.006256] crashkernel: memory value expected [ 0.062844] Zone ranges: [ 0.062847] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.062850] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.062851] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.062853] Movable zone start for each node [ 0.062855] Early memory node ranges [ 0.062855] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.062857] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.062859] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.062862] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.062868] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.062901] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.119730] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.119841] ACPI: PM-Timer IO Port: 0x408 [ 0.119847] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.119849] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.119850] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.119851] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.119852] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.119853] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.119853] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.119854] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.119868] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.119873] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.119875] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.119877] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.119880] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.119881] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.119886] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.119888] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.119898] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.119899] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.119900] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.119902] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.119903] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.119904] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.119904] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.119905] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.119906] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.119907] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.119908] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.119910] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.119912] Booting paravirtualized kernel on bare hardware [ 0.119914] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.123743] setup_percpu: NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.124102] percpu: Embedded 58 pages/cpu s198112 r8192 d31264 u262144 [ 0.124129] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-6.4.0-g84139c18d56f root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.124178] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-6.4.0-g84139c18d56f", will be passed to user space. [ 0.124208] random: crng init done [ 0.127766] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.129524] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.129599] Fallback order for Node 0: 0 [ 0.129603] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.129604] Policy zone: Normal [ 0.129610] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.129620] software IO TLB: area num 8. [ 0.217488] Memory: 32691084K/33438012K available (14336K kernel code, 2761K rwdata, 4788K rodata, 2192K init, 19456K bss, 746672K reserved, 0K cma-reserved) [ 0.217566] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.217596] Kernel/User page tables isolation: enabled [ 0.217652] ftrace: allocating 42262 entries in 166 pages [ 0.223746] ftrace: allocated 166 pages with 4 groups [ 0.224669] Dynamic Preempt: voluntary [ 0.224741] Running RCU self tests [ 0.224742] Running RCU synchronous self tests [ 0.224749] rcu: Preemptible hierarchical RCU implementation. [ 0.224750] rcu: RCU lockdep checking is enabled. [ 0.224751] Trampoline variant of Tasks RCU enabled. [ 0.224752] Rude variant of Tasks RCU enabled. [ 0.224753] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.224774] Running RCU synchronous self tests [ 0.227304] NR_IRQS: 4352, nr_irqs: 896, preallocated irqs: 16 [ 0.227487] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.232813] Console: colour VGA+ 80x25 [ 0.232844] printk: console [ttyS1] enabled [ 1.261477] Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar [ 1.269211] ... MAX_LOCKDEP_SUBCLASSES: 8 [ 1.273301] ... MAX_LOCK_DEPTH: 48 [ 1.277477] ... MAX_LOCKDEP_KEYS: 8192 [ 1.281828] ... CLASSHASH_SIZE: 4096 [ 1.286182] ... MAX_LOCKDEP_ENTRIES: 32768 [ 1.290619] ... MAX_LOCKDEP_CHAINS: 65536 [ 1.295056] ... CHAINHASH_SIZE: 32768 [ 1.299493] memory used by lock dependency info: 6365 kB [ 1.304885] memory used for stack traces: 4224 kB [ 1.309670] per task-struct memory footprint: 1920 bytes [ 1.315103] ACPI: Core revision 20230331 [ 1.319280] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.328426] APIC: Switch to symmetric I/O mode setup [ 1.333466] DMAR: Host address width 46 [ 1.337310] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.342633] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.350632] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.356898] DMAR: ATSR flags: 0x0 [ 1.360219] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.366485] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.372840] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.379191] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.384593] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.384594] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.399638] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.404945] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.411269] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.421429] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327205aef5e, max_idle_ns: 440795352906 ns [ 1.431948] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.29 BogoMIPS (lpj=3499649) [ 1.432939] pid_max: default: 32768 minimum: 301 [ 1.433966] LSM: initializing lsm=capability,selinux [ 1.434943] SELinux: Initializing. [ 1.436054] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.436999] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.439417] CPU0: Thermal monitoring enabled (TM1) [ 1.440009] process: using mwait in idle threads [ 1.440945] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.441939] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.442942] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.443940] Spectre V2 : Kernel not compiled with retpoline; no mitigation available! [ 1.443941] Spectre V2 : Vulnerable [ 1.445939] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.446939] Speculative Store Bypass: Vulnerable [ 1.447948] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.448939] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.449939] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.455022] Freeing SMP alternatives memory: 36K [ 1.456060] Running RCU synchronous self tests [ 1.456941] Running RCU synchronous self tests [ 1.560769] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.562244] cblist_init_generic: Setting adjustable number of callback queues. [ 1.562940] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.563986] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.564974] Running RCU-tasks wait API self tests [ 1.667107] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.667945] ... version: 3 [ 1.668940] ... bit width: 48 [ 1.669940] ... generic registers: 4 [ 1.670940] ... value mask: 0000ffffffffffff [ 1.671940] ... max period: 00007fffffffffff [ 1.672940] ... fixed-purpose events: 3 [ 1.673940] ... event mask: 000000070000000f [ 1.675115] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.675996] rcu: Hierarchical SRCU implementation. [ 1.676940] rcu: Max phase no-delay instances is 400. [ 1.679724] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.680120] smp: Bringing up secondary CPUs ... [ 1.681221] x86: Booting SMP configuration: [ 1.681946] .... node #0, CPUs: #1 #2 #3 #4 [ 1.686078] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.687945] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.688940] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.690166] #5 #6 #7 [ 1.692721] smp: Brought up 1 node, 8 CPUs [ 1.693945] smpboot: Max logical packages: 1 [ 1.694940] smpboot: Total of 8 processors activated (55994.38 BogoMIPS) [ 1.699292] devtmpfs: initialized [ 1.701017] x86/mm: Memory block size: 128MB [ 1.710789] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.711347] Running RCU synchronous self tests [ 1.711949] Running RCU synchronous self tests [ 1.712974] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.713943] futex hash table entries: 2048 (order: 6, 262144 bytes, linear) [ 1.715120] pinctrl core: initialized pinctrl subsystem [ 1.716085] PM: RTC time: 01:37:54, date: 2023-07-12 [ 1.718528] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.719231] audit: initializing netlink subsys (disabled) [ 1.719965] audit: type=2000 audit(1689125872.309:1): state=initialized audit_enabled=0 res=1 [ 1.720166] thermal_sys: Registered thermal governor 'fair_share' [ 1.720942] thermal_sys: Registered thermal governor 'bang_bang' [ 1.721940] thermal_sys: Registered thermal governor 'step_wise' [ 1.722940] thermal_sys: Registered thermal governor 'user_space' [ 1.723970] cpuidle: using governor menu [ 1.726976] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.727942] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.729082] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.729941] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.730952] PCI: Using configuration type 1 for base access [ 1.732980] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.735004] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.735942] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.736940] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.737939] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.739955] cryptd: max_cpu_qlen set to 1000 [ 1.741120] ACPI: Added _OSI(Module Device) [ 1.741943] ACPI: Added _OSI(Processor Device) [ 1.742940] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.743940] ACPI: Added _OSI(Processor Aggregator Device) [ 1.779063] Callback from call_rcu_tasks_rude() invoked. [ 1.824145] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.835610] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.846174] ACPI: Dynamic OEM Table Load: [ 1.898107] ACPI: Interpreter enabled [ 1.898978] ACPI: PM: (supports S0 S4 S5) [ 1.899944] ACPI: Using IOAPIC for interrupt routing [ 1.900980] HEST: Enabling Firmware First mode for corrected errors. [ 1.902061] HEST: Table parsing has been initialized. [ 1.903204] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.903942] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.904939] PCI: Using E820 reservations for host bridge windows [ 1.907866] ACPI: Enabled 5 GPEs in block 00 to 3F [ 2.004536] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 2.004944] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 2.012641] acpi PNP0A03:03: _OSC: platform does not support [AER LTR] [ 2.014580] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.014940] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.016117] PCI host bridge to bus 0000:ff [ 2.016944] pci_bus 0000:ff: root bus resource [bus ff] [ 2.018940] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 2.020067] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 2.021028] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 2.022036] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 2.023027] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 2.024024] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 2.025025] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 2.026025] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 2.027026] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 2.028024] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 2.029024] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 2.030941] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 2.032028] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 2.033024] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 2.034025] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 2.035030] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 2.036022] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 2.037023] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 2.038023] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 2.039012] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 2.040035] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 2.041137] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 2.043051] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 2.044045] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 2.045047] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 2.046044] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 2.047041] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 2.048029] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 2.049028] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.050044] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.051045] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.053001] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.054043] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.055025] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.056028] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.057026] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.058027] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.059046] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.060046] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.061052] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.062047] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.063995] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.065026] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.066026] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.067033] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.068026] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.069026] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.070026] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.071031] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.072024] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.073026] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.074025] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.075972] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.077028] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.078029] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.087995] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.088943] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 2.090313] acpi PNP0A08:00: _OSC: platform does not support [AER LTR] [ 2.091654] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.091940] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.095296] PCI host bridge to bus 0000:00 [ 2.095941] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.096940] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.097940] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.098940] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.099940] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.100940] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.101940] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.102987] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.104172] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.104997] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.107052] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.107997] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.109207] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.109996] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.111198] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.111949] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.113141] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.113948] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.115142] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.115948] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.117140] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.117948] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.119139] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.119948] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.121138] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.121948] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.123147] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.123948] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.125141] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.125948] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.127140] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.128983] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.130144] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.131069] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.131946] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.133095] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.135026] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.135952] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.136946] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.137946] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.138946] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.139946] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.140946] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.141981] pci 0000:00:11.4: PME# supported from D3hot [ 2.143129] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.143955] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.144999] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.146201] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.146955] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.148000] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.149111] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.149955] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.151000] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.152125] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.152954] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.154023] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.155141] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.156018] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.157178] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.158949] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.160168] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.161019] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.162201] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.162954] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.164024] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.165150] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.166237] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.166950] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.167945] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.168947] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.169945] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.170945] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.171945] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.172976] pci 0000:00:1f.2: PME# supported from D3hot [ 2.174121] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.174955] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.175957] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.178152] acpiphp: Slot [1] registered [ 2.178986] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.180298] pci 0000:02:00.0: [8086:2700] type 00 class 0x010802 [ 2.180950] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.181959] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.182943] pci 0000:02:00.0: enabling Extended Tags [ 2.185180] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.185942] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.188307] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.188951] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.189944] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.190951] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.191944] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.192990] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.193959] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.194940] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.195948] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.196940] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.198237] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.198951] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.199944] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.200951] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.201944] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.202989] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.203956] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.204940] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.205948] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.206940] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.208219] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.208941] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.209941] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.210942] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.212000] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.213046] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.214009] pci 0000:05:00.0: enabling Extended Tags [ 2.215024] pci 0000:05:00.0: supports D1 D2 [ 2.215940] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.217170] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.217942] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.218941] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.220961] pci_bus 0000:06: extended config space not accessible [ 2.222010] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.222963] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.223952] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.224952] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.226010] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.226985] pci 0000:06:00.0: supports D1 D2 [ 2.227940] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.229162] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.229946] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.230943] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.232093] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.232958] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.233958] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.234949] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.236073] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.236977] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.237940] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.238961] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.239940] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.241272] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.241958] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.242958] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.243949] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.245068] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.245976] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.246940] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.247961] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.248940] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.251137] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.251942] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.252941] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.253943] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.257676] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.258019] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.259016] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.260015] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.261015] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.261940] ACPI: PCI: Interrupt link LNKE disabled [ 2.263014] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.263940] ACPI: PCI: Interrupt link LNKF disabled [ 2.265014] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.265940] ACPI: PCI: Interrupt link LNKG disabled [ 2.267014] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.267940] ACPI: PCI: Interrupt link LNKH disabled [ 2.269424] iommu: Default domain type: Translated [ 2.269941] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.271975] SCSI subsystem initialized [ 2.273035] ACPI: bus type USB registered [ 2.273967] usbcore: registered new interface driver usbfs [ 2.274957] usbcore: registered new interface driver hub [ 2.275955] usbcore: registered new device driver usb [ 2.277001] EDAC MC: Ver: 3.0.0 [ 2.278356] NetLabel: Initializing [ 2.278942] NetLabel: domain hash size = 128 [ 2.279940] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.280967] NetLabel: unlabeled traffic allowed by default [ 2.281940] PCI: Using ACPI for IRQ routing [ 2.290109] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.290938] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.290938] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.290942] vgaarb: loaded [ 2.292020] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.292941] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.296074] clocksource: Switched to clocksource tsc-early [ 2.301925] VFS: Disk quotas dquot_6.6.0 [ 2.305868] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.312902] pnp: PnP ACPI init [ 2.314450] Callback from call_rcu_tasks() invoked. [ 2.316749] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.326767] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.332687] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.338610] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.344527] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.350445] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.356359] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.362973] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.369585] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.376196] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.382802] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.389416] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.396030] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.403070] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.408990] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.414908] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.420828] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.426749] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.434388] pnp: PnP ACPI: found 5 devices [ 2.446416] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.455369] NET: Registered PF_INET protocol family [ 2.460461] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 2.470517] tcp_listen_portaddr_hash hash table entries: 16384 (order: 8, 1179648 bytes, linear) [ 2.479553] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 2.487365] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 2.495709] TCP bind hash table entries: 65536 (order: 11, 9437184 bytes, vmalloc hugepage) [ 2.506002] TCP: Hash tables configured (established 262144 bind 65536) [ 2.512807] UDP hash table entries: 16384 (order: 9, 2621440 bytes, linear) [ 2.520408] UDP-Lite hash table entries: 16384 (order: 9, 2621440 bytes, linear) [ 2.528415] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 2.534119] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.545599] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.553425] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.558395] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.563362] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.570151] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.577724] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.585651] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.593303] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.601302] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.608862] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.616768] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.624412] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.632408] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.639971] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.647876] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.655528] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.663522] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.671087] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.678992] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.686636] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.694632] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.699597] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.705690] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.712476] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.720220] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.725190] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.730151] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.736248] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.743038] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.748257] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.754351] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.761145] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.768879] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.776706] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.784448] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.792275] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.797238] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.803334] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.810118] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.817862] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.826900] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.833078] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.839250] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.846121] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.852988] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.859860] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.866726] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.872993] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.878558] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.884824] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.892035] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.897600] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.903858] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.909424] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.915688] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.921253] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.927511] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.935088] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.958632] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x690 took 15628 usecs [ 2.982612] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x690 took 16176 usecs [ 2.990021] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.996589] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.996691] Trying to unpack rootfs image as initramfs... [ 3.003028] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 3.016414] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 3.024325] RAPL PMU: hw unit of domain package 2^-14 Joules [ 3.029980] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 3.039353] Initialise system trusted keyrings [ 3.043912] workingset: timestamp_bits=37 max_order=23 bucket_order=0 [ 3.050379] zbud: loaded [ 3.061522] NET: Registered PF_ALG protocol family [ 3.066339] Key type asymmetric registered [ 3.070453] Asymmetric key parser 'x509' registered [ 3.075354] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251) [ 3.082831] io scheduler mq-deadline registered [ 3.087364] io scheduler kyber registered [ 3.092830] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.100494] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.106796] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.113056] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.119188] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.125320] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.131417] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.137571] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.144710] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.153130] ACPI: button: Power Button [PWRB] [ 3.157566] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.165119] ACPI: button: Power Button [PWRF] [ 3.172177] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.179693] pstore: Registered erst as persistent store backend [ 3.185892] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.192283] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.199861] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.208393] Non-volatile memory driver v1.3 [ 3.214240] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 3.222330] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 3.239514] scsi host0: ahci [ 3.242708] scsi host1: ahci [ 3.245865] scsi host2: ahci [ 3.249006] scsi host3: ahci [ 3.252057] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 3.259452] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 3.266844] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 3.274237] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 3.282112] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 3.290293] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 3.314756] scsi host4: ahci [ 3.317913] scsi host5: ahci [ 3.321065] scsi host6: ahci [ 3.324203] scsi host7: ahci [ 3.327343] scsi host8: ahci [ 3.330501] scsi host9: ahci [ 3.333500] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 34 [ 3.340896] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 34 [ 3.348284] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 34 [ 3.355678] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 34 [ 3.363071] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 34 [ 3.370466] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 34 [ 3.379593] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.385126] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.392545] ehci-pci 0000:00:1a.0: debug port 2 [ 3.401088] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.413467] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.419432] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.04 [ 3.427699] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.434917] usb usb1: Product: EHCI Host Controller [ 3.439787] usb usb1: Manufacturer: Linux 6.4.0-g84139c18d56f ehci_hcd [ 3.446306] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.451537] hub 1-0:1.0: USB hub found [ 3.455328] hub 1-0:1.0: 2 ports detected [ 3.460011] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.465451] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.473932] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.483652] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.483661] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.489005] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.494240] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 4 [ 3.501497] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.508907] ehci-pci 0000:00:1d.0: debug port 2 [ 3.515269] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.04 [ 3.523612] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.527941] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.540459] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.540802] usb usb2: Product: xHCI Host Controller [ 3.551411] usb usb2: Manufacturer: Linux 6.4.0-g84139c18d56f xhci-hcd [ 3.557936] usb usb2: SerialNumber: 0000:00:14.0 [ 3.563105] hub 2-0:1.0: USB hub found [ 3.566913] hub 2-0:1.0: 15 ports detected [ 3.577800] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 6.04 [ 3.586060] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.591693] ata3: SATA link down (SStatus 0 SControl 300) [ 3.593279] usb usb3: Product: xHCI Host Controller [ 3.593281] usb usb3: Manufacturer: Linux 6.4.0-g84139c18d56f xhci-hcd [ 3.593283] usb usb3: SerialNumber: 0000:00:14.0 [ 3.593627] hub 3-0:1.0: USB hub found [ 3.598722] ata4: SATA link down (SStatus 0 SControl 300) [ 3.603869] hub 3-0:1.0: 6 ports detected [ 3.610125] ata2: SATA link down (SStatus 0 SControl 300) [ 3.618483] usbcore: registered new interface driver usbserial_generic [ 3.618550] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.04 [ 3.618555] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.618557] usb usb4: Product: EHCI Host Controller [ 3.618559] usb usb4: Manufacturer: Linux 6.4.0-g84139c18d56f ehci_hcd [ 3.618562] usb usb4: SerialNumber: 0000:00:1d.0 [ 3.619057] hub 4-0:1.0: USB hub found [ 3.619085] hub 4-0:1.0: 2 ports detected [ 3.623884] ata1: SATA link down (SStatus 0 SControl 300) [ 3.627921] usbserial: USB Serial support registered for generic [ 3.687619] ata8: SATA link down (SStatus 0 SControl 300) [ 3.690812] i8042: PNP: No PS/2 controller found. [ 3.695855] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 3.700697] mousedev: PS/2 mouse device common for all mice [ 3.706735] ata7: SATA link down (SStatus 0 SControl 300) [ 3.712628] rtc_cmos 00:00: RTC can wake from S4 [ 3.717709] ata9: SATA link down (SStatus 0 SControl 300) [ 3.723046] rtc_cmos 00:00: registered as rtc0 [ 3.727730] ata10: SATA link down (SStatus 0 SControl 300) [ 3.732217] rtc_cmos 00:00: setting system clock to 2023-07-12T01:37:58 UTC (1689125878) [ 3.737661] ata6: SATA link down (SStatus 0 SControl 300) [ 3.745724] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.746612] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 3.751307] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 3.757755] device-mapper: uevent: version 1.0.3 [ 3.764807] ata5.00: NCQ Send/Recv Log not supported [ 3.770853] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com [ 3.772830] Freeing initrd memory: 55188K [ 3.775240] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 3.776586] ata5.00: NCQ Send/Recv Log not supported [ 3.804593] ata5.00: configured for UDMA/133 [ 3.804598] intel_pstate: Intel P-state driver initializing [ 3.809257] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 3.823472] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.823493] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 3.823587] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 3.823602] sd 4:0:0:0: [sda] Write Protect is off [ 3.823621] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 3.823645] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 3.851072] sda: sda1 [ 3.857834] hid: raw HID events driver (C) Jiri Kosina [ 3.863385] sd 4:0:0:0: [sda] Attached SCSI disk [ 3.865706] usbcore: registered new interface driver usbhid [ 3.871527] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 3.875261] usbhid: USB HID core driver [ 3.875576] drop_monitor: Initializing network drop monitor service [ 3.887975] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 3.891391] Initializing XFRM netlink socket [ 3.897574] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.905772] NET: Registered PF_INET6 protocol family [ 3.911490] hub 1-1:1.0: USB hub found [ 3.917731] Segment Routing with IPv6 [ 3.922397] hub 1-1:1.0: 6 ports detected [ 3.925904] In-situ OAM (IOAM) with IPv6 [ 3.925921] mip6: Mobile IPv6 [ 3.940490] NET: Registered PF_PACKET protocol family [ 3.947587] microcode: Microcode Update Driver: v2.2. [ 3.947593] IPI shorthand broadcast: enabled [ 3.956759] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 3.956944] AVX2 version of gcm_enc/dec engaged. [ 3.965213] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.977189] AES CTR mode by8 optimization enabled [ 3.979306] hub 2-12:1.0: USB hub found [ 3.985883] hub 2-12:1.0: 4 ports detected [ 3.986162] sched_clock: Marking stable (2802001578, 1183420032)->(5863182553, -1877760943) [ 3.998656] registered taskstats version 1 [ 4.002765] Loading compiled-in X.509 certificates [ 4.010851] usb 4-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.019044] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.027163] hub 4-1:1.0: USB hub found [ 4.031109] hub 4-1:1.0: 8 ports detected [ 4.035585] Loaded X.509 cert 'Build time autogenerated kernel key: 341f123a993b8e7174eb8f33914088b566107c94' [ 4.051925] debug_vm_pgtable: [debug_vm_pgtable ]: Validating architecture page table helpers [ 4.067532] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.073757] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.179085] clocksource: Switched to clocksource tsc [ 4.179644] Key type .fscrypt registered [ 4.188014] Key type fscrypt-provisioning registered [ 4.193229] pstore: Using crash dump compression: deflate [ 4.266241] PM: Magic number: 15:590:609 [ 4.270480] acpi device:179: hash matches [ 4.274543] acpi device:14c: hash matches [ 4.278616] acpi ACPI0004:02: hash matches [ 4.282735][ 4.287117] c [ 4.294840] Freeing unused kernel image (initmem) memory: 2192K [ 4.312508] Write protecting the kernel read-only data: 20480k [ 4.319027] Freeing unused kernel image (rodata/data gap) memory: 1356K [ 4.325721] rodata_test: all tests were successful [ 4.330523] Run /init as init process [ 4.366453] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 4.3733 (239-75.el8) ruUDIT +SELINUX +I +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.396303] systemd[1]: Detected architecture x86-64. [ 4.401400] systemd[1]: Running in initial RAM disk. Welcome to CentOS Stream 8 dracut-049-224.git20230330.el8 (Initramfs)! [ 4.434645] systemd[1]: Set hostname to . [ 4.481735] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.490182] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.504245] iput: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 4.533353] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 4.545535] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 4.555504] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 4.565556] systemd[1]: Reached target Local File Sys [ 4.569601] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ OK ] Reached targ[ 4.584880] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 et Local File Sy[ 4.597910] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 stems. [ 4.612619] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ 4.623053] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket. [ OK ] Reached target Sockets. [ OK ] Started Memstrack Anylazing Service. Starting Load Kernel Modules... Starting Create Volatile Files and Directories... Starting Setup Virtual Console... Starting Journal Service... Starting Create list of required st…ce nodes for the current kernel... [ 4.715286] fuse: init (API version 7.38) [ OK ] Started Load Kernel Modules. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... Starting Apply Kernel Variables... [ OK ] Started Setup Virtual Console. [ OK ] Started Journal Service. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting Show Plymouth Boot Screen... Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Started Show Plymouth Boot Screen. [ OK ] Reached target Paths. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [ OK ] Reached target Basic Syst[ 5.541645] dca service started, version 1.12.1 em. [ 5.556907] pps_core: LinuxPPS API ver. 1 registered [ 5.561890] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 5.590296] PTP clock support registered [ 5.612821] nvme nvme0: pci function 0000:02:00.0 [ 5.658691] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.659096] nvme nvme0: 8/0/0 default/read/poll queues [ 5.664094] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.722031] igb 0000:07:00.0: added PHC on eth0 [ 5.726582] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.733468] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:da:6a:c0 [ 5.740717] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.740721] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.744780] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.744783] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.796981] igb 0000:07:00.1: added PHC on eth1 [ 5.801521] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.801522] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:da:6a:c1 [ 5.801600] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.820696] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ OK ] Found device ST1000NM0033-9Z[ 5.831849] igb 0000:07:00.0 eno1: renamed from eth0 M173 1. [ OK ] Reached target Initrd Root Device. [ 5.858746] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.880928] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.891244] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.899777] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.905974] ixgbe 0000:03:00.0: 0c:c4:7a:88:6d:fc [ 6.918017] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.077897] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.088213] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.096743] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.103802] ixgbe 0000:03:00.1: 0c:c4:7a:88:6d:fd [ 7.115247] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.125219] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.137733] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. Starting File System Check on /dev/…ddf-553d-41ea-8bce-5708f99a0430... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ OK ] Started File System Check on /dev/d…36ddf-553d-41ea-8bce-5708f99a0430. Mounting /sysroot... [ 7.387055] EXT4-fs (sda1): mounted filesystem c5236ddf-553d-41ea-8bce-5708f99a0430 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ 7.429150] memfd_create() without MFD_EXEC nor MFD_NOEXEC_SEAL, pid=1 'systemd' [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Plymouth switch root service... Starting Setup Virtual Console... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Timers. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. Stopping udev Kernel Device Manager... [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Swap. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Sockets. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 8.073578] printk: systemd: 18 output lines suppressed due to ratelimiting [ 8.738242] SELinux: Permission watch in class filesystem not defined in policy. [ 8.745774] SELinux: Permission watch in class file not defined in policy. [ 8.752734] SELinux: Permission watch_mount in class file not defined in policy. [ 8.760212] SELinux: Permission watch_sb in class file not defined in policy. [ 8.767424] SELinux: Permission watch_with_perm in class file not defined in policy. [ 8.775249] SELinux: Permission watch_reads in class file not defined in policy. [ 8.782721] SELinux: Permission watch in class dir not defined in policy. [ 8.789593] SELinux: Permission watch_mount in class dir not defined in policy. [ 8.796979] SELinux: Permission watch_sb in class dir not defined in policy. [ 8.804111] SELinux: Permission watch_with_perm in class dir not defined in policy. [ 8.811850] SELinux: Permission watch_reads in class dir not defined in policy. [ 8.819245] SELinux: Permission watch in class lnk_file not defined in policy. [ 8.826547] SELinux: Permission watch_mount in class lnk_file not defined in policy. [ 8.834365] SELinux: Permission watch_sb in class lnk_file not defined in policy. [ 8.841923] SELinux: Permission watch_with_perm in class lnk_file not defined in policy. [ 8.850088] SELinux: Permission watch_reads in class lnk_file not defined in policy. [ 8.857913] SELinux: Permission watch in class chr_file not defined in policy. [ 8.865210] SELinux: Permission watch_mount in class chr_file not defined in policy. [ 8.873029] SELinux: Permission watch_sb in class chr_file not defined in policy. [ 8.880595] SELinux: Permission watch_with_perm in class chr_file not defined in policy. [ 8.888759] SELinux: Permission watch_reads in class chr_file not defined in policy. [ 8.896584] SELinux: Permission watch in class blk_file not defined in policy. [ 8.903883] SELinux: Permission watch_mount in class blk_file not defined in policy. [ 8.911707] SELinux: Permission watch_sb in class blk_file not defined in policy. [ 8.919265] SELinux: Permission watch_with_perm in class blk_file not defined in policy. [ 8.927430] SELinux: Permission watch_reads in class blk_file not defined in policy. [ 8.935247] SELinux: Permission watch in class sock_file not defined in policy. [ 8.942630] SELinux: Permission watch_mount in class sock_file not defined in policy. [ 8.950536] SELinux: Permission watch_sb in class sock_file not defined in policy. [ 8.958189] SELinux: Permission watch_with_perm in class sock_file not defined in policy. [ 8.966440] SELinux: Permission watch_reads in class sock_file not defined in policy. [ 8.974351] SELinux: Permission watch in class fifo_file not defined in policy. [ 8.981735] SELinux: Permission watch_mount in class fifo_file not defined in policy. [ 8.989641] SELinux: Permission watch_sb in class fifo_file not defined in policy. [ 8.997295] SELinux: Permission watch_with_perm in class fifo_file not defined in policy. [ 9.005551] SELinux: Permission watch_reads in class fifo_file not defined in policy. [ 9.013483] SELinux: Permission perfmon in class capability2 not defined in policy. [ 9.021223] SELinux: Permission bpf in class capability2 not defined in policy. [ 9.028618] SELinux: Permission perfmon in class cap2_userns not defined in policy. [ 9.036353] SELinux: Permission bpf in class cap2_userns not defined in policy. [ 9.043754] SELinux: Class mctp_socket not defined in policy. [ 9.049579] SELinux: Class anon_inode not defined in policy. [ 9.055316] SELinux: Class io_uring not defined in policy. [ 9.060886] SELinux: Class user_namespace not defined in policy. [ 9.066975] SELinux: the above unknown classes and permissions will be allowed [ 9.088208] SELinux: policy capability network_peer_controls=1 [ 9.094134] SELinux: policy capability open_perms=1 [ 9.099095] SELinux: policy capability extended_socket_class=1 [ 9.105013] SELinux: policy capability always_check_network=0 [ 9.110836] SELinux: policy capability cgroup_seclabel=1 [ 9.116228] SELinux: policy capability nnp_nosuid_transition=1 [ 9.122138] SELinux: policy capability genfs_seclabel_symlinks=0 [ 9.128224] SELinux: policy capability ioctl_skip_cloexec=0 [ 9.192667] audit: type=1403 audit(1689125883.959:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 9.195466] systemd[1]: Successfully loaded SELinux policy in 715.445ms. [ 9.301179] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 28.130ms. [ 9.316768] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 9.339422] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 8! [ 9.362966] systemd[1]: Set hostname to . [ 10.346071] systemd[1]: initrd-switch-root.service: Succeeded. [ 10.353064] systemd[1]: Stopped Switch Root. [ OK [[ 10.358887] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 10.369734] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 10.379958] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 10.393697] systemd[1]: Starting Journal Service... Starting Journal Servic[ 10.400347] systemd[1]: Listening on udev Control Socket. e... [ OK ] Listening on udev Control Socket. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. Mounting POSIX Message Queue File System... Mounting Huge Pages File System... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Stopped Plymouth switch root service. [ OK ] Reached target Paths. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Listening on LVM2 poll daemon socket. Mounting Kernel Debug File System... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Created slice system-getty.slice. [ OK ] Reached target Local Encrypted Volumes. Starting Load Kernel Modules... Starting Remount Root and Kernel File Systems..[ 10.523124] EXT4-fs (sda1): re-mounted c5236ddf-553d-41ea-8bce-5708f99a0430 r/w. Quota mode: none. . [ OK ] Stopped target Switch Root. Starting Setup Virtual Console... [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Reached target Swap. [ OK ] Started Journal Service. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Started Remount Root and Kernel File Systems. Starting Load/Save Random Seed... Starting Flush Journal to Persistent Storage... [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. Starting Create Static Device Nodes in /dev... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load/Save Random Seed. [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Started Setup Virtual Console. [ OK ] Started udev Kernel Device Manager. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Import network configuration from initramfs... [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network confi[ 11.291949] ioatdma: Intel(R) QuickData Technology Driver 5.00 guration from initramfs. Starting Create Volatile Files and Directories... [ 11.314293] igb 0000:07:00.0: DCA enabled [ 11.318402] igb 0000:07:00.1: DCA enabled [ 11.402901] IPMI message handler: version 39.2 [ 11.422546] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 11.435401] power_meter ACPI000D:00: Found ACPI power meter. [ 11.442017] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 11.448790] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 11.470269] ipmi device interface [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ 11.632827] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.642583] i2c i2c-2: 2/8 memory slots populated (from DMI) [ 11.648251] i2c i2c-2: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 11.688670] ipmi_si: IPMI System Interface driver [ 11.688709] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 11.688712] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 11.688766] ipmi_si: Adding SMBIOS-specified kcs state machine [ 11.689246] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 11.689469] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ OK ] Started Create Volatile Files and Directories. [ 11.806665] iTCO_vendor_support: vendor-support=0 [ 11.832204] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 11.840961] ipmi_si: Adding ACPI-specified kcs state machine [ 11.846880] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 11.877560] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.888257] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) Starting RPC Bind... Starting Security Auditing Service... Mounting RPC Pipe File System... [ OK ] Started LVM event activation on device 259:0. [ 11.932423] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 11.974369] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 12.025947] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 12.193704] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Started RPC Bind. [ 12.621996] RPC: Registered named UNIX socket transport module. [ 12.627970] RPC: Registered udp transport module. [ 12.632680] RPC: Registered tcp transport module. [ 12.637406] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Sockets. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Updates mlocate database every day. [ OK ] Reached target Timers. [ OK ] Reached target Basic System. Starting Authorization Manager... Starting VDO volume services... [ OK ] Started libstoragemgmt plug-in server daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... Starting Kernel Samepage Merging... Starting Resets System Activity Logs... Starting NTP client/server... [ OK ] Started irqbalance daemon. Starting Restore /run/initramfs on shutdown... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started Machine Check Exception Logging Daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Login Service... [ OK ] Started Kernel Samepage Merging. [ OK ] Started Restore /run/initramfs on shutdown. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ 15.642826] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 15.653838] EDAC sbridge: Ver: 1.1.2 [ 16.031199] intel_rapl_common: Found RAPL domain package [ 16.036751] intel_rapl_common: Found RAPL domain dram [ 16.041830] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Login Service. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started NTP client/server. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Hostname Service. [ OK ] Started Permit User Sessions. [ OK ] Started Job spooling tools. [ OK ] Started Command Scheduler. Starting Network Manager Script Dispatcher Service... [ OK ] Started Authorization Manager. [ OK ] Started Network Manager Script Dispatcher Service. [ 17.212979] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ OK ] Started VDO volume services. [ 17.371893] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 17.598548] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 17.795520] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 17.803512] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ 18.180619] msr: Write to unrecognized MSR 0x1b0 by x86_energy_perf (pid: 1043). [ 18.188045] msr: See https://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git/about for details. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Created slice User Slice of UID 1000. Starting User runtime directory /run/user/1000... [ OK ] Started User runtime directory /run/user/1000. Starting User Manager for UID 1000... [ OK ] Started User Manager for UID 1000. [ OK ] Started Session 1 of user ubuntu. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting /etc/rc.d/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [FAILED] Failed to start Crash recovery kernel arming. See 'systemctl status kdump.service' for details. [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.156 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' 172.21.15.156 '!=' '' ']' + set -e + '[' -n 172.21.15.156 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.156 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.156 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi156.front.sepia.ceph.com + '[' -n smithi156.front.sepia.ceph.com ']' + hostname smithi156.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi156 + echo smithi156 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.156 smithi156.front.sepia.ceph.com smithi156\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 8 Kernel 6.4.0-g84139c18d56f on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi156 login: [ 444.215508] SELinux: Permission watch in class filesystem not defined in policy. [ 444.222996] SELinux: Permission watch in class file not defined in policy. [ 444.229959] SELinux: Permission watch_mount in class file not defined in policy. [ 444.237435] SELinux: Permission watch_sb in class file not defined in policy. [ 444.244651] SELinux: Permission watch_with_perm in class file not defined in policy. [ 444.252481] SELinux: Permission watch_reads in class file not defined in policy. [ 444.259959] SELinux: Permission watch in class dir not defined in policy. [ 444.266846] SELinux: Permission watch_mount in class dir not defined in policy. [ 444.274239] SELinux: Permission watch_sb in class dir not defined in policy. [ 444.281370] SELinux: Permission watch_with_perm in class dir not defined in policy. [ 444.289102] SELinux: Permission watch_reads in class dir not defined in policy. [ 444.296498] SELinux: Permission watch in class lnk_file not defined in policy. [ 444.303819] SELinux: Permission watch_mount in class lnk_file not defined in policy. [ 444.311644] SELinux: Permission watch_sb in class lnk_file not defined in policy. [ 444.319219] SELinux: Permission watch_with_perm in class lnk_file not defined in policy. [ 444.327392] SELinux: Permission watch_reads in class lnk_file not defined in policy. [ 444.335217] SELinux: Permission watch in class chr_file not defined in policy. [ 444.342514] SELinux: Permission watch_mount in class chr_file not defined in policy. [ 444.350333] SELinux: Permission watch_sb in class chr_file not defined in policy. [ 444.357901] SELinux: Permission watch_with_perm in class chr_file not defined in policy. [ 444.366089] SELinux: Permission watch_reads in class chr_file not defined in policy. [ 444.373907] SELinux: Permission watch in class blk_file not defined in policy. [ 444.381230] SELinux: Permission watch_mount in class blk_file not defined in policy. [ 444.389062] SELinux: Permission watch_sb in class blk_file not defined in policy. [ 444.396638] SELinux: Permission watch_with_perm in class blk_file not defined in policy. [ 444.404804] SELinux: Permission watch_reads in class blk_file not defined in policy. [ 444.412648] SELinux: Permission watch in class sock_file not defined in policy. [ 444.420056] SELinux: Permission watch_mount in class sock_file not defined in policy. [ 444.427960] SELinux: Permission watch_sb in class sock_file not defined in policy. [ 444.435623] SELinux: Permission watch_with_perm in class sock_file not defined in policy. [ 444.443883] SELinux: Permission watch_reads in class sock_file not defined in policy. [ 444.451814] SELinux: Permission watch in class fifo_file not defined in policy. [ 444.459207] SELinux: Permission watch_mount in class fifo_file not defined in policy. [ 444.467135] SELinux: Permission watch_sb in class fifo_file not defined in policy. [ 444.474780] SELinux: Permission watch_with_perm in class fifo_file not defined in policy. [ 444.483056] SELinux: Permission watch_reads in class fifo_file not defined in policy. [ 444.491014] SELinux: Permission perfmon in class capability2 not defined in policy. [ 444.498768] SELinux: Permission bpf in class capability2 not defined in policy. [ 444.506184] SELinux: Permission perfmon in class cap2_userns not defined in policy. [ 444.513921] SELinux: Permission bpf in class cap2_userns not defined in policy. [ 444.521328] SELinux: Class mctp_socket not defined in policy. [ 444.527179] SELinux: Class anon_inode not defined in policy. [ 444.532943] SELinux: Class io_uring not defined in policy. [ 444.538515] SELinux: Class user_namespace not defined in policy. [ 444.544599] SELinux: the above unknown classes and permissions will be allowed [ 444.551927] SELinux: Converting 423 SID table entries... [ 444.579782] SELinux: policy capability network_peer_controls=1 [ 444.585755] SELinux: policy capability open_perms=1 [ 444.590723] SELinux: policy capability extended_socket_class=1 [ 444.596643] SELinux: policy capability always_check_network=0 [ 444.602478] SELinux: policy capability cgroup_seclabel=1 [ 444.607876] SELinux: policy capability nnp_nosuid_transition=1 [ 444.613796] SELinux: policy capability genfs_seclabel_symlinks=0 [ 444.619889] SELinux: policy capability ioctl_skip_cloexec=0 [ 466.463952] SELinux: Permission watch in class filesystem not defined in policy. [ 466.471436] SELinux: Permission watch in class file not defined in policy. [ 466.478395] SELinux: Permission watch_mount in class file not defined in policy. [ 466.485872] SELinux: Permission watch_sb in class file not defined in policy. [ 466.493090] SELinux: Permission watch_with_perm in class file not defined in policy. [ 466.500934] SELinux: Permission watch_reads in class file not defined in policy. [ 466.508432] SELinux: Permission watch in class dir not defined in policy. [ 466.515319] SELinux: Permission watch_mount in class dir not defined in policy. [ 466.522707] SELinux: Permission watch_sb in class dir not defined in policy. [ 466.529837] SELinux: Permission watch_with_perm in class dir not defined in policy. [ 466.537577] SELinux: Permission watch_reads in class dir not defined in policy. [ 466.544970] SELinux: Permission watch in class lnk_file not defined in policy. [ 466.552276] SELinux: Permission watch_mount in class lnk_file not defined in policy. [ 466.560160] SELinux: Permission watch_sb in class lnk_file not defined in policy. [ 466.567724] SELinux: Permission watch_with_perm in class lnk_file not defined in policy. [ 466.575893] SELinux: Permission watch_reads in class lnk_file not defined in policy. [ 466.583718] SELinux: Permission watch in class chr_file not defined in policy. [ 466.591028] SELinux: Permission watch_mount in class chr_file not defined in policy. [ 466.598852] SELinux: Permission watch_sb in class chr_file not defined in policy. [ 466.606416] SELinux: Permission watch_with_perm in class chr_file not defined in policy. [ 466.614581] SELinux: Permission watch_reads in class chr_file not defined in policy. [ 466.622398] SELinux: Permission watch in class blk_file not defined in policy. [ 466.629695] SELinux: Permission watch_mount in class blk_file not defined in policy. [ 466.637513] SELinux: Permission watch_sb in class blk_file not defined in policy. [ 466.645072] SELinux: Permission watch_with_perm in class blk_file not defined in policy. [ 466.653248] SELinux: Permission watch_reads in class blk_file not defined in policy. [ 466.661089] SELinux: Permission watch in class sock_file not defined in policy. [ 466.668495] SELinux: Permission watch_mount in class sock_file not defined in policy. [ 466.676400] SELinux: Permission watch_sb in class sock_file not defined in policy. [ 466.684045] SELinux: Permission watch_with_perm in class sock_file not defined in policy. [ 466.692297] SELinux: Permission watch_reads in class sock_file not defined in policy. [ 466.700228] SELinux: Permission watch in class fifo_file not defined in policy. [ 466.707635] SELinux: Permission watch_mount in class fifo_file not defined in policy. [ 466.715557] SELinux: Permission watch_sb in class fifo_file not defined in policy. [ 466.723226] SELinux: Permission watch_with_perm in class fifo_file not defined in policy. [ 466.731477] SELinux: Permission watch_reads in class fifo_file not defined in policy. [ 466.739447] SELinux: Permission perfmon in class capability2 not defined in policy. [ 466.747183] SELinux: Permission bpf in class capability2 not defined in policy. [ 466.754579] SELinux: Permission perfmon in class cap2_userns not defined in policy. [ 466.762315] SELinux: Permission bpf in class cap2_userns not defined in policy. [ 466.769740] SELinux: Class mctp_socket not defined in policy. [ 466.775592] SELinux: Class anon_inode not defined in policy. [ 466.781330] SELinux: Class io_uring not defined in policy. [ 466.786921] SELinux: Class user_namespace not defined in policy. [ 466.793013] SELinux: the above unknown classes and permissions will be allowed [ 466.800334] SELinux: Converting 429 SID table entries... [ 466.828726] SELinux: policy capability network_peer_controls=1 [ 466.834648] SELinux: policy capability open_perms=1 [ 466.839615] SELinux: policy capability extended_socket_class=1 [ 466.845536] SELinux: policy capability always_check_network=0 [ 466.851365] SELinux: policy capability cgroup_seclabel=1 [ 466.856758] SELinux: policy capability nnp_nosuid_transition=1 [ 466.862678] SELinux: policy capability genfs_seclabel_symlinks=0 [ 466.868770] SELinux: policy capability ioctl_skip_cloexec=0 [ 487.117865] SELinux: Permission watch in class filesystem not defined in policy. [ 487.125349] SELinux: Permission watch in class file not defined in policy. [ 487.132313] SELinux: Permission watch_mount in class file not defined in policy. [ 487.139800] SELinux: Permission watch_sb in class file not defined in policy. [ 487.147021] SELinux: Permission watch_with_perm in class file not defined in policy. [ 487.154850] SELinux: Permission watch_reads in class file not defined in policy. [ 487.162329] SELinux: Permission watch in class dir not defined in policy. [ 487.169203] SELinux: Permission watch_mount in class dir not defined in policy. [ 487.176591] SELinux: Permission watch_sb in class dir not defined in policy. [ 487.183728] SELinux: Permission watch_with_perm in class dir not defined in policy. [ 487.191464] SELinux: Permission watch_reads in class dir not defined in policy. [ 487.198879] SELinux: Permission watch in class lnk_file not defined in policy. [ 487.206184] SELinux: Permission watch_mount in class lnk_file not defined in policy. [ 487.214008] SELinux: Permission watch_sb in class lnk_file not defined in policy. [ 487.221574] SELinux: Permission watch_with_perm in class lnk_file not defined in policy. [ 487.229746] SELinux: Permission watch_reads in class lnk_file not defined in policy. [ 487.237573] SELinux: Permission watch in class chr_file not defined in policy. [ 487.244883] SELinux: Permission watch_mount in class chr_file not defined in policy. [ 487.252704] SELinux: Permission watch_sb in class chr_file not defined in policy. [ 487.260277] SELinux: Permission watch_with_perm in class chr_file not defined in policy. [ 487.268455] SELinux: Permission watch_reads in class chr_file not defined in policy. [ 487.276300] SELinux: Permission watch in class blk_file not defined in policy. [ 487.283603] SELinux: Permission watch_mount in class blk_file not defined in policy. [ 487.291446] SELinux: Permission watch_sb in class blk_file not defined in policy. [ 487.299028] SELinux: Permission watch_with_perm in class blk_file not defined in policy. [ 487.307203] SELinux: Permission watch_reads in class blk_file not defined in policy. [ 487.315030] SELinux: Permission watch in class sock_file not defined in policy. [ 487.322423] SELinux: Permission watch_mount in class sock_file not defined in policy. [ 487.330332] SELinux: Permission watch_sb in class sock_file not defined in policy. [ 487.337990] SELinux: Permission watch_with_perm in class sock_file not defined in policy. [ 487.346254] SELinux: Permission watch_reads in class sock_file not defined in policy. [ 487.354169] SELinux: Permission watch in class fifo_file not defined in policy. [ 487.361559] SELinux: Permission watch_mount in class fifo_file not defined in policy. [ 487.369473] SELinux: Permission watch_sb in class fifo_file not defined in policy. [ 487.377126] SELinux: Permission watch_with_perm in class fifo_file not defined in policy. [ 487.385407] SELinux: Permission watch_reads in class fifo_file not defined in policy. [ 487.393360] SELinux: Permission perfmon in class capability2 not defined in policy. [ 487.401128] SELinux: Permission bpf in class capability2 not defined in policy. [ 487.408524] SELinux: Permission perfmon in class cap2_userns not defined in policy. [ 487.416265] SELinux: Permission bpf in class cap2_userns not defined in policy. [ 487.423699] SELinux: Class mctp_socket not defined in policy. [ 487.429535] SELinux: Class anon_inode not defined in policy. [ 487.435280] SELinux: Class io_uring not defined in policy. [ 487.440853] SELinux: Class user_namespace not defined in policy. [ 487.446944] SELinux: the above unknown classes and permissions will be allowed [ 487.454253] SELinux: Converting 429 SID table entries... [ 487.481920] SELinux: policy capability network_peer_controls=1 [ 487.487843] SELinux: policy capability open_perms=1 [ 487.492810] SELinux: policy capability extended_socket_class=1 [ 487.498730] SELinux: policy capability always_check_network=0 [ 487.504562] SELinux: policy capability cgroup_seclabel=1 [ 487.509980] SELinux: policy capability nnp_nosuid_transition=1 [ 487.515896] SELinux: policy capability genfs_seclabel_symlinks=0 [ 487.521990] SELinux: policy capability ioctl_skip_cloexec=0 [ 590.122573] dm-0: detected capacity change from 187490304 to 0 [ 590.139688] dm-1: detected capacity change from 187490304 to 0 [ 590.163302] dm-2: detected capacity change from 187490304 to 0 [ 590.182225] dm-3: detected capacity change from 187490304 to 0 [ 590.200519] dm-4: detected capacity change from 31252480 to 0 [ 603.666591] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 603.676468] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ 603.685498] XFS (dm-4): Mounting V4 Filesystem 3085b88c-65bd-47d2-8451-1e2654aa41f4 [ 603.696045] evict_inodes inode 000000002698dfac, i_count = 1, was skipped! [ 603.702993] XFS (dm-4): Ending clean mount [ 603.707267] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038-01-19 (0x7fffffff) [ 1379.481360] SELinux: Permission watch in class filesystem not defined in policy. [ 1379.488843] SELinux: Permission watch in class file not defined in policy. [ 1379.495805] SELinux: Permission watch_mount in class file not defined in policy. [ 1379.503281] SELinux: Permission watch_sb in class file not defined in policy. [ 1379.510497] SELinux: Permission watch_with_perm in class file not defined in policy. [ 1379.518341] SELinux: Permission watch_reads in class file not defined in policy. [ 1379.525820] SELinux: Permission watch in class dir not defined in policy. [ 1379.532710] SELinux: Permission watch_mount in class dir not defined in policy. [ 1379.540103] SELinux: Permission watch_sb in class dir not defined in policy. [ 1379.547234] SELinux: Permission watch_with_perm in class dir not defined in policy. [ 1379.554966] SELinux: Permission watch_reads in class dir not defined in policy. [ 1379.562363] SELinux: Permission watch in class lnk_file not defined in policy. [ 1379.569665] SELinux: Permission watch_mount in class lnk_file not defined in policy. [ 1379.577508] SELinux: Permission watch_sb in class lnk_file not defined in policy. [ 1379.585074] SELinux: Permission watch_with_perm in class lnk_file not defined in policy. [ 1379.593264] SELinux: Permission watch_reads in class lnk_file not defined in policy. [ 1379.601091] SELinux: Permission watch in class chr_file not defined in policy. [ 1379.608396] SELinux: Permission watch_mount in class chr_file not defined in policy. [ 1379.616223] SELinux: Permission watch_sb in class chr_file not defined in policy. [ 1379.623790] SELinux: Permission watch_with_perm in class chr_file not defined in policy. [ 1379.631980] SELinux: Permission watch_reads in class chr_file not defined in policy. [ 1379.639808] SELinux: Permission watch in class blk_file not defined in policy. [ 1379.647110] SELinux: Permission watch_mount in class blk_file not defined in policy. [ 1379.654929] SELinux: Permission watch_sb in class blk_file not defined in policy. [ 1379.662496] SELinux: Permission watch_with_perm in class blk_file not defined in policy. [ 1379.670667] SELinux: Permission watch_reads in class blk_file not defined in policy. [ 1379.678496] SELinux: Permission watch in class sock_file not defined in policy. [ 1379.685887] SELinux: Permission watch_mount in class sock_file not defined in policy. [ 1379.693808] SELinux: Permission watch_sb in class sock_file not defined in policy. [ 1379.701471] SELinux: Permission watch_with_perm in class sock_file not defined in policy. [ 1379.709728] SELinux: Permission watch_reads in class sock_file not defined in policy. [ 1379.717651] SELinux: Permission watch in class fifo_file not defined in policy. [ 1379.725060] SELinux: Permission watch_mount in class fifo_file not defined in policy. [ 1379.732972] SELinux: Permission watch_sb in class fifo_file not defined in policy. [ 1379.740634] SELinux: Permission watch_with_perm in class fifo_file not defined in policy. [ 1379.748886] SELinux: Permission watch_reads in class fifo_file not defined in policy. [ 1379.756849] SELinux: Permission perfmon in class capability2 not defined in policy. [ 1379.764599] SELinux: Permission bpf in class capability2 not defined in policy. [ 1379.771996] SELinux: Permission perfmon in class cap2_userns not defined in policy. [ 1379.779732] SELinux: Permission bpf in class cap2_userns not defined in policy. [ 1379.787140] SELinux: Class mctp_socket not defined in policy. [ 1379.792990] SELinux: Class anon_inode not defined in policy. [ 1379.798729] SELinux: Class io_uring not defined in policy. [ 1379.804301] SELinux: Class user_namespace not defined in policy. [ 1379.810394] SELinux: the above unknown classes and permissions will be allowed [ 1379.817910] SELinux: Converting 451 SID table entries... [ 1379.846357] SELinux: policy capability network_peer_controls=1 [ 1379.852327] SELinux: policy capability open_perms=1 [ 1379.857292] SELinux: policy capability extended_socket_class=1 [ 1379.863208] SELinux: policy capability always_check_network=0 [ 1379.869033] SELinux: policy capability cgroup_seclabel=1 [ 1379.874424] SELinux: policy capability nnp_nosuid_transition=1 [ 1379.880344] SELinux: policy capability genfs_seclabel_symlinks=0 [ 1379.886435] SELinux: policy capability ioctl_skip_cloexec=0 [ 1419.674937] XFS (dm-0): Mounting V5 Filesystem 9feb585f-77d2-489c-b307-85c1733efe29 [ 1419.685645] evict_inodes inode 0000000023d53ae8, i_count = 1, was skipped! [ 1419.692529] XFS (dm-0): Ending clean mount [ 1419.697009] xfs filesystem being mounted at /var/lib/ceph/osd/ceph-0 supports timestamps until 2038-01-19 (0x7fffffff) [ 1420.019865] XFS (dm-1): Mounting V5 Filesystem e3083463-69a7-40db-ad20-d2974bb747cd [ 1420.030857] evict_inodes inode 0000000026dc2f01, i_count = 1, was skipped! [ 1420.037755] XFS (dm-1): Ending clean mount [ 1420.042356] xfs filesystem being mounted at /var/lib/ceph/osd/ceph-1 supports timestamps until 2038-01-19 (0x7fffffff) [ 1420.363822] XFS (dm-2): Mounting V5 Filesystem 4993655e-4f41-4ba9-afae-7db387cb253c [ 1420.374615] evict_inodes inode 0000000001053048, i_count = 1, was skipped! [ 1420.381515] XFS (dm-2): Ending clean mount [ 1420.385942] xfs filesystem being mounted at /var/lib/ceph/osd/ceph-2 supports timestamps until 2038-01-19 (0x7fffffff) [ 1420.706891] XFS (dm-3): Mounting V5 Filesystem 0314732a-292c-44d1-887b-5734fb83177e [ 1420.717431] evict_inodes inode 00000000c701eb88, i_count = 1, was skipped! [ 1420.724379] XFS (dm-3): Ending clean mount [ 1420.728778] xfs filesystem being mounted at /var/lib/ceph/osd/ceph-3 supports timestamps until 2038-01-19 (0x7fffffff) [ 1483.102786] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. [ 1484.720646] IPv6: ADDRCONF(NETDEV_CHANGE): brx.0: link becomes ready [ 1484.727404] IPv6: ADDRCONF(NETDEV_CHANGE): veth0: link becomes ready [ 1484.754548] ceph-brx: port 1(brx.0) entered blocking state [ 1484.760045] ceph-brx: port 1(brx.0) entered disabled state [ 1484.765574] brx.0: entered allmulticast mode [ 1484.770048] brx.0: entered promiscuous mode [ 1484.774676] ceph-brx: port 1(brx.0) entered blocking state [ 1484.780224] ceph-brx: port 1(brx.0) entered forwarding state [ 1525.681189] ceph-brx: port 1(brx.0) entered disabled state [ 1525.688515] brx.0 (unregistering): left allmulticast mode [ 1525.693980] brx.0 (unregistering): left promiscuous mode [ 1525.699581] ceph-brx: port 1(brx.0) entered disabled state [ 1527.424364] IPv6: ADDRCONF(NETDEV_CHANGE): brx.0: link becomes ready [ 1527.430797] IPv6: ADDRCONF(NETDEV_CHANGE): veth0: link becomes ready [ 1527.457954] ceph-brx: port 1(brx.0) entered blocking state [ 1527.463449] ceph-brx: port 1(brx.0) entered disabled state [ 1527.468957] brx.0: entered allmulticast mode [ 1527.473350] brx.0: entered promiscuous mode [ 1527.477786] ceph-brx: port 1(brx.0) entered blocking state [ 1527.483296] ceph-brx: port 1(brx.0) entered forwarding state [ 1527.854321] FS-Cache: Loaded [ 1527.869220] Key type dns_resolver registered [ 1528.011293] Key type ceph registered [ 1528.015243] libceph: loaded (mon/osd proto 15/24) [ 1528.169011] ceph: loaded (mds proto 32) [ 1528.183396] libceph: mon2 (2)172.21.15.164:3301 session established [ 1528.190635] libceph: client4811 fsid a17db4e0-a59c-4315-af4a-fdee0cfa4502 [ 1581.335000] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state V2_BANNER_PREFIX) [ 1581.343839] libceph: mon2 (2)172.21.15.164:3301 session established [ 1581.350192] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e31): osd0 weight 0x10000 (in) [ 1581.358370] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e32): osd1 weight 0x10000 (in) [ 1581.366465] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e33): osd2 weight 0x10000 (in) [ 1581.374559] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e34): osd3 weight 0x10000 (in) [ 1581.382675] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e35): osd4 weight 0x10000 (in) [ 1581.390877] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e36): osd5 weight 0x10000 (in) [ 1581.399180] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e37): osd6 weight 0x10000 (in) [ 1581.407510] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e38): osd7 weight 0x10000 (in) [ 1581.415729] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e47): osd1 down [ 1584.010828] libceph: osd3 (2)172.21.15.156:6808 socket error on write [ 1584.020666] libceph: osd6 (2)172.21.15.164:6808 socket error on write [ 1584.030278] libceph: mon2 (2)172.21.15.164:3301 session established [ 1584.032540] libceph: osd3 (2)172.21.15.156:6808 socket error on write [ 1584.043458] libceph: mon2 (2)172.21.15.164:3301 session established [ 1584.089828] libceph: osd3 (2)172.21.15.156:6808 socket error on write [ 1584.097091] libceph: mon2 (2)172.21.15.164:3301 session established [ 1584.105459] libceph: osd5 (2)172.21.15.164:6816 socket error on write [ 1584.128125] libceph: mon2 (2)172.21.15.164:3301 session established [ 1592.819487] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1592.827426] libceph: mon2 (2)172.21.15.164:3301 session established [ 1594.363905] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1594.371730] libceph: mon2 (2)172.21.15.164:3301 session established [ 1600.163242] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1600.170967] libceph: mon2 (2)172.21.15.164:3301 session established [ 1601.994347] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1602.002315] libceph: mon2 (2)172.21.15.164:3301 session established [ 1604.808652] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1604.816337] libceph: mon2 (2)172.21.15.164:3301 session established [ 1605.084193] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1605.092044] libceph: mon2 (2)172.21.15.164:3301 session established [ 1606.646030] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1606.653809] libceph: mon2 (2)172.21.15.164:3301 session established [ 1606.916645] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1606.924473] libceph: mon2 (2)172.21.15.164:3301 session established [ 1611.716522] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1611.724318] libceph: mon2 (2)172.21.15.164:3301 session established [ 1612.299834] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e56): osd1 up [ 1612.306537] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e57): osd0 weight 0x10000 (in) [ 1612.315037] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e58): osd1 weight 0x10000 (in) [ 1612.323342] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e59): osd2 weight 0x10000 (in) [ 1612.333738] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e60): osd3 weight 0x10000 (in) [ 1612.342720] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e61): osd4 weight 0x10000 (in) [ 1612.351339] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e62): osd5 weight 0x10000 (in) [ 1612.359561] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e63): osd6 weight 0x10000 (in) [ 1612.367761] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e64): osd7 weight 0x10000 (in) [ 1612.375948] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e65): osd7 weight 0x0 (out) [ 1612.383925] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e70): osd6 primary-affinity 0x0 [ 1612.392327] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e73): osd7 weight 0x10000 (in) [ 1612.478477] libceph: osd4 (2)172.21.15.164:6820 socket error on write [ 1612.479796] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 1612.485637] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 1612.503854] libceph: mon2 (2)172.21.15.164:3301 session established [ 1612.545084] libceph: osd4 (2)172.21.15.164:6820 socket error on write [ 1612.564015] libceph: mon2 (2)172.21.15.164:3301 session established [ 1613.081187] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1613.089275] libceph: mon2 (2)172.21.15.164:3301 session established [ 1617.025574] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1617.033347] libceph: mon2 (2)172.21.15.164:3301 session established [ 1617.920892] libceph: osd5 (2)172.21.15.164:6816 socket closed (con state OPEN) [ 1617.921947] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 1617.926024] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e78): osd5 weight 0xeba4 [ 1617.932701] libceph: mon2 (2)172.21.15.164:3301 session established [ 1617.956687] libceph: mon2 (2)172.21.15.164:3301 session established [ 1617.975236] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 1617.986060] libceph: mon2 (2)172.21.15.164:3301 session established [ 1618.196495] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1618.208236] libceph: mon2 (2)172.21.15.164:3301 session established [ 1618.327755] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 1618.337434] libceph: mon2 (2)172.21.15.164:3301 session established [ 1619.586415] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1619.594235] libceph: mon2 (2)172.21.15.164:3301 session established [ 1620.095525] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1620.103272] libceph: mon2 (2)172.21.15.164:3301 session established [ 1621.669876] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1621.677591] libceph: mon2 (2)172.21.15.164:3301 session established [ 1627.689272] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1627.697067] libceph: mon2 (2)172.21.15.164:3301 session established [ 1627.714205] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1627.721806] libceph: mon2 (2)172.21.15.164:3301 session established [ 1632.749924] ceph: [a17db4e0-a59c-4315-af4a-fdee0cfa4502 4811] handle_session: mds4 is already opened [ 1632.783004] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1632.791482] libceph: mon2 (2)172.21.15.164:3301 session established [ 1638.388854] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1638.396683] libceph: mon2 (2)172.21.15.164:3301 session established [ 1638.653298] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1638.661075] libceph: mon2 (2)172.21.15.164:3301 session established [ 1638.991624] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1639.002629] libceph: mon2 (2)172.21.15.164:3301 session established [ 1643.513182] libceph: osd4 (2)172.21.15.164:6820 socket error on write [ 1643.520078] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e87): osd0 weight 0x10000 (in) [ 1643.531685] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e88): osd1 weight 0x10000 (in) [ 1643.543491] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 1643.545643] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e89): osd2 weight 0x10000 (in) [ 1643.548262] libceph: mon2 (2)172.21.15.164:3301 session established [ 1643.568508] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e90): osd3 weight 0x10000 (in) [ 1643.570361] libceph: mon2 (2)172.21.15.164:3301 session established [ 1643.580104] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e91): osd4 weight 0x10000 (in) [ 1643.594724] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e92): osd5 weight 0x10000 (in) [ 1643.606460] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e93): osd6 weight 0x10000 (in) [ 1643.618631] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e94): osd7 weight 0x10000 (in) [ 1643.656060] libceph: osd4 (2)172.21.15.164:6820 socket error on write [ 1643.664497] libceph: mon2 (2)172.21.15.164:3301 session established [ 1643.673690] libceph: osd4 (2)172.21.15.164:6820 socket error on write [ 1643.677245] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1643.691574] libceph: mon2 (2)172.21.15.164:3301 session established [ 1643.703977] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1643.716073] libceph: mon2 (2)172.21.15.164:3301 session established [ 1643.744350] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1643.755363] libceph: mon2 (2)172.21.15.164:3301 session established [ 1643.916396] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 1643.929795] libceph: mon2 (2)172.21.15.164:3301 session established [ 1643.936549] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 1643.946433] libceph: mon2 (2)172.21.15.164:3301 session established [ 1645.861963] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1645.869828] libceph: mon2 (2)172.21.15.164:3301 session established [ 1652.238690] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1652.246313] libceph: mon2 (2)172.21.15.164:3301 session established [ 1654.270943] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e97): osd2 primary-affinity 0x104 [ 1654.271776] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 1654.292298] libceph: mon2 (2)172.21.15.164:3301 session established [ 1655.430408] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1655.438251] libceph: mon2 (2)172.21.15.164:3301 session established [ 1655.883433] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1655.891506] libceph: mon2 (2)172.21.15.164:3301 session established [ 1656.547968] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1656.555835] libceph: mon2 (2)172.21.15.164:3301 session established [ 1660.395627] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state V2_AUTH) [ 1660.403699] libceph: mon2 (2)172.21.15.164:3301 session established [ 1660.666659] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1660.674591] libceph: mon2 (2)172.21.15.164:3301 session established [ 1663.205580] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1663.213307] libceph: mon2 (2)172.21.15.164:3301 session established [ 1663.542970] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1663.550850] libceph: mon2 (2)172.21.15.164:3301 session established [ 1664.182268] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1664.190069] libceph: mon2 (2)172.21.15.164:3301 session established [ 1666.713007] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1666.721979] libceph: mon2 (2)172.21.15.164:3301 session established [ 1667.303115] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1667.311458] libceph: mon2 (2)172.21.15.164:3301 session established [ 1667.586896] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1667.594676] libceph: mon2 (2)172.21.15.164:3301 session established [ 1667.974188] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1667.977057] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1667.981884] libceph: mon2 (2)172.21.15.164:3301 session established [ 1667.995283] libceph: mon2 (2)172.21.15.164:3301 session established [ 1668.378738] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1668.386410] libceph: mon2 (2)172.21.15.164:3301 session established [ 1669.409503] libceph: mds2 (2)172.21.15.164:6837 socket error on write [ 1669.416757] libceph: mon2 (2)172.21.15.164:3301 session established [ 1670.144433] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 1670.154157] libceph: mon2 (2)172.21.15.164:3301 session established [ 1670.472949] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 1670.480413] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e108): osd3 primary-affinity 0x0 [ 1670.490459] libceph: mon2 (2)172.21.15.164:3301 session established [ 1672.075275] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1672.089143] libceph: mon2 (2)172.21.15.164:3301 session established [ 1675.386732] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1675.394449] libceph: mon2 (2)172.21.15.164:3301 session established [ 1677.313752] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1677.321515] libceph: mon2 (2)172.21.15.164:3301 session established [ 1679.421560] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 1679.429311] libceph: mon2 (2)172.21.15.164:3301 session established [ 1682.024707] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1682.036211] libceph: mon2 (2)172.21.15.164:3301 session established [ 1682.311810] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1682.319768] libceph: mon2 (2)172.21.15.164:3301 session established [ 1682.883256] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1682.891268] libceph: mon2 (2)172.21.15.164:3301 session established [ 1684.848191] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1684.856164] libceph: mon2 (2)172.21.15.164:3301 session established [ 1685.186285] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1685.193897] libceph: mon2 (2)172.21.15.164:3301 session established [ 1687.706984] libceph: osd5 (2)172.21.15.164:6816 socket closed (con state OPEN) [ 1687.716121] libceph: mon2 (2)172.21.15.164:3301 session established [ 1687.873498] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1687.881356] libceph: mon2 (2)172.21.15.164:3301 session established [ 1693.676847] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state V2_SESSION_RECONNECT) [ 1693.686199] libceph: mon2 (2)172.21.15.164:3301 session established [ 1696.042970] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1696.050846] libceph: mon2 (2)172.21.15.164:3301 session established [ 1696.147317] libceph: osd5 (2)172.21.15.164:6816 socket closed (con state OPEN) [ 1696.154978] libceph: mon2 (2)172.21.15.164:3301 session established [ 1696.524295] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1696.532157] libceph: mon2 (2)172.21.15.164:3301 session established [ 1696.916123] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 1696.923828] libceph: mon2 (2)172.21.15.164:3301 session established [ 1696.995681] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1697.003334] libceph: mon2 (2)172.21.15.164:3301 session established [ 1697.749278] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1697.756954] libceph: mon2 (2)172.21.15.164:3301 session established [ 1698.100641] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1698.108299] libceph: mon2 (2)172.21.15.164:3301 session established [ 1698.464764] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 1698.472480] libceph: mon2 (2)172.21.15.164:3301 session established [ 1698.695688] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1698.703332] libceph: mon2 (2)172.21.15.164:3301 session established [ 1698.956159] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state V2_AUTH) [ 1698.964365] libceph: mon2 (2)172.21.15.164:3301 session established [ 1699.484138] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1699.492286] libceph: mon2 (2)172.21.15.164:3301 session established [ 1699.664804] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1699.672620] libceph: mon2 (2)172.21.15.164:3301 session established [ 1701.457060] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e121): osd0 weight 0x10000 (in) [ 1703.419483] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 1703.419558] libceph: osd5 (2)172.21.15.164:6816 socket closed (con state OPEN) [ 1703.430590] libceph: mon2 (2)172.21.15.164:3301 session established [ 1703.440430] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e122): osd1 weight 0x10000 (in) [ 1703.453285] libceph: mon2 (2)172.21.15.164:3301 session established [ 1703.501731] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e123): osd2 weight 0x10000 (in) [ 1704.035228] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1704.043172] libceph: mon2 (2)172.21.15.164:3301 session established [ 1705.000795] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e124): osd3 weight 0x10000 (in) [ 1705.919798] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e125): osd4 weight 0x10000 (in) [ 1706.724205] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e126): osd5 weight 0x10000 (in) [ 1706.805221] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1706.813081] libceph: mon2 (2)172.21.15.164:3301 session established [ 1708.120155] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e127): osd6 weight 0x10000 (in) [ 1708.535507] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e128): osd7 weight 0x10000 (in) [ 1708.548125] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1708.555971] libceph: mon2 (2)172.21.15.164:3301 session established [ 1708.774743] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1708.782366] libceph: mon2 (2)172.21.15.164:3301 session established [ 1709.051178] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1709.058881] libceph: mon2 (2)172.21.15.164:3301 session established [ 1711.971946] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1711.979786] libceph: mon2 (2)172.21.15.164:3301 session established [ 1714.158675] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e129): osd6 weight 0xff6b [ 1714.616460] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1714.624705] libceph: mon2 (2)172.21.15.164:3301 session established [ 1715.614690] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 1715.622717] libceph: mon2 (2)172.21.15.164:3301 session established [ 1716.430554] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e131): osd2 down [ 1717.470278] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1717.478203] libceph: mon2 (2)172.21.15.164:3301 session established [ 1717.735376] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1717.743153] libceph: mon2 (2)172.21.15.164:3301 session established [ 1719.011428] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1719.019167] libceph: mon2 (2)172.21.15.164:3301 session established [ 1722.080459] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1722.088273] libceph: mon2 (2)172.21.15.164:3301 session established [ 1724.313285] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1724.320964] libceph: mon2 (2)172.21.15.164:3301 session established [ 1728.372144] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1728.379898] libceph: mon2 (2)172.21.15.164:3301 session established [ 1735.559883] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1735.567606] libceph: mon2 (2)172.21.15.164:3301 session established [ 1740.309761] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1740.317598] libceph: mon2 (2)172.21.15.164:3301 session established [ 1745.584360] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1745.592086] libceph: mon2 (2)172.21.15.164:3301 session established [ 1749.292961] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1749.301933] libceph: mon2 (2)172.21.15.164:3301 session established [ 1755.512757] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1755.521153] libceph: mon2 (2)172.21.15.164:3301 session established [ 1757.097956] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1757.105801] libceph: mon2 (2)172.21.15.164:3301 session established [ 1759.728620] libceph: mds0 (2)172.21.15.156:6836 socket error on write [ 1759.735805] libceph: mon2 (2)172.21.15.164:3301 session established [ 1760.814053] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1760.822472] libceph: mon2 (2)172.21.15.164:3301 session established [ 1771.008781] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1771.016655] libceph: mon2 (2)172.21.15.164:3301 session established [ 1771.681346] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1771.691015] libceph: mon2 (2)172.21.15.164:3301 session established [ 1772.316170] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1772.323756] libceph: mon2 (2)172.21.15.164:3301 session established [ 1773.067125] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1773.074810] libceph: mon2 (2)172.21.15.164:3301 session established [ 1773.337445] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1773.345284] libceph: mon2 (2)172.21.15.164:3301 session established [ 1776.089543] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1776.097635] libceph: mon2 (2)172.21.15.164:3301 session established [ 1777.242856] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1777.251056] libceph: mon2 (2)172.21.15.164:3301 session established [ 1780.402195] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1780.409966] libceph: mon2 (2)172.21.15.164:3301 session established [ 1784.477931] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1784.485760] libceph: mon2 (2)172.21.15.164:3301 session established [ 1785.101255] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1785.109050] libceph: mon2 (2)172.21.15.164:3301 session established [ 1787.518433] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e139): osd2 up [ 1787.525274] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e140): osd0 weight 0x10000 (in) [ 1787.535282] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e141): osd1 weight 0x10000 (in) [ 1787.543560] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e142): osd2 weight 0x10000 (in) [ 1787.551888] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e143): osd3 weight 0x10000 (in) [ 1787.560286] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e144): osd4 weight 0x10000 (in) [ 1787.568761] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e145): osd5 weight 0x10000 (in) [ 1787.577062] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e146): osd6 weight 0x10000 (in) [ 1787.585603] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e147): osd7 weight 0x10000 (in) [ 1787.594055] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e149): osd6 primary-affinity 0x3dfd [ 1787.603188] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e181): osd6 weight 0x0 (out) [ 1787.611197] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e187): osd5 primary-affinity 0x1d87 [ 1788.786537] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1788.794244] libceph: mon2 (2)172.21.15.164:3301 session established [ 1792.602847] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e192): osd0 weight 0x10000 (in) [ 1792.714578] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1792.722717] libceph: mon2 (2)172.21.15.164:3301 session established [ 1793.680384] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1793.688143] libceph: mon2 (2)172.21.15.164:3301 session established [ 1794.000870] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1794.008891] libceph: mon2 (2)172.21.15.164:3301 session established [ 1802.677888] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e193): osd1 weight 0x10000 (in) [ 1802.686111] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e194): osd2 weight 0x10000 (in) [ 1802.694364] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e195): osd3 weight 0x10000 (in) [ 1802.707488] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e196): osd4 weight 0x10000 (in) [ 1802.716333] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e197): osd5 weight 0x10000 (in) [ 1802.724591] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e198): osd7 weight 0x10000 (in) [ 1802.732893] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e199): osd4 weight 0x0 (out) [ 1809.446715] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1809.459057] libceph: mon2 (2)172.21.15.164:3301 session established [ 1812.578628] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e210): osd5 primary-affinity 0x293f [ 1813.885393] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1813.893395] libceph: mon2 (2)172.21.15.164:3301 session established [ 1814.184232] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1814.192772] libceph: mon2 (2)172.21.15.164:3301 session established [ 1818.806882] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1818.814573] libceph: mon2 (2)172.21.15.164:3301 session established [ 1823.209814] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1823.217891] libceph: mon2 (2)172.21.15.164:3301 session established [ 1827.180842] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1827.190501] libceph: mon2 (2)172.21.15.164:3301 session established [ 1827.429451] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1827.437187] libceph: mon2 (2)172.21.15.164:3301 session established [ 1840.888140] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1840.895931] libceph: mon2 (2)172.21.15.164:3301 session established [ 1841.196212] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1841.209625] libceph: mon2 (2)172.21.15.164:3301 session established [ 1847.118455] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1847.126218] libceph: mon2 (2)172.21.15.164:3301 session established [ 1847.383349] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state V2_AUTH) [ 1847.391659] libceph: mon2 (2)172.21.15.164:3301 session established [ 1847.782808] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1847.790740] libceph: mon2 (2)172.21.15.164:3301 session established [ 1848.188786] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1848.196435] libceph: mon2 (2)172.21.15.164:3301 session established [ 1848.215845] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1848.223469] libceph: mon2 (2)172.21.15.164:3301 session established [ 1857.991934] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1857.999641] libceph: mon2 (2)172.21.15.164:3301 session established [ 1859.070942] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1859.078783] libceph: mon2 (2)172.21.15.164:3301 session established [ 1859.515729] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e226): osd5 down [ 1859.522695] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e232): osd1 weight 0x0 (out) [ 1863.238697] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1863.246420] libceph: mon2 (2)172.21.15.164:3301 session established [ 1863.925699] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1863.933583] libceph: mon2 (2)172.21.15.164:3301 session established [ 1864.540223] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e238): osd2 primary-affinity 0x10000 [ 1867.502402] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e244): osd1 weight 0x10000 (in) [ 1869.155633] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1869.166524] libceph: mon2 (2)172.21.15.164:3301 session established [ 1870.717899] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1870.725630] libceph: mon2 (2)172.21.15.164:3301 session established [ 1877.138243] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1877.146046] libceph: mon2 (2)172.21.15.164:3301 session established [ 1877.443322] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1877.451266] libceph: mon2 (2)172.21.15.164:3301 session established [ 1879.338001] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1879.345835] libceph: mon2 (2)172.21.15.164:3301 session established [ 1880.591792] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 1880.599508] libceph: mon2 (2)172.21.15.164:3301 session established [ 1888.233717] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1888.241485] libceph: mon2 (2)172.21.15.164:3301 session established [ 1893.074529] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1893.082394] libceph: mon2 (2)172.21.15.164:3301 session established [ 1895.038584] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e254): osd7 primary-affinity 0xcae8 [ 1895.047199] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e257): osd7 weight 0xee10 [ 1901.933374] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e262): osd5 up [ 1904.060591] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1904.068285] libceph: mon2 (2)172.21.15.164:3301 session established [ 1904.850080] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 1904.857832] libceph: mon2 (2)172.21.15.164:3301 session established [ 1919.658846] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1919.670465] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1919.670727] libceph: mon2 (2)172.21.15.164:3301 session established [ 1919.684388] libceph: mon2 (2)172.21.15.164:3301 session established [ 1920.076167] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1920.083902] libceph: mon2 (2)172.21.15.164:3301 session established [ 1920.380213] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1920.387981] libceph: mon2 (2)172.21.15.164:3301 session established [ 1924.655497] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 1924.663682] libceph: mon2 (2)172.21.15.164:3301 session established [ 1928.802568] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1928.810749] libceph: mon2 (2)172.21.15.164:3301 session established [ 1931.249072] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state V2_AUTH) [ 1931.249494] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e271): osd2 weight 0x0 (out) [ 1931.265601] libceph: mon2 (2)172.21.15.164:3301 session established [ 1931.266736] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e282): osd0 primary-affinity 0xb96f [ 1946.695477] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e290): osd7 primary-affinity 0xbd29 [ 1946.771288] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1946.781175] libceph: mon2 (2)172.21.15.164:3301 session established [ 1946.854178] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1946.871134] libceph: mon2 (2)172.21.15.164:3301 session established [ 1952.274496] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1952.297064] libceph: mon2 (2)172.21.15.164:3301 session established [ 1952.370030] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1952.377759] libceph: mon2 (2)172.21.15.164:3301 session established [ 1952.613889] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1952.665241] libceph: mon2 (2)172.21.15.164:3301 session established [ 1952.856383] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1952.863912] libceph: mon2 (2)172.21.15.164:3301 session established [ 1952.955768] libceph: osd1 (2)172.21.15.156:6816 socket error on write [ 1952.962908] libceph: mon2 (2)172.21.15.164:3301 session established [ 1953.037577] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1953.044687] libceph: mon2 (2)172.21.15.164:3301 session established [ 1953.063034] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1953.069956] libceph: mon2 (2)172.21.15.164:3301 session established [ 1953.152860] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1953.160269] libceph: mon2 (2)172.21.15.164:3301 session established [ 1953.340650] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1953.348148] libceph: mon2 (2)172.21.15.164:3301 session established [ 1953.456465] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1953.463465] libceph: mon2 (2)172.21.15.164:3301 session established [ 1953.814983] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1953.822043] libceph: mon2 (2)172.21.15.164:3301 session established [ 1953.954997] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1953.961986] libceph: mon2 (2)172.21.15.164:3301 session established [ 1953.990629] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1953.997497] libceph: mon2 (2)172.21.15.164:3301 session established [ 1954.075130] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1954.082069] libceph: mon2 (2)172.21.15.164:3301 session established [ 1954.090406] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1954.097273] libceph: mon2 (2)172.21.15.164:3301 session established [ 1954.143628] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1954.150516] libceph: mon2 (2)172.21.15.164:3301 session established [ 1954.191932] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1954.199219] libceph: mon2 (2)172.21.15.164:3301 session established [ 1958.256637] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 1958.264422] libceph: mon2 (2)172.21.15.164:3301 session established [ 1966.980387] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 1966.989750] libceph: mon2 (2)172.21.15.164:3301 session established [ 1974.280564] libceph: osd0 (2)172.21.15.156:6800 socket error on write [ 1974.286531] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e306): osd0 down [ 1974.329550] libceph: mon2 (2)172.21.15.164:3301 session established [ 1974.401836] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1974.409949] libceph: mon2 (2)172.21.15.164:3301 session established [ 1974.473276] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1974.483475] libceph: mon2 (2)172.21.15.164:3301 session established [ 1974.669075] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1974.720149] libceph: mon2 (2)172.21.15.164:3301 session established [ 1974.934151] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1974.941178] libceph: mon2 (2)172.21.15.164:3301 session established [ 1974.999270] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1975.006548] libceph: mon2 (2)172.21.15.164:3301 session established [ 1989.089955] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e313): osd6 weight 0x10000 (in) [ 1990.261179] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1990.277018] libceph: mon2 (2)172.21.15.164:3301 session established [ 1990.301347] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1990.307233] libceph: osd1 (2)172.21.15.156:6816 socket error on write [ 1990.310789] libceph: mon2 (2)172.21.15.164:3301 session established [ 1990.320917] libceph: mon2 (2)172.21.15.164:3301 session established [ 1990.323258] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1990.334013] libceph: mon2 (2)172.21.15.164:3301 session established [ 1995.535154] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 1995.551822] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e325): osd0 up [ 1995.558745] libceph: mon2 (2)172.21.15.164:3301 session established [ 1997.543683] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 1997.551436] libceph: mon2 (2)172.21.15.164:3301 session established [ 1997.809436] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state V2_AUTH) [ 1997.817372] libceph: mon2 (2)172.21.15.164:3301 session established [ 2001.570695] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2001.578416] libceph: mon2 (2)172.21.15.164:3301 session established [ 2003.005509] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2003.013925] libceph: mon2 (2)172.21.15.164:3301 session established [ 2003.993013] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2004.000712] libceph: mon2 (2)172.21.15.164:3301 session established [ 2006.647245] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2006.655110] libceph: mon2 (2)172.21.15.164:3301 session established [ 2007.543553] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2007.551453] libceph: mon2 (2)172.21.15.164:3301 session established [ 2011.994086] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2012.001896] libceph: mon2 (2)172.21.15.164:3301 session established [ 2012.695644] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2012.703531] libceph: mon2 (2)172.21.15.164:3301 session established [ 2013.812439] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2013.820206] libceph: mon2 (2)172.21.15.164:3301 session established [ 2014.224932] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e334): osd7 weight 0x0 (out) [ 2014.259068] libceph: osd6 (2)172.21.15.164:6808 socket error on write [ 2014.268390] libceph: osd0 (2)172.21.15.156:6800 socket error on write [ 2014.268729] libceph: mon2 (2)172.21.15.164:3301 session established [ 2014.286501] libceph: mon2 (2)172.21.15.164:3301 session established [ 2014.336087] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 2014.340789] libceph: osd6 (2)172.21.15.164:6808 socket error on write [ 2014.345492] libceph: mon2 (2)172.21.15.164:3301 session established [ 2014.356606] libceph: mon2 (2)172.21.15.164:3301 session established [ 2014.586537] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2014.606596] libceph: mon2 (2)172.21.15.164:3301 session established [ 2014.621068] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2014.629639] libceph: mon2 (2)172.21.15.164:3301 session established [ 2014.672173] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 2014.680347] libceph: mon2 (2)172.21.15.164:3301 session established [ 2014.693510] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 2014.702973] libceph: mon2 (2)172.21.15.164:3301 session established [ 2014.850619] libceph: mds0 (2)172.21.15.156:6836 socket error on write [ 2014.860106] libceph: mon2 (2)172.21.15.164:3301 session established [ 2016.911822] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2016.919514] libceph: mon2 (2)172.21.15.164:3301 session established [ 2017.404999] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2017.413440] libceph: mon2 (2)172.21.15.164:3301 session established [ 2019.406945] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2019.414605] libceph: mon2 (2)172.21.15.164:3301 session established [ 2019.539917] libceph: osd1 (2)172.21.15.156:6816 socket error on write [ 2019.547009] libceph: mon2 (2)172.21.15.164:3301 session established [ 2019.773211] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2019.781045] libceph: mon2 (2)172.21.15.164:3301 session established [ 2021.648625] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2021.657461] libceph: mon2 (2)172.21.15.164:3301 session established [ 2022.528657] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e346): osd3 primary-affinity 0x10000 [ 2023.574914] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2023.583951] libceph: mon2 (2)172.21.15.164:3301 session established [ 2026.090332] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2026.098173] libceph: mon2 (2)172.21.15.164:3301 session established [ 2026.288893] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2026.296793] libceph: mon2 (2)172.21.15.164:3301 session established [ 2026.620434] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2026.628429] libceph: mon2 (2)172.21.15.164:3301 session established [ 2031.461181] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2031.468911] libceph: mon2 (2)172.21.15.164:3301 session established [ 2031.869967] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2031.877860] libceph: mon2 (2)172.21.15.164:3301 session established [ 2033.691275] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2033.699498] libceph: mon2 (2)172.21.15.164:3301 session established [ 2035.204479] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2035.212495] libceph: mon2 (2)172.21.15.164:3301 session established [ 2036.253061] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2036.260842] libceph: mon2 (2)172.21.15.164:3301 session established [ 2036.618771] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2036.626409] libceph: mon2 (2)172.21.15.164:3301 session established [ 2038.219541] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2038.227401] libceph: mon2 (2)172.21.15.164:3301 session established [ 2038.553633] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2038.561390] libceph: mon2 (2)172.21.15.164:3301 session established [ 2038.858083] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2038.865907] libceph: mon2 (2)172.21.15.164:3301 session established [ 2042.020008] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2042.027694] libceph: mon2 (2)172.21.15.164:3301 session established [ 2045.444268] libceph: osd5 (2)172.21.15.164:6816 socket error on write [ 2045.453025] libceph: mon2 (2)172.21.15.164:3301 session established [ 2045.472853] libceph: osd5 (2)172.21.15.164:6816 socket error on write [ 2045.477679] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2045.481269] libceph: mon2 (2)172.21.15.164:3301 session established [ 2045.494289] libceph: osd5 (2)172.21.15.164:6816 socket closed (con state OPEN) [ 2045.496105] libceph: mon2 (2)172.21.15.164:3301 session established [ 2045.505311] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2045.511824] libceph: mon2 (2)172.21.15.164:3301 session established [ 2045.517535] libceph: osd5 (2)172.21.15.164:6816 socket error on write [ 2045.529374] libceph: mon2 (2)172.21.15.164:3301 session established [ 2045.537137] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2045.549549] libceph: mon2 (2)172.21.15.164:3301 session established [ 2045.586835] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e356): osd0 weight 0x10000 (in) [ 2045.644422] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2045.652786] libceph: mon2 (2)172.21.15.164:3301 session established [ 2045.837400] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2045.846795] libceph: mon2 (2)172.21.15.164:3301 session established [ 2045.892970] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2045.901478] libceph: mon2 (2)172.21.15.164:3301 session established [ 2046.262500] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2046.270229] libceph: mon2 (2)172.21.15.164:3301 session established [ 2046.606053] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e357): osd3 weight 0x10000 (in) [ 2046.653778] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2046.662382] libceph: mon2 (2)172.21.15.164:3301 session established [ 2046.927027] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2046.935549] libceph: mon2 (2)172.21.15.164:3301 session established [ 2047.867935] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2047.875930] libceph: mon2 (2)172.21.15.164:3301 session established [ 2048.174265] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2048.181979] libceph: mon2 (2)172.21.15.164:3301 session established [ 2048.947359] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2048.955101] libceph: mon2 (2)172.21.15.164:3301 session established [ 2049.337825] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2049.345606] libceph: mon2 (2)172.21.15.164:3301 session established [ 2049.643595] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2049.651366] libceph: mon2 (2)172.21.15.164:3301 session established [ 2050.423896] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2050.431772] libceph: mon2 (2)172.21.15.164:3301 session established [ 2052.488776] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2052.496506] libceph: mon2 (2)172.21.15.164:3301 session established [ 2053.714236] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2053.722078] libceph: mon2 (2)172.21.15.164:3301 session established [ 2054.466203] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2054.474617] libceph: mon2 (2)172.21.15.164:3301 session established [ 2061.594794] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2061.602476] libceph: mon2 (2)172.21.15.164:3301 session established [ 2063.346660] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state V2_SESSION_RECONNECT) [ 2063.355742] libceph: mon2 (2)172.21.15.164:3301 session established [ 2063.614287] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2063.621866] libceph: mon2 (2)172.21.15.164:3301 session established [ 2063.876366] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2063.884213] libceph: mon2 (2)172.21.15.164:3301 session established [ 2064.137129] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state V2_BANNER_PREFIX) [ 2064.146083] libceph: mon2 (2)172.21.15.164:3301 session established [ 2065.300167] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2065.312995] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2065.318760] libceph: mon2 (2)172.21.15.164:3301 session established [ 2065.327175] libceph: mon2 (2)172.21.15.164:3301 session established [ 2066.449089] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e358): osd5 weight 0x10000 (in) [ 2066.461572] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e359): osd1 weight 0x10000 (in) [ 2066.473624] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e360): osd6 weight 0x10000 (in) [ 2066.485952] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e361): osd2 weight 0x10000 (in) [ 2066.531711] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 2066.542304] libceph: mon2 (2)172.21.15.164:3301 session established [ 2066.549315] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 2066.557692] libceph: mon2 (2)172.21.15.164:3301 session established [ 2066.773556] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2066.781716] libceph: mon2 (2)172.21.15.164:3301 session established [ 2066.782140] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2066.805198] libceph: mon2 (2)172.21.15.164:3301 session established [ 2067.056814] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2067.064451] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2067.064696] libceph: mon2 (2)172.21.15.164:3301 session established [ 2067.083095] libceph: mon2 (2)172.21.15.164:3301 session established [ 2067.906686] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2067.914650] libceph: mon2 (2)172.21.15.164:3301 session established [ 2068.608636] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e377): osd3 primary-affinity 0x10000 [ 2069.502745] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2069.510554] libceph: mon2 (2)172.21.15.164:3301 session established [ 2071.606963] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2071.614609] libceph: mon2 (2)172.21.15.164:3301 session established [ 2073.844536] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2073.852395] libceph: mon2 (2)172.21.15.164:3301 session established [ 2079.947101] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2079.954720] libceph: mon2 (2)172.21.15.164:3301 session established [ 2080.979935] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2080.991725] libceph: mon2 (2)172.21.15.164:3301 session established [ 2082.149235] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2082.157009] libceph: mon2 (2)172.21.15.164:3301 session established [ 2082.317710] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e380): osd7 weight 0xee10 [ 2082.431259] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2082.438887] libceph: mon2 (2)172.21.15.164:3301 session established [ 2082.609595] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 2082.617735] libceph: mon2 (2)172.21.15.164:3301 session established [ 2082.938245] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2082.949174] libceph: mon2 (2)172.21.15.164:3301 session established [ 2083.070951] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2083.078585] libceph: mon2 (2)172.21.15.164:3301 session established [ 2083.572491] libceph: mds2 (2)172.21.15.164:6837 socket error on write [ 2083.579465] libceph: mon2 (2)172.21.15.164:3301 session established [ 2087.457732] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2087.465470] libceph: mon2 (2)172.21.15.164:3301 session established [ 2089.707485] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2089.715289] libceph: mon2 (2)172.21.15.164:3301 session established [ 2092.617333] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2092.624986] libceph: mon2 (2)172.21.15.164:3301 session established [ 2092.885318] libceph: mds2 (2)172.21.15.164:6837 socket error on write [ 2092.892356] libceph: mon2 (2)172.21.15.164:3301 session established [ 2095.186105] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2095.193818] libceph: mon2 (2)172.21.15.164:3301 session established [ 2095.484049] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2095.491602] libceph: mon2 (2)172.21.15.164:3301 session established [ 2095.760055] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2095.767862] libceph: mon2 (2)172.21.15.164:3301 session established [ 2096.052399] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2096.060054] libceph: mon2 (2)172.21.15.164:3301 session established [ 2097.578700] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2097.588270] libceph: mon2 (2)172.21.15.164:3301 session established [ 2098.209002] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 2098.219645] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e393): osd0 weight 0x0 (out) [ 2098.222683] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2098.248584] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e399): osd0 weight 0x10000 (in) [ 2098.260109] libceph: mon2 (2)172.21.15.164:3301 session established [ 2098.300145] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state V2_SESSION_CONNECT) [ 2098.309660] libceph: mon2 (2)172.21.15.164:3301 session established [ 2098.348643] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2098.361944] libceph: mon2 (2)172.21.15.164:3301 session established [ 2098.620644] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2098.636489] libceph: mon2 (2)172.21.15.164:3301 session established [ 2098.861579] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2098.870297] libceph: mon2 (2)172.21.15.164:3301 session established [ 2098.885807] libceph: mds2 (2)172.21.15.164:6837 socket error on write [ 2098.894948] libceph: mon2 (2)172.21.15.164:3301 session established [ 2099.147259] libceph: mds2 (2)172.21.15.164:6837 socket error on write [ 2099.154158] libceph: mon2 (2)172.21.15.164:3301 session established [ 2102.249932] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2102.257536] libceph: mon2 (2)172.21.15.164:3301 session established [ 2102.545905] libceph: mds2 (2)172.21.15.164:6837 socket error on write [ 2102.552809] libceph: mon2 (2)172.21.15.164:3301 session established [ 2102.809730] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state V2_BANNER_PREFIX) [ 2102.818640] libceph: mon2 (2)172.21.15.164:3301 session established [ 2103.632963] libceph: mds2 (2)172.21.15.164:6837 socket error on write [ 2103.639910] libceph: mon2 (2)172.21.15.164:3301 session established [ 2105.081938] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2105.089621] libceph: mon2 (2)172.21.15.164:3301 session established [ 2107.154906] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e410): osd4 weight 0x10000 (in) [ 2109.042547] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2109.050441] libceph: mon2 (2)172.21.15.164:3301 session established [ 2109.404630] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2109.412296] libceph: mon2 (2)172.21.15.164:3301 session established [ 2111.734475] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2111.742138] libceph: mon2 (2)172.21.15.164:3301 session established [ 2111.916608] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2111.924270] libceph: mon2 (2)172.21.15.164:3301 session established [ 2112.620834] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2112.628472] libceph: mon2 (2)172.21.15.164:3301 session established [ 2114.430550] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2114.438243] libceph: mon2 (2)172.21.15.164:3301 session established [ 2117.523199] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2117.531344] libceph: mon2 (2)172.21.15.164:3301 session established [ 2118.269972] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e418): osd1 weight 0xf334 [ 2118.277736] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e418): osd3 weight 0xf334 [ 2118.285534] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e418): osd7 weight 0xe144 [ 2118.371601] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2118.379615] libceph: mon2 (2)172.21.15.164:3301 session established [ 2118.689670] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2118.697281] libceph: mon2 (2)172.21.15.164:3301 session established [ 2119.175011] libceph: osd3 (2)172.21.15.156:6808 socket error on write [ 2119.199472] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 2119.204090] libceph: mon2 (2)172.21.15.164:3301 session established [ 2119.219397] libceph: mon2 (2)172.21.15.164:3301 session established [ 2119.229969] libceph: osd4 (2)172.21.15.164:6820 socket error on write [ 2119.249667] libceph: mon2 (2)172.21.15.164:3301 session established [ 2119.753008] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2119.764387] libceph: mon2 (2)172.21.15.164:3301 session established [ 2119.863708] libceph: mds2 (2)172.21.15.164:6837 socket error on write [ 2119.870649] libceph: mon2 (2)172.21.15.164:3301 session established [ 2120.245501] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2120.253634] libceph: osd1 (2)172.21.15.156:6816 socket error on write [ 2120.253881] libceph: mon2 (2)172.21.15.164:3301 session established [ 2120.272744] libceph: mon2 (2)172.21.15.164:3301 session established [ 2120.521681] libceph: osd1 (2)172.21.15.156:6816 socket error on write [ 2120.528587] libceph: mon2 (2)172.21.15.164:3301 session established [ 2120.673715] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e424): osd1 down [ 2120.698072] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 2120.707331] libceph: mon2 (2)172.21.15.164:3301 session established [ 2120.730077] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2120.737740] libceph: mon2 (2)172.21.15.164:3301 session established [ 2121.085207] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2121.092843] libceph: mon2 (2)172.21.15.164:3301 session established [ 2121.962501] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2121.970126] libceph: mon2 (2)172.21.15.164:3301 session established [ 2122.439793] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2122.445256] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2122.447502] libceph: mon2 (2)172.21.15.164:3301 session established [ 2122.461145] libceph: mon2 (2)172.21.15.164:3301 session established [ 2122.915117] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2122.922778] libceph: mon2 (2)172.21.15.164:3301 session established [ 2123.664495] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2123.672261] libceph: mon2 (2)172.21.15.164:3301 session established [ 2124.074471] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2124.082257] libceph: mon2 (2)172.21.15.164:3301 session established [ 2124.716938] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2124.724601] libceph: mon2 (2)172.21.15.164:3301 session established [ 2126.712391] libceph: osd5 (2)172.21.15.164:6816 socket closed (con state OPEN) [ 2126.720233] libceph: mon2 (2)172.21.15.164:3301 session established [ 2127.075309] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2127.083047] libceph: mon2 (2)172.21.15.164:3301 session established [ 2127.308064] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2127.318840] libceph: mon2 (2)172.21.15.164:3301 session established [ 2128.328971] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2128.336628] libceph: mon2 (2)172.21.15.164:3301 session established [ 2128.471158] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2128.478970] libceph: mon2 (2)172.21.15.164:3301 session established [ 2128.824120] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2128.831901] libceph: mon2 (2)172.21.15.164:3301 session established [ 2130.827723] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2130.841171] libceph: mon2 (2)172.21.15.164:3301 session established [ 2132.043914] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2132.057411] libceph: mon2 (2)172.21.15.164:3301 session established [ 2132.166894] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2132.174591] libceph: mon2 (2)172.21.15.164:3301 session established [ 2132.200124] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2132.209515] libceph: mon2 (2)172.21.15.164:3301 session established [ 2132.277249] libceph: mds2 (2)172.21.15.164:6837 socket error on read [ 2132.284239] libceph: mon2 (2)172.21.15.164:3301 session established [ 2134.516415] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state V2_SESSION_RECONNECT) [ 2134.526796] libceph: mon2 (2)172.21.15.164:3301 session established [ 2135.974968] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2135.982758] libceph: mon2 (2)172.21.15.164:3301 session established [ 2136.257705] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2136.265703] libceph: mon2 (2)172.21.15.164:3301 session established [ 2136.618348] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2136.626297] libceph: mon2 (2)172.21.15.164:3301 session established [ 2137.107593] libceph: mds1 (2)172.21.15.156:6833 socket error on write [ 2137.114550] libceph: mon2 (2)172.21.15.164:3301 session established [ 2138.330135] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2138.337886] libceph: mon2 (2)172.21.15.164:3301 session established [ 2139.499576] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2139.507315] libceph: mon2 (2)172.21.15.164:3301 session established [ 2141.961403] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2141.969304] libceph: mon2 (2)172.21.15.164:3301 session established [ 2142.243167] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2142.253916] libceph: mon2 (2)172.21.15.164:3301 session established [ 2143.729209] libceph: mds1 (2)172.21.15.156:6833 socket error on write [ 2143.741941] libceph: mon2 (2)172.21.15.164:3301 session established [ 2143.994569] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2144.002928] libceph: mon2 (2)172.21.15.164:3301 session established [ 2144.307186] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2144.315486] libceph: mon2 (2)172.21.15.164:3301 session established [ 2144.574865] libceph: mds1 (2)172.21.15.156:6833 socket error on write [ 2144.581773] libceph: mon2 (2)172.21.15.164:3301 session established [ 2145.289677] libceph: osd2 (2)172.21.15.156:6818 socket error on write [ 2145.316410] libceph: mon2 (2)172.21.15.164:3301 session established [ 2145.480038] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 2145.499955] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2145.507424] libceph: mon2 (2)172.21.15.164:3301 session established [ 2145.528272] libceph: osd0 (2)172.21.15.156:6800 socket error on write [ 2145.543588] libceph: mon2 (2)172.21.15.164:3301 session established [ 2145.555347] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 2145.564886] libceph: mon2 (2)172.21.15.164:3301 session established [ 2145.780842] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 2145.792470] libceph: mon2 (2)172.21.15.164:3301 session established [ 2145.865247] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 2145.883867] libceph: mon2 (2)172.21.15.164:3301 session established [ 2145.948106] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 2145.959728] libceph: mon2 (2)172.21.15.164:3301 session established [ 2145.969265] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state V2_SESSION_CONNECT) [ 2145.978616] libceph: mon2 (2)172.21.15.164:3301 session established [ 2146.068826] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 2146.077195] libceph: mon2 (2)172.21.15.164:3301 session established [ 2146.082528] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 2146.092261] libceph: mon2 (2)172.21.15.164:3301 session established [ 2146.131296] libceph: osd4 (2)172.21.15.164:6820 socket error on write [ 2146.140655] libceph: mon2 (2)172.21.15.164:3301 session established [ 2146.180863] libceph: osd3 (2)172.21.15.156:6808 socket error on write [ 2146.189416] libceph: mon2 (2)172.21.15.164:3301 session established [ 2146.489889] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2146.497775] libceph: mon2 (2)172.21.15.164:3301 session established [ 2146.740833] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2146.748749] libceph: mon2 (2)172.21.15.164:3301 session established [ 2148.668821] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e440): osd7 weight 0x0 (out) [ 2151.423958] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2151.431597] libceph: mon2 (2)172.21.15.164:3301 session established [ 2151.756742] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2151.764442] libceph: mon2 (2)172.21.15.164:3301 session established [ 2158.066757] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e446): osd1 primary-affinity 0x0 [ 2160.573570] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e452): osd5 weight 0x0 (out) [ 2161.571697] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2161.585122] libceph: mon2 (2)172.21.15.164:3301 session established [ 2166.613144] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e458): osd5 weight 0x10000 (in) [ 2167.629096] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2167.637243] libceph: mon2 (2)172.21.15.164:3301 session established [ 2171.684203] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2171.691900] libceph: mon2 (2)172.21.15.164:3301 session established [ 2172.678346] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2172.685958] libceph: mon2 (2)172.21.15.164:3301 session established [ 2173.200782] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2173.208605] libceph: mon2 (2)172.21.15.164:3301 session established [ 2173.809984] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2173.817689] libceph: mon2 (2)172.21.15.164:3301 session established [ 2174.198838] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2174.207070] libceph: mon2 (2)172.21.15.164:3301 session established [ 2174.696868] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2174.708263] libceph: mon2 (2)172.21.15.164:3301 session established [ 2175.615672] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2175.623430] libceph: mon2 (2)172.21.15.164:3301 session established [ 2175.912827] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2175.920531] libceph: mon2 (2)172.21.15.164:3301 session established [ 2176.521760] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e464): osd7 weight 0xe144 [ 2176.539941] libceph: osd6 (2)172.21.15.164:6808 socket error on write [ 2176.553511] libceph: mon2 (2)172.21.15.164:3301 session established [ 2176.649085] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2176.657010] libceph: osd6 (2)172.21.15.164:6808 socket closed (con state OPEN) [ 2176.675914] libceph: mon2 (2)172.21.15.164:3301 session established [ 2176.698827] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 2176.707041] libceph: mon2 (2)172.21.15.164:3301 session established [ 2176.726610] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2176.741213] libceph: mon2 (2)172.21.15.164:3301 session established [ 2177.153629] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2177.161287] libceph: mon2 (2)172.21.15.164:3301 session established [ 2177.519961] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2177.527607] libceph: mon2 (2)172.21.15.164:3301 session established [ 2177.748404] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 2177.756918] libceph: mon2 (2)172.21.15.164:3301 session established [ 2177.992770] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2178.000545] libceph: mon2 (2)172.21.15.164:3301 session established [ 2178.677415] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e470): osd0 down [ 2179.400949] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2179.408981] libceph: mon2 (2)172.21.15.164:3301 session established [ 2182.105548] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2182.113193] libceph: mon2 (2)172.21.15.164:3301 session established [ 2186.362956] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2186.370683] libceph: mon2 (2)172.21.15.164:3301 session established [ 2186.735887] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2186.743731] libceph: mon2 (2)172.21.15.164:3301 session established [ 2191.016847] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2191.024831] libceph: mon2 (2)172.21.15.164:3301 session established [ 2195.483115] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2195.490902] libceph: mon2 (2)172.21.15.164:3301 session established [ 2203.276132] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2203.284601] libceph: mon2 (2)172.21.15.164:3301 session established [ 2207.566238] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2207.573895] libceph: mon2 (2)172.21.15.164:3301 session established [ 2209.858141] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2209.865879] libceph: mon2 (2)172.21.15.164:3301 session established [ 2210.428215] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2210.435886] libceph: mon2 (2)172.21.15.164:3301 session established [ 2211.689393] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2211.697919] libceph: mon2 (2)172.21.15.164:3301 session established [ 2212.435060] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2212.442722] libceph: mon2 (2)172.21.15.164:3301 session established [ 2212.777500] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2212.785213] libceph: mon2 (2)172.21.15.164:3301 session established [ 2217.462077] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e481): osd2 weight 0x0 (out) [ 2217.510923] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2217.518718] libceph: mon2 (2)172.21.15.164:3301 session established [ 2222.609665] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e497): osd0 up [ 2222.646104] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2222.654072] libceph: mon2 (2)172.21.15.164:3301 session established [ 2228.943269] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2228.951759] libceph: mon2 (2)172.21.15.164:3301 session established [ 2229.834489] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2229.842327] libceph: mon2 (2)172.21.15.164:3301 session established [ 2231.303144] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2231.310891] libceph: mon2 (2)172.21.15.164:3301 session established [ 2232.249883] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2232.257618] libceph: mon2 (2)172.21.15.164:3301 session established [ 2234.158020] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2234.166240] libceph: mon2 (2)172.21.15.164:3301 session established [ 2234.364044] libceph: mds0 (2)172.21.15.156:6836 socket error on write [ 2234.372693] libceph: mds1 (2)172.21.15.156:6833 socket error on write [ 2234.379539] libceph: mds2 (2)172.21.15.164:6837 socket error on write [ 2234.390489] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state V2_SESSION_RECONNECT) [ 2234.390582] libceph: mon2 (2)172.21.15.164:3301 session established [ 2234.405982] libceph: mon2 (2)172.21.15.164:3301 session established [ 2234.664772] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2234.674275] libceph: mon2 (2)172.21.15.164:3301 session established [ 2234.980122] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2234.988041] libceph: mon2 (2)172.21.15.164:3301 session established [ 2240.606847] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2240.614520] libceph: mon2 (2)172.21.15.164:3301 session established [ 2240.884099] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2240.892337] libceph: mon2 (2)172.21.15.164:3301 session established [ 2241.341706] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2241.349441] libceph: mon2 (2)172.21.15.164:3301 session established [ 2244.808481] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2244.819589] libceph: mon2 (2)172.21.15.164:3301 session established [ 2245.072852] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2245.080795] libceph: mon2 (2)172.21.15.164:3301 session established [ 2250.754349] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e508): osd1 weight 0xf377 [ 2250.762126] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e508): osd3 weight 0xe668 [ 2250.769924] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e508): osd4 weight 0xf334 [ 2250.777711] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e509): osd1 weight 0xf3ba [ 2250.785473] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e509): osd3 weight 0xc564 [ 2250.793232] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e509): osd4 weight 0xdb56 [ 2250.803138] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e511): osd1 weight 0xf4b0 [ 2250.810925] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e511): osd3 weight 0xb898 [ 2250.818689] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e511): osd4 weight 0xce8a [ 2250.826456] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e512): osd1 weight 0xf5a8 [ 2250.834229] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e518): osd7 weight 0x0 (out) [ 2251.833845] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2251.841606] libceph: mon2 (2)172.21.15.164:3301 session established [ 2257.068263] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2257.076734] libceph: mon2 (2)172.21.15.164:3301 session established [ 2258.588019] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2258.599120] libceph: mon2 (2)172.21.15.164:3301 session established [ 2259.141555] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2259.149174] libceph: mon2 (2)172.21.15.164:3301 session established [ 2261.856080] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2261.863762] libceph: mon2 (2)172.21.15.164:3301 session established [ 2263.154809] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2263.162610] libceph: mon2 (2)172.21.15.164:3301 session established [ 2268.189230] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2268.197116] libceph: mon2 (2)172.21.15.164:3301 session established [ 2271.357287] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2271.364899] libceph: mon2 (2)172.21.15.164:3301 session established [ 2272.354073] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2272.362175] libceph: mon2 (2)172.21.15.164:3301 session established [ 2272.648086] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2272.655792] libceph: mon2 (2)172.21.15.164:3301 session established [ 2277.187575] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2277.195372] libceph: mon2 (2)172.21.15.164:3301 session established [ 2280.281853] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2280.289579] libceph: mon2 (2)172.21.15.164:3301 session established [ 2280.686810] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2280.694526] libceph: mon2 (2)172.21.15.164:3301 session established [ 2281.931344] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2281.939096] libceph: mon2 (2)172.21.15.164:3301 session established [ 2282.231126] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2282.238914] libceph: mon2 (2)172.21.15.164:3301 session established [ 2282.574217] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2282.583948] libceph: mon2 (2)172.21.15.164:3301 session established [ 2283.773043] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2283.780760] libceph: mon2 (2)172.21.15.164:3301 session established [ 2286.958193] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2286.974058] libceph: mon2 (2)172.21.15.164:3301 session established [ 2288.067049] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e536): osd2 weight 0x10000 (in) [ 2288.075372] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e547): osd1 up [ 2288.082133] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e552): osd3 down [ 2289.253307] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2289.261161] libceph: mon2 (2)172.21.15.164:3301 session established [ 2289.657934] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2289.665563] libceph: mon2 (2)172.21.15.164:3301 session established [ 2299.493504] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2299.501345] libceph: mon2 (2)172.21.15.164:3301 session established [ 2300.534453] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2300.542176] libceph: mon2 (2)172.21.15.164:3301 session established [ 2300.945050] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2300.952727] libceph: mon2 (2)172.21.15.164:3301 session established [ 2302.847210] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e567): osd7 weight 0xe144 [ 2302.855015] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e573): osd7 primary-affinity 0x10000 [ 2302.877583] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2302.885413] libceph: mon2 (2)172.21.15.164:3301 session established [ 2306.573528] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2306.581143] libceph: mon2 (2)172.21.15.164:3301 session established [ 2306.855643] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2306.863345] libceph: mon2 (2)172.21.15.164:3301 session established [ 2310.384903] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2310.392529] libceph: mon2 (2)172.21.15.164:3301 session established [ 2311.581336] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2311.589015] libceph: mon2 (2)172.21.15.164:3301 session established [ 2311.977885] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2311.985977] libceph: mon2 (2)172.21.15.164:3301 session established [ 2312.516224] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2312.523952] libceph: mon2 (2)172.21.15.164:3301 session established [ 2314.629943] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2314.637771] libceph: mon2 (2)172.21.15.164:3301 session established [ 2314.894829] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2314.902717] libceph: mon2 (2)172.21.15.164:3301 session established [ 2319.507875] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2319.515604] libceph: mon2 (2)172.21.15.164:3301 session established [ 2320.119216] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2320.126916] libceph: mon2 (2)172.21.15.164:3301 session established [ 2320.461796] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2320.469505] libceph: mon2 (2)172.21.15.164:3301 session established [ 2320.727204] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2320.734804] libceph: mon2 (2)172.21.15.164:3301 session established [ 2321.121173] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2321.128828] libceph: mon2 (2)172.21.15.164:3301 session established [ 2321.414171] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2321.421899] libceph: mon2 (2)172.21.15.164:3301 session established [ 2321.779975] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2321.787648] libceph: mon2 (2)172.21.15.164:3301 session established [ 2322.149302] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2322.157232] libceph: mon2 (2)172.21.15.164:3301 session established [ 2323.062829] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2323.072118] libceph: mon2 (2)172.21.15.164:3301 session established [ 2327.543018] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2327.550940] libceph: mon2 (2)172.21.15.164:3301 session established [ 2327.572825] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e596): osd3 up [ 2328.800715] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2328.808484] libceph: mon2 (2)172.21.15.164:3301 session established [ 2334.433344] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2334.440994] libceph: mon2 (2)172.21.15.164:3301 session established [ 2335.731154] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2335.738844] libceph: mon2 (2)172.21.15.164:3301 session established [ 2336.952742] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e602): osd3 weight 0x10000 (in) [ 2336.960938] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e603): osd1 weight 0x10000 (in) [ 2336.969135] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e604): osd6 weight 0x10000 (in) [ 2336.977336] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e605): osd0 weight 0x10000 (in) [ 2336.985537] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e606): osd4 weight 0x10000 (in) [ 2341.714711] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2341.723020] libceph: mon2 (2)172.21.15.164:3301 session established [ 2342.001115] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2342.008802] libceph: mon2 (2)172.21.15.164:3301 session established [ 2342.269849] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e607): osd5 weight 0x10000 (in) [ 2342.278046] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e608): osd2 weight 0x10000 (in) [ 2342.286231] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e609): osd7 weight 0x10000 (in) [ 2342.328716] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2342.336439] libceph: mon2 (2)172.21.15.164:3301 session established [ 2344.438325] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2344.446759] libceph: mon2 (2)172.21.15.164:3301 session established [ 2350.824780] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2350.837948] libceph: mon2 (2)172.21.15.164:3301 session established [ 2353.071629] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2353.079496] libceph: mon2 (2)172.21.15.164:3301 session established [ 2353.311904] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2353.327970] libceph: mon2 (2)172.21.15.164:3301 session established [ 2353.901751] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2353.909473] libceph: mon2 (2)172.21.15.164:3301 session established [ 2355.712026] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2355.719896] libceph: mon2 (2)172.21.15.164:3301 session established [ 2357.516473] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2357.524237] libceph: mon2 (2)172.21.15.164:3301 session established [ 2361.400890] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2361.408653] libceph: mon2 (2)172.21.15.164:3301 session established [ 2361.696722] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2361.704595] libceph: mon2 (2)172.21.15.164:3301 session established [ 2363.359489] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2363.367183] libceph: mon2 (2)172.21.15.164:3301 session established [ 2364.891191] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2364.899034] libceph: mon2 (2)172.21.15.164:3301 session established [ 2368.006198] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2368.013824] libceph: mon2 (2)172.21.15.164:3301 session established [ 2368.275082] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2368.282840] libceph: mon2 (2)172.21.15.164:3301 session established [ 2369.842824] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2369.850494] libceph: mon2 (2)172.21.15.164:3301 session established [ 2375.285376] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2375.293637] libceph: mon2 (2)172.21.15.164:3301 session established [ 2375.550187] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state V2_SESSION_RECONNECT) [ 2375.559346] libceph: mon2 (2)172.21.15.164:3301 session established [ 2377.554033] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2377.562296] libceph: mon2 (2)172.21.15.164:3301 session established [ 2379.364612] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e636): osd3 weight 0x10000 (in) [ 2379.372793] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e637): osd1 weight 0x10000 (in) [ 2379.380965] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e638): osd6 weight 0x10000 (in) [ 2379.389148] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e639): osd0 weight 0x10000 (in) [ 2379.397324] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e640): osd4 weight 0x10000 (in) [ 2379.405500] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e641): osd5 weight 0x10000 (in) [ 2380.418204] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2380.426105] libceph: mon2 (2)172.21.15.164:3301 session established [ 2381.390955] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2381.398621] libceph: mon2 (2)172.21.15.164:3301 session established [ 2381.872117] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2381.879843] libceph: mon2 (2)172.21.15.164:3301 session established [ 2383.373878] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2383.381798] libceph: mon2 (2)172.21.15.164:3301 session established [ 2388.623675] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2388.631407] libceph: mon2 (2)172.21.15.164:3301 session established [ 2389.094484] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2389.102480] libceph: mon2 (2)172.21.15.164:3301 session established [ 2393.427186] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2393.434839] libceph: mon2 (2)172.21.15.164:3301 session established [ 2396.652985] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2396.660666] libceph: mon2 (2)172.21.15.164:3301 session established [ 2397.104722] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2397.112412] libceph: mon2 (2)172.21.15.164:3301 session established [ 2398.001924] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2398.010584] libceph: mon2 (2)172.21.15.164:3301 session established [ 2400.079950] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2400.088282] libceph: mon2 (2)172.21.15.164:3301 session established [ 2400.705703] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2400.713267] libceph: mon2 (2)172.21.15.164:3301 session established [ 2405.414754] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2405.422380] libceph: mon2 (2)172.21.15.164:3301 session established [ 2405.758735] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2405.766319] libceph: mon2 (2)172.21.15.164:3301 session established [ 2406.192072] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2406.199689] libceph: mon2 (2)172.21.15.164:3301 session established [ 2412.133146] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2412.140911] libceph: mon2 (2)172.21.15.164:3301 session established [ 2414.643550] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e642): osd2 weight 0x10000 (in) [ 2414.651822] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e643): osd7 weight 0x10000 (in) [ 2414.660023] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e650): osd0 weight 0x0 (out) [ 2414.667988] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e656): osd3 weight 0x10000 (in) [ 2414.676239] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e657): osd1 weight 0x10000 (in) [ 2414.684517] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e658): osd6 weight 0x10000 (in) [ 2414.692787] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e659): osd4 weight 0x10000 (in) [ 2414.701103] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e660): osd5 weight 0x10000 (in) [ 2414.709400] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e661): osd2 weight 0x10000 (in) [ 2414.717635] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e662): osd7 weight 0x10000 (in) [ 2416.076046] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2416.083654] libceph: mon2 (2)172.21.15.164:3301 session established [ 2416.683738] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2416.691430] libceph: mon2 (2)172.21.15.164:3301 session established [ 2422.758025] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2422.766442] libceph: mon2 (2)172.21.15.164:3301 session established [ 2423.048129] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2423.055966] libceph: mon2 (2)172.21.15.164:3301 session established [ 2423.330617] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2423.338281] libceph: mon2 (2)172.21.15.164:3301 session established [ 2425.508796] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2425.516444] libceph: mon2 (2)172.21.15.164:3301 session established [ 2425.929702] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2425.937442] libceph: mon2 (2)172.21.15.164:3301 session established [ 2426.574593] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2426.582242] libceph: mon2 (2)172.21.15.164:3301 session established [ 2427.448117] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2427.455818] libceph: mon2 (2)172.21.15.164:3301 session established [ 2432.729772] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e684): osd0 weight 0x10000 (in) [ 2435.481372] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2435.489201] libceph: mon2 (2)172.21.15.164:3301 session established [ 2439.589996] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2439.597686] libceph: mon2 (2)172.21.15.164:3301 session established [ 2445.319836] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2445.327790] libceph: mon2 (2)172.21.15.164:3301 session established [ 2446.632384] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2446.640722] libceph: mon2 (2)172.21.15.164:3301 session established [ 2447.270531] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2447.278211] libceph: mon2 (2)172.21.15.164:3301 session established [ 2450.722192] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2450.729874] libceph: mon2 (2)172.21.15.164:3301 session established [ 2452.677015] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e695): osd5 primary-affinity 0x0 [ 2452.685351] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e706): osd7 primary-affinity 0x10000 [ 2455.427089] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2455.435251] libceph: mon2 (2)172.21.15.164:3301 session established [ 2455.810468] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2455.818421] libceph: mon2 (2)172.21.15.164:3301 session established [ 2456.083577] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2456.093398] libceph: mon2 (2)172.21.15.164:3301 session established [ 2460.739594] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2460.747338] libceph: mon2 (2)172.21.15.164:3301 session established [ 2461.681729] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e711): osd6 weight 0xad7b [ 2473.984588] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2473.992535] libceph: mon2 (2)172.21.15.164:3301 session established [ 2475.554107] libceph: mds0 (2)172.21.15.156:6836 socket error on write [ 2475.561058] libceph: mon2 (2)172.21.15.164:3301 session established [ 2476.260038] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 2476.267744] libceph: mon2 (2)172.21.15.164:3301 session established [ 2476.336582] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2476.346506] libceph: mon2 (2)172.21.15.164:3301 session established [ 2476.784260] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2476.792027] libceph: mon2 (2)172.21.15.164:3301 session established [ 2479.139796] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 2479.148904] libceph: mon2 (2)172.21.15.164:3301 session established [ 2479.182137] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 2479.192840] libceph: mon2 (2)172.21.15.164:3301 session established [ 2479.195727] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 2479.207270] libceph: mon2 (2)172.21.15.164:3301 session established [ 2479.336995] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2479.349682] libceph: mon2 (2)172.21.15.164:3301 session established [ 2480.595484] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2480.603081] libceph: mon2 (2)172.21.15.164:3301 session established [ 2480.946325] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2480.953964] libceph: mon2 (2)172.21.15.164:3301 session established [ 2482.163538] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2482.179801] libceph: mon2 (2)172.21.15.164:3301 session established [ 2483.644363] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2483.652832] libceph: mon2 (2)172.21.15.164:3301 session established [ 2485.329332] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2485.337305] libceph: mon2 (2)172.21.15.164:3301 session established [ 2485.592233] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2485.599975] libceph: mon2 (2)172.21.15.164:3301 session established [ 2485.996648] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2486.005430] libceph: mon2 (2)172.21.15.164:3301 session established [ 2486.601588] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2486.609202] libceph: mon2 (2)172.21.15.164:3301 session established [ 2488.315562] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2488.323194] libceph: mon2 (2)172.21.15.164:3301 session established [ 2488.398262] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2488.406886] libceph: mon2 (2)172.21.15.164:3301 session established [ 2493.615979] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2493.623775] libceph: mon2 (2)172.21.15.164:3301 session established [ 2495.800036] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2495.807849] libceph: mon2 (2)172.21.15.164:3301 session established [ 2496.078470] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2496.086214] libceph: mon2 (2)172.21.15.164:3301 session established [ 2496.593321] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2496.601890] libceph: mon2 (2)172.21.15.164:3301 session established [ 2500.002206] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2500.009853] libceph: mon2 (2)172.21.15.164:3301 session established [ 2500.900153] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e739): osd4 primary-affinity 0x0 [ 2502.469495] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2502.477212] libceph: mon2 (2)172.21.15.164:3301 session established [ 2502.601461] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2502.609274] libceph: mon2 (2)172.21.15.164:3301 session established [ 2503.238296] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2503.245930] libceph: mon2 (2)172.21.15.164:3301 session established [ 2503.444473] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2503.452185] libceph: mon2 (2)172.21.15.164:3301 session established [ 2503.541250] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2503.548925] libceph: mon2 (2)172.21.15.164:3301 session established [ 2504.254813] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2504.262752] libceph: mon2 (2)172.21.15.164:3301 session established [ 2504.675986] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e742): osd0 weight 0x0 (out) [ 2504.958532] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2504.966198] libceph: mon2 (2)172.21.15.164:3301 session established [ 2505.224766] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state V2_SESSION_RECONNECT) [ 2505.233775] libceph: mon2 (2)172.21.15.164:3301 session established [ 2505.744505] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2505.752275] libceph: mon2 (2)172.21.15.164:3301 session established [ 2506.040022] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2506.047938] libceph: mon2 (2)172.21.15.164:3301 session established [ 2507.480431] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2507.488122] libceph: mon2 (2)172.21.15.164:3301 session established [ 2511.583980] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e748): osd0 weight 0x10000 (in) [ 2513.409045] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state V2_BANNER_PREFIX) [ 2513.419256] libceph: mon2 (2)172.21.15.164:3301 session established [ 2514.428394] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2514.437321] libceph: mon2 (2)172.21.15.164:3301 session established [ 2514.687656] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state V2_AUTH) [ 2514.695623] libceph: mon2 (2)172.21.15.164:3301 session established [ 2515.976624] libceph: osd0 (2)172.21.15.156:6800 socket error on write [ 2515.999292] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 2516.007395] libceph: mon2 (2)172.21.15.164:3301 session established [ 2516.032325] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 2516.049296] libceph: mon2 (2)172.21.15.164:3301 session established [ 2516.051264] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 2516.070693] libceph: mon2 (2)172.21.15.164:3301 session established [ 2516.472899] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2516.480966] libceph: mon2 (2)172.21.15.164:3301 session established [ 2516.721312] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e754): osd3 weight 0x10000 (in) [ 2517.300162] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2517.308055] libceph: mon2 (2)172.21.15.164:3301 session established [ 2517.601796] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2517.609470] libceph: mon2 (2)172.21.15.164:3301 session established [ 2518.455318] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2518.463317] libceph: mon2 (2)172.21.15.164:3301 session established [ 2518.940058] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2518.948309] libceph: mon2 (2)172.21.15.164:3301 session established [ 2519.537872] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2519.545636] libceph: mon2 (2)172.21.15.164:3301 session established [ 2520.606680] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2520.614397] libceph: mon2 (2)172.21.15.164:3301 session established [ 2521.596624] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2521.604493] libceph: mon2 (2)172.21.15.164:3301 session established [ 2521.838463] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2521.846145] libceph: mon2 (2)172.21.15.164:3301 session established [ 2522.723720] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2522.731364] libceph: mon2 (2)172.21.15.164:3301 session established [ 2522.961272] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e755): osd1 weight 0x10000 (in) [ 2522.969768] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e756): osd6 weight 0x10000 (in) [ 2522.978572] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e757): osd4 weight 0x10000 (in) [ 2522.987118] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e758): osd5 weight 0x10000 (in) [ 2522.995721] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e759): osd2 weight 0x10000 (in) [ 2523.004454] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e760): osd7 weight 0x10000 (in) [ 2524.279131] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e761): osd0 weight 0x10000 (in) [ 2524.947362] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 2524.958157] libceph: mon2 (2)172.21.15.164:3301 session established [ 2524.991410] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2525.002852] libceph: mon2 (2)172.21.15.164:3301 session established [ 2526.207000] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2526.214808] libceph: mon2 (2)172.21.15.164:3301 session established [ 2527.452734] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2527.460722] libceph: mon2 (2)172.21.15.164:3301 session established [ 2528.273533] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2528.281208] libceph: mon2 (2)172.21.15.164:3301 session established [ 2532.629111] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2532.637065] libceph: mon2 (2)172.21.15.164:3301 session established [ 2536.587467] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e769): osd1 weight 0xb575 [ 2536.612456] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2536.620921] libceph: mon2 (2)172.21.15.164:3301 session established [ 2537.789009] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2537.796882] libceph: mon2 (2)172.21.15.164:3301 session established [ 2538.214880] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2538.222597] libceph: mon2 (2)172.21.15.164:3301 session established [ 2539.033796] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2539.041665] libceph: mon2 (2)172.21.15.164:3301 session established [ 2539.179333] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2539.190064] libceph: mon2 (2)172.21.15.164:3301 session established [ 2539.206589] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2539.214592] libceph: mon2 (2)172.21.15.164:3301 session established [ 2539.454577] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2539.463431] libceph: mon2 (2)172.21.15.164:3301 session established [ 2540.737683] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2540.745541] libceph: mon2 (2)172.21.15.164:3301 session established [ 2542.229699] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2542.237489] libceph: mon2 (2)172.21.15.164:3301 session established [ 2543.028790] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2543.036513] libceph: mon2 (2)172.21.15.164:3301 session established [ 2543.153244] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2543.160925] libceph: mon2 (2)172.21.15.164:3301 session established [ 2543.810106] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2543.817891] libceph: mon2 (2)172.21.15.164:3301 session established [ 2544.020403] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2544.028274] libceph: mon2 (2)172.21.15.164:3301 session established [ 2544.294315] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2544.304597] libceph: mon2 (2)172.21.15.164:3301 session established [ 2549.567786] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2549.575735] libceph: mon2 (2)172.21.15.164:3301 session established [ 2552.459188] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2552.467806] libceph: mon2 (2)172.21.15.164:3301 session established [ 2554.362572] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e784): osd3 weight 0x10000 (in) [ 2554.439069] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2554.449356] libceph: mon2 (2)172.21.15.164:3301 session established [ 2554.710076] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2554.717876] libceph: mon2 (2)172.21.15.164:3301 session established [ 2556.584988] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e785): osd1 weight 0x10000 (in) [ 2556.593248] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e786): osd6 weight 0x10000 (in) [ 2556.834433] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2556.842231] libceph: mon2 (2)172.21.15.164:3301 session established [ 2557.449553] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e787): osd4 weight 0x10000 (in) [ 2557.946689] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e788): osd5 weight 0x10000 (in) [ 2559.491999] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2559.499710] libceph: mon2 (2)172.21.15.164:3301 session established [ 2559.777028] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2559.792953] libceph: mon2 (2)172.21.15.164:3301 session established [ 2561.955460] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e789): osd2 weight 0x10000 (in) [ 2561.963792] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e790): osd7 weight 0x10000 (in) [ 2561.973503] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e791): osd0 weight 0x10000 (in) [ 2562.074296] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2562.081940] libceph: mon2 (2)172.21.15.164:3301 session established [ 2563.095910] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 2563.104190] libceph: mon2 (2)172.21.15.164:3301 session established [ 2563.984921] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2563.993265] libceph: mon2 (2)172.21.15.164:3301 session established [ 2565.497463] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2565.505096] libceph: mon2 (2)172.21.15.164:3301 session established [ 2566.129169] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2566.136898] libceph: mon2 (2)172.21.15.164:3301 session established [ 2566.500417] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2566.508076] libceph: mon2 (2)172.21.15.164:3301 session established [ 2570.850123] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2570.865067] libceph: mon2 (2)172.21.15.164:3301 session established [ 2571.753114] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e794): osd2 weight 0x0 (out) [ 2571.792232] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2571.799939] libceph: mon2 (2)172.21.15.164:3301 session established [ 2572.857665] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2572.870350] libceph: mon2 (2)172.21.15.164:3301 session established [ 2575.649223] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2575.656884] libceph: mon2 (2)172.21.15.164:3301 session established [ 2577.453995] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2577.461739] libceph: mon2 (2)172.21.15.164:3301 session established [ 2578.976941] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2578.984756] libceph: mon2 (2)172.21.15.164:3301 session established [ 2581.517069] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2581.524802] libceph: mon2 (2)172.21.15.164:3301 session established [ 2581.964249] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2581.971865] libceph: mon2 (2)172.21.15.164:3301 session established [ 2582.447807] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e808): osd0 primary-affinity 0x474a [ 2585.808249] libceph: osd6 (2)172.21.15.164:6808 socket closed (con state OPEN) [ 2585.816074] libceph: mon2 (2)172.21.15.164:3301 session established [ 2586.644090] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2586.651710] libceph: mon2 (2)172.21.15.164:3301 session established [ 2586.702063] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e814): osd6 down [ 2586.954951] libceph: osd3 (2)172.21.15.156:6808 socket error on write [ 2586.962051] libceph: mon2 (2)172.21.15.164:3301 session established [ 2590.624736] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2590.626603] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2590.639353] libceph: mon2 (2)172.21.15.164:3301 session established [ 2590.656058] libceph: mon2 (2)172.21.15.164:3301 session established [ 2591.610473] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2591.618970] libceph: mon2 (2)172.21.15.164:3301 session established [ 2595.042930] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 2595.050847] libceph: mon2 (2)172.21.15.164:3301 session established [ 2604.445721] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2604.453340] libceph: mon2 (2)172.21.15.164:3301 session established [ 2606.587739] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e823): osd6 up [ 2607.488509] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2607.496305] libceph: mon2 (2)172.21.15.164:3301 session established [ 2607.891168] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2607.898794] libceph: mon2 (2)172.21.15.164:3301 session established [ 2614.407151] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e828): osd2 weight 0x10000 (in) [ 2614.438867] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2614.446697] libceph: mon2 (2)172.21.15.164:3301 session established [ 2615.311043] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2615.318986] libceph: mon2 (2)172.21.15.164:3301 session established [ 2619.454989] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2619.462681] libceph: mon2 (2)172.21.15.164:3301 session established [ 2621.976020] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2621.984020] libceph: mon2 (2)172.21.15.164:3301 session established [ 2622.554736] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2622.562504] libceph: mon2 (2)172.21.15.164:3301 session established [ 2624.885798] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 2624.893453] libceph: mon2 (2)172.21.15.164:3301 session established [ 2626.956241] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e842): osd3 down [ 2631.726274] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2631.734071] libceph: mon2 (2)172.21.15.164:3301 session established [ 2638.419967] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2638.427740] libceph: mon2 (2)172.21.15.164:3301 session established [ 2639.445372] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2639.453314] libceph: mon2 (2)172.21.15.164:3301 session established [ 2639.639651] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2639.647329] libceph: mon2 (2)172.21.15.164:3301 session established [ 2639.877106] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 2639.885539] libceph: mon2 (2)172.21.15.164:3301 session established [ 2640.115920] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2640.124273] libceph: mon2 (2)172.21.15.164:3301 session established [ 2640.906439] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2640.914304] libceph: mon2 (2)172.21.15.164:3301 session established [ 2646.336521] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2646.344233] libceph: mon2 (2)172.21.15.164:3301 session established [ 2647.725215] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2647.732799] libceph: mon2 (2)172.21.15.164:3301 session established [ 2648.299485] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2648.308178] libceph: mon2 (2)172.21.15.164:3301 session established [ 2649.446079] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2649.453941] libceph: mon2 (2)172.21.15.164:3301 session established [ 2650.818447] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2650.827228] libceph: mon2 (2)172.21.15.164:3301 session established [ 2651.108792] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2651.117262] libceph: mon2 (2)172.21.15.164:3301 session established [ 2653.717319] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2653.725034] libceph: mon2 (2)172.21.15.164:3301 session established [ 2654.323171] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2654.331724] libceph: mon2 (2)172.21.15.164:3301 session established [ 2655.231064] libceph: osd2 (2)172.21.15.156:6818 socket error on write [ 2655.244876] libceph: mon2 (2)172.21.15.164:3301 session established [ 2655.307113] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2655.318969] libceph: mon2 (2)172.21.15.164:3301 session established [ 2655.571236] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2655.578941] libceph: mon2 (2)172.21.15.164:3301 session established [ 2656.533452] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2656.541231] libceph: mon2 (2)172.21.15.164:3301 session established [ 2656.855482] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2656.863202] libceph: mon2 (2)172.21.15.164:3301 session established [ 2658.440972] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2658.448907] libceph: mon2 (2)172.21.15.164:3301 session established [ 2661.630267] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2661.638002] libceph: mon2 (2)172.21.15.164:3301 session established [ 2661.880661] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e868): osd3 up [ 2666.517011] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e873): osd3 weight 0x10000 (in) [ 2666.813932] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e874): osd1 weight 0x10000 (in) [ 2670.305823] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2670.314497] libceph: mon2 (2)172.21.15.164:3301 session established [ 2677.487652] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2677.501638] libceph: mon2 (2)172.21.15.164:3301 session established [ 2679.200066] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2679.207750] libceph: mon2 (2)172.21.15.164:3301 session established [ 2679.471683] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2679.479389] libceph: mon2 (2)172.21.15.164:3301 session established [ 2681.499871] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e875): osd6 weight 0x10000 (in) [ 2681.508096] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e876): osd4 weight 0x10000 (in) [ 2681.516305] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e877): osd5 weight 0x10000 (in) [ 2681.524518] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e878): osd7 weight 0x10000 (in) [ 2681.532718] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e879): osd0 weight 0x10000 (in) [ 2681.540904] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e880): osd2 weight 0x10000 (in) [ 2681.549094] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e883): osd3 weight 0x10000 (in) [ 2681.557292] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e884): osd1 weight 0x10000 (in) [ 2681.609620] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2681.617487] libceph: mon2 (2)172.21.15.164:3301 session established [ 2681.642591] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2681.650475] libceph: mon2 (2)172.21.15.164:3301 session established [ 2681.894439] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2681.902080] libceph: mon2 (2)172.21.15.164:3301 session established [ 2682.551815] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e885): osd6 weight 0x10000 (in) [ 2682.942870] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e886): osd4 weight 0x10000 (in) [ 2683.056341] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2683.065026] libceph: mon2 (2)172.21.15.164:3301 session established [ 2683.753750] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2683.761437] libceph: mon2 (2)172.21.15.164:3301 session established [ 2686.622886] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2686.630581] libceph: mon2 (2)172.21.15.164:3301 session established [ 2687.598378] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2687.606023] libceph: mon2 (2)172.21.15.164:3301 session established [ 2693.484421] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2693.492247] libceph: mon2 (2)172.21.15.164:3301 session established [ 2694.448042] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2694.455878] libceph: mon2 (2)172.21.15.164:3301 session established [ 2695.590523] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2695.598426] libceph: mon2 (2)172.21.15.164:3301 session established [ 2696.617759] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2696.625663] libceph: mon2 (2)172.21.15.164:3301 session established [ 2697.725689] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2697.733376] libceph: mon2 (2)172.21.15.164:3301 session established [ 2698.259515] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e887): osd5 weight 0x10000 (in) [ 2698.271450] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e888): osd7 weight 0x10000 (in) [ 2698.281087] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e889): osd0 weight 0x10000 (in) [ 2698.290778] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e890): osd2 weight 0x10000 (in) [ 2698.591809] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2698.599883] libceph: mon2 (2)172.21.15.164:3301 session established [ 2698.632728] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2698.640958] libceph: mon2 (2)172.21.15.164:3301 session established [ 2699.131832] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2699.139547] libceph: mon2 (2)172.21.15.164:3301 session established [ 2704.658163] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2704.665924] libceph: mon2 (2)172.21.15.164:3301 session established [ 2708.588179] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2708.595750] libceph: mon2 (2)172.21.15.164:3301 session established [ 2708.947276] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2708.955070] libceph: mon2 (2)172.21.15.164:3301 session established [ 2714.112012] libceph: osd2 (2)172.21.15.156:6818 socket error on write [ 2714.124489] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e902): osd0 weight 0x0 (out) [ 2714.138937] libceph: mon2 (2)172.21.15.164:3301 session established [ 2714.230089] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2714.239770] libceph: mon2 (2)172.21.15.164:3301 session established [ 2715.084471] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2715.092108] libceph: mon2 (2)172.21.15.164:3301 session established [ 2715.199141] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e908): osd1 primary-affinity 0x10000 [ 2715.585716] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2715.593392] libceph: mon2 (2)172.21.15.164:3301 session established [ 2716.656373] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2716.664188] libceph: mon2 (2)172.21.15.164:3301 session established [ 2719.260811] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2719.268807] libceph: mon2 (2)172.21.15.164:3301 session established [ 2719.277569] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2719.285173] libceph: mon2 (2)172.21.15.164:3301 session established [ 2719.564468] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2719.572122] libceph: mon2 (2)172.21.15.164:3301 session established [ 2723.893389] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2723.901003] libceph: mon2 (2)172.21.15.164:3301 session established [ 2725.332753] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e914): osd0 weight 0x10000 (in) [ 2725.880709] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2725.888587] libceph: mon2 (2)172.21.15.164:3301 session established [ 2729.497089] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 2729.505718] libceph: mon2 (2)172.21.15.164:3301 session established [ 2729.510725] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2729.526668] libceph: mon2 (2)172.21.15.164:3301 session established [ 2729.806393] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2729.814022] libceph: mon2 (2)172.21.15.164:3301 session established [ 2732.658845] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2732.677410] libceph: mon2 (2)172.21.15.164:3301 session established [ 2734.281242] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2734.289006] libceph: mon2 (2)172.21.15.164:3301 session established [ 2734.608055] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2734.615787] libceph: mon2 (2)172.21.15.164:3301 session established [ 2735.352120] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e925): osd2 primary-affinity 0xb8ac [ 2736.217816] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2736.226370] libceph: mon2 (2)172.21.15.164:3301 session established [ 2739.456835] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2739.464576] libceph: mon2 (2)172.21.15.164:3301 session established [ 2740.181329] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2740.189122] libceph: mon2 (2)172.21.15.164:3301 session established [ 2740.649111] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2740.656817] libceph: mon2 (2)172.21.15.164:3301 session established [ 2741.665659] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2741.673300] libceph: mon2 (2)172.21.15.164:3301 session established [ 2742.884275] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 2742.895236] libceph: mon2 (2)172.21.15.164:3301 session established [ 2742.958321] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2742.968551] libceph: mon2 (2)172.21.15.164:3301 session established [ 2743.303777] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2743.311729] libceph: mon2 (2)172.21.15.164:3301 session established [ 2743.461904] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2743.470209] libceph: mon2 (2)172.21.15.164:3301 session established [ 2744.473823] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2744.481878] libceph: mon2 (2)172.21.15.164:3301 session established [ 2747.537386] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2747.545376] libceph: mon2 (2)172.21.15.164:3301 session established [ 2752.892693] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2752.900365] libceph: mon2 (2)172.21.15.164:3301 session established [ 2753.169952] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2753.177546] libceph: mon2 (2)172.21.15.164:3301 session established [ 2753.915740] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2753.923399] libceph: mon2 (2)172.21.15.164:3301 session established [ 2759.260175] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e939): osd3 weight 0x10000 (in) [ 2759.268386] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e940): osd1 weight 0x10000 (in) [ 2759.528825] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2759.536440] libceph: mon2 (2)172.21.15.164:3301 session established [ 2759.874267] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e941): osd6 weight 0x10000 (in) [ 2759.917129] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2759.925035] libceph: mon2 (2)172.21.15.164:3301 session established [ 2760.046657] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2760.054577] libceph: mon2 (2)172.21.15.164:3301 session established [ 2760.375180] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2760.383808] libceph: mon2 (2)172.21.15.164:3301 session established [ 2761.035843] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e942): osd4 weight 0x10000 (in) [ 2764.283882] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2764.292567] libceph: mon2 (2)172.21.15.164:3301 session established [ 2764.299026] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e943): osd5 weight 0x10000 (in) [ 2764.307239] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e944): osd7 weight 0x10000 (in) [ 2764.315437] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e945): osd2 weight 0x10000 (in) [ 2765.373700] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e946): osd0 weight 0x10000 (in) [ 2765.631375] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2765.645902] libceph: mon2 (2)172.21.15.164:3301 session established [ 2774.014439] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e949): osd0 primary-affinity 0x0 [ 2776.605118] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 2776.614124] libceph: mon2 (2)172.21.15.164:3301 session established [ 2779.455342] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2779.463164] libceph: mon2 (2)172.21.15.164:3301 session established [ 2781.597868] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e952): osd5 weight 0x0 (out) [ 2783.351151] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2783.359470] libceph: mon2 (2)172.21.15.164:3301 session established [ 2783.861137] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2783.868882] libceph: mon2 (2)172.21.15.164:3301 session established [ 2785.153911] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2785.162157] libceph: mon2 (2)172.21.15.164:3301 session established [ 2786.932715] libceph: osd3 (2)172.21.15.156:6808 socket error on write [ 2786.933907] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e958): osd3 weight 0x10000 (in) [ 2786.950201] libceph: mon2 (2)172.21.15.164:3301 session established [ 2787.037285] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e959): osd1 weight 0x10000 (in) [ 2788.064952] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2788.072699] libceph: mon2 (2)172.21.15.164:3301 session established [ 2789.371823] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e960): osd6 weight 0x10000 (in) [ 2789.380197] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e961): osd4 weight 0x10000 (in) [ 2789.461355] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2789.469085] libceph: mon2 (2)172.21.15.164:3301 session established [ 2792.955633] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e962): osd7 weight 0x10000 (in) [ 2792.963917] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e963): osd2 weight 0x10000 (in) [ 2792.972245] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e964): osd0 weight 0x10000 (in) [ 2793.445839] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2793.453620] libceph: mon2 (2)172.21.15.164:3301 session established [ 2794.444339] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2794.451938] libceph: mon2 (2)172.21.15.164:3301 session established [ 2794.533452] libceph: osd7 (2)172.21.15.164:6800 socket error on read [ 2794.542692] libceph: mon2 (2)172.21.15.164:3301 session established [ 2794.557973] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 2794.567698] libceph: mon2 (2)172.21.15.164:3301 session established [ 2794.600213] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2794.609714] libceph: mon2 (2)172.21.15.164:3301 session established [ 2794.864304] libceph: mds4 (2)172.21.15.164:6835 socket error on write [ 2794.871736] libceph: mon2 (2)172.21.15.164:3301 session established [ 2795.125543] libceph: mds4 (2)172.21.15.164:6835 socket error on write [ 2795.132405] libceph: mon2 (2)172.21.15.164:3301 session established [ 2795.721420] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2795.729255] libceph: mon2 (2)172.21.15.164:3301 session established [ 2796.339787] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2796.348424] libceph: mon2 (2)172.21.15.164:3301 session established [ 2802.570041] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2802.577824] libceph: mon2 (2)172.21.15.164:3301 session established [ 2802.864910] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2802.873429] libceph: mon2 (2)172.21.15.164:3301 session established [ 2803.436279] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2803.443904] libceph: mon2 (2)172.21.15.164:3301 session established [ 2805.657224] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2805.665443] libceph: mon2 (2)172.21.15.164:3301 session established [ 2806.411554] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2806.426466] libceph: mon2 (2)172.21.15.164:3301 session established [ 2808.486281] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2808.494072] libceph: mon2 (2)172.21.15.164:3301 session established [ 2809.797395] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2809.805161] libceph: mon2 (2)172.21.15.164:3301 session established [ 2811.805747] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2811.813375] libceph: mon2 (2)172.21.15.164:3301 session established [ 2812.226612] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2812.234541] libceph: mon2 (2)172.21.15.164:3301 session established [ 2815.493904] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 2815.512115] libceph: mon2 (2)172.21.15.164:3301 session established [ 2816.196215] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2816.204600] libceph: mon2 (2)172.21.15.164:3301 session established [ 2837.319472] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2837.327254] libceph: mon2 (2)172.21.15.164:3301 session established [ 2838.528088] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2838.535764] libceph: mon2 (2)172.21.15.164:3301 session established [ 2856.841032] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2856.849239] libceph: mon2 (2)172.21.15.164:3301 session established [ 2858.197064] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2858.204764] libceph: mon2 (2)172.21.15.164:3301 session established [ 2858.596348] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2858.604339] libceph: mon2 (2)172.21.15.164:3301 session established [ 2858.620702] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2858.628386] libceph: mon2 (2)172.21.15.164:3301 session established [ 2859.579685] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2859.587716] libceph: mon2 (2)172.21.15.164:3301 session established [ 2859.864719] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2859.872534] libceph: mon2 (2)172.21.15.164:3301 session established [ 2860.893841] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 2860.901738] libceph: mon2 (2)172.21.15.164:3301 session established [ 2862.544362] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2862.552024] libceph: mon2 (2)172.21.15.164:3301 session established [ 2862.834996] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2862.842633] libceph: mon2 (2)172.21.15.164:3301 session established [ 2862.874826] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2862.882486] libceph: mon2 (2)172.21.15.164:3301 session established [ 2863.455490] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2863.463162] libceph: mon2 (2)172.21.15.164:3301 session established [ 2865.061582] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2865.069199] libceph: mon2 (2)172.21.15.164:3301 session established [ 2869.789260] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2869.797083] libceph: mon2 (2)172.21.15.164:3301 session established [ 2871.821596] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1005): osd5 weight 0x10000 (in) [ 2871.865706] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 2871.909888] libceph: mon2 (2)172.21.15.164:3301 session established [ 2871.926347] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 2871.934806] libceph: mon2 (2)172.21.15.164:3301 session established [ 2871.948542] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2871.956933] libceph: mon2 (2)172.21.15.164:3301 session established [ 2872.171603] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2872.179416] libceph: mon2 (2)172.21.15.164:3301 session established [ 2872.892293] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1011): osd1 weight 0x0 (out) [ 2875.974056] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2875.981951] libceph: mon2 (2)172.21.15.164:3301 session established [ 2876.002552] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2876.010154] libceph: mon2 (2)172.21.15.164:3301 session established [ 2897.008394] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1025): osd1 weight 0x10000 (in) [ 2910.896849] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1039): osd2 weight 0x0 (out) [ 2928.233005] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2928.240715] libceph: mon2 (2)172.21.15.164:3301 session established [ 2929.557726] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2929.565377] libceph: mon2 (2)172.21.15.164:3301 session established [ 2929.864722] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2929.873204] libceph: mon2 (2)172.21.15.164:3301 session established [ 2930.220305] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2930.228033] libceph: mon2 (2)172.21.15.164:3301 session established [ 2933.409039] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2933.416737] libceph: mon2 (2)172.21.15.164:3301 session established [ 2941.438699] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1062): osd3 weight 0x10000 (in) [ 2941.447160] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1063): osd6 weight 0x10000 (in) [ 2941.455636] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1064): osd4 weight 0x10000 (in) [ 2946.557872] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1065): osd7 weight 0x10000 (in) [ 2946.566331] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1066): osd0 weight 0x10000 (in) [ 2946.574773] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1067): osd5 weight 0x10000 (in) [ 2946.583228] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1068): osd1 weight 0x10000 (in) [ 2977.678055] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2977.685767] libceph: mon2 (2)172.21.15.164:3301 session established [ 2979.327329] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2979.335141] libceph: mon2 (2)172.21.15.164:3301 session established [ 2983.374087] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 2983.381788] libceph: mon2 (2)172.21.15.164:3301 session established [ 2986.876623] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2986.884544] libceph: mon2 (2)172.21.15.164:3301 session established [ 2989.753236] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2989.760956] libceph: mon2 (2)172.21.15.164:3301 session established [ 2992.004369] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2992.011246] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 2992.019649] libceph: mon2 (2)172.21.15.164:3301 session established [ 2992.095996] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2992.104230] libceph: mon2 (2)172.21.15.164:3301 session established [ 2993.020248] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2993.028153] libceph: mon2 (2)172.21.15.164:3301 session established [ 2994.483423] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2994.491079] libceph: mon2 (2)172.21.15.164:3301 session established [ 2994.750784] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2994.758505] libceph: mon2 (2)172.21.15.164:3301 session established [ 2995.109113] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2995.117187] libceph: mon2 (2)172.21.15.164:3301 session established [ 2995.806870] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 2995.814682] libceph: mon2 (2)172.21.15.164:3301 session established [ 2997.269506] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 2997.279249] libceph: mon2 (2)172.21.15.164:3301 session established [ 2997.387362] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 2997.396053] libceph: mon2 (2)172.21.15.164:3301 session established [ 2997.529681] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2997.538307] libceph: mon2 (2)172.21.15.164:3301 session established [ 2998.566109] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 2998.573712] libceph: mon2 (2)172.21.15.164:3301 session established [ 3001.746534] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3001.754435] libceph: mon2 (2)172.21.15.164:3301 session established [ 3002.482427] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3002.490277] libceph: mon2 (2)172.21.15.164:3301 session established [ 3006.691117] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3006.698859] libceph: mon2 (2)172.21.15.164:3301 session established [ 3006.745622] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3006.753509] libceph: mon2 (2)172.21.15.164:3301 session established [ 3013.169760] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1103): osd3 primary-affinity 0x0 [ 3013.178185] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1106): osd2 weight 0x10000 (in) [ 3013.687996] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3013.695897] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3013.699574] libceph: mon2 (2)172.21.15.164:3301 session established [ 3013.710942] libceph: mon2 (2)172.21.15.164:3301 session established [ 3013.952663] libceph: mds2 (2)172.21.15.164:6837 socket error on write [ 3013.959464] libceph: mon2 (2)172.21.15.164:3301 session established [ 3015.726134] libceph: mds2 (2)172.21.15.164:6837 socket error on write [ 3015.734242] libceph: mon2 (2)172.21.15.164:3301 session established [ 3015.795568] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3015.803418] libceph: mon2 (2)172.21.15.164:3301 session established [ 3016.298287] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3016.306220] libceph: mon2 (2)172.21.15.164:3301 session established [ 3018.883191] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3018.892027] libceph: mon2 (2)172.21.15.164:3301 session established [ 3019.561525] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3019.569274] libceph: mon2 (2)172.21.15.164:3301 session established [ 3024.179952] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3024.187740] libceph: mon2 (2)172.21.15.164:3301 session established [ 3024.469566] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3024.481636] libceph: mon2 (2)172.21.15.164:3301 session established [ 3025.936138] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 3025.946198] libceph: mon2 (2)172.21.15.164:3301 session established [ 3026.082515] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3026.095717] libceph: mon2 (2)172.21.15.164:3301 session established [ 3027.901612] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3027.909310] libceph: mon2 (2)172.21.15.164:3301 session established [ 3030.120951] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3030.131460] libceph: mon2 (2)172.21.15.164:3301 session established [ 3030.169431] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3030.177697] libceph: mon2 (2)172.21.15.164:3301 session established [ 3030.698227] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3030.709687] libceph: mon2 (2)172.21.15.164:3301 session established [ 3032.439212] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3032.447062] libceph: mon2 (2)172.21.15.164:3301 session established [ 3033.139762] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1119): osd0 weight 0x0 (out) [ 3038.256552] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3038.264274] libceph: mon2 (2)172.21.15.164:3301 session established [ 3038.377880] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3038.385527] libceph: mon2 (2)172.21.15.164:3301 session established [ 3039.938763] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3039.946462] libceph: mon2 (2)172.21.15.164:3301 session established [ 3040.281026] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1130): osd5 weight 0x95b4 [ 3041.322758] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 3041.331600] libceph: mon2 (2)172.21.15.164:3301 session established [ 3041.331842] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 3041.353426] libceph: mon2 (2)172.21.15.164:3301 session established [ 3041.401993] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3041.410877] libceph: mon2 (2)172.21.15.164:3301 session established [ 3041.620684] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3041.628444] libceph: mon2 (2)172.21.15.164:3301 session established [ 3042.679827] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3042.689033] libceph: mon2 (2)172.21.15.164:3301 session established [ 3044.775211] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3044.782829] libceph: mon2 (2)172.21.15.164:3301 session established [ 3045.970560] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3045.978216] libceph: mon2 (2)172.21.15.164:3301 session established [ 3046.996090] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3047.003942] libceph: mon2 (2)172.21.15.164:3301 session established [ 3050.264290] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3050.273188] libceph: mon2 (2)172.21.15.164:3301 session established [ 3051.029181] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3051.037187] libceph: mon2 (2)172.21.15.164:3301 session established [ 3057.951492] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3057.960644] libceph: mon2 (2)172.21.15.164:3301 session established [ 3059.389442] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3059.406125] libceph: mon2 (2)172.21.15.164:3301 session established [ 3059.841875] libceph: mds1 (2)172.21.15.156:6833 socket error on write [ 3059.849446] libceph: mon2 (2)172.21.15.164:3301 session established [ 3061.993431] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3062.001343] libceph: mon2 (2)172.21.15.164:3301 session established [ 3067.492988] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3067.503575] libceph: mon2 (2)172.21.15.164:3301 session established [ 3067.513480] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3067.526017] libceph: mon2 (2)172.21.15.164:3301 session established [ 3067.723331] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3067.733326] libceph: mon2 (2)172.21.15.164:3301 session established [ 3068.394710] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3068.402407] libceph: mon2 (2)172.21.15.164:3301 session established [ 3069.443821] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1153): osd3 weight 0x10000 (in) [ 3069.500802] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3069.508462] libceph: mon2 (2)172.21.15.164:3301 session established [ 3069.795796] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3069.803650] libceph: mon2 (2)172.21.15.164:3301 session established [ 3072.633138] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3072.641303] libceph: mon2 (2)172.21.15.164:3301 session established [ 3073.859003] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1154): osd6 weight 0x10000 (in) [ 3073.867880] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1155): osd4 weight 0x10000 (in) [ 3073.876765] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1156): osd7 weight 0x10000 (in) [ 3073.885618] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1157): osd5 weight 0x10000 (in) [ 3074.135055] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3074.142817] libceph: mon2 (2)172.21.15.164:3301 session established [ 3074.849316] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1158): osd1 weight 0x10000 (in) [ 3076.018155] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1159): osd2 weight 0x10000 (in) [ 3076.198484] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3076.206472] libceph: mon2 (2)172.21.15.164:3301 session established [ 3078.239160] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3078.248440] libceph: mon2 (2)172.21.15.164:3301 session established [ 3078.551658] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3078.551924] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3078.559383] libceph: mon2 (2)172.21.15.164:3301 session established [ 3078.572802] libceph: mon2 (2)172.21.15.164:3301 session established [ 3081.398343] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3081.410216] libceph: mon2 (2)172.21.15.164:3301 session established [ 3084.418386] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3084.427440] libceph: mon2 (2)172.21.15.164:3301 session established [ 3085.941470] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3085.949390] libceph: mon2 (2)172.21.15.164:3301 session established [ 3086.033417] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3086.041059] libceph: mon2 (2)172.21.15.164:3301 session established [ 3086.290658] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3086.298342] libceph: mon2 (2)172.21.15.164:3301 session established [ 3087.078164] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3087.085903] libceph: mon2 (2)172.21.15.164:3301 session established [ 3087.902616] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 3087.915447] libceph: mon2 (2)172.21.15.164:3301 session established [ 3087.949118] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 3087.958543] libceph: mon2 (2)172.21.15.164:3301 session established [ 3087.962374] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 3087.976803] libceph: mon2 (2)172.21.15.164:3301 session established [ 3087.992235] libceph: osd1 (2)172.21.15.156:6816 socket error on write [ 3088.001499] libceph: mon2 (2)172.21.15.164:3301 session established [ 3088.034607] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 3088.056557] libceph: mon2 (2)172.21.15.164:3301 session established [ 3088.248127] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3088.266558] libceph: mon2 (2)172.21.15.164:3301 session established [ 3089.010902] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3089.018774] libceph: mon2 (2)172.21.15.164:3301 session established [ 3090.987410] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3090.995206] libceph: mon2 (2)172.21.15.164:3301 session established [ 3113.922608] libceph: osd2 (2)172.21.15.156:6818 socket error on write [ 3113.929556] libceph: mon2 (2)172.21.15.164:3301 session established [ 3115.009820] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3115.018930] libceph: mon2 (2)172.21.15.164:3301 session established [ 3115.125903] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3115.135086] libceph: mon2 (2)172.21.15.164:3301 session established [ 3119.217143] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3119.225231] libceph: mon2 (2)172.21.15.164:3301 session established [ 3123.661124] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3123.668960] libceph: mon2 (2)172.21.15.164:3301 session established [ 3124.922806] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3124.930601] libceph: mon2 (2)172.21.15.164:3301 session established [ 3125.380348] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3125.388202] libceph: mon2 (2)172.21.15.164:3301 session established [ 3126.288145] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3126.296327] libceph: mon2 (2)172.21.15.164:3301 session established [ 3126.587600] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3126.596125] libceph: mon2 (2)172.21.15.164:3301 session established [ 3126.868669] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3126.876453] libceph: mon2 (2)172.21.15.164:3301 session established [ 3127.154460] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3127.163110] libceph: mon2 (2)172.21.15.164:3301 session established [ 3127.875215] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3127.885108] libceph: mon2 (2)172.21.15.164:3301 session established [ 3132.007549] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3132.015253] libceph: mon2 (2)172.21.15.164:3301 session established [ 3132.450222] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3132.459247] libceph: mon2 (2)172.21.15.164:3301 session established [ 3134.194952] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3134.202819] libceph: mon2 (2)172.21.15.164:3301 session established [ 3135.695333] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3135.702983] libceph: mon2 (2)172.21.15.164:3301 session established [ 3138.064820] libceph: osd2 (2)172.21.15.156:6818 socket error on write [ 3138.074040] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1191): osd3 weight 0x10000 (in) [ 3138.083077] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1192): osd6 weight 0x10000 (in) [ 3138.096521] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1193): osd4 weight 0x10000 (in) [ 3138.105689] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1194): osd7 weight 0x10000 (in) [ 3138.117915] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1195): osd5 weight 0x10000 (in) [ 3138.129002] libceph: mon2 (2)172.21.15.164:3301 session established [ 3138.478294] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3138.490262] libceph: mon2 (2)172.21.15.164:3301 session established [ 3138.786096] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3138.793754] libceph: mon2 (2)172.21.15.164:3301 session established [ 3144.094335] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3144.102136] libceph: mon2 (2)172.21.15.164:3301 session established [ 3146.625914] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3146.633661] libceph: mon2 (2)172.21.15.164:3301 session established [ 3146.935705] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1196): osd1 weight 0x10000 (in) [ 3146.944006] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1197): osd2 weight 0x10000 (in) [ 3146.952291] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1198): osd1 primary-affinity 0xe086 [ 3147.454783] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 3147.463726] libceph: mon2 (2)172.21.15.164:3301 session established [ 3147.770774] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3147.778454] libceph: mon2 (2)172.21.15.164:3301 session established [ 3150.947055] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3150.954994] libceph: mon2 (2)172.21.15.164:3301 session established [ 3151.567373] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 3151.577526] libceph: mon2 (2)172.21.15.164:3301 session established [ 3152.342535] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3152.350280] libceph: mon2 (2)172.21.15.164:3301 session established [ 3152.363917] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3152.371639] libceph: mon2 (2)172.21.15.164:3301 session established [ 3152.493739] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3152.501551] libceph: mon2 (2)172.21.15.164:3301 session established [ 3158.394776] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3158.402527] libceph: mon2 (2)172.21.15.164:3301 session established [ 3160.648106] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3160.656576] libceph: mon2 (2)172.21.15.164:3301 session established [ 3162.208004] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3162.215783] libceph: mon2 (2)172.21.15.164:3301 session established [ 3162.376367] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3162.384295] libceph: mon2 (2)172.21.15.164:3301 session established [ 3162.702951] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3162.710635] libceph: mon2 (2)172.21.15.164:3301 session established [ 3163.022201] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3163.030644] libceph: mon2 (2)172.21.15.164:3301 session established [ 3163.762730] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3163.771628] libceph: mon2 (2)172.21.15.164:3301 session established [ 3164.537837] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3164.545645] libceph: mon2 (2)172.21.15.164:3301 session established [ 3164.683998] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state V2_SESSION_RECONNECT) [ 3164.693183] libceph: mon2 (2)172.21.15.164:3301 session established [ 3166.129259] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1208): osd3 weight 0xe5fe [ 3166.588211] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3166.596076] libceph: mon2 (2)172.21.15.164:3301 session established [ 3168.860170] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3168.867854] libceph: mon2 (2)172.21.15.164:3301 session established [ 3169.987187] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3169.994943] libceph: mon2 (2)172.21.15.164:3301 session established [ 3170.162066] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1213): osd3 primary-affinity 0x4e98 [ 3176.288164] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3176.296805] libceph: mon2 (2)172.21.15.164:3301 session established [ 3178.509038] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1217): osd4 primary-affinity 0x7e81 [ 3178.703189] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3178.711623] libceph: mon2 (2)172.21.15.164:3301 session established [ 3179.075903] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3179.083512] libceph: mon2 (2)172.21.15.164:3301 session established [ 3179.547648] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3179.555516] libceph: mon2 (2)172.21.15.164:3301 session established [ 3180.573775] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3180.581666] libceph: mon2 (2)172.21.15.164:3301 session established [ 3181.546620] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3181.554480] libceph: mon2 (2)172.21.15.164:3301 session established [ 3183.599236] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1220): osd6 weight 0x0 (out) [ 3186.473141] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3186.481230] libceph: mon2 (2)172.21.15.164:3301 session established [ 3186.874531] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3186.882464] libceph: mon2 (2)172.21.15.164:3301 session established [ 3187.841579] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3187.849851] libceph: mon2 (2)172.21.15.164:3301 session established [ 3188.897349] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1226): osd0 weight 0x10000 (in) [ 3190.092656] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3190.100507] libceph: mon2 (2)172.21.15.164:3301 session established [ 3190.186425] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3190.194059] libceph: mon2 (2)172.21.15.164:3301 session established [ 3191.363550] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3191.373251] libceph: mon2 (2)172.21.15.164:3301 session established [ 3192.620031] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3192.628234] libceph: mon2 (2)172.21.15.164:3301 session established [ 3195.700815] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3195.708636] libceph: mon2 (2)172.21.15.164:3301 session established [ 3196.646399] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3196.654153] libceph: mon2 (2)172.21.15.164:3301 session established [ 3197.558209] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3197.565880] libceph: mon2 (2)172.21.15.164:3301 session established [ 3199.315857] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3199.323651] libceph: mon2 (2)172.21.15.164:3301 session established [ 3203.314027] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3203.322056] libceph: mon2 (2)172.21.15.164:3301 session established [ 3206.525492] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3206.551505] libceph: mon2 (2)172.21.15.164:3301 session established [ 3206.603568] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3206.613853] libceph: mon2 (2)172.21.15.164:3301 session established [ 3207.475050] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3207.482843] libceph: mon2 (2)172.21.15.164:3301 session established [ 3207.796485] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3207.804134] libceph: mon2 (2)172.21.15.164:3301 session established [ 3207.979529] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1242): osd5 weight 0x0 (out) [ 3208.059433] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3208.067034] libceph: mon2 (2)172.21.15.164:3301 session established [ 3210.789591] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3210.799616] libceph: mon2 (2)172.21.15.164:3301 session established [ 3211.410051] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3211.422318] libceph: mon2 (2)172.21.15.164:3301 session established [ 3211.645582] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3211.654337] libceph: mon2 (2)172.21.15.164:3301 session established [ 3214.454256] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1248): osd4 primary-affinity 0x10000 [ 3216.657511] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3216.665280] libceph: mon2 (2)172.21.15.164:3301 session established [ 3220.127200] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1253): osd3 weight 0x10000 (in) [ 3220.135655] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1253): osd4 weight 0xc955 [ 3220.143542] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1253): osd7 weight 0xc701 [ 3223.049009] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1255): osd4 weight 0xbc89 [ 3223.056879] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1255): osd7 weight 0xba35 [ 3223.586364] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 3223.588938] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 3223.598429] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 3223.609110] libceph: mon2 (2)172.21.15.164:3301 session established [ 3226.073588] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1259): osd4 weight 0x936b [ 3226.081478] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1259): osd7 weight 0x911e [ 3245.131903] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1272): osd6 weight 0x10000 (in) [ 3245.173993] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 3245.185830] libceph: mon2 (2)172.21.15.164:3301 session established [ 3251.929444] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1279): osd5 weight 0x10000 (in) [ 3262.162978] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3262.170742] libceph: mon2 (2)172.21.15.164:3301 session established [ 3264.206982] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3264.214640] libceph: mon2 (2)172.21.15.164:3301 session established [ 3265.733476] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3265.741495] libceph: mon2 (2)172.21.15.164:3301 session established [ 3265.835186] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3265.842790] libceph: mon2 (2)172.21.15.164:3301 session established [ 3266.098635] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state V2_AUTH) [ 3266.106554] libceph: mon2 (2)172.21.15.164:3301 session established [ 3266.847344] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3266.855044] libceph: mon2 (2)172.21.15.164:3301 session established [ 3267.224881] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3267.232695] libceph: mon2 (2)172.21.15.164:3301 session established [ 3268.106354] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3268.114154] libceph: mon2 (2)172.21.15.164:3301 session established [ 3268.428339] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3268.436007] libceph: mon2 (2)172.21.15.164:3301 session established [ 3268.760941] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3268.768769] libceph: mon2 (2)172.21.15.164:3301 session established [ 3273.573383] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3273.581095] libceph: mon2 (2)172.21.15.164:3301 session established [ 3275.657619] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3275.666254] libceph: mon2 (2)172.21.15.164:3301 session established [ 3276.557290] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3276.565284] libceph: mon2 (2)172.21.15.164:3301 session established [ 3277.525960] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 3277.529720] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 3277.545304] libceph: mon2 (2)172.21.15.164:3301 session established [ 3277.715012] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3277.723281] libceph: mon2 (2)172.21.15.164:3301 session established [ 3277.813257] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3277.822080] libceph: mon2 (2)172.21.15.164:3301 session established [ 3278.908122] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3278.915908] libceph: mon2 (2)172.21.15.164:3301 session established [ 3279.371684] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3279.379422] libceph: mon2 (2)172.21.15.164:3301 session established [ 3279.681532] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3279.691641] libceph: mon2 (2)172.21.15.164:3301 session established [ 3279.731206] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state V2_SESSION_RECONNECT) [ 3279.740567] libceph: mon2 (2)172.21.15.164:3301 session established [ 3280.085470] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3280.093115] libceph: mon2 (2)172.21.15.164:3301 session established [ 3280.888657] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3280.896429] libceph: mon2 (2)172.21.15.164:3301 session established [ 3283.729192] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3283.737755] libceph: mon2 (2)172.21.15.164:3301 session established [ 3290.301224] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1309): osd1 weight 0x0 (out) [ 3306.017940] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1322): osd3 weight 0x10000 (in) [ 3306.028483] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1323): osd4 weight 0x10000 (in) [ 3306.057649] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 3306.067367] libceph: mon2 (2)172.21.15.164:3301 session established [ 3307.015250] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1324): osd7 weight 0x10000 (in) [ 3307.897856] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1325): osd2 weight 0x10000 (in) [ 3309.087260] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1326): osd0 weight 0x10000 (in) [ 3310.085275] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1327): osd6 weight 0x10000 (in) [ 3312.444051] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1328): osd5 weight 0x10000 (in) [ 3315.068316] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3315.076126] libceph: mon2 (2)172.21.15.164:3301 session established [ 3382.491765] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3382.499387] libceph: mon2 (2)172.21.15.164:3301 session established [ 3443.355578] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3443.367254] libceph: mon2 (2)172.21.15.164:3301 session established [ 3445.858112] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3445.865783] libceph: mon2 (2)172.21.15.164:3301 session established [ 3447.302106] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3447.309925] libceph: mon2 (2)172.21.15.164:3301 session established [ 3452.496209] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3452.504101] libceph: mon2 (2)172.21.15.164:3301 session established [ 3477.771874] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3477.779665] libceph: mon2 (2)172.21.15.164:3301 session established [ 3478.339975] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3478.347600] libceph: mon2 (2)172.21.15.164:3301 session established [ 3481.405644] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3481.413422] libceph: mon2 (2)172.21.15.164:3301 session established [ 3482.123989] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 3482.138686] libceph: mon2 (2)172.21.15.164:3301 session established [ 3486.749533] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3486.758153] libceph: mon2 (2)172.21.15.164:3301 session established [ 3489.621572] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3489.629176] libceph: mon2 (2)172.21.15.164:3301 session established [ 3490.233372] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3490.241029] libceph: mon2 (2)172.21.15.164:3301 session established [ 3491.582787] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3491.590659] libceph: mon2 (2)172.21.15.164:3301 session established [ 3491.851450] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3491.859363] libceph: mon2 (2)172.21.15.164:3301 session established [ 3494.282297] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3494.291659] libceph: mon2 (2)172.21.15.164:3301 session established [ 3494.475249] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1421): osd1 weight 0x10000 (in) [ 3496.867256] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3496.874870] libceph: mon2 (2)172.21.15.164:3301 session established [ 3498.084424] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3498.092237] libceph: mon2 (2)172.21.15.164:3301 session established [ 3501.422028] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3501.430027] libceph: mon2 (2)172.21.15.164:3301 session established [ 3502.373856] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3502.381463] libceph: mon2 (2)172.21.15.164:3301 session established [ 3502.654976] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3502.662666] libceph: mon2 (2)172.21.15.164:3301 session established [ 3507.022259] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1432): osd3 weight 0x10000 (in) [ 3507.030743] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1433): osd4 weight 0x10000 (in) [ 3508.889780] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3508.897495] libceph: mon2 (2)172.21.15.164:3301 session established [ 3509.260389] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3509.269471] libceph: mon2 (2)172.21.15.164:3301 session established [ 3509.766021] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1434): osd7 weight 0x10000 (in) [ 3509.774353] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1435): osd2 weight 0x10000 (in) [ 3509.948745] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3509.956427] libceph: mon2 (2)172.21.15.164:3301 session established [ 3510.459251] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3510.470308] libceph: mon2 (2)172.21.15.164:3301 session established [ 3513.094943] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1436): osd0 weight 0x10000 (in) [ 3513.103377] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1437): osd6 weight 0x10000 (in) [ 3513.111726] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1438): osd5 weight 0x10000 (in) [ 3513.120044] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1439): osd1 weight 0x10000 (in) [ 3513.216568] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3513.225071] libceph: mon2 (2)172.21.15.164:3301 session established [ 3513.479222] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state V2_AUTH) [ 3513.487767] libceph: mon2 (2)172.21.15.164:3301 session established [ 3514.053036] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3514.064420] libceph: mon2 (2)172.21.15.164:3301 session established [ 3515.265054] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3515.273193] libceph: mon2 (2)172.21.15.164:3301 session established [ 3518.737514] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3518.745466] libceph: mon2 (2)172.21.15.164:3301 session established [ 3519.806076] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3519.813795] libceph: mon2 (2)172.21.15.164:3301 session established [ 3520.086468] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3520.094586] libceph: mon2 (2)172.21.15.164:3301 session established [ 3526.569932] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3526.577749] libceph: mon2 (2)172.21.15.164:3301 session established [ 3527.018279] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3527.027884] libceph: mon2 (2)172.21.15.164:3301 session established [ 3527.520964] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3527.528671] libceph: mon2 (2)172.21.15.164:3301 session established [ 3528.086861] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3528.094637] libceph: mon2 (2)172.21.15.164:3301 session established [ 3529.785810] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3529.793481] libceph: mon2 (2)172.21.15.164:3301 session established [ 3530.112390] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3530.120351] libceph: mon2 (2)172.21.15.164:3301 session established [ 3532.457518] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3532.466208] libceph: mon2 (2)172.21.15.164:3301 session established [ 3532.497200] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3532.504945] libceph: mon2 (2)172.21.15.164:3301 session established [ 3534.181927] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3534.189570] libceph: mon2 (2)172.21.15.164:3301 session established [ 3536.474561] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3536.483278] libceph: mon2 (2)172.21.15.164:3301 session established [ 3539.225330] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3539.233074] libceph: mon2 (2)172.21.15.164:3301 session established [ 3543.284279] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3543.292215] libceph: mon2 (2)172.21.15.164:3301 session established [ 3547.314639] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3547.325024] libceph: mon2 (2)172.21.15.164:3301 session established [ 3547.664852] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 3547.698602] libceph: mon2 (2)172.21.15.164:3301 session established [ 3547.879651] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3547.891939] libceph: mon2 (2)172.21.15.164:3301 session established [ 3548.085046] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3548.093411] libceph: mon2 (2)172.21.15.164:3301 session established [ 3559.376019] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3559.383988] libceph: mon2 (2)172.21.15.164:3301 session established [ 3561.514826] libceph: osd5 (2)172.21.15.164:6816 socket closed (con state OPEN) [ 3561.525597] libceph: mon2 (2)172.21.15.164:3301 session established [ 3563.937714] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3563.945517] libceph: mon2 (2)172.21.15.164:3301 session established [ 3564.263100] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3564.271301] libceph: mon2 (2)172.21.15.164:3301 session established [ 3564.560232] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 3564.573961] libceph: mon2 (2)172.21.15.164:3301 session established [ 3566.652257] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3566.660140] libceph: mon2 (2)172.21.15.164:3301 session established [ 3567.184826] libceph: osd5 (2)172.21.15.164:6816 socket closed (con state OPEN) [ 3567.194038] libceph: mon2 (2)172.21.15.164:3301 session established [ 3567.201197] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 3567.201475] libceph: osd5 (2)172.21.15.164:6816 socket closed (con state OPEN) [ 3567.209177] libceph: mon2 (2)172.21.15.164:3301 session established [ 3567.222375] libceph: mon2 (2)172.21.15.164:3301 session established [ 3567.233110] libceph: osd5 (2)172.21.15.164:6816 socket error on write [ 3567.240100] libceph: mon2 (2)172.21.15.164:3301 session established [ 3569.634767] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3569.642478] libceph: mon2 (2)172.21.15.164:3301 session established [ 3571.628314] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3571.636068] libceph: mon2 (2)172.21.15.164:3301 session established [ 3571.812162] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 3571.819973] libceph: mon2 (2)172.21.15.164:3301 session established [ 3571.958398] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3571.969737] libceph: mon2 (2)172.21.15.164:3301 session established [ 3572.524538] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3572.532363] libceph: mon2 (2)172.21.15.164:3301 session established [ 3575.378247] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3575.386051] libceph: mon2 (2)172.21.15.164:3301 session established [ 3575.420644] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 3575.443181] libceph: mon2 (2)172.21.15.164:3301 session established [ 3575.571948] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3575.580055] libceph: mon2 (2)172.21.15.164:3301 session established [ 3575.629315] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 3575.637452] libceph: mon2 (2)172.21.15.164:3301 session established [ 3575.832041] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3575.839750] libceph: mon2 (2)172.21.15.164:3301 session established [ 3576.675529] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3576.683172] libceph: mon2 (2)172.21.15.164:3301 session established [ 3576.745007] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3576.752843] libceph: mon2 (2)172.21.15.164:3301 session established [ 3577.040005] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3577.048283] libceph: mon2 (2)172.21.15.164:3301 session established [ 3579.522761] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3579.530480] libceph: mon2 (2)172.21.15.164:3301 session established [ 3582.209774] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3582.218432] libceph: mon2 (2)172.21.15.164:3301 session established [ 3588.402586] libceph: osd5 (2)172.21.15.164:6816 socket closed (con state OPEN) [ 3588.412566] libceph: mon2 (2)172.21.15.164:3301 session established [ 3594.365435] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3594.373199] libceph: mon2 (2)172.21.15.164:3301 session established [ 3595.102607] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3595.110500] libceph: mon2 (2)172.21.15.164:3301 session established [ 3595.915629] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3595.923378] libceph: mon2 (2)172.21.15.164:3301 session established [ 3598.732393] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3598.740384] libceph: mon2 (2)172.21.15.164:3301 session established [ 3599.499235] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3599.507043] libceph: mon2 (2)172.21.15.164:3301 session established [ 3599.761049] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state V2_AUTH) [ 3599.769169] libceph: mon2 (2)172.21.15.164:3301 session established [ 3607.006824] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 3607.015159] libceph: mon2 (2)172.21.15.164:3301 session established [ 3607.561465] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3607.569796] libceph: mon2 (2)172.21.15.164:3301 session established [ 3612.125145] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3612.132816] libceph: mon2 (2)172.21.15.164:3301 session established [ 3612.297997] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 3612.308904] libceph: mon2 (2)172.21.15.164:3301 session established [ 3612.913248] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3612.924250] libceph: mon2 (2)172.21.15.164:3301 session established [ 3616.566821] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3616.574564] libceph: mon2 (2)172.21.15.164:3301 session established [ 3616.857401] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3616.865105] libceph: mon2 (2)172.21.15.164:3301 session established [ 3621.728186] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3621.736296] libceph: mon2 (2)172.21.15.164:3301 session established [ 3621.750951] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3621.758613] libceph: mon2 (2)172.21.15.164:3301 session established [ 3623.021860] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3623.029600] libceph: mon2 (2)172.21.15.164:3301 session established [ 3628.215466] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3628.223336] libceph: mon2 (2)172.21.15.164:3301 session established [ 3629.476825] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1502): osd3 weight 0x10000 (in) [ 3630.433980] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3630.442472] libceph: mon2 (2)172.21.15.164:3301 session established [ 3630.863041] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1503): osd4 weight 0x10000 (in) [ 3631.453986] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1504): osd7 weight 0x10000 (in) [ 3632.503329] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1505): osd2 weight 0x10000 (in) [ 3632.892145] libceph: osd4 (2)172.21.15.164:6820 socket error on write [ 3632.901920] libceph: mon2 (2)172.21.15.164:3301 session established [ 3633.051941] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3633.059533] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1506): osd0 weight 0x10000 (in) [ 3633.091618] libceph: mon2 (2)172.21.15.164:3301 session established [ 3633.097402] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3633.106228] libceph: mon2 (2)172.21.15.164:3301 session established [ 3634.291838] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1507): osd6 weight 0x10000 (in) [ 3635.098128] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3635.105714] libceph: mon2 (2)172.21.15.164:3301 session established [ 3635.310726] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3635.318546] libceph: mon2 (2)172.21.15.164:3301 session established [ 3636.632770] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1508): osd5 weight 0x10000 (in) [ 3636.641249] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1509): osd1 weight 0x10000 (in) [ 3637.308983] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3637.317066] libceph: mon2 (2)172.21.15.164:3301 session established [ 3637.351551] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 3637.359279] libceph: mon2 (2)172.21.15.164:3301 session established [ 3637.501503] libceph: osd1 (2)172.21.15.156:6816 socket error on write [ 3637.511599] libceph: mon2 (2)172.21.15.164:3301 session established [ 3637.759739] libceph: osd1 (2)172.21.15.156:6816 socket error on write [ 3637.766872] libceph: mon2 (2)172.21.15.164:3301 session established [ 3638.102200] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1510): osd1 down [ 3638.435938] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3638.443514] libceph: mon2 (2)172.21.15.164:3301 session established [ 3638.752219] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3638.769617] libceph: mon2 (2)172.21.15.164:3301 session established [ 3639.507515] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3639.515225] libceph: mon2 (2)172.21.15.164:3301 session established [ 3641.352391] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3641.360092] libceph: mon2 (2)172.21.15.164:3301 session established [ 3642.311806] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3642.319624] libceph: mon2 (2)172.21.15.164:3301 session established [ 3643.227529] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3643.235278] libceph: mon2 (2)172.21.15.164:3301 session established [ 3644.890134] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3644.897814] libceph: mon2 (2)172.21.15.164:3301 session established [ 3646.279980] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3646.287856] libceph: mon2 (2)172.21.15.164:3301 session established [ 3646.472413] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3646.481083] libceph: mon2 (2)172.21.15.164:3301 session established [ 3647.520032] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 3647.528622] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3647.536133] libceph: mon2 (2)172.21.15.164:3301 session established [ 3648.008535] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 3648.016217] libceph: mon2 (2)172.21.15.164:3301 session established [ 3652.040810] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3652.048420] libceph: mon2 (2)172.21.15.164:3301 session established [ 3652.535537] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3652.544919] libceph: mon2 (2)172.21.15.164:3301 session established [ 3653.440903] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3653.449065] libceph: mon2 (2)172.21.15.164:3301 session established [ 3658.254891] libceph: osd5 (2)172.21.15.164:6816 socket error on write [ 3658.269941] libceph: mon2 (2)172.21.15.164:3301 session established [ 3661.055287] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3661.063074] libceph: mon2 (2)172.21.15.164:3301 session established [ 3661.849667] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3661.857285] libceph: mon2 (2)172.21.15.164:3301 session established [ 3662.474158] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3662.481964] libceph: mon2 (2)172.21.15.164:3301 session established [ 3662.816236] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3662.824271] libceph: mon2 (2)172.21.15.164:3301 session established [ 3663.719064] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3663.727933] libceph: mon2 (2)172.21.15.164:3301 session established [ 3664.551474] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3664.559715] libceph: mon2 (2)172.21.15.164:3301 session established [ 3666.300077] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3666.319022] libceph: mon2 (2)172.21.15.164:3301 session established [ 3667.518501] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1520): osd4 weight 0x0 (out) [ 3669.579208] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3669.587455] libceph: mon2 (2)172.21.15.164:3301 session established [ 3673.635576] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3673.645356] libceph: mon2 (2)172.21.15.164:3301 session established [ 3674.962269] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3674.970119] libceph: mon2 (2)172.21.15.164:3301 session established [ 3677.536129] libceph: osd0 (2)172.21.15.156:6800 socket closed (con state OPEN) [ 3677.543630] libceph: osd0 (2)172.21.15.156:6800 socket error on write [ 3677.543871] libceph: mon2 (2)172.21.15.164:3301 session established [ 3677.556923] libceph: mon2 (2)172.21.15.164:3301 session established [ 3677.809506] libceph: osd0 (2)172.21.15.156:6800 socket error on write [ 3677.816407] libceph: mon2 (2)172.21.15.164:3301 session established [ 3678.042275] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1533): osd0 down [ 3678.773552] libceph: osd6 (2)172.21.15.164:6808 socket closed (con state OPEN) [ 3678.783427] libceph: mon2 (2)172.21.15.164:3301 session established [ 3678.804327] libceph: osd6 (2)172.21.15.164:6808 socket closed (con state OPEN) [ 3678.812947] libceph: mon2 (2)172.21.15.164:3301 session established [ 3679.164236] libceph: osd6 (2)172.21.15.164:6808 socket closed (con state OPEN) [ 3679.172001] libceph: mon2 (2)172.21.15.164:3301 session established [ 3679.178791] libceph: osd6 (2)172.21.15.164:6808 socket closed (con state OPEN) [ 3679.186503] libceph: mon2 (2)172.21.15.164:3301 session established [ 3679.512354] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3679.519996] libceph: mon2 (2)172.21.15.164:3301 session established [ 3680.048879] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3680.058549] libceph: mon2 (2)172.21.15.164:3301 session established [ 3680.148535] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 3680.160027] libceph: mon2 (2)172.21.15.164:3301 session established [ 3680.170092] libceph: osd3 (2)172.21.15.156:6808 socket error on write [ 3680.179457] libceph: mon2 (2)172.21.15.164:3301 session established [ 3681.649726] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3681.657637] libceph: mon2 (2)172.21.15.164:3301 session established [ 3690.506837] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3690.514513] libceph: mon2 (2)172.21.15.164:3301 session established [ 3709.450645] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1546): osd6 primary-affinity 0x9b89 [ 3714.275771] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 3714.283729] libceph: mon2 (2)172.21.15.164:3301 session established [ 3719.309705] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1552): osd4 weight 0x10000 (in) [ 3736.394341] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1563): osd0 up [ 3736.421792] libceph: osd4 (2)172.21.15.164:6820 socket error on write [ 3736.429407] libceph: mon2 (2)172.21.15.164:3301 session established [ 3737.514908] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3737.524172] libceph: mon2 (2)172.21.15.164:3301 session established [ 3737.779363] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state V2_AUTH) [ 3737.787697] libceph: mon2 (2)172.21.15.164:3301 session established [ 3739.234127] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3739.242064] libceph: mon2 (2)172.21.15.164:3301 session established [ 3739.265600] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3739.273255] libceph: mon2 (2)172.21.15.164:3301 session established [ 3739.497596] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state V2_AUTH) [ 3739.505511] libceph: mon2 (2)172.21.15.164:3301 session established [ 3741.277648] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3741.285347] libceph: mon2 (2)172.21.15.164:3301 session established [ 3743.207628] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3743.215385] libceph: mon2 (2)172.21.15.164:3301 session established [ 3743.228832] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3743.236461] libceph: mon2 (2)172.21.15.164:3301 session established [ 3746.990770] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3746.998704] libceph: mon2 (2)172.21.15.164:3301 session established [ 3748.787124] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3748.796587] libceph: mon2 (2)172.21.15.164:3301 session established [ 3748.846997] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3748.854793] libceph: mon2 (2)172.21.15.164:3301 session established [ 3750.050434] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3750.058131] libceph: mon2 (2)172.21.15.164:3301 session established [ 3751.299094] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3751.307230] libceph: mon2 (2)172.21.15.164:3301 session established [ 3751.577260] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3751.585491] libceph: mon2 (2)172.21.15.164:3301 session established [ 3752.531723] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1569): osd2 weight 0x0 (out) [ 3752.984223] libceph: osd6 (2)172.21.15.164:6808 socket closed (con state OPEN) [ 3752.995515] libceph: mon2 (2)172.21.15.164:3301 session established [ 3753.069231] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3753.080973] libceph: mon2 (2)172.21.15.164:3301 session established [ 3754.423246] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3754.431059] libceph: mon2 (2)172.21.15.164:3301 session established [ 3763.239945] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 3763.247900] libceph: mon2 (2)172.21.15.164:3301 session established [ 3763.256258] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 3763.265103] libceph: mon2 (2)172.21.15.164:3301 session established [ 3763.288236] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 3763.296301] libceph: mon2 (2)172.21.15.164:3301 session established [ 3768.330779] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3768.338465] libceph: mon2 (2)172.21.15.164:3301 session established [ 3771.112847] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 3771.120602] libceph: mon2 (2)172.21.15.164:3301 session established [ 3776.105659] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1587): osd2 weight 0x10000 (in) [ 3778.420907] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3778.428704] libceph: mon2 (2)172.21.15.164:3301 session established [ 3779.101290] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3779.114814] libceph: mon2 (2)172.21.15.164:3301 session established [ 3780.574626] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3780.582685] libceph: mon2 (2)172.21.15.164:3301 session established [ 3783.642034] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3783.649769] libceph: mon2 (2)172.21.15.164:3301 session established [ 3783.696022] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 3783.713043] libceph: mon2 (2)172.21.15.164:3301 session established [ 3783.723600] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state V2_SESSION_CONNECT) [ 3783.739879] libceph: mon2 (2)172.21.15.164:3301 session established [ 3786.364620] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3786.372605] libceph: mon2 (2)172.21.15.164:3301 session established [ 3787.548279] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3787.556292] libceph: mon2 (2)172.21.15.164:3301 session established [ 3790.207813] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1598): osd3 weight 0x0 (out) [ 3791.636110] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3791.646811] libceph: mon2 (2)172.21.15.164:3301 session established [ 3791.717619] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3791.726667] libceph: mon2 (2)172.21.15.164:3301 session established [ 3795.487682] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1604): osd7 weight 0x0 (out) [ 3796.672369] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3796.680769] libceph: mon2 (2)172.21.15.164:3301 session established [ 3799.907463] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3799.915095] libceph: mon2 (2)172.21.15.164:3301 session established [ 3800.605664] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3800.613288] libceph: mon2 (2)172.21.15.164:3301 session established [ 3800.900322] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3800.908090] libceph: mon2 (2)172.21.15.164:3301 session established [ 3804.834241] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3804.848046] libceph: mon2 (2)172.21.15.164:3301 session established [ 3806.672396] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3806.681043] libceph: mon2 (2)172.21.15.164:3301 session established [ 3807.045183] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3807.053073] libceph: mon2 (2)172.21.15.164:3301 session established [ 3825.169944] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1622): osd1 up [ 3825.199845] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 3825.230328] libceph: mon2 (2)172.21.15.164:3301 session established [ 3842.160165] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1636): osd7 weight 0x10000 (in) [ 3843.047797] libceph: osd7 (2)172.21.15.164:6800 socket error on write [ 3843.072783] libceph: mon2 (2)172.21.15.164:3301 session established [ 3844.559672] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3844.568238] libceph: mon2 (2)172.21.15.164:3301 session established [ 3871.302207] libceph: osd4 (2)172.21.15.164:6820 socket error on write [ 3871.308770] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1659): osd3 weight 0x10000 (in) [ 3871.313467] libceph: mon2 (2)172.21.15.164:3301 session established [ 3876.169518] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3876.177205] libceph: mon2 (2)172.21.15.164:3301 session established [ 3878.500442] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3878.508094] libceph: mon2 (2)172.21.15.164:3301 session established [ 3881.744014] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3881.751813] libceph: mon2 (2)172.21.15.164:3301 session established [ 3882.183483] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3882.191243] libceph: mon2 (2)172.21.15.164:3301 session established [ 3887.487717] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1673): osd5 primary-affinity 0x5751 [ 3887.534679] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3887.542359] libceph: mon2 (2)172.21.15.164:3301 session established [ 3887.581966] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3887.589578] libceph: mon2 (2)172.21.15.164:3301 session established [ 3889.676675] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3889.704944] libceph: mon2 (2)172.21.15.164:3301 session established [ 3890.329131] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3890.336806] libceph: mon2 (2)172.21.15.164:3301 session established [ 3890.956873] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3890.965680] libceph: mon2 (2)172.21.15.164:3301 session established [ 3892.637225] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1677): osd7 weight 0x0 (out) [ 3898.361962] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1683): osd0 weight 0x10000 (in) [ 3898.746737] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1684): osd6 weight 0x10000 (in) [ 3899.610561] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1685): osd5 weight 0x10000 (in) [ 3900.631385] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1686): osd1 weight 0x10000 (in) [ 3901.363888] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3901.380429] libceph: mon2 (2)172.21.15.164:3301 session established [ 3902.528426] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3902.536146] libceph: mon2 (2)172.21.15.164:3301 session established [ 3904.012790] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1687): osd4 weight 0x10000 (in) [ 3904.021114] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1688): osd2 weight 0x10000 (in) [ 3906.165963] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1689): osd3 weight 0x10000 (in) [ 3906.218257] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3906.225980] libceph: mon2 (2)172.21.15.164:3301 session established [ 3909.979931] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3909.987647] libceph: mon2 (2)172.21.15.164:3301 session established [ 3910.472709] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3910.480685] libceph: mon2 (2)172.21.15.164:3301 session established [ 3916.820749] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 3916.828828] libceph: mon2 (2)172.21.15.164:3301 session established [ 3916.955199] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 3916.966726] libceph: mon2 (2)172.21.15.164:3301 session established [ 3918.529622] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3918.537673] libceph: mon2 (2)172.21.15.164:3301 session established [ 3919.289496] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3919.299100] libceph: mon2 (2)172.21.15.164:3301 session established [ 3919.881868] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3919.889558] libceph: mon2 (2)172.21.15.164:3301 session established [ 3920.848333] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 3920.856041] libceph: mon2 (2)172.21.15.164:3301 session established [ 3929.855840] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3929.864267] libceph: mon2 (2)172.21.15.164:3301 session established [ 3937.830398] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 3937.842426] libceph: mon2 (2)172.21.15.164:3301 session established [ 3938.043982] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 3938.057211] libceph: mon2 (2)172.21.15.164:3301 session established [ 3938.068406] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 3938.078331] libceph: mon2 (2)172.21.15.164:3301 session established [ 4126.755516] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4126.767697] libceph: mon2 (2)172.21.15.164:3301 session established [ 4127.420839] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4127.432398] libceph: mon2 (2)172.21.15.164:3301 session established [ 4128.945112] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4128.953097] libceph: mon2 (2)172.21.15.164:3301 session established [ 4131.344184] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4131.352734] libceph: mon2 (2)172.21.15.164:3301 session established [ 4134.556530] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4134.564803] libceph: mon2 (2)172.21.15.164:3301 session established [ 4135.766418] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4135.774821] libceph: mon2 (2)172.21.15.164:3301 session established [ 4136.078047] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4136.087515] libceph: mon2 (2)172.21.15.164:3301 session established [ 4139.344688] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4139.357876] libceph: mon2 (2)172.21.15.164:3301 session established [ 4141.683447] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4141.691177] libceph: mon2 (2)172.21.15.164:3301 session established [ 4142.315076] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4142.323366] libceph: mon2 (2)172.21.15.164:3301 session established [ 4144.076444] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4144.085489] libceph: mon2 (2)172.21.15.164:3301 session established [ 4144.466602] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4144.474493] libceph: mon2 (2)172.21.15.164:3301 session established [ 4145.487910] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4145.495610] libceph: mon2 (2)172.21.15.164:3301 session established [ 4148.388725] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4148.396499] libceph: mon2 (2)172.21.15.164:3301 session established [ 4148.480161] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4148.487791] libceph: mon2 (2)172.21.15.164:3301 session established [ 4149.928737] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4149.936624] libceph: mon2 (2)172.21.15.164:3301 session established [ 4154.628823] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4154.638201] libceph: mon2 (2)172.21.15.164:3301 session established [ 4157.945762] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4157.953466] libceph: mon2 (2)172.21.15.164:3301 session established [ 4158.211038] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4158.218752] libceph: mon2 (2)172.21.15.164:3301 session established [ 4158.639967] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4158.647713] libceph: mon2 (2)172.21.15.164:3301 session established [ 4159.010695] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4159.018373] libceph: mon2 (2)172.21.15.164:3301 session established [ 4162.071601] libceph: osd4 (2)172.21.15.164:6820 socket error on write [ 4162.084805] libceph: mon2 (2)172.21.15.164:3301 session established [ 4162.112177] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 4162.128219] libceph: mon2 (2)172.21.15.164:3301 session established [ 4170.545395] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4170.553333] libceph: mon2 (2)172.21.15.164:3301 session established [ 4173.121223] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4173.129713] libceph: mon2 (2)172.21.15.164:3301 session established [ 4173.190821] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4173.199850] libceph: mon2 (2)172.21.15.164:3301 session established [ 4175.364143] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4175.365983] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4175.381408] libceph: mon2 (2)172.21.15.164:3301 session established [ 4175.388794] libceph: mon2 (2)172.21.15.164:3301 session established [ 4175.644172] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state V2_SESSION_RECONNECT) [ 4175.653270] libceph: mon2 (2)172.21.15.164:3301 session established [ 4176.222291] libceph: mds1 (2)172.21.15.156:6833 socket error on write [ 4176.229150] libceph: mon2 (2)172.21.15.164:3301 session established [ 4182.509512] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4182.517141] libceph: mon2 (2)172.21.15.164:3301 session established [ 4182.965108] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4182.972898] libceph: mon2 (2)172.21.15.164:3301 session established [ 4187.021186] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4187.029026] libceph: mon2 (2)172.21.15.164:3301 session established [ 4187.561520] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4187.569370] libceph: mon2 (2)172.21.15.164:3301 session established [ 4187.726298] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4187.734102] libceph: mon2 (2)172.21.15.164:3301 session established [ 4192.048075] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4192.055800] libceph: mon2 (2)172.21.15.164:3301 session established [ 4193.324139] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 4193.341665] libceph: mon2 (2)172.21.15.164:3301 session established [ 4193.576296] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4193.586175] libceph: mon2 (2)172.21.15.164:3301 session established [ 4195.336653] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4195.344348] libceph: mon2 (2)172.21.15.164:3301 session established [ 4195.670908] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4195.678633] libceph: mon2 (2)172.21.15.164:3301 session established [ 4197.854736] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4197.866277] libceph: mon2 (2)172.21.15.164:3301 session established [ 4200.124192] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4200.139750] libceph: mon2 (2)172.21.15.164:3301 session established [ 4201.248490] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4201.256209] libceph: mon2 (2)172.21.15.164:3301 session established [ 4201.552181] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4201.561013] libceph: mon2 (2)172.21.15.164:3301 session established [ 4207.081845] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4207.089425] libceph: mon2 (2)172.21.15.164:3301 session established [ 4209.310461] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4209.321078] libceph: mon2 (2)172.21.15.164:3301 session established [ 4209.671290] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4209.679104] libceph: mon2 (2)172.21.15.164:3301 session established [ 4209.950957] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4209.958737] libceph: mon2 (2)172.21.15.164:3301 session established [ 4210.790205] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4210.798146] libceph: mon2 (2)172.21.15.164:3301 session established [ 4211.210136] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4211.217837] libceph: mon2 (2)172.21.15.164:3301 session established [ 4211.563651] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4211.571331] libceph: mon2 (2)172.21.15.164:3301 session established [ 4211.839448] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4211.847191] libceph: mon2 (2)172.21.15.164:3301 session established [ 4211.855190] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4211.863251] libceph: mon2 (2)172.21.15.164:3301 session established [ 4212.107609] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4212.115518] libceph: mon2 (2)172.21.15.164:3301 session established [ 4213.500180] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4213.513997] libceph: mon2 (2)172.21.15.164:3301 session established [ 4213.954817] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4213.962539] libceph: mon2 (2)172.21.15.164:3301 session established [ 4214.474518] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4214.483226] libceph: mon2 (2)172.21.15.164:3301 session established [ 4214.823988] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4214.831965] libceph: mon2 (2)172.21.15.164:3301 session established [ 4214.860149] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4214.867872] libceph: mon2 (2)172.21.15.164:3301 session established [ 4215.121307] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4215.129951] libceph: mon2 (2)172.21.15.164:3301 session established [ 4215.483967] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4215.491660] libceph: mon2 (2)172.21.15.164:3301 session established [ 4220.537045] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4220.547567] libceph: mon2 (2)172.21.15.164:3301 session established [ 4220.605557] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4220.613626] libceph: mon2 (2)172.21.15.164:3301 session established [ 4220.633254] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4220.641188] libceph: mon2 (2)172.21.15.164:3301 session established [ 4220.771234] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4220.778943] libceph: mon2 (2)172.21.15.164:3301 session established [ 4221.803105] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4221.812069] libceph: mon2 (2)172.21.15.164:3301 session established [ 4224.877319] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4224.884957] libceph: mon2 (2)172.21.15.164:3301 session established [ 4225.941455] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4225.949225] libceph: mon2 (2)172.21.15.164:3301 session established [ 4227.200571] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4227.208375] libceph: mon2 (2)172.21.15.164:3301 session established [ 4227.600507] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4227.608172] libceph: mon2 (2)172.21.15.164:3301 session established [ 4229.139452] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4229.147204] libceph: mon2 (2)172.21.15.164:3301 session established [ 4229.180416] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4229.188294] libceph: mon2 (2)172.21.15.164:3301 session established [ 4229.451819] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4229.459585] libceph: mon2 (2)172.21.15.164:3301 session established [ 4230.150273] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4230.160187] libceph: mon2 (2)172.21.15.164:3301 session established [ 4230.508170] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4230.516088] libceph: mon2 (2)172.21.15.164:3301 session established [ 4230.778332] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4230.786001] libceph: mon2 (2)172.21.15.164:3301 session established [ 4232.177391] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4232.186206] libceph: mon2 (2)172.21.15.164:3301 session established [ 4233.590429] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4233.598014] libceph: mon2 (2)172.21.15.164:3301 session established [ 4234.628052] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4234.635908] libceph: mon2 (2)172.21.15.164:3301 session established [ 4236.843610] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4236.851278] libceph: mon2 (2)172.21.15.164:3301 session established [ 4237.614351] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4237.621973] libceph: mon2 (2)172.21.15.164:3301 session established [ 4238.010442] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4238.018223] libceph: mon2 (2)172.21.15.164:3301 session established [ 4238.028803] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4238.037303] libceph: mon2 (2)172.21.15.164:3301 session established [ 4238.656171] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4238.666217] libceph: mon2 (2)172.21.15.164:3301 session established [ 4240.329534] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4240.338321] libceph: mon2 (2)172.21.15.164:3301 session established [ 4240.363716] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4240.371591] libceph: mon2 (2)172.21.15.164:3301 session established [ 4240.393040] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4240.400695] libceph: mon2 (2)172.21.15.164:3301 session established [ 4241.461942] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4241.470350] libceph: mon2 (2)172.21.15.164:3301 session established [ 4242.215312] libceph: osd6 (2)172.21.15.164:6808 socket closed (con state OPEN) [ 4242.225372] libceph: mon2 (2)172.21.15.164:3301 session established [ 4243.241271] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4243.249439] libceph: mon2 (2)172.21.15.164:3301 session established [ 4244.478910] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4244.486867] libceph: mon2 (2)172.21.15.164:3301 session established [ 4244.557437] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4244.565107] libceph: mon2 (2)172.21.15.164:3301 session established [ 4247.610075] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4247.617802] libceph: mon2 (2)172.21.15.164:3301 session established [ 4249.307436] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4249.322495] libceph: mon2 (2)172.21.15.164:3301 session established [ 4249.353669] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4249.361601] libceph: mon2 (2)172.21.15.164:3301 session established [ 4249.423272] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4249.431107] libceph: mon2 (2)172.21.15.164:3301 session established [ 4250.774959] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4250.782872] libceph: mon2 (2)172.21.15.164:3301 session established [ 4252.846753] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4252.854547] libceph: mon2 (2)172.21.15.164:3301 session established [ 4254.682195] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4254.689890] libceph: mon2 (2)172.21.15.164:3301 session established [ 4255.029660] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 4255.037540] libceph: mon2 (2)172.21.15.164:3301 session established [ 4255.154185] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4255.161969] libceph: mon2 (2)172.21.15.164:3301 session established [ 4258.168560] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4258.176211] libceph: mon2 (2)172.21.15.164:3301 session established [ 4259.554351] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4259.569630] libceph: mon2 (2)172.21.15.164:3301 session established [ 4264.466172] libceph: mds2 (2)172.21.15.164:6837 socket error on write [ 4264.475951] libceph: mon2 (2)172.21.15.164:3301 session established [ 4264.775239] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4264.783730] libceph: mon2 (2)172.21.15.164:3301 session established [ 4265.203887] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4265.211727] libceph: mon2 (2)172.21.15.164:3301 session established [ 4265.489248] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4265.496995] libceph: mon2 (2)172.21.15.164:3301 session established [ 4265.845607] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4265.853278] libceph: mon2 (2)172.21.15.164:3301 session established [ 4267.181528] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4267.189242] libceph: mon2 (2)172.21.15.164:3301 session established [ 4268.310895] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4268.318738] libceph: mon2 (2)172.21.15.164:3301 session established [ 4268.663508] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4268.671235] libceph: mon2 (2)172.21.15.164:3301 session established [ 4268.953470] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4268.961201] libceph: mon2 (2)172.21.15.164:3301 session established [ 4269.118945] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4269.122696] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4269.126598] libceph: mon2 (2)172.21.15.164:3301 session established [ 4269.140050] libceph: mon2 (2)172.21.15.164:3301 session established [ 4269.386345] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4269.394245] libceph: mon2 (2)172.21.15.164:3301 session established [ 4269.405407] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4269.413949] libceph: mon2 (2)172.21.15.164:3301 session established [ 4270.782808] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4270.790689] libceph: mon2 (2)172.21.15.164:3301 session established [ 4271.345314] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4271.353005] libceph: mon2 (2)172.21.15.164:3301 session established [ 4272.948795] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4272.958800] libceph: mon2 (2)172.21.15.164:3301 session established [ 4273.250008] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4273.257628] libceph: mon2 (2)172.21.15.164:3301 session established [ 4274.278058] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4274.285762] libceph: mon2 (2)172.21.15.164:3301 session established [ 4276.217517] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4276.226184] libceph: mon2 (2)172.21.15.164:3301 session established [ 4276.496071] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4276.503859] libceph: mon2 (2)172.21.15.164:3301 session established [ 4277.330861] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4277.340865] libceph: mon2 (2)172.21.15.164:3301 session established [ 4278.842030] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4278.849780] libceph: mon2 (2)172.21.15.164:3301 session established [ 4279.174933] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4279.182565] libceph: mon2 (2)172.21.15.164:3301 session established [ 4279.520364] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4279.532903] libceph: mon2 (2)172.21.15.164:3301 session established [ 4281.610678] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4281.618532] libceph: mon2 (2)172.21.15.164:3301 session established [ 4281.994636] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4282.002306] libceph: mon2 (2)172.21.15.164:3301 session established [ 4283.678926] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4283.686706] libceph: mon2 (2)172.21.15.164:3301 session established [ 4283.785974] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4283.793641] libceph: mon2 (2)172.21.15.164:3301 session established [ 4284.054495] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4284.062283] libceph: mon2 (2)172.21.15.164:3301 session established [ 4286.481287] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4286.490098] libceph: mon2 (2)172.21.15.164:3301 session established [ 4286.523506] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4286.534981] libceph: mon2 (2)172.21.15.164:3301 session established [ 4288.623110] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4288.631022] libceph: mon2 (2)172.21.15.164:3301 session established [ 4288.891822] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4288.899575] libceph: mon2 (2)172.21.15.164:3301 session established [ 4293.998701] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4294.006416] libceph: mon2 (2)172.21.15.164:3301 session established [ 4294.035246] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4294.043221] libceph: mon2 (2)172.21.15.164:3301 session established [ 4294.085144] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4294.092948] libceph: mon2 (2)172.21.15.164:3301 session established [ 4294.904701] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4294.913136] libceph: mon2 (2)172.21.15.164:3301 session established [ 4295.184277] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4295.192091] libceph: mon2 (2)172.21.15.164:3301 session established [ 4295.407772] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4295.416117] libceph: mon2 (2)172.21.15.164:3301 session established [ 4295.692785] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4295.700527] libceph: mon2 (2)172.21.15.164:3301 session established [ 4296.696205] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4296.703899] libceph: mon2 (2)172.21.15.164:3301 session established [ 4296.962708] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4296.970358] libceph: mon2 (2)172.21.15.164:3301 session established [ 4297.333392] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 4297.341074] libceph: mon2 (2)172.21.15.164:3301 session established [ 4298.038501] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4298.046653] libceph: mon2 (2)172.21.15.164:3301 session established [ 4298.409900] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4298.417709] libceph: mon2 (2)172.21.15.164:3301 session established [ 4298.534029] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4298.541902] libceph: mon2 (2)172.21.15.164:3301 session established [ 4300.624563] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4300.632402] libceph: mon2 (2)172.21.15.164:3301 session established [ 4301.852841] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4301.860710] libceph: mon2 (2)172.21.15.164:3301 session established [ 4301.989739] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4301.997769] libceph: mon2 (2)172.21.15.164:3301 session established [ 4302.657148] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4302.664870] libceph: mon2 (2)172.21.15.164:3301 session established [ 4302.927124] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4302.934890] libceph: mon2 (2)172.21.15.164:3301 session established [ 4304.852858] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4304.860583] libceph: mon2 (2)172.21.15.164:3301 session established [ 4305.466261] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4305.473923] libceph: mon2 (2)172.21.15.164:3301 session established [ 4307.738833] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1851): osd7 weight 0x10000 (in) [ 4318.738028] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1857): osd4 weight 0x0 (out) [ 4347.456810] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1881): osd0 weight 0x0 (out) [ 4364.819870] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1895): osd2 weight 0x0 (out) [ 4369.939646] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1900): osd2 weight 0x10000 (in) [ 4390.418939] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1913): osd3 primary-affinity 0x7c4b [ 4392.376720] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1917): osd0 weight 0x10000 (in) [ 4398.509494] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1921): osd4 weight 0x10000 (in) [ 4409.131777] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 4409.139655] libceph: mon2 (2)172.21.15.164:3301 session established [ 4409.300797] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1932): osd1 down [ 4436.499644] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1947): osd6 primary-affinity 0x10000 [ 4453.529467] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1961): osd1 up [ 4462.105577] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1965): osd6 weight 0x10000 (in) [ 4462.113858] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1966): osd5 weight 0x10000 (in) [ 4462.122140] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1967): osd1 weight 0x10000 (in) [ 4462.130434] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1968): osd3 weight 0x10000 (in) [ 4467.220602] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1969): osd7 weight 0x10000 (in) [ 4467.228895] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1970): osd2 weight 0x10000 (in) [ 4467.237182] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1971): osd0 weight 0x10000 (in) [ 4467.245543] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e1972): osd4 weight 0x10000 (in) [ 4479.508081] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4479.515854] libceph: mon2 (2)172.21.15.164:3301 session established [ 4589.589614] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4589.597348] libceph: mon2 (2)172.21.15.164:3301 session established [ 4622.980966] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4622.988711] libceph: mon2 (2)172.21.15.164:3301 session established [ 4623.035263] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4623.043125] libceph: mon2 (2)172.21.15.164:3301 session established [ 4623.332856] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4623.340927] libceph: mon2 (2)172.21.15.164:3301 session established [ 4623.716033] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 4623.723748] libceph: mon2 (2)172.21.15.164:3301 session established [ 4624.767369] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4624.775133] libceph: mon2 (2)172.21.15.164:3301 session established [ 4624.814739] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 4624.822413] libceph: mon2 (2)172.21.15.164:3301 session established [ 4626.164403] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 4626.172136] libceph: mon2 (2)172.21.15.164:3301 session established [ 4628.459709] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2035): osd4 weight 0x0 (out) [ 4635.584193] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2045): osd0 weight 0x0 (out) [ 4641.417675] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2051): osd0 weight 0x10000 (in) [ 4651.916307] libceph: osd3 (2)172.21.15.156:6808 socket closed (con state OPEN) [ 4651.924159] libceph: mon2 (2)172.21.15.164:3301 session established [ 4656.663384] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2059): osd3 down [ 4695.871630] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2081): osd0 weight 0x0 (out) [ 4702.747115] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2087): osd7 weight 0x0 (out) [ 4714.553088] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2097): osd3 up [ 4736.500908] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2111): osd5 weight 0x972f [ 4764.501971] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2129): osd1 primary-affinity 0x0 [ 4778.427635] perf: interrupt took too long (2503 > 2500), lowering kernel.perf_event_max_sample_rate to 79000 [ 4794.905305] INFO: task kcompactd0:61 blocked for more than 122 seconds. [ 4794.906524] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2145): osd5 weight 0x0 (out) [ 4794.912361] Tainted: G S 6.4.0-g84139c18d56f #1 [ 4794.912366] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4794.912368] task:kcompactd0 state:D stack:0 pid:61 ppid:2 flags:0x00004000 [ 4794.912374] Call Trace: [ 4794.912376] [ 4794.912398] __schedule+0x37d/0xe80 [ 4794.912412] ? __folio_lock+0x101/0x230 [ 4794.912419] schedule+0x54/0xc0 [ 4794.912422] io_schedule+0x16/0x40 [ 4794.912425] __folio_lock+0x101/0x230 [ 4794.912432] ? filemap_invalidate_unlock_two+0x40/0x40 [ 4794.912440] migrate_pages_batch+0x69e/0xd10 [ 4794.912447] ? isolate_freepages_block+0x460/0x460 [ 4794.912452] ? defer_compaction+0xb0/0xb0 [ 4794.912460] ? __lock_acquire+0xbe8/0x1f50 [ 4794.912470] migrate_pages_sync+0x188/0x230 [ 4794.912475] ? isolate_freepages_block+0x460/0x460 [ 4794.912478] ? defer_compaction+0xb0/0xb0 [ 4794.912489] migrate_pages+0xa9f/0xb50 [ 4794.912494] ? isolate_freepages_block+0x460/0x460 [ 4794.912497] ? defer_compaction+0xb0/0xb0 [ 4794.912501] ? isolate_migratepages_block+0x484/0x1460 [ 4794.912515] compact_zone+0x7c8/0xed0 [ 4794.912530] proactive_compact_node+0x83/0xd0 [ 4794.912545] kcompactd+0x13c/0x2f0 [ 4794.912549] ? sched_numa_warn+0xf0/0xf0 [ 4794.912557] ? kcompactd_do_work+0x370/0x370 [ 4794.912561] kthread+0xf6/0x130 [ 4794.912564] ? kthread_complete_and_exit+0x20/0x20 [ 4794.912570] ret_from_fork+0x1f/0x30 [ 4795.049494] [ 4795.051773] [ 4795.051773] Showing all locks held in the system: [ 4795.057971] 1 lock held by rcu_tasks_kthre/12: [ 4795.062425] #0: ffffffff8255e450 (rcu_tasks.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x30/0x420 [ 4795.072004] 1 lock held by rcu_tasks_rude_/13: [ 4795.076453] #0: ffffffff8255e1d0 (rcu_tasks_rude.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x30/0x420 [ 4795.086459] 1 lock held by khungtaskd/56: [ 4795.090466] #0: ffffffff8255eec0 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x12/0x1d0 [ 4795.099444] 1 lock held by systemd-journal/516: [ 4795.103991] 2 locks held by in:imjournal/1461: [ 4795.108449] #0: ffff88817e48d448 (sb_writers#12){.+.+}-{0:0}, at: do_renameat2+0x1aa/0x4f0 [ 4795.116817] #1: ffff88810aaab358 (&type->i_mutex_dir_key#6/1){+.+.}-{3:3}, at: lock_rename+0x4d/0x60 [ 4795.126096] 1 lock held by git/507270: [ 4795.129847] #0: ffff88817d788150 (&sb->s_type->i_mutex_key#21){++++}-{3:3}, at: ceph_start_io_read+0x1d/0x60 [ceph] [ 4795.140394] 1 lock held by gzip/518123: [ 4795.144233] #0: ffff8881120feee8 (&f->f_pos_lock){+.+.}-{3:3}, at: __fdget_pos+0x48/0x60 [ 4795.152414] [ 4795.153915] ============================================= [ 4795.153915] [ 4815.386161] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2158): osd7 down [ 4851.226808] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2174): osd7 up [ 4894.476751] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2196): osd1 weight 0x2f56 [ 4917.787225] INFO: task kcompactd0:61 blocked for more than 245 seconds. [ 4917.793845] Tainted: G S 6.4.0-g84139c18d56f #1 [ 4917.800297] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4917.808135] task:kcompactd0 state:D stack:0 pid:61 ppid:2 flags:0x00004000 [ 4917.816494] Call Trace: [ 4917.818961] [ 4917.821084] __schedule+0x37d/0xe80 [ 4917.824591] ? __folio_lock+0x101/0x230 [ 4917.828442] schedule+0x54/0xc0 [ 4917.831593] io_schedule+0x16/0x40 [ 4917.835013] __folio_lock+0x101/0x230 [ 4917.838690] ? filemap_invalidate_unlock_two+0x40/0x40 [ 4917.843862] migrate_pages_batch+0x69e/0xd10 [ 4917.848153] ? isolate_freepages_block+0x460/0x460 [ 4917.852948] ? defer_compaction+0xb0/0xb0 [ 4917.856968] ? __lock_acquire+0xbe8/0x1f50 [ 4917.861070] migrate_pages_sync+0x188/0x230 [ 4917.865266] ? isolate_freepages_block+0x460/0x460 [ 4917.870072] ? defer_compaction+0xb0/0xb0 [ 4917.874100] migrate_pages+0xa9f/0xb50 [ 4917.877865] ? isolate_freepages_block+0x460/0x460 [ 4917.882670] ? defer_compaction+0xb0/0xb0 [ 4917.886695] ? isolate_migratepages_block+0x484/0x1460 [ 4917.891854] compact_zone+0x7c8/0xed0 [ 4917.895541] proactive_compact_node+0x83/0xd0 [ 4917.899913] kcompactd+0x13c/0x2f0 [ 4917.903322] ? sched_numa_warn+0xf0/0xf0 [ 4917.907255] ? kcompactd_do_work+0x370/0x370 [ 4917.911530] kthread+0xf6/0x130 [ 4917.914683] ? kthread_complete_and_exit+0x20/0x20 [ 4917.919482] ret_from_fork+0x1f/0x30 [ 4917.923070] [ 4917.925336] [ 4917.925336] Showing all locks held in the system: [ 4917.931528] 1 lock held by rcu_tasks_kthre/12: [ 4917.936006] #0: ffffffff8255e450 (rcu_tasks.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x30/0x420 [ 4917.945585] 1 lock held by rcu_tasks_rude_/13: [ 4917.950040] #0: ffffffff8255e1d0 (rcu_tasks_rude.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x30/0x420 [ 4917.960052] 1 lock held by khungtaskd/56: [ 4917.964065] #0: ffffffff8255eec0 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x12/0x1d0 [ 4917.973070] 3 locks held by log/154160: [ 4917.976912] #0: ffff88885fdeec18 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0xf7/0xe80 [ 4917.984839] #1: ffffffff8255eec0 (rcu_read_lock){....}-{1:2}, at: __update_idle_core+0x9/0x220 [ 4917.993555] #2: ffff88859178ec28 (&sb->s_type->i_mutex_key#13){++++}-{3:3}, at: ext4_buffered_write_iter+0x35/0x120 [ 4918.004104] 3 locks held by bstore_kv_sync/155404: [ 4918.008901] #0: ffff88885fc6ec18 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0xf7/0xe80 [ 4918.016840] #1: ffffffff8255eec0 (rcu_read_lock){....}-{1:2}, at: __update_idle_core+0x9/0x220 [ 4918.025565] #2: ffffffff8255eec0 (rcu_read_lock){....}-{1:2}, at: __update_idle_core+0x9/0x220 [ 4918.034439] 3 locks held by log/485318: [ 4918.038284] #0: ffff88885fdaec18 (&rq->__lock){-.-.}-{2:2}, at: raw_spin_rq_lock_nested+0x15/0x20 [ 4918.047259] #1: ffff88885fdaec18 (&rq->__lock){-.-.}-{2:2}, at: raw_spin_rq_lock_nested+0x15/0x20 [ 4918.056224] #2: ffff88859178f5a0 (&sb->s_type->i_mutex_key#13){++++}-{3:3}, at: ext4_buffered_write_iter+0x35/0x120 [ 4918.066759] 1 lock held by git/507270: [ 4918.070512] #0: ffff88817d788150 (&sb->s_type->i_mutex_key#21){++++}-{3:3}, at: ceph_start_io_read+0x1d/0x60 [ceph] [ 4918.081071] 2 locks held by ceph/540868: [ 4918.084990] [ 4918.086493] ============================================= [ 4918.086493] [ 4931.610873] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 4931.618518] libceph: mon2 (2)172.21.15.164:3301 session established [ 4949.028795] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2231): osd5 weight 0x972f [ 4954.496088] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2237): osd3 weight 0x0 (out) [ 4969.500463] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2248): osd1 primary-affinity 0x8a55 [ 4973.669886] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2253): osd6 weight 0x10000 (in) [ 4973.678323] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2254): osd1 weight 0x10000 (in) [ 4974.640723] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2255): osd2 weight 0x10000 (in) [ 4975.754698] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2256): osd5 weight 0x10000 (in) [ 5040.669028] INFO: task kcompactd0:61 blocked for more than 368 seconds. [ 5040.675681] Tainted: G S 6.4.0-g84139c18d56f #1 [ 5040.682133] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5040.689977] task:kcompactd0 state:D stack:0 pid:61 ppid:2 flags:0x00004000 [ 5040.698338] Call Trace: [ 5040.700789] [ 5040.702902] __schedule+0x37d/0xe80 [ 5040.706412] ? __folio_lock+0x101/0x230 [ 5040.710251] schedule+0x54/0xc0 [ 5040.713400] io_schedule+0x16/0x40 [ 5040.716815] __folio_lock+0x101/0x230 [ 5040.720494] ? filemap_invalidate_unlock_two+0x40/0x40 [ 5040.725706] migrate_pages_batch+0x69e/0xd10 [ 5040.730029] ? isolate_freepages_block+0x460/0x460 [ 5040.734870] ? defer_compaction+0xb0/0xb0 [ 5040.738909] ? __lock_acquire+0xbe8/0x1f50 [ 5040.743030] migrate_pages_sync+0x188/0x230 [ 5040.747226] ? isolate_freepages_block+0x460/0x460 [ 5040.752033] ? defer_compaction+0xb0/0xb0 [ 5040.756061] migrate_pages+0xa9f/0xb50 [ 5040.759828] ? isolate_freepages_block+0x460/0x460 [ 5040.764642] ? defer_compaction+0xb0/0xb0 [ 5040.768717] ? isolate_migratepages_block+0x484/0x1460 [ 5040.773960] compact_zone+0x7c8/0xed0 [ 5040.777667] proactive_compact_node+0x83/0xd0 [ 5040.782129] kcompactd+0x13c/0x2f0 [ 5040.785550] ? sched_numa_warn+0xf0/0xf0 [ 5040.789488] ? kcompactd_do_work+0x370/0x370 [ 5040.793776] kthread+0xf6/0x130 [ 5040.796933] ? kthread_complete_and_exit+0x20/0x20 [ 5040.801736] ret_from_fork+0x1f/0x30 [ 5040.805321] [ 5040.807603] [ 5040.807603] Showing all locks held in the system: [ 5040.813942] 1 lock held by rcu_tasks_kthre/12: [ 5040.818391] #0: ffffffff8255e450 (rcu_tasks.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x30/0x420 [ 5040.827976] 1 lock held by rcu_tasks_rude_/13: [ 5040.832432] #0: ffffffff8255e1d0 (rcu_tasks_rude.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x30/0x420 [ 5040.842462] 1 lock held by khungtaskd/56: [ 5040.846484] #0: ffffffff8255eec0 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x12/0x1d0 [ 5040.855523] 1 lock held by git/507270: [ 5040.859276] #0: ffff88817d788150 (&sb->s_type->i_mutex_key#21){++++}-{3:3}, at: ceph_start_io_read+0x1d/0x60 [ceph] [ 5040.869872] 1 lock held by ceph/554476: [ 5040.873724] [ 5040.875227] ============================================= [ 5040.875227] [ 5092.381041] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 5092.388804] libceph: mon2 (2)172.21.15.164:3301 session established [ 5123.294407] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 5123.303320] libceph: mon2 (2)172.21.15.164:3301 session established [ 5163.549838] INFO: task kcompactd0:61 blocked for more than 491 seconds. [ 5163.556481] Tainted: G S 6.4.0-g84139c18d56f #1 [ 5163.562947] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5163.570804] task:kcompactd0 state:D stack:0 pid:61 ppid:2 flags:0x00004000 [ 5163.579171] Call Trace: [ 5163.581634] [ 5163.583757] __schedule+0x37d/0xe80 [ 5163.587267] ? __folio_lock+0x101/0x230 [ 5163.591120] schedule+0x54/0xc0 [ 5163.594289] io_schedule+0x16/0x40 [ 5163.597709] __folio_lock+0x101/0x230 [ 5163.601387] ? filemap_invalidate_unlock_two+0x40/0x40 [ 5163.606544] migrate_pages_batch+0x69e/0xd10 [ 5163.610828] ? isolate_freepages_block+0x460/0x460 [ 5163.615637] ? defer_compaction+0xb0/0xb0 [ 5163.619669] ? __lock_acquire+0xbe8/0x1f50 [ 5163.623791] migrate_pages_sync+0x188/0x230 [ 5163.627984] ? isolate_freepages_block+0x460/0x460 [ 5163.632791] ? defer_compaction+0xb0/0xb0 [ 5163.636829] migrate_pages+0xa9f/0xb50 [ 5163.640602] ? isolate_freepages_block+0x460/0x460 [ 5163.645411] ? defer_compaction+0xb0/0xb0 [ 5163.649443] ? isolate_migratepages_block+0x484/0x1460 [ 5163.654603] compact_zone+0x7c8/0xed0 [ 5163.658304] proactive_compact_node+0x83/0xd0 [ 5163.662706] kcompactd+0x13c/0x2f0 [ 5163.666129] ? sched_numa_warn+0xf0/0xf0 [ 5163.670076] ? kcompactd_do_work+0x370/0x370 [ 5163.674370] kthread+0xf6/0x130 [ 5163.677526] ? kthread_complete_and_exit+0x20/0x20 [ 5163.682340] ret_from_fork+0x1f/0x30 [ 5163.685953] [ 5163.690215] [ 5163.690215] Showing all locks held in the system: [ 5163.696439] 1 lock held by rcu_tasks_kthre/12: [ 5163.700906] #0: ffffffff8255e450 (rcu_tasks.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x30/0x420 [ 5163.710502] 1 lock held by rcu_tasks_rude_/13: [ 5163.714955] #0: ffffffff8255e1d0 (rcu_tasks_rude.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x30/0x420 [ 5163.724985] 1 lock held by khungtaskd/56: [ 5163.729037] #0: ffffffff8255eec0 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x12/0x1d0 [ 5163.738130] 1 lock held by git/507270: [ 5163.741899] #0: ffff88817d788150 (&sb->s_type->i_mutex_key#21){++++}-{3:3}, at: ceph_start_io_read+0x1d/0x60 [ceph] [ 5163.752466] [ 5163.753971] ============================================= [ 5163.753971] [ 5264.420458] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5264.428089] libceph: mon2 (2)172.21.15.164:3301 session established [ 5264.705071] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5264.712833] libceph: mon2 (2)172.21.15.164:3301 session established [ 5265.054473] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 5265.062533] libceph: mon2 (2)172.21.15.164:3301 session established [ 5265.684614] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 5265.692343] libceph: mon2 (2)172.21.15.164:3301 session established [ 5265.716641] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5265.724426] libceph: mon2 (2)172.21.15.164:3301 session established [ 5266.034259] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 5266.042098] libceph: mon2 (2)172.21.15.164:3301 session established [ 5266.398386] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5266.406172] libceph: mon2 (2)172.21.15.164:3301 session established [ 5362.721007] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 5362.728764] libceph: mon2 (2)172.21.15.164:3301 session established [ 5699.152167] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 5699.160130] libceph: mon2 (2)172.21.15.164:3301 session established [ 5699.377579] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 5699.385321] libceph: mon2 (2)172.21.15.164:3301 session established [ 5699.484696] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5699.493531] libceph: mon2 (2)172.21.15.164:3301 session established [ 5699.816257] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 5699.824108] libceph: mon2 (2)172.21.15.164:3301 session established [ 5700.260274] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5700.268165] libceph: mon2 (2)172.21.15.164:3301 session established [ 5700.326292] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 5700.334033] libceph: mon2 (2)172.21.15.164:3301 session established [ 5701.366973] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 5701.374591] libceph: mon2 (2)172.21.15.164:3301 session established [ 5709.252780] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 5709.260517] libceph: mon2 (2)172.21.15.164:3301 session established [ 5709.645788] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 5709.653494] libceph: mon2 (2)172.21.15.164:3301 session established [ 5709.949466] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 5709.957885] libceph: mon2 (2)172.21.15.164:3301 session established [ 5711.172894] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5711.180554] libceph: mon2 (2)172.21.15.164:3301 session established [ 5712.168506] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 5712.176904] libceph: mon2 (2)172.21.15.164:3301 session established [ 5712.546828] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 5712.554504] libceph: mon2 (2)172.21.15.164:3301 session established [ 5713.882358] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5713.890065] libceph: mon2 (2)172.21.15.164:3301 session established [ 5715.115900] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 5715.123619] libceph: mon2 (2)172.21.15.164:3301 session established [ 5718.608383] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 5718.619247] libceph: mon2 (2)172.21.15.164:3301 session established [ 5718.913212] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5718.920885] libceph: mon2 (2)172.21.15.164:3301 session established [ 5720.989218] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 5720.996920] libceph: mon2 (2)172.21.15.164:3301 session established [ 5735.647633] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5735.655271] libceph: mon2 (2)172.21.15.164:3301 session established [ 5737.323289] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 5737.331257] libceph: mon2 (2)172.21.15.164:3301 session established [ 5737.513426] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 5737.521000] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state V2_BANNER_PREFIX) [ 5737.521173] libceph: mon2 (2)172.21.15.164:3301 session established [ 5737.535905] libceph: mon2 (2)172.21.15.164:3301 session established [ 5739.600588] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5739.608503] libceph: mon2 (2)172.21.15.164:3301 session established [ 5742.827575] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2563): osd7 weight 0x10000 (in) [ 5757.992812] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2572): osd5 weight 0x0 (out) [ 5778.471206] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2586): osd2 primary-affinity 0xb662 [ 5782.885821] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5782.893925] libceph: mon2 (2)172.21.15.164:3301 session established [ 5783.948535] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 5783.956445] libceph: mon2 (2)172.21.15.164:3301 session established [ 5784.358450] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 5784.366262] libceph: mon2 (2)172.21.15.164:3301 session established [ 5784.799488] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5784.807181] libceph: mon2 (2)172.21.15.164:3301 session established [ 5785.069223] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5785.077134] libceph: mon2 (2)172.21.15.164:3301 session established [ 5785.329296] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 5785.336978] libceph: mon2 (2)172.21.15.164:3301 session established [ 5786.014466] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 5786.022360] libceph: mon2 (2)172.21.15.164:3301 session established [ 5786.304910] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 5786.312579] libceph: mon2 (2)172.21.15.164:3301 session established [ 5786.570787] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2590): osd7 primary-affinity 0x10000 [ 5793.832338] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2593): osd7 primary-affinity 0x10000 [ 5802.095022] libceph: osd5 (2)172.21.15.164:6816 socket closed (con state OPEN) [ 5802.103226] libceph: mon2 (2)172.21.15.164:3301 session established [ 5804.085485] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2600): osd5 down [ 5829.677134] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2614): osd1 primary-affinity 0x4463 [ 5834.793109] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2618): osd6 weight 0x388d [ 5850.152496] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2626): osd5 up [ 5851.306193] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 5851.322961] libceph: mon2 (2)172.21.15.164:3301 session established [ 5859.368249] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 5859.375909] libceph: mon2 (2)172.21.15.164:3301 session established [ 5870.632663] libceph: osd2 (2)172.21.15.156:6818 socket closed (con state OPEN) [ 5870.632748] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2636): osd5 down [ 5870.647253] libceph: mon2 (2)172.21.15.164:3301 session established [ 5901.354345] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2652): osd2 weight 0x97e2 [ 5921.833358] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2664): osd1 primary-affinity 0xce40 [ 5926.139586] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2668): osd4 weight 0x10000 (in) [ 5951.991613] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2683): osd5 up [ 5951.998585] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2686): osd6 weight 0x10000 (in) [ 5952.905001] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2687): osd1 weight 0x10000 (in) [ 5962.805569] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2688): osd2 weight 0x10000 (in) [ 5962.813865] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2689): osd7 weight 0x10000 (in) [ 5962.822166] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2690): osd4 weight 0x10000 (in) [ 6342.025737] libceph: osd4 (2)172.21.15.164:6820 socket closed (con state OPEN) [ 6342.034264] libceph: mon2 (2)172.21.15.164:3301 session established [ 6429.906617] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 6429.914818] libceph: mon2 (2)172.21.15.164:3301 session established [ 6430.236020] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 6430.244955] libceph: mon2 (2)172.21.15.164:3301 session established [ 6430.514966] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 6430.523338] libceph: mon2 (2)172.21.15.164:3301 session established [ 6431.133842] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 6431.141557] libceph: mon2 (2)172.21.15.164:3301 session established [ 6431.443619] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6431.451284] libceph: mon2 (2)172.21.15.164:3301 session established [ 6431.832892] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 6431.840642] libceph: mon2 (2)172.21.15.164:3301 session established [ 6433.048639] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6433.056369] libceph: mon2 (2)172.21.15.164:3301 session established [ 6434.794320] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 6434.802085] libceph: mon2 (2)172.21.15.164:3301 session established [ 6434.825251] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 6434.833132] libceph: mon2 (2)172.21.15.164:3301 session established [ 6434.893056] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 6434.900929] libceph: mon2 (2)172.21.15.164:3301 session established [ 6434.935867] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6434.943622] libceph: mon2 (2)172.21.15.164:3301 session established [ 6435.563238] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 6435.571028] libceph: mon2 (2)172.21.15.164:3301 session established [ 6435.841728] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6435.849547] libceph: mon2 (2)172.21.15.164:3301 session established [ 6437.053958] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 6437.061642] libceph: mon2 (2)172.21.15.164:3301 session established [ 6438.486252] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 6438.494384] libceph: mon2 (2)172.21.15.164:3301 session established [ 6459.461688] perf: interrupt took too long (3129 > 3128), lowering kernel.perf_event_max_sample_rate to 63000 [ 6623.028868] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 6623.036574] libceph: mon2 (2)172.21.15.164:3301 session established [ 6623.123568] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 6623.131295] libceph: mon2 (2)172.21.15.164:3301 session established [ 6624.023460] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 6624.031340] libceph: mon2 (2)172.21.15.164:3301 session established [ 6624.337989] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 6624.345750] libceph: mon2 (2)172.21.15.164:3301 session established [ 6625.657183] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6625.664891] libceph: mon2 (2)172.21.15.164:3301 session established [ 6626.356000] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 6626.363722] libceph: mon2 (2)172.21.15.164:3301 session established [ 6626.738433] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6626.746379] libceph: mon2 (2)172.21.15.164:3301 session established [ 6627.042665] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 6627.050324] libceph: mon2 (2)172.21.15.164:3301 session established [ 6627.339630] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 6627.347506] libceph: mon2 (2)172.21.15.164:3301 session established [ 6628.687856] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6628.696001] libceph: mon2 (2)172.21.15.164:3301 session established [ 6628.998755] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6629.008730] libceph: mon2 (2)172.21.15.164:3301 session established [ 6630.191560] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 6630.199389] libceph: mon2 (2)172.21.15.164:3301 session established [ 6630.494142] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 6630.501936] libceph: mon2 (2)172.21.15.164:3301 session established [ 6630.796847] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6630.804479] libceph: mon2 (2)172.21.15.164:3301 session established [ 6631.188985] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6631.196652] libceph: mon2 (2)172.21.15.164:3301 session established [ 6633.914048] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6633.921883] libceph: mon2 (2)172.21.15.164:3301 session established [ 6634.179984] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6634.187707] libceph: mon2 (2)172.21.15.164:3301 session established [ 6634.585798] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 6634.593518] libceph: mon2 (2)172.21.15.164:3301 session established [ 6635.297144] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6635.304793] libceph: mon2 (2)172.21.15.164:3301 session established [ 6635.611158] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6635.618881] libceph: mon2 (2)172.21.15.164:3301 session established [ 6636.060899] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6636.068779] libceph: mon2 (2)172.21.15.164:3301 session established [ 6636.675302] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6636.683823] libceph: mon2 (2)172.21.15.164:3301 session established [ 6636.811530] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6636.819246] libceph: mon2 (2)172.21.15.164:3301 session established [ 6637.882028] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6637.889892] libceph: mon2 (2)172.21.15.164:3301 session established [ 6638.383259] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6638.391130] libceph: mon2 (2)172.21.15.164:3301 session established [ 6638.660771] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6638.668538] libceph: mon2 (2)172.21.15.164:3301 session established [ 6639.148851] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6639.156617] libceph: mon2 (2)172.21.15.164:3301 session established [ 6639.427022] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6639.434870] libceph: mon2 (2)172.21.15.164:3301 session established [ 6642.769082] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6642.776854] libceph: mon2 (2)172.21.15.164:3301 session established [ 6643.784721] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6643.793959] libceph: mon2 (2)172.21.15.164:3301 session established [ 6644.052325] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 6644.060251] libceph: mon2 (2)172.21.15.164:3301 session established [ 6645.433233] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 6645.441219] libceph: mon2 (2)172.21.15.164:3301 session established [ 6645.907241] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2964): osd3 weight 0x10000 (in) [ 6648.132438] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2969): osd6 weight 0x0 (out) [ 6654.142854] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2975): osd0 weight 0x10000 (in) [ 6669.364555] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2986): osd1 weight 0x10000 (in) [ 6669.372869] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2987): osd2 weight 0x10000 (in) [ 6674.491077] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2988): osd7 weight 0x10000 (in) [ 6674.499400] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2989): osd4 weight 0x10000 (in) [ 6674.507711] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2990): osd3 weight 0x10000 (in) [ 6674.516013] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e2991): osd0 weight 0x10000 (in) [ 7028.795518] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7028.803290] libceph: mon2 (2)172.21.15.164:3301 session established [ 7124.346798] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7124.354542] libceph: mon2 (2)172.21.15.164:3301 session established [ 7253.749539] libceph: osd7 (2)172.21.15.164:6800 socket closed (con state OPEN) [ 7253.758565] libceph: mon2 (2)172.21.15.164:3301 session established [ 7253.969017] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7253.976751] libceph: mon2 (2)172.21.15.164:3301 session established [ 7255.743839] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7255.751593] libceph: mon2 (2)172.21.15.164:3301 session established [ 7255.932783] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7255.940642] libceph: mon2 (2)172.21.15.164:3301 session established [ 7256.216562] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7256.224240] libceph: mon2 (2)172.21.15.164:3301 session established [ 7256.327614] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7256.335409] libceph: mon2 (2)172.21.15.164:3301 session established [ 7256.367929] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7256.375771] libceph: mon2 (2)172.21.15.164:3301 session established [ 7256.765296] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7256.773070] libceph: mon2 (2)172.21.15.164:3301 session established [ 7257.075886] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7257.084515] libceph: mon2 (2)172.21.15.164:3301 session established [ 7258.045935] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7258.053746] libceph: mon2 (2)172.21.15.164:3301 session established [ 7258.309734] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7258.317351] libceph: mon2 (2)172.21.15.164:3301 session established [ 7258.675252] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7258.682899] libceph: mon2 (2)172.21.15.164:3301 session established [ 7259.144315] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7259.152032] libceph: mon2 (2)172.21.15.164:3301 session established [ 7259.417405] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7259.428057] libceph: mon2 (2)172.21.15.164:3301 session established [ 7259.680729] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7259.688476] libceph: mon2 (2)172.21.15.164:3301 session established [ 7260.146298] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7260.154181] libceph: mon2 (2)172.21.15.164:3301 session established [ 7264.955741] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7264.963491] libceph: mon2 (2)172.21.15.164:3301 session established [ 7265.348122] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7265.355807] libceph: mon2 (2)172.21.15.164:3301 session established [ 7265.678182] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7265.685859] libceph: mon2 (2)172.21.15.164:3301 session established [ 7265.961250] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7265.969199] libceph: mon2 (2)172.21.15.164:3301 session established [ 7265.969490] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7265.983185] libceph: mon2 (2)172.21.15.164:3301 session established [ 7266.382556] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7266.390374] libceph: mon2 (2)172.21.15.164:3301 session established [ 7266.737858] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7266.745642] libceph: mon2 (2)172.21.15.164:3301 session established [ 7267.108347] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7267.116236] libceph: mon2 (2)172.21.15.164:3301 session established [ 7267.478413] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7267.486192] libceph: mon2 (2)172.21.15.164:3301 session established [ 7268.859919] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7268.868698] libceph: mon2 (2)172.21.15.164:3301 session established [ 7269.398406] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7269.406012] libceph: mon2 (2)172.21.15.164:3301 session established [ 7270.133289] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7270.140893] libceph: mon2 (2)172.21.15.164:3301 session established [ 7270.148308] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7270.156190] libceph: mon2 (2)172.21.15.164:3301 session established [ 7270.452487] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7270.460428] libceph: mon2 (2)172.21.15.164:3301 session established [ 7270.473919] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7270.481528] libceph: mon2 (2)172.21.15.164:3301 session established [ 7271.417755] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7271.425516] libceph: mon2 (2)172.21.15.164:3301 session established [ 7273.360411] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7273.368248] libceph: mon2 (2)172.21.15.164:3301 session established [ 7275.788715] libceph: osd1 (2)172.21.15.156:6816 socket closed (con state OPEN) [ 7275.796480] libceph: mon2 (2)172.21.15.164:3301 session established [ 7277.001333] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7277.009169] libceph: mon2 (2)172.21.15.164:3301 session established [ 7280.072268] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7280.079945] libceph: mon2 (2)172.21.15.164:3301 session established [ 7281.729673] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7281.737302] libceph: mon2 (2)172.21.15.164:3301 session established [ 7282.042571] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7282.051144] libceph: mon2 (2)172.21.15.164:3301 session established [ 7282.244081] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7282.251750] libceph: mon2 (2)172.21.15.164:3301 session established [ 7282.603564] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7282.611668] libceph: mon2 (2)172.21.15.164:3301 session established [ 7282.645914] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7282.653503] libceph: mon2 (2)172.21.15.164:3301 session established [ 7282.915559] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7282.923251] libceph: mon2 (2)172.21.15.164:3301 session established [ 7283.182509] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7283.190069] libceph: mon2 (2)172.21.15.164:3301 session established [ 7284.023441] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7284.031286] libceph: mon2 (2)172.21.15.164:3301 session established [ 7284.395451] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7284.403405] libceph: mon2 (2)172.21.15.164:3301 session established [ 7284.412474] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7284.420283] libceph: mon2 (2)172.21.15.164:3301 session established [ 7284.818552] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7284.826331] libceph: mon2 (2)172.21.15.164:3301 session established [ 7285.112968] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7285.120555] libceph: mon2 (2)172.21.15.164:3301 session established [ 7285.883212] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7285.890848] libceph: mon2 (2)172.21.15.164:3301 session established [ 7286.189294] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7286.197098] libceph: mon2 (2)172.21.15.164:3301 session established [ 7286.246287] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7286.253873] libceph: mon2 (2)172.21.15.164:3301 session established [ 7286.584675] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7286.592339] libceph: mon2 (2)172.21.15.164:3301 session established [ 7287.028686] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7287.036597] libceph: mon2 (2)172.21.15.164:3301 session established [ 7287.105356] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7287.113223] libceph: mon2 (2)172.21.15.164:3301 session established [ 7287.538616] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7287.546266] libceph: mon2 (2)172.21.15.164:3301 session established [ 7287.812699] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7287.820638] libceph: mon2 (2)172.21.15.164:3301 session established [ 7288.447975] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7288.455644] libceph: mon2 (2)172.21.15.164:3301 session established [ 7288.738889] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7288.746645] libceph: mon2 (2)172.21.15.164:3301 session established [ 7288.821894] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7288.829539] libceph: mon2 (2)172.21.15.164:3301 session established [ 7290.058429] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7290.066329] libceph: mon2 (2)172.21.15.164:3301 session established [ 7291.349468] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7291.358017] libceph: mon2 (2)172.21.15.164:3301 session established [ 7292.521467] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3239): osd5 weight 0x10000 (in) [ 7294.922105] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7294.933428] libceph: mon2 (2)172.21.15.164:3301 session established [ 7295.773902] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7295.781673] libceph: mon2 (2)172.21.15.164:3301 session established [ 7296.114580] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7296.122218] libceph: mon2 (2)172.21.15.164:3301 session established [ 7296.332711] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7296.340555] libceph: mon2 (2)172.21.15.164:3301 session established [ 7296.344476] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7296.354480] libceph: mon2 (2)172.21.15.164:3301 session established [ 7296.661998] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7296.669729] libceph: mon2 (2)172.21.15.164:3301 session established [ 7296.961769] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7296.969610] libceph: mon2 (2)172.21.15.164:3301 session established [ 7297.272115] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7297.280088] libceph: mon2 (2)172.21.15.164:3301 session established [ 7297.378172] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7297.386247] libceph: mon2 (2)172.21.15.164:3301 session established [ 7297.701017] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7297.709111] libceph: mon2 (2)172.21.15.164:3301 session established [ 7298.013455] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7298.021107] libceph: mon2 (2)172.21.15.164:3301 session established [ 7298.285899] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7298.293582] libceph: mon2 (2)172.21.15.164:3301 session established [ 7298.459376] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7298.467916] libceph: mon2 (2)172.21.15.164:3301 session established [ 7299.311243] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7299.318955] libceph: mon2 (2)172.21.15.164:3301 session established [ 7299.592535] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7299.600309] libceph: mon2 (2)172.21.15.164:3301 session established [ 7299.874964] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7299.882839] libceph: mon2 (2)172.21.15.164:3301 session established [ 7300.590360] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7300.598104] libceph: mon2 (2)172.21.15.164:3301 session established [ 7301.791103] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3245): osd6 weight 0x10000 (in) [ 7304.297478] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3251): osd4 primary-affinity 0xca6b [ 7310.262944] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3257): osd3 weight 0x0 (out) [ 7316.326160] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3263): osd6 down [ 7320.637783] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7320.645479] libceph: mon2 (2)172.21.15.164:3301 session established [ 7350.335969] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3280): osd3 weight 0x10000 (in) [ 7360.575394] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3288): osd6 primary-affinity 0x10000 [ 7373.001629] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3295): osd0 weight 0x0 (out) [ 7378.971599] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3301): osd0 weight 0x10000 (in) [ 7391.296523] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3310): osd6 up [ 7401.537251] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3316): osd2 weight 0xa4c5 [ 7401.545112] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3316): osd4 weight 0x9b20 [ 7411.775772] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3323): osd2 weight 0x6a03 [ 7411.783630] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3323): osd4 weight 0x6417 [ 7417.443609] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3330): osd4 weight 0x0 (out) [ 7432.162731] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3340): osd1 weight 0x0 (out) [ 7439.001315] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3345): osd1 weight 0x10000 (in) [ 7444.235765] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3350): osd4 weight 0x6417 [ 7450.986226] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3356): osd1 weight 0x0 (out) [ 7457.857558] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3362): osd1 weight 0x10000 (in) [ 7461.482437] libceph: osd5 (2)172.21.15.164:6816 socket closed (con state OPEN) [ 7461.493502] libceph: mon2 (2)172.21.15.164:3301 session established [ 7462.516961] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3367): osd5 down [ 7508.420139] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3389): osd5 up [ 7514.186214] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3392): osd2 weight 0x10000 (in) [ 7514.194593] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3393): osd7 weight 0x10000 (in) [ 7516.365215] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7516.378228] libceph: mon2 (2)172.21.15.164:3301 session established [ 7519.297631] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3394): osd5 weight 0x10000 (in) [ 7519.305925] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3395): osd6 weight 0x10000 (in) [ 7519.314224] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3396): osd3 weight 0x10000 (in) [ 7519.322535] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3397): osd0 weight 0x10000 (in) [ 7519.330905] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3398): osd4 weight 0x10000 (in) [ 7523.292792] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3399): osd1 weight 0x10000 (in) [ 7547.329069] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7547.336934] libceph: mon2 (2)172.21.15.164:3301 session established [ 7732.765566] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7732.773655] libceph: mon2 (2)172.21.15.164:3301 session established [ 7733.264947] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7733.272673] libceph: mon2 (2)172.21.15.164:3301 session established [ 7733.724232] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7733.731920] libceph: mon2 (2)172.21.15.164:3301 session established [ 7734.012273] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7734.020108] libceph: mon2 (2)172.21.15.164:3301 session established [ 7734.284153] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7734.291825] libceph: mon2 (2)172.21.15.164:3301 session established [ 7735.505606] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7735.513798] libceph: mon2 (2)172.21.15.164:3301 session established [ 7735.879214] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7735.887077] libceph: mon2 (2)172.21.15.164:3301 session established [ 7737.702366] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7737.711162] libceph: mon2 (2)172.21.15.164:3301 session established [ 7742.247579] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7742.257392] libceph: mon2 (2)172.21.15.164:3301 session established [ 7742.339815] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7742.347411] libceph: mon2 (2)172.21.15.164:3301 session established [ 7742.622932] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7742.631514] libceph: mon2 (2)172.21.15.164:3301 session established [ 7742.643924] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7742.651760] libceph: mon2 (2)172.21.15.164:3301 session established [ 7742.680489] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7742.688528] libceph: mon2 (2)172.21.15.164:3301 session established [ 7742.947039] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7742.954661] libceph: mon2 (2)172.21.15.164:3301 session established [ 7743.838608] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7743.846358] libceph: mon2 (2)172.21.15.164:3301 session established [ 7743.856371] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7743.864155] libceph: mon2 (2)172.21.15.164:3301 session established [ 7743.874585] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7743.882219] libceph: mon2 (2)172.21.15.164:3301 session established [ 7744.164204] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7744.171843] libceph: mon2 (2)172.21.15.164:3301 session established [ 7744.498473] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7744.506402] libceph: mon2 (2)172.21.15.164:3301 session established [ 7744.601589] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7744.622573] libceph: mon2 (2)172.21.15.164:3301 session established [ 7744.881550] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7744.889372] libceph: mon2 (2)172.21.15.164:3301 session established [ 7745.185146] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7745.192835] libceph: mon2 (2)172.21.15.164:3301 session established [ 7745.193493] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7745.207035] libceph: mon2 (2)172.21.15.164:3301 session established [ 7746.065422] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7746.073075] libceph: mon2 (2)172.21.15.164:3301 session established [ 7746.327535] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7746.335186] libceph: mon2 (2)172.21.15.164:3301 session established [ 7751.771133] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7751.779016] libceph: mon2 (2)172.21.15.164:3301 session established [ 7752.710713] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7752.718510] libceph: mon2 (2)172.21.15.164:3301 session established [ 7753.044165] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7753.052042] libceph: mon2 (2)172.21.15.164:3301 session established [ 7753.056095] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7753.066220] libceph: mon2 (2)172.21.15.164:3301 session established [ 7753.189630] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7753.197315] libceph: mon2 (2)172.21.15.164:3301 session established [ 7753.559174] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7753.567203] libceph: mon2 (2)172.21.15.164:3301 session established [ 7753.683314] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7753.691033] libceph: mon2 (2)172.21.15.164:3301 session established [ 7753.737854] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7753.745572] libceph: mon2 (2)172.21.15.164:3301 session established [ 7753.887592] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7753.895359] libceph: mon2 (2)172.21.15.164:3301 session established [ 7754.319336] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7754.326976] libceph: mon2 (2)172.21.15.164:3301 session established [ 7754.585686] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7754.593377] libceph: mon2 (2)172.21.15.164:3301 session established [ 7754.711131] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7754.718839] libceph: mon2 (2)172.21.15.164:3301 session established [ 7754.989840] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7754.997536] libceph: mon2 (2)172.21.15.164:3301 session established [ 7755.306258] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7755.314614] libceph: mon2 (2)172.21.15.164:3301 session established [ 7756.136667] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7756.145935] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7756.150716] libceph: mon2 (2)172.21.15.164:3301 session established [ 7756.159776] libceph: mon2 (2)172.21.15.164:3301 session established [ 7757.424217] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7757.432028] libceph: mon2 (2)172.21.15.164:3301 session established [ 7757.701148] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7757.708990] libceph: mon2 (2)172.21.15.164:3301 session established [ 7758.004180] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7758.012042] libceph: mon2 (2)172.21.15.164:3301 session established [ 7759.227816] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7759.235453] libceph: mon2 (2)172.21.15.164:3301 session established [ 7759.646262] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7759.653991] libceph: mon2 (2)172.21.15.164:3301 session established [ 7759.921931] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7759.929807] libceph: mon2 (2)172.21.15.164:3301 session established [ 7760.286328] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3499): osd2 primary-affinity 0x1a8f [ 7761.332259] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7761.340086] libceph: mon2 (2)172.21.15.164:3301 session established [ 7761.598468] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7761.606234] libceph: mon2 (2)172.21.15.164:3301 session established [ 7761.662610] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7761.670430] libceph: mon2 (2)172.21.15.164:3301 session established [ 7761.992666] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7762.000445] libceph: mon2 (2)172.21.15.164:3301 session established [ 7763.075816] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7763.083658] libceph: mon2 (2)172.21.15.164:3301 session established [ 7763.341710] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7763.349630] libceph: mon2 (2)172.21.15.164:3301 session established [ 7765.788427] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3502): osd2 weight 0x10000 (in) [ 7765.796725] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3503): osd7 weight 0x10000 (in) [ 7765.805041] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3504): osd5 weight 0x10000 (in) [ 7766.096414] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7766.104064] libceph: mon2 (2)172.21.15.164:3301 session established [ 7766.403334] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7766.411052] libceph: mon2 (2)172.21.15.164:3301 session established [ 7767.152662] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7767.160254] libceph: mon2 (2)172.21.15.164:3301 session established [ 7767.632045] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7767.639699] libceph: mon2 (2)172.21.15.164:3301 session established [ 7768.907796] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7768.915430] libceph: mon2 (2)172.21.15.164:3301 session established [ 7769.189859] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7769.197746] libceph: mon2 (2)172.21.15.164:3301 session established [ 7769.241706] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7769.249325] libceph: mon2 (2)172.21.15.164:3301 session established [ 7769.462331] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7769.470259] libceph: mon2 (2)172.21.15.164:3301 session established [ 7771.065777] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7771.073659] libceph: mon2 (2)172.21.15.164:3301 session established [ 7771.931225] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7771.938994] libceph: mon2 (2)172.21.15.164:3301 session established [ 7773.807736] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3505): osd6 weight 0x10000 (in) [ 7773.816023] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3506): osd3 weight 0x10000 (in) [ 7773.824307] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3507): osd0 weight 0x10000 (in) [ 7773.832597] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3508): osd4 weight 0x10000 (in) [ 7773.840885] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3509): osd1 weight 0x10000 (in) [ 7773.956112] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7773.964117] libceph: mon2 (2)172.21.15.164:3301 session established [ 7773.991417] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7773.999430] libceph: mon2 (2)172.21.15.164:3301 session established [ 7774.253695] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7774.261644] libceph: mon2 (2)172.21.15.164:3301 session established [ 7774.604067] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7774.612237] libceph: mon2 (2)172.21.15.164:3301 session established [ 7774.903153] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7774.911977] libceph: mon2 (2)172.21.15.164:3301 session established [ 7775.027359] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7775.035421] libceph: mon2 (2)172.21.15.164:3301 session established [ 7776.012837] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7776.020490] libceph: mon2 (2)172.21.15.164:3301 session established [ 7776.313791] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7776.321454] libceph: mon2 (2)172.21.15.164:3301 session established [ 7776.333087] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7776.341028] libceph: mon2 (2)172.21.15.164:3301 session established [ 7776.482977] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7776.490766] libceph: mon2 (2)172.21.15.164:3301 session established [ 7776.542990] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7776.550863] libceph: mon2 (2)172.21.15.164:3301 session established [ 7777.060785] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7777.068524] libceph: mon2 (2)172.21.15.164:3301 session established [ 7777.433297] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7777.440962] libceph: mon2 (2)172.21.15.164:3301 session established [ 7777.717692] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7777.725436] libceph: mon2 (2)172.21.15.164:3301 session established [ 7778.779286] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7778.787137] libceph: mon2 (2)172.21.15.164:3301 session established [ 7779.449379] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7779.457323] libceph: mon2 (2)172.21.15.164:3301 session established [ 7781.312974] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7781.322064] libceph: mon2 (2)172.21.15.164:3301 session established [ 7781.429519] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7781.437236] libceph: mon2 (2)172.21.15.164:3301 session established [ 7781.697109] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7781.704841] libceph: mon2 (2)172.21.15.164:3301 session established [ 7782.239144] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7782.247298] libceph: mon2 (2)172.21.15.164:3301 session established [ 7782.405729] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7782.413474] libceph: mon2 (2)172.21.15.164:3301 session established [ 7785.016485] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7785.024473] libceph: mon2 (2)172.21.15.164:3301 session established [ 7785.087899] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7785.095608] libceph: mon2 (2)172.21.15.164:3301 session established [ 7785.396655] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7785.404359] libceph: mon2 (2)172.21.15.164:3301 session established [ 7786.365968] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7786.373725] libceph: mon2 (2)172.21.15.164:3301 session established [ 7786.663626] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7786.671623] libceph: mon2 (2)172.21.15.164:3301 session established [ 7786.963162] libceph: mds4 (2)172.21.15.164:6835 socket closed (con state OPEN) [ 7786.970911] libceph: mon2 (2)172.21.15.164:3301 session established [ 7787.901961] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7787.909574] libceph: mon2 (2)172.21.15.164:3301 session established [ 7788.237188] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7788.244902] libceph: mon2 (2)172.21.15.164:3301 session established [ 7788.515049] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7788.522933] libceph: mon2 (2)172.21.15.164:3301 session established [ 7788.555090] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7788.562657] libceph: mon2 (2)172.21.15.164:3301 session established [ 7789.428843] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7789.436555] libceph: mon2 (2)172.21.15.164:3301 session established [ 7789.755342] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7789.763093] libceph: mon2 (2)172.21.15.164:3301 session established [ 7790.077902] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7790.088220] libceph: mon2 (2)172.21.15.164:3301 session established [ 7790.405204] libceph: mds0 (2)172.21.15.156:6836 socket closed (con state OPEN) [ 7790.412944] libceph: mon2 (2)172.21.15.164:3301 session established [ 7790.807932] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7790.815776] libceph: mon2 (2)172.21.15.164:3301 session established [ 7791.189564] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7791.197308] libceph: mon2 (2)172.21.15.164:3301 session established [ 7791.902352] libceph: mds3 (2)172.21.15.156:6832 socket closed (con state OPEN) [ 7791.910255] libceph: mon2 (2)172.21.15.164:3301 session established [ 7792.928233] libceph: mds1 (2)172.21.15.156:6833 socket closed (con state OPEN) [ 7792.936257] libceph: mon2 (2)172.21.15.164:3301 session established [ 7793.241100] libceph (a17db4e0-a59c-4315-af4a-fdee0cfa4502 e3519): osd3 weight 0x0 (out) [ 7807.367383] libceph: mds2 (2)172.21.15.164:6837 socket closed (con state OPEN) [ 7807.375069] libceph: mon2 (2)172.21.15.164:3301 session established [ 7826.857602] ceph-brx: port 1(brx.0) entered disabled state [ 7826.864863] brx.0 (unregistering): left allmulticast mode [ 7826.870268] brx.0 (unregistering): left promiscuous mode [ 7826.875611] ceph-brx: port 1(brx.0) entered disabled state [ 7957.459693] evict_inodes inode 0000000023d53ae8, i_count = 1, was skipped! [ 7957.542780] XFS (dm-0): Unmounting Filesystem 9feb585f-77d2-489c-b307-85c1733efe29 [ 7957.739986] evict_inodes inode 0000000026dc2f01, i_count = 1, was skipped! [ 7957.827657] XFS (dm-1): Unmounting Filesystem e3083463-69a7-40db-ad20-d2974bb747cd [ 7958.025161] evict_inodes inode 0000000001053048, i_count = 1, was skipped! [ 7958.093991] XFS (dm-2): Unmounting Filesystem 4993655e-4f41-4ba9-afae-7db387cb253c [ 7958.299629] evict_inodes inode 00000000c701eb88, i_count = 1, was skipped! [ 7958.398697] XFS (dm-3): Unmounting Filesystem 0314732a-292c-44d1-887b-5734fb83177e